2023-11-28T10:55:12.266 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T10:55:12.266 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954 --owner scheduled_neesingh@teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} --name neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi -- /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954/orig.config.yaml 2023-11-28T10:55:12.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T10:55:12.385 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954 branch: wip-neesingh-testing-231123 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7469954' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-neesingh-testing-231123 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: issue_54557 sha1: e67b67438c1e5e13734a7203ff9e57e30b8e4d32 owner: scheduled_neesingh@teuthology priority: 10 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9437 sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 sleep_before_teardown: 0 suite: fs suite_branch: issue_54557 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_e67b67438c1e5e13734a7203ff9e57e30b8e4d32/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: e67b67438c1e5e13734a7203ff9e57e30b8e4d32 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi125.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_10:48:03 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T10:55:12.385 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_e67b67438c1e5e13734a7203ff9e57e30b8e4d32/qa; will attempt to use it 2023-11-28T10:55:12.386 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_e67b67438c1e5e13734a7203ff9e57e30b8e4d32/qa/tasks 2023-11-28T10:55:12.386 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T10:55:12.388 INFO:teuthology.task.internal:Checking packages... 2023-11-28T10:55:12.410 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '2f5f6028b893ad41357cd06e827373f0fe2a1232' 2023-11-28T10:55:12.410 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T10:55:12.410 INFO:teuthology.packaging:ref: None 2023-11-28T10:55:12.410 INFO:teuthology.packaging:tag: None 2023-11-28T10:55:12.411 INFO:teuthology.packaging:branch: wip-neesingh-testing-231123 2023-11-28T10:55:12.411 INFO:teuthology.packaging:sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T10:55:12.411 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-neesingh-testing-231123 2023-11-28T10:55:12.547 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2697.g2f5f6028 2023-11-28T10:55:12.547 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T10:55:12.554 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T10:55:12.554 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T10:55:12.598 INFO:teuthology.task.internal:Saving configuration 2023-11-28T10:55:12.613 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T10:55:12.665 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T10:55:12.691 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 10:49:55.772381', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T10:55:12.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 10:49:55.773777', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T10:55:12.713 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T10:55:12.718 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-28T10:55:12.718 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-28T10:55:12.719 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T10:55:12.797 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f692e38da60>, signals=[15]) 2023-11-28T10:55:12.797 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T10:55:12.803 INFO:teuthology.task.internal:Opening connections... 2023-11-28T10:55:12.803 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T10:55:12.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T10:55:12.872 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T10:55:12.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T10:55:12.944 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T10:55:12.952 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-11-28T10:55:12.973 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-11-28T10:55:12.974 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-11-28T10:55:13.033 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T10:55:13.033 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T10:55:13.033 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2023-11-28T10:55:13.033 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2023-11-28T10:55:13.034 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2023-11-28T10:55:13.034 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-11-28T10:55:13.034 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T10:55:13.034 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-11-28T10:55:13.034 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T10:55:13.034 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T10:55:13.034 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T10:55:13.034 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T10:55:13.034 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T10:55:13.034 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T10:55:13.035 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T10:55:13.035 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T10:55:13.035 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T10:55:13.035 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-11-28T10:55:13.061 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-11-28T10:55:13.081 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-11-28T10:55:13.082 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-11-28T10:55:13.144 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T10:55:13.144 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T10:55:13.144 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2023-11-28T10:55:13.145 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2023-11-28T10:55:13.145 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6" 2023-11-28T10:55:13.145 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-11-28T10:55:13.145 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T10:55:13.145 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-11-28T10:55:13.145 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T10:55:13.145 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T10:55:13.145 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T10:55:13.145 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T10:55:13.145 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T10:55:13.145 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T10:55:13.146 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T10:55:13.146 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T10:55:13.146 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T10:55:13.146 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-11-28T10:55:13.169 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T10:55:13.178 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T10:55:13.184 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T10:55:13.184 DEBUG:teuthology.orchestra.run.smithi125:> test '!' -e /home/ubuntu/cephtest 2023-11-28T10:55:13.190 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2023-11-28T10:55:13.208 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T10:55:13.213 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T10:55:13.214 DEBUG:teuthology.orchestra.run.smithi125:> test -z $(ls -A /var/lib/ceph) 2023-11-28T10:55:13.245 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2023-11-28T10:55:13.274 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T10:55:13.331 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T10:55:13.346 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-28T10:55:13.346 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-28T10:55:13.346 DEBUG:teuthology.orchestra.run.smithi125:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T10:55:13.347 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T10:55:13.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T10:55:13.364 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-11-28T10:55:13.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T10:55:13.365 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2023-11-28T10:55:13.423 INFO:teuthology.orchestra.run.smithi125.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-28T10:55:13.424 INFO:teuthology.task.kernel:Running kernel on smithi125: 4.18.0-372.9.1.el8.x86_64 2023-11-28T10:55:13.424 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum install -y kernel 2023-11-28T10:55:13.425 INFO:teuthology.orchestra.run.smithi167.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-28T10:55:13.425 INFO:teuthology.task.kernel:Running kernel on smithi167: 4.18.0-372.9.1.el8.x86_64 2023-11-28T10:55:13.426 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum install -y kernel 2023-11-28T10:55:14.543 INFO:teuthology.orchestra.run.smithi125.stdout:Updating Subscription Management repositories. 2023-11-28T10:55:14.543 INFO:teuthology.orchestra.run.smithi125.stdout:Unable to read consumer identity 2023-11-28T10:55:14.591 INFO:teuthology.orchestra.run.smithi167.stdout:Updating Subscription Management repositories. 2023-11-28T10:55:14.591 INFO:teuthology.orchestra.run.smithi167.stdout:Unable to read consumer identity 2023-11-28T10:55:16.088 INFO:teuthology.orchestra.run.smithi167.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-11-28T10:55:16.111 INFO:teuthology.orchestra.run.smithi125.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-11-28T10:55:17.897 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 16 MB 00:01 2023-11-28T10:55:17.919 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 16 MB 00:01 2023-11-28T10:55:21.372 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 366 kB/s | 24 kB 00:00 2023-11-28T10:55:21.477 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 500 kB/s | 24 kB 00:00 2023-11-28T10:55:22.066 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-28T10:55:22.119 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-11-28T10:55:22.120 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2023-11-28T10:55:22.120 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-11-28T10:55:22.172 INFO:teuthology.orchestra.run.smithi125.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-28T10:55:22.215 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-11-28T10:55:22.216 INFO:teuthology.orchestra.run.smithi125.stdout:Nothing to do. 2023-11-28T10:55:22.216 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-11-28T10:55:22.231 DEBUG:teuthology.orchestra.run.smithi167:> echo no | sudo yum reinstall kernel || true 2023-11-28T10:55:22.352 DEBUG:teuthology.orchestra.run.smithi125:> echo no | sudo yum reinstall kernel || true 2023-11-28T10:55:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:Updating Subscription Management repositories. 2023-11-28T10:55:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:Unable to read consumer identity 2023-11-28T10:55:22.684 INFO:teuthology.orchestra.run.smithi125.stdout:Updating Subscription Management repositories. 2023-11-28T10:55:22.684 INFO:teuthology.orchestra.run.smithi125.stdout:Unable to read consumer identity 2023-11-28T10:55:22.827 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:01 ago on Tue 28 Nov 2023 10:55:21 AM UTC. 2023-11-28T10:55:22.868 INFO:teuthology.orchestra.run.smithi167.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-28T10:55:22.913 INFO:teuthology.orchestra.run.smithi167.stderr:Error: No packages marked for reinstall. 2023-11-28T10:55:22.941 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:00:01 ago on Tue 28 Nov 2023 10:55:21 AM UTC. 2023-11-28T10:55:22.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum reinstall -y kernel || true 2023-11-28T10:55:22.981 INFO:teuthology.orchestra.run.smithi125.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-28T10:55:23.012 INFO:teuthology.orchestra.run.smithi125.stderr:Error: No packages marked for reinstall. 2023-11-28T10:55:23.058 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum reinstall -y kernel || true 2023-11-28T10:55:23.291 INFO:teuthology.orchestra.run.smithi167.stdout:Updating Subscription Management repositories. 2023-11-28T10:55:23.292 INFO:teuthology.orchestra.run.smithi167.stdout:Unable to read consumer identity 2023-11-28T10:55:23.387 INFO:teuthology.orchestra.run.smithi125.stdout:Updating Subscription Management repositories. 2023-11-28T10:55:23.387 INFO:teuthology.orchestra.run.smithi125.stdout:Unable to read consumer identity 2023-11-28T10:55:23.547 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:02 ago on Tue 28 Nov 2023 10:55:21 AM UTC. 2023-11-28T10:55:23.587 INFO:teuthology.orchestra.run.smithi167.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-28T10:55:23.619 INFO:teuthology.orchestra.run.smithi167.stderr:Error: No packages marked for reinstall. 2023-11-28T10:55:23.639 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:00:02 ago on Tue 28 Nov 2023 10:55:21 AM UTC. 2023-11-28T10:55:23.666 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2023-11-28T10:55:23.678 INFO:teuthology.orchestra.run.smithi125.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-28T10:55:23.701 INFO:teuthology.orchestra.run.smithi125.stderr:Error: No packages marked for reinstall. 2023-11-28T10:55:23.746 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-28T10:55:23.747 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-28T10:55:23.747 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-28T10:55:23.747 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-28T10:55:23.747 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T10:55:23.748 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q kernel | sort -rV | head -n 1 2023-11-28T10:55:23.779 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2023-11-28T10:55:23.796 DEBUG:teuthology.parallel:result is None 2023-11-28T10:55:23.827 INFO:teuthology.orchestra.run.smithi125.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-28T10:55:23.827 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-28T10:55:23.828 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-28T10:55:23.828 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-28T10:55:23.828 DEBUG:teuthology.orchestra.run.smithi125:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T10:55:23.859 INFO:teuthology.orchestra.run.smithi125.stdout:ttyS1 2023-11-28T10:55:23.878 DEBUG:teuthology.parallel:result is None 2023-11-28T10:55:23.878 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T10:55:23.885 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T10:55:23.885 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T10:55:23.920 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T10:55:23.937 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T10:55:23.944 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T10:55:23.950 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T10:55:23.951 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T10:55:23.977 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T10:55:24.000 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T10:55:24.007 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T10:55:24.007 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T10:55:24.035 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T10:55:24.059 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T10:55:24.069 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T10:55:24.084 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T10:55:24.094 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T10:55:24.095 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T10:55:24.102 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T10:55:24.103 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T10:55:24.113 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T10:55:24.140 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T10:55:24.149 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T10:55:24.149 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T10:55:24.180 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T10:55:24.197 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T10:55:24.280 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T10:55:24.337 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T10:55:24.423 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T10:55:24.462 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T10:55:24.462 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T10:55:24.529 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T10:55:24.572 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T10:55:24.629 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T10:55:24.712 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T10:55:24.755 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T10:55:24.755 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T10:55:24.822 DEBUG:teuthology.orchestra.run.smithi125:> sudo service rsyslog restart 2023-11-28T10:55:24.824 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2023-11-28T10:55:24.874 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-28T10:55:24.929 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-28T10:55:25.379 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T10:55:25.387 INFO:teuthology.task.internal:Starting timer... 2023-11-28T10:55:25.387 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T10:55:25.397 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T10:55:25.405 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-11-28T10:55:25.406 DEBUG:teuthology.orchestra.run.smithi125:> sudo service auditd rotate 2023-11-28T10:55:25.466 INFO:teuthology.orchestra.run.smithi125.stdout:Rotating logs: 2023-11-28T10:55:25.468 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2023-11-28T10:55:25.533 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2023-11-28T10:55:25.535 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T10:55:25.535 DEBUG:teuthology.orchestra.run.smithi125:> /usr/sbin/getenforce 2023-11-28T10:55:25.557 INFO:teuthology.orchestra.run.smithi125.stdout:Permissive 2023-11-28T10:55:25.557 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2023-11-28T10:55:25.578 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2023-11-28T10:55:25.579 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi125.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2023-11-28T10:55:25.579 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-28T10:55:25.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T10:55:25.623 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-28T10:55:25.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T10:55:25.651 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T10:55:25.651 DEBUG:teuthology.orchestra.run.smithi125:> sudo /usr/sbin/setenforce permissive 2023-11-28T10:55:25.692 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2023-11-28T10:55:25.719 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T10:55:25.730 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-28T10:55:25.730 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T10:55:25.747 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T10:55:25.749 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi125.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T11:05:04.559 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi125.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2023-11-28T11:05:04.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-28T11:05:04.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:05:04.630 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-11-28T11:05:04.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-28T11:05:04.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-28T11:05:04.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:05:04.778 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-11-28T11:05:04.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-28T11:05:04.843 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T11:05:04.855 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T11:05:04.855 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T11:05:04.855 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T11:05:04.858 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T11:05:04.858 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T11:05:04.890 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-28T11:05:04.905 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-28T11:05:04.914 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-28T11:05:04.928 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-28T11:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: ntpd: command not found 2023-11-28T11:05:04.983 INFO:teuthology.orchestra.run.smithi125.stdout:506 Cannot talk to daemon 2023-11-28T11:05:04.999 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-28T11:05:04.999 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2023-11-28T11:05:05.011 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2023-11-28T11:05:05.013 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-28T11:05:05.025 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-28T11:05:05.041 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-28T11:05:05.089 INFO:teuthology.orchestra.run.smithi125.stderr:bash: ntpq: command not found 2023-11-28T11:05:05.092 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-28T11:05:05.092 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2023-11-28T11:05:05.092 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:05:05.092 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:05:05.092 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:05:05.092 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:05:05.111 INFO:teuthology.orchestra.run.smithi167.stderr:bash: ntpq: command not found 2023-11-28T11:05:05.114 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-28T11:05:05.114 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2023-11-28T11:05:05.114 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:05:05.114 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:05:05.115 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:05:05.115 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:05:05.116 INFO:teuthology.run_tasks:Running task install... 2023-11-28T11:05:05.125 DEBUG:teuthology.task.install:project ceph 2023-11-28T11:05:05.125 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}} 2023-11-28T11:05:05.125 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'} 2023-11-28T11:05:05.125 INFO:teuthology.task.install:Using flavor: default 2023-11-28T11:05:05.131 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T11:05:05.131 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T11:05:05.131 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232', 'tag': None, 'wait_for_package': False} 2023-11-28T11:05:05.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:05:05.134 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232', 'tag': None, 'wait_for_package': False} 2023-11-28T11:05:05.134 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:05:05.352 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/ 2023-11-28T11:05:05.352 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2697.g2f5f6028 2023-11-28T11:05:05.357 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/ 2023-11-28T11:05:05.357 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2697.g2f5f6028 2023-11-28T11:05:05.469 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-28T11:05:05.470 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:05:05.470 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-28T11:05:05.473 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-28T11:05:05.473 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:05:05.473 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-28T11:05:05.497 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-28T11:05:05.497 DEBUG:teuthology.orchestra.run.smithi125:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f5f6028b893ad41357cd06e827373f0fe2a1232/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-28T11:05:05.501 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-28T11:05:05.501 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f5f6028b893ad41357cd06e827373f0fe2a1232/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-28T11:05:05.564 DEBUG:teuthology.orchestra.run.smithi125:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-28T11:05:05.568 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-28T11:05:05.641 DEBUG:teuthology.orchestra.run.smithi125:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-28T11:05:05.645 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-28T11:05:05.707 INFO:teuthology.orchestra.run.smithi125.stdout:check_obsoletes = 1 2023-11-28T11:05:05.708 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum clean all 2023-11-28T11:05:05.711 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2023-11-28T11:05:05.712 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2023-11-28T11:05:06.080 INFO:teuthology.orchestra.run.smithi125.stdout:Updating Subscription Management repositories. 2023-11-28T11:05:06.084 INFO:teuthology.orchestra.run.smithi167.stdout:Updating Subscription Management repositories. 2023-11-28T11:05:06.585 INFO:teuthology.orchestra.run.smithi125.stdout:44 files removed 2023-11-28T11:05:06.610 INFO:teuthology.orchestra.run.smithi167.stdout:44 files removed 2023-11-28T11:05:06.631 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-28T11:05:06.658 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-28T11:05:06.961 INFO:teuthology.orchestra.run.smithi125.stdout:Updating Subscription Management repositories. 2023-11-28T11:05:06.989 INFO:teuthology.orchestra.run.smithi167.stdout:Updating Subscription Management repositories. 2023-11-28T11:05:08.459 INFO:teuthology.orchestra.run.smithi125.stdout:ceph packages for x86_64 316 kB/s | 80 kB 00:00 2023-11-28T11:05:08.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 252 kB/s | 80 kB 00:00 2023-11-28T11:05:08.785 INFO:teuthology.orchestra.run.smithi125.stdout:ceph noarch packages 32 kB/s | 9.4 kB 00:00 2023-11-28T11:05:08.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 32 kB/s | 9.4 kB 00:00 2023-11-28T11:05:09.102 INFO:teuthology.orchestra.run.smithi125.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2023-11-28T11:05:09.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 5.8 kB/s | 1.5 kB 00:00 2023-11-28T11:05:09.252 INFO:teuthology.orchestra.run.smithi125.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-11-28T11:05:09.256 INFO:teuthology.orchestra.run.smithi167.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-11-28T11:05:10.453 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-11-28T11:05:11.185 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 16 MB 00:01 2023-11-28T11:05:13.904 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 555 kB/s | 24 kB 00:00 2023-11-28T11:05:14.724 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 364 kB/s | 24 kB 00:00 2023-11-28T11:05:14.997 INFO:teuthology.orchestra.run.smithi125.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 47 MB 00:01 2023-11-28T11:05:15.959 INFO:teuthology.orchestra.run.smithi167.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 53 MB 00:01 2023-11-28T11:05:23.056 INFO:teuthology.orchestra.run.smithi125.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-11-28T11:05:24.085 INFO:teuthology.orchestra.run.smithi167.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-11-28T11:05:34.228 INFO:teuthology.orchestra.run.smithi125.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-28T11:05:34.229 INFO:teuthology.orchestra.run.smithi125.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-28T11:05:34.243 INFO:teuthology.orchestra.run.smithi125.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-28T11:05:34.245 INFO:teuthology.orchestra.run.smithi125.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-28T11:05:34.246 INFO:teuthology.orchestra.run.smithi125.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-28T11:05:34.249 INFO:teuthology.orchestra.run.smithi125.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-28T11:05:34.249 INFO:teuthology.orchestra.run.smithi125.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-28T11:05:34.252 INFO:teuthology.orchestra.run.smithi125.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-28T11:05:34.253 INFO:teuthology.orchestra.run.smithi125.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-28T11:05:34.386 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-11-28T11:05:34.399 INFO:teuthology.orchestra.run.smithi125.stdout:=========================================================================================================================== 2023-11-28T11:05:34.399 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2023-11-28T11:05:34.399 INFO:teuthology.orchestra.run.smithi125.stdout:=========================================================================================================================== 2023-11-28T11:05:34.399 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2023-11-28T11:05:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-28T11:05:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-28T11:05:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: ceph x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 6.4 k 2023-11-28T11:05:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 5.4 M 2023-11-28T11:05:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 845 k 2023-11-28T11:05:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 165 k 2023-11-28T11:05:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 1.5 M 2023-11-28T11:05:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 123 k 2023-11-28T11:05:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 1.7 M 2023-11-28T11:05:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 7.4 M 2023-11-28T11:05:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 47 k 2023-11-28T11:05:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 13 M 2023-11-28T11:05:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 47 M 2023-11-28T11:05:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-volume noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 263 k 2023-11-28T11:05:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: cephadm noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 83 k 2023-11-28T11:05:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-mirror x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 257 k 2023-11-28T11:05:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-top noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 18 k 2023-11-28T11:05:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-28T11:05:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-28T11:05:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-28T11:05:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 30 k 2023-11-28T11:05:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 767 k 2023-11-28T11:05:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 139 k 2023-11-28T11:05:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-28T11:05:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-28T11:05:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-28T11:05:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-28T11:05:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-28T11:05:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-28T11:05:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 190 k 2023-11-28T11:05:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 371 k 2023-11-28T11:05:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 364 k 2023-11-28T11:05:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 107 k 2023-11-28T11:05:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 94 k 2023-11-28T11:05:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.4 M 2023-11-28T11:05:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 180 k 2023-11-28T11:05:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-28T11:05:34.406 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrading: 2023-11-28T11:05:34.406 INFO:teuthology.orchestra.run.smithi125.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-28T11:05:34.406 INFO:teuthology.orchestra.run.smithi125.stdout: librados2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.7 M 2023-11-28T11:05:34.406 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.6 M 2023-11-28T11:05:34.406 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2023-11-28T11:05:34.407 INFO:teuthology.orchestra.run.smithi125.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-28T11:05:34.407 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 22 M 2023-11-28T11:05:34.407 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 23 k 2023-11-28T11:05:34.407 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 2.3 M 2023-11-28T11:05:34.407 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 236 k 2023-11-28T11:05:34.408 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 4.6 M 2023-11-28T11:05:34.408 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 18 M 2023-11-28T11:05:34.408 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 15 k 2023-11-28T11:05:34.408 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 24 k 2023-11-28T11:05:34.408 INFO:teuthology.orchestra.run.smithi125.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-28T11:05:34.408 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-28T11:05:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-28T11:05:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-28T11:05:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-28T11:05:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 137 k 2023-11-28T11:05:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-28T11:05:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-28T11:05:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-28T11:05:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-28T11:05:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-28T11:05:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-28T11:05:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 474 k 2023-11-28T11:05:34.411 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-28T11:05:34.411 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 6.5 M 2023-11-28T11:05:34.411 INFO:teuthology.orchestra.run.smithi125.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-28T11:05:34.411 INFO:teuthology.orchestra.run.smithi125.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-28T11:05:34.411 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-28T11:05:34.412 INFO:teuthology.orchestra.run.smithi125.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-28T11:05:34.412 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-28T11:05:34.412 INFO:teuthology.orchestra.run.smithi125.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-28T11:05:34.412 INFO:teuthology.orchestra.run.smithi125.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-28T11:05:34.412 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-28T11:05:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-28T11:05:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-28T11:05:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-28T11:05:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-28T11:05:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-28T11:05:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-28T11:05:34.414 INFO:teuthology.orchestra.run.smithi125.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-28T11:05:34.414 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-28T11:05:34.414 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 45 k 2023-11-28T11:05:34.414 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 117 k 2023-11-28T11:05:34.414 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-28T11:05:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-28T11:05:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-28T11:05:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-28T11:05:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-28T11:05:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-28T11:05:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-28T11:05:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-28T11:05:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-28T11:05:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-28T11:05:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-28T11:05:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-28T11:05:34.417 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-28T11:05:34.417 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-28T11:05:34.417 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-28T11:05:34.417 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-28T11:05:34.417 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-28T11:05:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-28T11:05:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-28T11:05:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-28T11:05:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-28T11:05:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-28T11:05:34.419 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-28T11:05:34.419 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-28T11:05:34.419 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-28T11:05:34.419 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-28T11:05:34.419 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-28T11:05:34.419 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-28T11:05:34.420 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-28T11:05:34.420 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-28T11:05:34.420 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-28T11:05:34.420 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-28T11:05:34.420 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-28T11:05:34.421 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-28T11:05:34.421 INFO:teuthology.orchestra.run.smithi125.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-28T11:05:34.421 INFO:teuthology.orchestra.run.smithi125.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-28T11:05:34.421 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-28T11:05:34.421 INFO:teuthology.orchestra.run.smithi125.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-28T11:05:34.421 INFO:teuthology.orchestra.run.smithi125.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-28T11:05:34.422 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-28T11:05:34.422 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-28T11:05:34.422 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-28T11:05:34.422 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-28T11:05:34.423 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-28T11:05:34.423 INFO:teuthology.orchestra.run.smithi125.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-28T11:05:34.423 INFO:teuthology.orchestra.run.smithi125.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-28T11:05:34.423 INFO:teuthology.orchestra.run.smithi125.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-28T11:05:34.423 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-28T11:05:34.423 INFO:teuthology.orchestra.run.smithi125.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-28T11:05:34.424 INFO:teuthology.orchestra.run.smithi125.stdout:Enabling module streams: 2023-11-28T11:05:34.424 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql 10 2023-11-28T11:05:34.424 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:05:34.424 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2023-11-28T11:05:34.424 INFO:teuthology.orchestra.run.smithi125.stdout:=========================================================================================================================== 2023-11-28T11:05:34.424 INFO:teuthology.orchestra.run.smithi125.stdout:Install 128 Packages 2023-11-28T11:05:34.425 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrade 3 Packages 2023-11-28T11:05:34.425 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:05:34.425 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 203 M 2023-11-28T11:05:34.426 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2023-11-28T11:05:34.664 INFO:teuthology.orchestra.run.smithi125.stdout:(1/131): ceph-18.0.0-2697.g2f5f6028.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2023-11-28T11:05:35.085 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-28T11:05:35.086 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-28T11:05:35.101 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-28T11:05:35.103 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-28T11:05:35.103 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-28T11:05:35.104 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-28T11:05:35.107 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-28T11:05:35.110 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-28T11:05:35.111 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-28T11:05:35.243 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-11-28T11:05:35.255 INFO:teuthology.orchestra.run.smithi167.stdout:=========================================================================================================================== 2023-11-28T11:05:35.255 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2023-11-28T11:05:35.255 INFO:teuthology.orchestra.run.smithi167.stdout:=========================================================================================================================== 2023-11-28T11:05:35.255 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2023-11-28T11:05:35.256 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-28T11:05:35.256 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-28T11:05:35.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 6.4 k 2023-11-28T11:05:35.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 5.4 M 2023-11-28T11:05:35.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 845 k 2023-11-28T11:05:35.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 165 k 2023-11-28T11:05:35.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 1.5 M 2023-11-28T11:05:35.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 123 k 2023-11-28T11:05:35.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 1.7 M 2023-11-28T11:05:35.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 7.4 M 2023-11-28T11:05:35.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 47 k 2023-11-28T11:05:35.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 13 M 2023-11-28T11:05:35.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 47 M 2023-11-28T11:05:35.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 263 k 2023-11-28T11:05:35.257 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 83 k 2023-11-28T11:05:35.257 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 257 k 2023-11-28T11:05:35.257 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 18 k 2023-11-28T11:05:35.257 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-28T11:05:35.257 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-28T11:05:35.257 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-28T11:05:35.257 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 30 k 2023-11-28T11:05:35.258 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 767 k 2023-11-28T11:05:35.258 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 139 k 2023-11-28T11:05:35.258 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-28T11:05:35.258 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-28T11:05:35.258 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-28T11:05:35.258 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-28T11:05:35.258 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-28T11:05:35.258 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-28T11:05:35.258 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 190 k 2023-11-28T11:05:35.258 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 371 k 2023-11-28T11:05:35.258 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 364 k 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 107 k 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 94 k 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.4 M 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 180 k 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.7 M 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.6 M 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-28T11:05:35.259 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 22 M 2023-11-28T11:05:35.260 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 23 k 2023-11-28T11:05:35.260 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 2.3 M 2023-11-28T11:05:35.260 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 236 k 2023-11-28T11:05:35.260 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 4.6 M 2023-11-28T11:05:35.260 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 18 M 2023-11-28T11:05:35.260 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 15 k 2023-11-28T11:05:35.260 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 24 k 2023-11-28T11:05:35.260 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-28T11:05:35.260 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-28T11:05:35.260 INFO:teuthology.orchestra.run.smithi167.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-28T11:05:35.260 INFO:teuthology.orchestra.run.smithi167.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 137 k 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 474 k 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 6.5 M 2023-11-28T11:05:35.261 INFO:teuthology.orchestra.run.smithi167.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-28T11:05:35.262 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 45 k 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 117 k 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-28T11:05:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-28T11:05:35.264 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-28T11:05:35.264 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-28T11:05:35.264 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-28T11:05:35.264 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-28T11:05:35.264 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-28T11:05:35.264 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-28T11:05:35.264 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-28T11:05:35.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-28T11:05:35.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-28T11:05:35.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-28T11:05:35.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-28T11:05:35.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-28T11:05:35.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-28T11:05:35.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-28T11:05:35.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-28T11:05:35.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-28T11:05:35.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-28T11:05:35.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-28T11:05:35.267 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-28T11:05:35.268 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-28T11:05:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:Enabling module streams: 2023-11-28T11:05:35.268 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql 10 2023-11-28T11:05:35.268 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:05:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2023-11-28T11:05:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:=========================================================================================================================== 2023-11-28T11:05:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:Install 128 Packages 2023-11-28T11:05:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 3 Packages 2023-11-28T11:05:35.268 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:05:35.269 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 203 M 2023-11-28T11:05:35.269 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2023-11-28T11:05:35.547 INFO:teuthology.orchestra.run.smithi167.stdout:(1/131): ceph-18.0.0-2697.g2f5f6028.el8.x86_64. 27 kB/s | 6.4 kB 00:00 2023-11-28T11:05:35.672 INFO:teuthology.orchestra.run.smithi125.stdout:(2/131): ceph-fuse-18.0.0-2697.g2f5f6028.el8.x8 838 kB/s | 845 kB 00:01 2023-11-28T11:05:35.797 INFO:teuthology.orchestra.run.smithi125.stdout:(3/131): ceph-immutable-object-cache-18.0.0-269 1.3 MB/s | 165 kB 00:00 2023-11-28T11:05:36.670 INFO:teuthology.orchestra.run.smithi167.stdout:(2/131): ceph-fuse-18.0.0-2697.g2f5f6028.el8.x8 751 kB/s | 845 kB 00:01 2023-11-28T11:05:36.672 INFO:teuthology.orchestra.run.smithi125.stdout:(4/131): ceph-mds-18.0.0-2697.g2f5f6028.el8.x86 2.6 MB/s | 2.3 MB 00:00 2023-11-28T11:05:36.828 INFO:teuthology.orchestra.run.smithi167.stdout:(3/131): ceph-immutable-object-cache-18.0.0-269 1.0 MB/s | 165 kB 00:00 2023-11-28T11:05:36.923 INFO:teuthology.orchestra.run.smithi125.stdout:(5/131): ceph-base-18.0.0-2697.g2f5f6028.el8.x8 2.2 MB/s | 5.4 MB 00:02 2023-11-28T11:05:37.140 INFO:teuthology.orchestra.run.smithi125.stdout:(6/131): ceph-mgr-18.0.0-2697.g2f5f6028.el8.x86 3.3 MB/s | 1.5 MB 00:00 2023-11-28T11:05:37.757 INFO:teuthology.orchestra.run.smithi125.stdout:(7/131): ceph-mon-18.0.0-2697.g2f5f6028.el8.x86 5.5 MB/s | 4.6 MB 00:00 2023-11-28T11:05:38.254 INFO:teuthology.orchestra.run.smithi167.stdout:(4/131): ceph-mds-18.0.0-2697.g2f5f6028.el8.x86 1.6 MB/s | 2.3 MB 00:01 2023-11-28T11:05:38.745 INFO:teuthology.orchestra.run.smithi167.stdout:(5/131): ceph-base-18.0.0-2697.g2f5f6028.el8.x8 1.6 MB/s | 5.4 MB 00:03 2023-11-28T11:05:39.387 INFO:teuthology.orchestra.run.smithi167.stdout:(6/131): ceph-mgr-18.0.0-2697.g2f5f6028.el8.x86 1.4 MB/s | 1.5 MB 00:01 2023-11-28T11:05:39.982 INFO:teuthology.orchestra.run.smithi125.stdout:(8/131): ceph-radosgw-18.0.0-2697.g2f5f6028.el8 5.9 MB/s | 13 MB 00:02 2023-11-28T11:05:40.093 INFO:teuthology.orchestra.run.smithi125.stdout:(9/131): ceph-selinux-18.0.0-2697.g2f5f6028.el8 221 kB/s | 24 kB 00:00 2023-11-28T11:05:40.440 INFO:teuthology.orchestra.run.smithi125.stdout:(10/131): ceph-osd-18.0.0-2697.g2f5f6028.el8.x8 5.4 MB/s | 18 MB 00:03 2023-11-28T11:05:40.462 INFO:teuthology.orchestra.run.smithi167.stdout:(7/131): ceph-mon-18.0.0-2697.g2f5f6028.el8.x86 2.7 MB/s | 4.6 MB 00:01 2023-11-28T11:05:40.524 INFO:teuthology.orchestra.run.smithi125.stdout:(11/131): cephfs-mirror-18.0.0-2697.g2f5f6028.e 3.0 MB/s | 257 kB 00:00 2023-11-28T11:05:40.658 INFO:teuthology.orchestra.run.smithi125.stdout:(12/131): libcephfs-devel-18.0.0-2697.g2f5f6028 229 kB/s | 30 kB 00:00 2023-11-28T11:05:40.916 INFO:teuthology.orchestra.run.smithi125.stdout:(13/131): libcephfs2-18.0.0-2697.g2f5f6028.el8. 2.9 MB/s | 767 kB 00:00 2023-11-28T11:05:41.016 INFO:teuthology.orchestra.run.smithi125.stdout:(14/131): libcephsqlite-18.0.0-2697.g2f5f6028.e 1.3 MB/s | 137 kB 00:00 2023-11-28T11:05:41.109 INFO:teuthology.orchestra.run.smithi125.stdout:(15/131): librados-devel-18.0.0-2697.g2f5f6028. 1.5 MB/s | 139 kB 00:00 2023-11-28T11:05:41.334 INFO:teuthology.orchestra.run.smithi125.stdout:(16/131): libradosstriper1-18.0.0-2697.g2f5f602 2.1 MB/s | 474 kB 00:00 2023-11-28T11:05:43.642 INFO:teuthology.orchestra.run.smithi125.stdout:(17/131): librgw2-18.0.0-2697.g2f5f6028.el8.x86 2.8 MB/s | 6.5 MB 00:02 2023-11-28T11:05:43.726 INFO:teuthology.orchestra.run.smithi125.stdout:(18/131): python3-ceph-argparse-18.0.0-2697.g2f 536 kB/s | 45 kB 00:00 2023-11-28T11:05:43.818 INFO:teuthology.orchestra.run.smithi125.stdout:(19/131): python3-ceph-common-18.0.0-2697.g2f5f 1.2 MB/s | 117 kB 00:00 2023-11-28T11:05:43.910 INFO:teuthology.orchestra.run.smithi125.stdout:(20/131): python3-cephfs-18.0.0-2697.g2f5f6028. 2.0 MB/s | 190 kB 00:00 2023-11-28T11:05:44.069 INFO:teuthology.orchestra.run.smithi125.stdout:(21/131): python3-rados-18.0.0-2697.g2f5f6028.e 2.3 MB/s | 371 kB 00:00 2023-11-28T11:05:44.244 INFO:teuthology.orchestra.run.smithi125.stdout:(22/131): python3-rbd-18.0.0-2697.g2f5f6028.el8 2.0 MB/s | 364 kB 00:00 2023-11-28T11:05:44.311 INFO:teuthology.orchestra.run.smithi125.stdout:(23/131): python3-rgw-18.0.0-2697.g2f5f6028.el8 1.6 MB/s | 107 kB 00:00 2023-11-28T11:05:44.363 INFO:teuthology.orchestra.run.smithi167.stdout:(8/131): ceph-common-18.0.0-2697.g2f5f6028.el8. 2.4 MB/s | 22 MB 00:09 2023-11-28T11:05:44.386 INFO:teuthology.orchestra.run.smithi125.stdout:(24/131): rbd-fuse-18.0.0-2697.g2f5f6028.el8.x8 1.2 MB/s | 94 kB 00:00 2023-11-28T11:05:44.437 INFO:teuthology.orchestra.run.smithi167.stdout:(9/131): ceph-selinux-18.0.0-2697.g2f5f6028.el8 326 kB/s | 24 kB 00:00 2023-11-28T11:05:45.121 INFO:teuthology.orchestra.run.smithi167.stdout:(10/131): ceph-radosgw-18.0.0-2697.g2f5f6028.el 2.8 MB/s | 13 MB 00:04 2023-11-28T11:05:45.538 INFO:teuthology.orchestra.run.smithi167.stdout:(11/131): cephfs-mirror-18.0.0-2697.g2f5f6028.e 618 kB/s | 257 kB 00:00 2023-11-28T11:05:45.630 INFO:teuthology.orchestra.run.smithi167.stdout:(12/131): libcephfs-devel-18.0.0-2697.g2f5f6028 332 kB/s | 30 kB 00:00 2023-11-28T11:05:45.636 INFO:teuthology.orchestra.run.smithi125.stdout:(25/131): rbd-mirror-18.0.0-2697.g2f5f6028.el8. 2.8 MB/s | 3.4 MB 00:01 2023-11-28T11:05:46.155 INFO:teuthology.orchestra.run.smithi167.stdout:(13/131): libcephfs2-18.0.0-2697.g2f5f6028.el8. 1.4 MB/s | 767 kB 00:00 2023-11-28T11:05:46.178 INFO:teuthology.orchestra.run.smithi125.stdout:(26/131): rbd-nbd-18.0.0-2697.g2f5f6028.el8.x86 333 kB/s | 180 kB 00:00 2023-11-28T11:05:46.322 INFO:teuthology.orchestra.run.smithi167.stdout:(14/131): libcephsqlite-18.0.0-2697.g2f5f6028.e 824 kB/s | 137 kB 00:00 2023-11-28T11:05:46.481 INFO:teuthology.orchestra.run.smithi167.stdout:(15/131): librados-devel-18.0.0-2697.g2f5f6028. 878 kB/s | 139 kB 00:00 2023-11-28T11:05:46.670 INFO:teuthology.orchestra.run.smithi125.stdout:(27/131): ceph-grafana-dashboards-18.0.0-2697.g 47 kB/s | 23 kB 00:00 2023-11-28T11:05:46.881 INFO:teuthology.orchestra.run.smithi167.stdout:(16/131): libradosstriper1-18.0.0-2697.g2f5f602 1.2 MB/s | 474 kB 00:00 2023-11-28T11:05:47.012 INFO:teuthology.orchestra.run.smithi125.stdout:(28/131): ceph-mgr-cephadm-18.0.0-2697.g2f5f602 359 kB/s | 123 kB 00:00 2023-11-28T11:05:48.262 INFO:teuthology.orchestra.run.smithi125.stdout:(29/131): ceph-common-18.0.0-2697.g2f5f6028.el8 1.6 MB/s | 22 MB 00:13 2023-11-28T11:05:48.431 INFO:teuthology.orchestra.run.smithi167.stdout:(17/131): ceph-osd-18.0.0-2697.g2f5f6028.el8.x8 2.0 MB/s | 18 MB 00:09 2023-11-28T11:05:48.523 INFO:teuthology.orchestra.run.smithi167.stdout:(18/131): python3-ceph-argparse-18.0.0-2697.g2f 488 kB/s | 45 kB 00:00 2023-11-28T11:05:48.546 INFO:teuthology.orchestra.run.smithi125.stdout:(30/131): ceph-mgr-dashboard-18.0.0-2697.g2f5f6 1.1 MB/s | 1.7 MB 00:01 2023-11-28T11:05:48.974 INFO:teuthology.orchestra.run.smithi167.stdout:(19/131): python3-ceph-common-18.0.0-2697.g2f5f 260 kB/s | 117 kB 00:00 2023-11-28T11:05:49.141 INFO:teuthology.orchestra.run.smithi167.stdout:(20/131): python3-cephfs-18.0.0-2697.g2f5f6028. 1.1 MB/s | 190 kB 00:00 2023-11-28T11:05:49.221 INFO:teuthology.orchestra.run.smithi125.stdout:(31/131): ceph-test-18.0.0-2697.g2f5f6028.el8.x 5.1 MB/s | 47 MB 00:09 2023-11-28T11:05:49.246 INFO:teuthology.orchestra.run.smithi125.stdout:(32/131): ceph-mgr-modules-core-18.0.0-2697.g2f 337 kB/s | 236 kB 00:00 2023-11-28T11:05:49.322 INFO:teuthology.orchestra.run.smithi125.stdout:(33/131): ceph-mgr-rook-18.0.0-2697.g2f5f6028.e 473 kB/s | 47 kB 00:00 2023-11-28T11:05:49.347 INFO:teuthology.orchestra.run.smithi125.stdout:(34/131): ceph-prometheus-alerts-18.0.0-2697.g2 145 kB/s | 15 kB 00:00 2023-11-28T11:05:49.474 INFO:teuthology.orchestra.run.smithi167.stdout:(21/131): python3-rados-18.0.0-2697.g2f5f6028.e 1.1 MB/s | 371 kB 00:00 2023-11-28T11:05:49.522 INFO:teuthology.orchestra.run.smithi125.stdout:(35/131): cephadm-18.0.0-2697.g2f5f6028.el8.noa 473 kB/s | 83 kB 00:00 2023-11-28T11:05:49.564 INFO:teuthology.orchestra.run.smithi125.stdout:(36/131): ceph-volume-18.0.0-2697.g2f5f6028.el8 1.1 MB/s | 263 kB 00:00 2023-11-28T11:05:49.623 INFO:teuthology.orchestra.run.smithi125.stdout:(37/131): cephfs-top-18.0.0-2697.g2f5f6028.el8. 180 kB/s | 18 kB 00:00 2023-11-28T11:05:49.791 INFO:teuthology.orchestra.run.smithi167.stdout:(22/131): python3-rbd-18.0.0-2697.g2f5f6028.el8 1.1 MB/s | 364 kB 00:00 2023-11-28T11:05:49.883 INFO:teuthology.orchestra.run.smithi167.stdout:(23/131): python3-rgw-18.0.0-2697.g2f5f6028.el8 1.1 MB/s | 107 kB 00:00 2023-11-28T11:05:49.906 INFO:teuthology.orchestra.run.smithi125.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 208 kB/s | 59 kB 00:00 2023-11-28T11:05:49.931 INFO:teuthology.orchestra.run.smithi125.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 834 kB/s | 306 kB 00:00 2023-11-28T11:05:49.984 INFO:teuthology.orchestra.run.smithi167.stdout:(24/131): rbd-fuse-18.0.0-2697.g2f5f6028.el8.x8 946 kB/s | 94 kB 00:00 2023-11-28T11:05:49.990 INFO:teuthology.orchestra.run.smithi125.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 899 kB/s | 75 kB 00:00 2023-11-28T11:05:50.032 INFO:teuthology.orchestra.run.smithi125.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-11-28T11:05:50.116 INFO:teuthology.orchestra.run.smithi125.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-11-28T11:05:50.141 INFO:teuthology.orchestra.run.smithi125.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-11-28T11:05:50.158 INFO:teuthology.orchestra.run.smithi125.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 790 kB/s | 33 kB 00:00 2023-11-28T11:05:50.183 INFO:teuthology.orchestra.run.smithi125.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 391 kB/s | 16 kB 00:00 2023-11-28T11:05:50.234 INFO:teuthology.orchestra.run.smithi125.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-11-28T11:05:50.292 INFO:teuthology.orchestra.run.smithi125.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-11-28T11:05:50.343 INFO:teuthology.orchestra.run.smithi125.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 223 kB/s | 11 kB 00:00 2023-11-28T11:05:50.401 INFO:teuthology.orchestra.run.smithi125.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2023-11-28T11:05:50.418 INFO:teuthology.orchestra.run.smithi125.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2023-11-28T11:05:50.460 INFO:teuthology.orchestra.run.smithi125.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-11-28T11:05:50.494 INFO:teuthology.orchestra.run.smithi125.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.7 MB/s | 59 kB 00:00 2023-11-28T11:05:50.527 INFO:teuthology.orchestra.run.smithi125.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.8 MB/s | 60 kB 00:00 2023-11-28T11:05:50.619 INFO:teuthology.orchestra.run.smithi125.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-11-28T11:05:50.653 INFO:teuthology.orchestra.run.smithi125.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 470 kB/s | 16 kB 00:00 2023-11-28T11:05:50.686 INFO:teuthology.orchestra.run.smithi125.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 1.0 MB/s | 34 kB 00:00 2023-11-28T11:05:50.795 INFO:teuthology.orchestra.run.smithi125.stdout:(57/131): python3-kubernetes-11.0.0-6.el8.noarc 3.0 MB/s | 1.2 MB 00:00 2023-11-28T11:05:50.820 INFO:teuthology.orchestra.run.smithi125.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-11-28T11:05:50.846 INFO:teuthology.orchestra.run.smithi125.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-11-28T11:05:50.871 INFO:teuthology.orchestra.run.smithi125.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2023-11-28T11:05:50.933 INFO:teuthology.orchestra.run.smithi125.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 274 kB/s | 24 kB 00:00 2023-11-28T11:05:50.963 INFO:teuthology.orchestra.run.smithi125.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 318 kB/s | 29 kB 00:00 2023-11-28T11:05:50.988 INFO:teuthology.orchestra.run.smithi125.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 503 kB/s | 27 kB 00:00 2023-11-28T11:05:51.064 INFO:teuthology.orchestra.run.smithi125.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-11-28T11:05:51.106 INFO:teuthology.orchestra.run.smithi125.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2023-11-28T11:05:51.134 INFO:teuthology.orchestra.run.smithi125.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 917 kB/s | 61 kB 00:00 2023-11-28T11:05:51.156 INFO:teuthology.orchestra.run.smithi125.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-11-28T11:05:51.181 INFO:teuthology.orchestra.run.smithi125.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 459 kB/s | 23 kB 00:00 2023-11-28T11:05:51.207 INFO:teuthology.orchestra.run.smithi125.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-11-28T11:05:51.524 INFO:teuthology.orchestra.run.smithi125.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 43 MB/s | 14 MB 00:00 2023-11-28T11:05:51.574 INFO:teuthology.orchestra.run.smithi125.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-11-28T11:05:51.616 INFO:teuthology.orchestra.run.smithi125.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-11-28T11:05:51.658 INFO:teuthology.orchestra.run.smithi125.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-11-28T11:05:51.700 INFO:teuthology.orchestra.run.smithi125.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-11-28T11:05:51.751 INFO:teuthology.orchestra.run.smithi125.stdout:(75/131): thrift-0.13.0-2.el8.x86_64.rpm 2.9 MB/s | 1.7 MB 00:00 2023-11-28T11:05:51.776 INFO:teuthology.orchestra.run.smithi125.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 514 kB/s | 39 kB 00:00 2023-11-28T11:05:51.834 INFO:teuthology.orchestra.run.smithi125.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 10 MB/s | 538 kB 00:00 2023-11-28T11:05:51.859 INFO:teuthology.orchestra.run.smithi167.stdout:(25/131): rbd-mirror-18.0.0-2697.g2f5f6028.el8. 1.8 MB/s | 3.4 MB 00:01 2023-11-28T11:05:51.876 INFO:teuthology.orchestra.run.smithi125.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 5.4 MB/s | 688 kB 00:00 2023-11-28T11:05:51.902 INFO:teuthology.orchestra.run.smithi125.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-11-28T11:05:51.927 INFO:teuthology.orchestra.run.smithi125.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-11-28T11:05:51.960 INFO:teuthology.orchestra.run.smithi125.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-11-28T11:05:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:(26/131): librgw2-18.0.0-2697.g2f5f6028.el8.x86 1.3 MB/s | 6.5 MB 00:05 2023-11-28T11:05:52.002 INFO:teuthology.orchestra.run.smithi125.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 638 kB/s | 27 kB 00:00 2023-11-28T11:05:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:(27/131): rbd-nbd-18.0.0-2697.g2f5f6028.el8.x86 1.1 MB/s | 180 kB 00:00 2023-11-28T11:05:52.053 INFO:teuthology.orchestra.run.smithi125.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2023-11-28T11:05:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:(28/131): ceph-grafana-dashboards-18.0.0-2697.g 277 kB/s | 23 kB 00:00 2023-11-28T11:05:52.120 INFO:teuthology.orchestra.run.smithi125.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2023-11-28T11:05:52.126 INFO:teuthology.orchestra.run.smithi167.stdout:(29/131): ceph-mgr-cephadm-18.0.0-2697.g2f5f602 1.2 MB/s | 123 kB 00:00 2023-11-28T11:05:52.145 INFO:teuthology.orchestra.run.smithi125.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 479 kB/s | 44 kB 00:00 2023-11-28T11:05:52.195 INFO:teuthology.orchestra.run.smithi125.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-11-28T11:05:52.262 INFO:teuthology.orchestra.run.smithi125.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 26 MB/s | 3.7 MB 00:00 2023-11-28T11:05:52.279 INFO:teuthology.orchestra.run.smithi125.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.6 MB/s | 225 kB 00:00 2023-11-28T11:05:52.304 INFO:teuthology.orchestra.run.smithi125.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-11-28T11:05:52.330 INFO:teuthology.orchestra.run.smithi125.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-11-28T11:05:52.357 INFO:teuthology.orchestra.run.smithi125.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-11-28T11:05:52.380 INFO:teuthology.orchestra.run.smithi125.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-11-28T11:05:52.414 INFO:teuthology.orchestra.run.smithi125.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-11-28T11:05:52.489 INFO:teuthology.orchestra.run.smithi125.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2023-11-28T11:05:52.581 INFO:teuthology.orchestra.run.smithi125.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 24 MB/s | 4.9 MB 00:00 2023-11-28T11:05:52.623 INFO:teuthology.orchestra.run.smithi125.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-11-28T11:05:52.698 INFO:teuthology.orchestra.run.smithi125.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 23 MB/s | 4.7 MB 00:00 2023-11-28T11:05:52.723 INFO:teuthology.orchestra.run.smithi125.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.4 MB/s | 354 kB 00:00 2023-11-28T11:05:52.774 INFO:teuthology.orchestra.run.smithi125.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 16 MB/s | 808 kB 00:00 2023-11-28T11:05:52.857 INFO:teuthology.orchestra.run.smithi125.stdout:(100/131): postgresql-server-10.21-2.module+el8 32 MB/s | 5.1 MB 00:00 2023-11-28T11:05:52.907 INFO:teuthology.orchestra.run.smithi125.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-11-28T11:05:52.933 INFO:teuthology.orchestra.run.smithi125.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 622 kB/s | 47 kB 00:00 2023-11-28T11:05:52.958 INFO:teuthology.orchestra.run.smithi125.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-11-28T11:05:52.983 INFO:teuthology.orchestra.run.smithi125.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 849 kB/s | 43 kB 00:00 2023-11-28T11:05:53.017 INFO:teuthology.orchestra.run.smithi125.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-11-28T11:05:53.042 INFO:teuthology.orchestra.run.smithi125.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 820 kB/s | 48 kB 00:00 2023-11-28T11:05:53.068 INFO:teuthology.orchestra.run.smithi125.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-11-28T11:05:53.093 INFO:teuthology.orchestra.run.smithi125.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 849 kB/s | 43 kB 00:00 2023-11-28T11:05:53.118 INFO:teuthology.orchestra.run.smithi125.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-11-28T11:05:53.135 INFO:teuthology.orchestra.run.smithi125.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.3 MB/s | 229 kB 00:00 2023-11-28T11:05:53.219 INFO:teuthology.orchestra.run.smithi125.stdout:(111/131): ceph-mgr-diskprediction-local-18.0.0 1.5 MB/s | 7.4 MB 00:04 2023-11-28T11:05:53.244 INFO:teuthology.orchestra.run.smithi125.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 172 kB/s | 19 kB 00:00 2023-11-28T11:05:53.286 INFO:teuthology.orchestra.run.smithi125.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-11-28T11:05:53.311 INFO:teuthology.orchestra.run.smithi125.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.6 MB/s | 155 kB 00:00 2023-11-28T11:05:53.336 INFO:teuthology.orchestra.run.smithi125.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 356 kB/s | 18 kB 00:00 2023-11-28T11:05:53.370 INFO:teuthology.orchestra.run.smithi125.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.5 MB/s | 559 kB 00:00 2023-11-28T11:05:53.403 INFO:teuthology.orchestra.run.smithi125.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-11-28T11:05:53.429 INFO:teuthology.orchestra.run.smithi125.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-11-28T11:05:53.454 INFO:teuthology.orchestra.run.smithi125.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-11-28T11:05:53.479 INFO:teuthology.orchestra.run.smithi125.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-11-28T11:05:53.505 INFO:teuthology.orchestra.run.smithi125.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-11-28T11:05:53.530 INFO:teuthology.orchestra.run.smithi125.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-11-28T11:05:53.535 INFO:teuthology.orchestra.run.smithi167.stdout:(30/131): ceph-mgr-dashboard-18.0.0-2697.g2f5f6 1.2 MB/s | 1.7 MB 00:01 2023-11-28T11:05:53.555 INFO:teuthology.orchestra.run.smithi125.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-11-28T11:05:53.581 INFO:teuthology.orchestra.run.smithi125.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 769 kB/s | 39 kB 00:00 2023-11-28T11:05:53.622 INFO:teuthology.orchestra.run.smithi125.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-11-28T11:05:53.648 INFO:teuthology.orchestra.run.smithi125.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-11-28T11:05:53.673 INFO:teuthology.orchestra.run.smithi125.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-11-28T11:05:53.715 INFO:teuthology.orchestra.run.smithi125.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.7 MB/s | 2.3 MB 00:00 2023-11-28T11:05:53.774 INFO:teuthology.orchestra.run.smithi125.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-11-28T11:05:53.918 INFO:teuthology.orchestra.run.smithi167.stdout:(31/131): ceph-mgr-modules-core-18.0.0-2697.g2f 618 kB/s | 236 kB 00:00 2023-11-28T11:05:54.011 INFO:teuthology.orchestra.run.smithi167.stdout:(32/131): ceph-mgr-rook-18.0.0-2697.g2f5f6028.e 512 kB/s | 47 kB 00:00 2023-11-28T11:05:54.103 INFO:teuthology.orchestra.run.smithi167.stdout:(33/131): ceph-prometheus-alerts-18.0.0-2697.g2 158 kB/s | 15 kB 00:00 2023-11-28T11:05:54.353 INFO:teuthology.orchestra.run.smithi167.stdout:(34/131): ceph-volume-18.0.0-2697.g2f5f6028.el8 1.0 MB/s | 263 kB 00:00 2023-11-28T11:05:54.454 INFO:teuthology.orchestra.run.smithi167.stdout:(35/131): cephadm-18.0.0-2697.g2f5f6028.el8.noa 828 kB/s | 83 kB 00:00 2023-11-28T11:05:54.545 INFO:teuthology.orchestra.run.smithi167.stdout:(36/131): cephfs-top-18.0.0-2697.g2f5f6028.el8. 197 kB/s | 18 kB 00:00 2023-11-28T11:05:54.729 INFO:teuthology.orchestra.run.smithi167.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-11-28T11:05:54.771 INFO:teuthology.orchestra.run.smithi167.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-11-28T11:05:54.821 INFO:teuthology.orchestra.run.smithi167.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-11-28T11:05:54.897 INFO:teuthology.orchestra.run.smithi167.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 6.2 MB/s | 476 kB 00:00 2023-11-28T11:05:54.939 INFO:teuthology.orchestra.run.smithi167.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-11-28T11:05:54.989 INFO:teuthology.orchestra.run.smithi167.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-11-28T11:05:55.039 INFO:teuthology.orchestra.run.smithi167.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 658 kB/s | 33 kB 00:00 2023-11-28T11:05:55.090 INFO:teuthology.orchestra.run.smithi167.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 324 kB/s | 16 kB 00:00 2023-11-28T11:05:55.140 INFO:teuthology.orchestra.run.smithi167.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-11-28T11:05:55.190 INFO:teuthology.orchestra.run.smithi167.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 7.5 MB/s | 384 kB 00:00 2023-11-28T11:05:55.233 INFO:teuthology.orchestra.run.smithi167.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2023-11-28T11:05:55.283 INFO:teuthology.orchestra.run.smithi167.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 223 kB/s | 11 kB 00:00 2023-11-28T11:05:55.333 INFO:teuthology.orchestra.run.smithi167.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-11-28T11:05:55.425 INFO:teuthology.orchestra.run.smithi167.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 13 MB/s | 1.2 MB 00:00 2023-11-28T11:05:55.475 INFO:teuthology.orchestra.run.smithi167.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 977 kB/s | 49 kB 00:00 2023-11-28T11:05:55.482 INFO:teuthology.orchestra.run.smithi125.stdout:(130/131): librbd1-18.0.0-2697.g2f5f6028.el8.x8 2.0 MB/s | 3.6 MB 00:01 2023-11-28T11:05:55.526 INFO:teuthology.orchestra.run.smithi167.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-11-28T11:05:55.576 INFO:teuthology.orchestra.run.smithi167.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-11-28T11:05:55.626 INFO:teuthology.orchestra.run.smithi167.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-11-28T11:05:55.677 INFO:teuthology.orchestra.run.smithi167.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2023-11-28T11:05:55.727 INFO:teuthology.orchestra.run.smithi167.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 674 kB/s | 34 kB 00:00 2023-11-28T11:05:55.777 INFO:teuthology.orchestra.run.smithi167.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-11-28T11:05:55.828 INFO:teuthology.orchestra.run.smithi167.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-11-28T11:05:55.878 INFO:teuthology.orchestra.run.smithi167.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 375 kB/s | 19 kB 00:00 2023-11-28T11:05:55.986 INFO:teuthology.orchestra.run.smithi167.stdout:(60/131): ceph-mgr-diskprediction-local-18.0.0- 1.9 MB/s | 7.4 MB 00:03 2023-11-28T11:05:56.012 INFO:teuthology.orchestra.run.smithi167.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 179 kB/s | 24 kB 00:00 2023-11-28T11:05:56.062 INFO:teuthology.orchestra.run.smithi167.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 605 kB/s | 27 kB 00:00 2023-11-28T11:05:56.104 INFO:teuthology.orchestra.run.smithi167.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 6.1 MB/s | 255 kB 00:00 2023-11-28T11:05:56.129 INFO:teuthology.orchestra.run.smithi167.stdout:(64/131): python3-tempora-1.14.1-5.el8.noarch.r 205 kB/s | 29 kB 00:00 2023-11-28T11:05:56.154 INFO:teuthology.orchestra.run.smithi167.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2023-11-28T11:05:56.196 INFO:teuthology.orchestra.run.smithi167.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 916 kB/s | 61 kB 00:00 2023-11-28T11:05:56.222 INFO:teuthology.orchestra.run.smithi167.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-11-28T11:05:56.247 INFO:teuthology.orchestra.run.smithi167.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 457 kB/s | 23 kB 00:00 2023-11-28T11:05:56.272 INFO:teuthology.orchestra.run.smithi167.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-11-28T11:05:56.323 INFO:teuthology.orchestra.run.smithi167.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 17 MB/s | 1.7 MB 00:00 2023-11-28T11:05:56.365 INFO:teuthology.orchestra.run.smithi167.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 508 kB/s | 47 kB 00:00 2023-11-28T11:05:56.399 INFO:teuthology.orchestra.run.smithi167.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.8 MB/s | 200 kB 00:00 2023-11-28T11:05:56.415 INFO:teuthology.orchestra.run.smithi167.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 853 kB/s | 43 kB 00:00 2023-11-28T11:05:56.441 INFO:teuthology.orchestra.run.smithi167.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-11-28T11:05:56.483 INFO:teuthology.orchestra.run.smithi167.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 715 kB/s | 48 kB 00:00 2023-11-28T11:05:56.508 INFO:teuthology.orchestra.run.smithi167.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2023-11-28T11:05:56.525 INFO:teuthology.orchestra.run.smithi167.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-11-28T11:05:56.552 INFO:teuthology.orchestra.run.smithi167.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.5 MB/s | 109 kB 00:00 2023-11-28T11:05:56.576 INFO:teuthology.orchestra.run.smithi167.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-11-28T11:05:56.609 INFO:teuthology.orchestra.run.smithi167.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-11-28T11:05:56.635 INFO:teuthology.orchestra.run.smithi167.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 320 kB/s | 19 kB 00:00 2023-11-28T11:05:56.660 INFO:teuthology.orchestra.run.smithi167.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-11-28T11:05:56.694 INFO:teuthology.orchestra.run.smithi167.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.3 MB/s | 559 kB 00:00 2023-11-28T11:05:56.719 INFO:teuthology.orchestra.run.smithi167.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 306 kB/s | 18 kB 00:00 2023-11-28T11:05:56.761 INFO:teuthology.orchestra.run.smithi167.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.8 MB/s | 605 kB 00:00 2023-11-28T11:05:56.786 INFO:teuthology.orchestra.run.smithi167.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-11-28T11:05:56.828 INFO:teuthology.orchestra.run.smithi167.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-11-28T11:05:56.879 INFO:teuthology.orchestra.run.smithi167.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 20 MB/s | 2.3 MB 00:00 2023-11-28T11:05:56.904 INFO:teuthology.orchestra.run.smithi167.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-11-28T11:05:56.929 INFO:teuthology.orchestra.run.smithi167.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-11-28T11:05:56.954 INFO:teuthology.orchestra.run.smithi167.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-11-28T11:05:56.980 INFO:teuthology.orchestra.run.smithi167.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-11-28T11:05:57.005 INFO:teuthology.orchestra.run.smithi167.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 768 kB/s | 39 kB 00:00 2023-11-28T11:05:57.039 INFO:teuthology.orchestra.run.smithi167.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-11-28T11:05:57.040 INFO:teuthology.orchestra.run.smithi125.stdout:(131/131): librados2-18.0.0-2697.g2f5f6028.el8. 1.1 MB/s | 3.7 MB 00:03 2023-11-28T11:05:57.044 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2023-11-28T11:05:57.044 INFO:teuthology.orchestra.run.smithi125.stdout:Total 9.0 MB/s | 203 MB 00:22 2023-11-28T11:05:57.064 INFO:teuthology.orchestra.run.smithi167.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-11-28T11:05:57.089 INFO:teuthology.orchestra.run.smithi167.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-11-28T11:05:57.131 INFO:teuthology.orchestra.run.smithi167.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-11-28T11:05:57.173 INFO:teuthology.orchestra.run.smithi167.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-11-28T11:05:57.215 INFO:teuthology.orchestra.run.smithi167.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-11-28T11:05:57.257 INFO:teuthology.orchestra.run.smithi167.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-11-28T11:05:57.291 INFO:teuthology.orchestra.run.smithi167.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-11-28T11:05:57.349 INFO:teuthology.orchestra.run.smithi167.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-11-28T11:05:57.400 INFO:teuthology.orchestra.run.smithi167.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 11 MB/s | 538 kB 00:00 2023-11-28T11:05:57.569 INFO:teuthology.orchestra.run.smithi167.stdout:(104/131): python3-scipy-1.0.0-21.module+el8.5. 27 MB/s | 14 MB 00:00 2023-11-28T11:05:57.600 INFO:teuthology.orchestra.run.smithi167.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 783 kB/s | 157 kB 00:00 2023-11-28T11:05:57.626 INFO:teuthology.orchestra.run.smithi167.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.3 MB/s | 187 kB 00:00 2023-11-28T11:05:57.659 INFO:teuthology.orchestra.run.smithi167.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-11-28T11:05:57.701 INFO:teuthology.orchestra.run.smithi167.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 636 kB/s | 27 kB 00:00 2023-11-28T11:05:57.743 INFO:teuthology.orchestra.run.smithi167.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-11-28T11:05:57.819 INFO:teuthology.orchestra.run.smithi167.stdout:(110/131): python3-babel-2.5.1-7.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2023-11-28T11:05:57.844 INFO:teuthology.orchestra.run.smithi167.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 438 kB/s | 44 kB 00:00 2023-11-28T11:05:57.859 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2023-11-28T11:05:57.894 INFO:teuthology.orchestra.run.smithi167.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-11-28T11:05:57.961 INFO:teuthology.orchestra.run.smithi167.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 26 MB/s | 3.7 MB 00:00 2023-11-28T11:05:57.978 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2023-11-28T11:05:57.978 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2023-11-28T11:05:57.986 INFO:teuthology.orchestra.run.smithi167.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.4 MB/s | 225 kB 00:00 2023-11-28T11:05:58.011 INFO:teuthology.orchestra.run.smithi167.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-11-28T11:05:58.038 INFO:teuthology.orchestra.run.smithi167.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-11-28T11:05:58.062 INFO:teuthology.orchestra.run.smithi167.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 397 kB/s | 20 kB 00:00 2023-11-28T11:05:58.088 INFO:teuthology.orchestra.run.smithi167.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-11-28T11:05:58.121 INFO:teuthology.orchestra.run.smithi167.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-11-28T11:05:58.163 INFO:teuthology.orchestra.run.smithi167.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-11-28T11:05:58.255 INFO:teuthology.orchestra.run.smithi167.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 29 MB/s | 4.9 MB 00:00 2023-11-28T11:05:58.297 INFO:teuthology.orchestra.run.smithi167.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-11-28T11:05:58.372 INFO:teuthology.orchestra.run.smithi167.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 23 MB/s | 4.7 MB 00:00 2023-11-28T11:05:58.406 INFO:teuthology.orchestra.run.smithi167.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-11-28T11:05:58.465 INFO:teuthology.orchestra.run.smithi167.stdout:(125/131): postgresql-contrib-10.21-2.module+el 14 MB/s | 808 kB 00:00 2023-11-28T11:05:58.557 INFO:teuthology.orchestra.run.smithi167.stdout:(126/131): postgresql-server-10.21-2.module+el8 27 MB/s | 5.1 MB 00:00 2023-11-28T11:05:58.599 INFO:teuthology.orchestra.run.smithi167.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-11-28T11:05:59.074 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2023-11-28T11:05:59.078 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2023-11-28T11:06:00.835 INFO:teuthology.orchestra.run.smithi167.stdout:(128/131): librados2-18.0.0-2697.g2f5f6028.el8. 1.6 MB/s | 3.7 MB 00:02 2023-11-28T11:06:00.899 INFO:teuthology.orchestra.run.smithi167.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 12 MB/s | 798 kB 00:00 2023-11-28T11:06:01.183 INFO:teuthology.orchestra.run.smithi167.stdout:(130/131): librbd1-18.0.0-2697.g2f5f6028.el8.x8 1.4 MB/s | 3.6 MB 00:02 2023-11-28T11:06:03.191 INFO:teuthology.orchestra.run.smithi167.stdout:(131/131): ceph-test-18.0.0-2697.g2f5f6028.el8. 2.5 MB/s | 47 MB 00:18 2023-11-28T11:06:03.196 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2023-11-28T11:06:03.196 INFO:teuthology.orchestra.run.smithi167.stdout:Total 7.3 MB/s | 203 MB 00:27 2023-11-28T11:06:04.019 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2023-11-28T11:06:04.062 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2023-11-28T11:06:04.141 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2023-11-28T11:06:04.142 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2023-11-28T11:06:04.250 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-28T11:06:04.442 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-28T11:06:04.649 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-11-28T11:06:04.834 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-28T11:06:04.950 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-28T11:06:05.134 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-28T11:06:05.249 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2023-11-28T11:06:05.253 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2023-11-28T11:06:05.577 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-28T11:06:05.792 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 6/134 2023-11-28T11:06:06.182 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 6/134 2023-11-28T11:06:06.392 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 7/134 2023-11-28T11:06:06.515 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 7/134 2023-11-28T11:06:06.675 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 8/134 2023-11-28T11:06:06.770 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 8/134 2023-11-28T11:06:06.959 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 9/134 2023-11-28T11:06:07.186 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-28T11:06:07.411 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-28T11:06:07.803 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-28T11:06:08.045 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-28T11:06:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 14/134 2023-11-28T11:06:08.326 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 14/134 2023-11-28T11:06:08.533 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 15/134 2023-11-28T11:06:08.610 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 15/134 2023-11-28T11:06:08.741 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-28T11:06:08.875 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-28T11:06:09.025 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-28T11:06:09.632 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-28T11:06:09.783 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-28T11:06:10.021 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2023-11-28T11:06:10.282 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-28T11:06:10.364 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-28T11:06:10.440 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-28T11:06:10.558 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-11-28T11:06:10.609 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-11-28T11:06:10.774 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-11-28T11:06:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-11-28T11:06:11.269 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-11-28T11:06:11.386 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-11-28T11:06:11.500 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-11-28T11:06:11.600 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 5/134 2023-11-28T11:06:11.750 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-11-28T11:06:11.978 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-11-28T11:06:11.990 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 5/134 2023-11-28T11:06:12.155 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-11-28T11:06:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 6/134 2023-11-28T11:06:12.313 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 6/134 2023-11-28T11:06:12.363 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-11-28T11:06:12.500 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 7/134 2023-11-28T11:06:12.592 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-28T11:06:12.596 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 7/134 2023-11-28T11:06:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 8/134 2023-11-28T11:06:12.773 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8. 26/134 2023-11-28T11:06:12.893 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el 27/134 2023-11-28T11:06:12.984 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-11-28T11:06:13.211 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-28T11:06:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-28T11:06:13.790 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_6 28/134 2023-11-28T11:06:13.822 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-28T11:06:14.071 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-28T11:06:14.095 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-11-28T11:06:14.258 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 14/134 2023-11-28T11:06:14.351 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-11-28T11:06:14.362 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 14/134 2023-11-28T11:06:14.558 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 15/134 2023-11-28T11:06:14.598 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-11-28T11:06:14.705 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 15/134 2023-11-28T11:06:14.807 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-28T11:06:14.878 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-11-28T11:06:15.080 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-11-28T11:06:15.236 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-11-28T11:06:15.366 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-11-28T11:06:15.516 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-11-28T11:06:15.666 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-11-28T11:06:16.279 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-11-28T11:06:16.441 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-11-28T11:06:16.570 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-28T11:06:16.866 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-11-28T11:06:17.039 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-11-28T11:06:17.076 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-28T11:06:17.258 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-11-28T11:06:17.275 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-28T11:06:17.471 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 36/134 2023-11-28T11:06:17.627 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_6 37/134 2023-11-28T11:06:17.791 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-11-28T11:06:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-11-28T11:06:17.975 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-11-28T11:06:18.159 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-11-28T11:06:18.219 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-11-28T11:06:18.294 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-11-28T11:06:18.438 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-11-28T11:06:18.472 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-11-28T11:06:18.668 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-28T11:06:18.695 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-11-28T11:06:18.822 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8. 26/134 2023-11-28T11:06:18.943 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el 27/134 2023-11-28T11:06:19.060 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-11-28T11:06:19.187 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_6 28/134 2023-11-28T11:06:19.309 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-11-28T11:06:19.366 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-11-28T11:06:19.491 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-11-28T11:06:19.700 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-11-28T11:06:19.919 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-11-28T11:06:20.221 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-11-28T11:06:20.464 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-11-28T11:06:20.632 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-11-28T11:06:20.842 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-11-28T11:06:21.012 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-11-28T11:06:21.143 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-11-28T11:06:21.176 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-11-28T11:06:21.477 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-11-28T11:06:21.777 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-11-28T11:06:21.994 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-11-28T11:06:22.161 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-11-28T11:06:22.221 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-11-28T11:06:22.388 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-11-28T11:06:22.463 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-11-28T11:06:22.548 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-11-28T11:06:22.739 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-11-28T11:06:22.742 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-11-28T11:06:22.795 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-11-28T11:06:22.961 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-11-28T11:06:23.009 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-11-28T11:06:23.160 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-28T11:06:23.259 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-11-28T11:06:23.342 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-28T11:06:23.422 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-28T11:06:23.498 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-28T11:06:23.539 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 36/134 2023-11-28T11:06:23.690 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_6 37/134 2023-11-28T11:06:23.718 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-11-28T11:06:23.880 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-11-28T11:06:23.898 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-11-28T11:06:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-11-28T11:06:24.063 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-28T11:06:24.190 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-11-28T11:06:24.233 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-28T11:06:24.264 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-11-28T11:06:24.497 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-28T11:06:24.497 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-11-28T11:06:24.704 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-28T11:06:24.727 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-11-28T11:06:24.882 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-11-28T11:06:24.884 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-28T11:06:24.959 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-11-28T11:06:25.032 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-28T11:06:25.204 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-11-28T11:06:25.223 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-28T11:06:25.379 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-11-28T11:06:25.411 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-28T11:06:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-11-28T11:06:25.601 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-28T11:06:25.734 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-11-28T11:06:25.783 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-28T11:06:25.893 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-11-28T11:06:25.928 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-28T11:06:26.094 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-11-28T11:06:26.126 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-28T11:06:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-11-28T11:06:26.358 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-28T11:06:26.487 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-11-28T11:06:26.535 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-28T11:06:26.776 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-28T11:06:26.848 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-11-28T11:06:26.979 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-28T11:06:27.137 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-28T11:06:27.150 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-11-28T11:06:27.355 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-28T11:06:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-11-28T11:06:27.626 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-11-28T11:06:27.866 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-11-28T11:06:28.180 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-11-28T11:06:28.422 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-11-28T11:06:28.444 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-28T11:06:28.590 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-11-28T11:06:28.683 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-28T11:06:28.794 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-11-28T11:06:28.912 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-28T11:06:28.963 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-11-28T11:06:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-11-28T11:06:29.178 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-28T11:06:29.453 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-11-28T11:06:29.469 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-28T11:06:29.653 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-28T11:06:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-11-28T11:06:29.936 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-11-28T11:06:30.149 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-11-28T11:06:30.314 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-28T11:06:30.434 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-28T11:06:30.493 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-28T11:06:30.604 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 92/134 2023-11-28T11:06:30.674 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 92/134 2023-11-28T11:06:30.767 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-28T11:06:30.880 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 93/134 2023-11-28T11:06:30.988 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-28T11:06:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-28T11:06:31.292 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-28T11:06:31.525 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-28T11:06:31.728 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-28T11:06:31.910 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-28T11:06:32.050 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-28T11:06:32.187 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-28T11:06:32.386 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-28T11:06:32.627 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-28T11:06:32.812 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-28T11:06:33.063 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-28T11:06:33.313 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-28T11:06:33.472 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-28T11:06:33.696 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-28T11:06:34.484 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 94/134 2023-11-28T11:06:34.696 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 94/134 2023-11-28T11:06:34.772 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-28T11:06:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-28T11:06:35.263 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-28T11:06:35.284 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 94/134 2023-11-28T11:06:35.549 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-28T11:06:35.591 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 95/134 2023-11-28T11:06:35.676 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 95/134 2023-11-28T11:06:35.812 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 96/134 2023-11-28T11:06:35.899 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-28T11:06:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-28T11:06:36.814 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-28T11:06:36.988 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 92/134 2023-11-28T11:06:37.060 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 92/134 2023-11-28T11:06:37.239 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 93/134 2023-11-28T11:06:40.837 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 94/134 2023-11-28T11:06:41.547 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 94/134 2023-11-28T11:06:42.139 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 94/134 2023-11-28T11:06:42.458 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 95/134 2023-11-28T11:06:42.541 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 95/134 2023-11-28T11:06:42.670 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 96/134 2023-11-28T11:06:54.337 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 96/134 2023-11-28T11:06:54.337 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /sys 2023-11-28T11:06:54.337 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /proc 2023-11-28T11:06:54.337 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /dev 2023-11-28T11:06:54.337 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /run 2023-11-28T11:06:54.337 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /mnt 2023-11-28T11:06:54.337 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /var/tmp 2023-11-28T11:06:54.338 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /home 2023-11-28T11:06:54.338 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /tmp 2023-11-28T11:06:54.338 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /dev 2023-11-28T11:06:54.338 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:06:54.643 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 97/134 2023-11-28T11:06:56.218 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 97/134 2023-11-28T11:06:56.379 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 98/134 2023-11-28T11:06:56.596 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 98/134 2023-11-28T11:06:56.742 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 99/134 2023-11-28T11:06:57.201 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 99/134 2023-11-28T11:06:57.400 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 100/134 2023-11-28T11:06:57.416 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 100/134 2023-11-28T11:06:59.127 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 101/134 2023-11-28T11:06:59.282 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 101/134 2023-11-28T11:06:59.397 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.e 102/134 2023-11-28T11:06:59.563 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028. 103/134 2023-11-28T11:06:59.741 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 104/134 2023-11-28T11:06:59.957 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 104/134 2023-11-28T11:07:00.270 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 105/134 2023-11-28T11:07:01.229 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 105/134 2023-11-28T11:07:01.374 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 106/134 2023-11-28T11:07:01.463 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 106/134 2023-11-28T11:07:01.798 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el 107/134 2023-11-28T11:07:01.945 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 96/134 2023-11-28T11:07:01.945 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2023-11-28T11:07:01.945 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2023-11-28T11:07:01.946 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /dev 2023-11-28T11:07:01.946 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /run 2023-11-28T11:07:01.946 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2023-11-28T11:07:01.946 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2023-11-28T11:07:01.946 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2023-11-28T11:07:01.946 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2023-11-28T11:07:01.946 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /dev 2023-11-28T11:07:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:01.979 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 108/134 2023-11-28T11:07:02.013 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 108/134 2023-11-28T11:07:02.207 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 109/134 2023-11-28T11:07:02.218 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 109/134 2023-11-28T11:07:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 97/134 2023-11-28T11:07:03.472 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 110/134 2023-11-28T11:07:03.705 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 111/134 2023-11-28T11:07:03.738 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 111/134 2023-11-28T11:07:03.862 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 97/134 2023-11-28T11:07:03.899 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 112/134 2023-11-28T11:07:03.942 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 112/134 2023-11-28T11:07:04.031 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 98/134 2023-11-28T11:07:04.082 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 113/134 2023-11-28T11:07:04.248 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 98/134 2023-11-28T11:07:04.385 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 99/134 2023-11-28T11:07:04.426 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 113/134 2023-11-28T11:07:04.607 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 114/134 2023-11-28T11:07:04.841 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 99/134 2023-11-28T11:07:05.026 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 100/134 2023-11-28T11:07:05.043 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 100/134 2023-11-28T11:07:06.704 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 101/134 2023-11-28T11:07:06.866 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 101/134 2023-11-28T11:07:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.e 102/134 2023-11-28T11:07:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028. 103/134 2023-11-28T11:07:07.342 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 104/134 2023-11-28T11:07:07.559 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 104/134 2023-11-28T11:07:07.863 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 105/134 2023-11-28T11:07:08.828 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 105/134 2023-11-28T11:07:08.983 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 106/134 2023-11-28T11:07:09.015 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 114/134 2023-11-28T11:07:09.072 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 106/134 2023-11-28T11:07:09.322 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 115/134 2023-11-28T11:07:09.398 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el 107/134 2023-11-28T11:07:09.506 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-11-28T11:07:09.588 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 108/134 2023-11-28T11:07:09.623 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 108/134 2023-11-28T11:07:09.696 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-11-28T11:07:09.783 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 109/134 2023-11-28T11:07:09.794 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 109/134 2023-11-28T11:07:10.559 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-11-28T11:07:10.871 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-11-28T11:07:11.047 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 110/134 2023-11-28T11:07:11.058 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 119/134 2023-11-28T11:07:11.257 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 111/134 2023-11-28T11:07:11.260 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-28T11:07:11.291 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 111/134 2023-11-28T11:07:11.426 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_ 121/134 2023-11-28T11:07:11.458 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 112/134 2023-11-28T11:07:11.500 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 112/134 2023-11-28T11:07:11.574 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-28T11:07:11.775 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 113/134 2023-11-28T11:07:12.121 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 113/134 2023-11-28T11:07:12.267 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 114/134 2023-11-28T11:07:13.713 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-28T11:07:13.930 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-28T11:07:13.948 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-28T11:07:14.131 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 124/134 2023-11-28T11:07:14.395 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 125/134 2023-11-28T11:07:14.674 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 126/134 2023-11-28T11:07:14.965 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-28T11:07:15.122 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-28T11:07:15.130 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-28T11:07:15.304 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-11-28T11:07:15.471 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-11-28T11:07:15.552 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-11-28T11:07:15.780 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-11-28T11:07:15.792 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-11-28T11:07:15.793 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-28T11:07:16.008 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-28T11:07:16.008 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-28T11:07:16.226 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-28T11:07:16.387 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-28T11:07:16.693 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 114/134 2023-11-28T11:07:16.900 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-28T11:07:16.900 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 1/134 2023-11-28T11:07:16.900 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 2/134 2023-11-28T11:07:16.900 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 3/134 2023-11-28T11:07:16.900 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 4/134 2023-11-28T11:07:16.900 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 5/134 2023-11-28T11:07:16.900 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 6/134 2023-11-28T11:07:16.900 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 7/134 2023-11-28T11:07:16.900 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 8/134 2023-11-28T11:07:16.900 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 9/134 2023-11-28T11:07:16.901 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 10/134 2023-11-28T11:07:16.901 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 11/134 2023-11-28T11:07:16.901 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 12/134 2023-11-28T11:07:16.901 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 13/134 2023-11-28T11:07:16.901 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_ 14/134 2023-11-28T11:07:16.901 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 15/134 2023-11-28T11:07:16.901 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 16/134 2023-11-28T11:07:16.901 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_6 17/134 2023-11-28T11:07:16.901 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 18/134 2023-11-28T11:07:16.901 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 19/134 2023-11-28T11:07:16.901 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el 20/134 2023-11-28T11:07:16.902 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8. 21/134 2023-11-28T11:07:16.902 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_6 22/134 2023-11-28T11:07:16.902 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 23/134 2023-11-28T11:07:16.902 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 24/134 2023-11-28T11:07:16.902 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 25/134 2023-11-28T11:07:16.902 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 26/134 2023-11-28T11:07:16.902 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 27/134 2023-11-28T11:07:16.902 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 28/134 2023-11-28T11:07:16.902 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028. 29/134 2023-11-28T11:07:16.902 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 30/134 2023-11-28T11:07:16.911 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 31/134 2023-11-28T11:07:16.911 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 32/134 2023-11-28T11:07:16.911 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el 33/134 2023-11-28T11:07:16.911 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 34/134 2023-11-28T11:07:16.911 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.e 35/134 2023-11-28T11:07:16.911 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 36/134 2023-11-28T11:07:16.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 37/134 2023-11-28T11:07:16.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 38/134 2023-11-28T11:07:16.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-28T11:07:16.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-28T11:07:16.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-28T11:07:16.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-28T11:07:16.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-28T11:07:16.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-28T11:07:16.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-28T11:07:16.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-28T11:07:16.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-28T11:07:16.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-28T11:07:16.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-28T11:07:16.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-28T11:07:16.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-28T11:07:16.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-28T11:07:16.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-28T11:07:16.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-28T11:07:16.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-28T11:07:16.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-28T11:07:16.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-28T11:07:16.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-28T11:07:16.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-28T11:07:16.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-28T11:07:16.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-28T11:07:16.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-28T11:07:16.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-28T11:07:16.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-28T11:07:16.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-28T11:07:16.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-28T11:07:16.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-28T11:07:16.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-28T11:07:16.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-11-28T11:07:16.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-11-28T11:07:16.916 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-11-28T11:07:16.916 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-11-28T11:07:16.916 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-11-28T11:07:16.916 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-11-28T11:07:16.916 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-11-28T11:07:16.916 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-11-28T11:07:16.916 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-11-28T11:07:16.916 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-11-28T11:07:16.916 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-11-28T11:07:16.916 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-11-28T11:07:16.916 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-11-28T11:07:16.917 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-11-28T11:07:16.918 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-11-28T11:07:16.918 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-11-28T11:07:16.918 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-11-28T11:07:16.918 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-11-28T11:07:16.918 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-11-28T11:07:16.918 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-11-28T11:07:16.918 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-11-28T11:07:16.918 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-11-28T11:07:16.918 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-11-28T11:07:16.918 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-11-28T11:07:16.918 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-11-28T11:07:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-11-28T11:07:16.920 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-28T11:07:16.920 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 129/134 2023-11-28T11:07:16.920 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-28T11:07:16.920 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 131/134 2023-11-28T11:07:16.920 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-28T11:07:16.920 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-28T11:07:17.557 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 115/134 2023-11-28T11:07:17.847 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-11-28T11:07:18.051 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 117/134 2023-11-28T11:07:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-11-28T11:07:18.432 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-11-28T11:07:18.624 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-11-28T11:07:18.836 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-11-28T11:07:19.020 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_ 121/134 2023-11-28T11:07:19.167 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-28T11:07:19.613 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-28T11:07:19.613 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:57 ago on Tue 28 Nov 2023 11:05:22 AM UTC. 2023-11-28T11:07:21.366 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-28T11:07:21.624 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-28T11:07:21.642 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-28T11:07:21.791 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 124/134 2023-11-28T11:07:22.082 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 125/134 2023-11-28T11:07:22.220 INFO:teuthology.orchestra.run.smithi125.stdout:Installed products updated. 2023-11-28T11:07:22.395 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 126/134 2023-11-28T11:07:22.449 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:22.449 INFO:teuthology.orchestra.run.smithi125.stdout:Upgraded: 2023-11-28T11:07:22.449 INFO:teuthology.orchestra.run.smithi125.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-28T11:07:22.450 INFO:teuthology.orchestra.run.smithi125.stdout: librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.450 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.450 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2023-11-28T11:07:22.450 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-28T11:07:22.450 INFO:teuthology.orchestra.run.smithi125.stdout: automake-1.16.1-7.el8.noarch 2023-11-28T11:07:22.450 INFO:teuthology.orchestra.run.smithi125.stdout: bison-3.0.4-10.el8.x86_64 2023-11-28T11:07:22.450 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.450 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.450 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.450 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.451 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:22.451 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.451 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.451 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.451 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:22.451 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:22.451 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:22.451 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:22.451 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:22.451 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: flex-2.6.1-9.el8.x86_64 2023-11-28T11:07:22.452 INFO:teuthology.orchestra.run.smithi125.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-28T11:07:22.453 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-28T11:07:22.453 INFO:teuthology.orchestra.run.smithi125.stdout: jq-1.6-3.el8.x86_64 2023-11-28T11:07:22.453 INFO:teuthology.orchestra.run.smithi125.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-28T11:07:22.453 INFO:teuthology.orchestra.run.smithi125.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-28T11:07:22.453 INFO:teuthology.orchestra.run.smithi125.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-28T11:07:22.453 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.453 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.453 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.453 INFO:teuthology.orchestra.run.smithi125.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-28T11:07:22.453 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-28T11:07:22.453 INFO:teuthology.orchestra.run.smithi125.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-28T11:07:22.454 INFO:teuthology.orchestra.run.smithi125.stdout: libpq-13.5-1.el8.x86_64 2023-11-28T11:07:22.454 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-28T11:07:22.454 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-28T11:07:22.454 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.454 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.454 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-28T11:07:22.454 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.454 INFO:teuthology.orchestra.run.smithi125.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-28T11:07:22.454 INFO:teuthology.orchestra.run.smithi125.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-28T11:07:22.454 INFO:teuthology.orchestra.run.smithi125.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-28T11:07:22.454 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-28T11:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-28T11:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-28T11:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-28T11:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-28T11:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-28T11:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-28T11:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-28T11:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-28T11:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-28T11:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-28T11:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-28T11:07:22.456 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-28T11:07:22.456 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-28T11:07:22.456 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-28T11:07:22.456 INFO:teuthology.orchestra.run.smithi125.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-28T11:07:22.456 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-28T11:07:22.456 INFO:teuthology.orchestra.run.smithi125.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-28T11:07:22.456 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-28T11:07:22.456 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.456 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.456 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.456 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-28T11:07:22.457 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-28T11:07:22.458 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-28T11:07:22.458 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-28T11:07:22.458 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-28T11:07:22.458 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-28T11:07:22.458 INFO:teuthology.orchestra.run.smithi125.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-28T11:07:22.458 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-28T11:07:22.458 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-28T11:07:22.458 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-28T11:07:22.458 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-28T11:07:22.458 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend-2.6-1.el8.noarch 2023-11-28T11:07:22.458 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-28T11:07:22.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-28T11:07:22.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-28T11:07:22.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-28T11:07:22.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-28T11:07:22.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-28T11:07:22.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-28T11:07:22.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-28T11:07:22.459 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-28T11:07:22.460 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-28T11:07:22.461 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-28T11:07:22.461 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.461 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.461 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:22.461 INFO:teuthology.orchestra.run.smithi125.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-28T11:07:22.461 INFO:teuthology.orchestra.run.smithi125.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-28T11:07:22.461 INFO:teuthology.orchestra.run.smithi125.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-28T11:07:22.461 INFO:teuthology.orchestra.run.smithi125.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-28T11:07:22.461 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-28T11:07:22.462 INFO:teuthology.orchestra.run.smithi125.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-28T11:07:22.462 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:22.462 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-11-28T11:07:22.645 DEBUG:teuthology.parallel:result is None 2023-11-28T11:07:22.734 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-28T11:07:22.915 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-11-28T11:07:23.009 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-11-28T11:07:23.206 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-11-28T11:07:23.219 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-11-28T11:07:23.365 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-11-28T11:07:23.373 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-11-28T11:07:23.500 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-11-28T11:07:23.500 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-28T11:07:23.734 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-28T11:07:23.735 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-28T11:07:23.953 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-28T11:07:24.122 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-28T11:07:24.645 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-28T11:07:24.645 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 1/134 2023-11-28T11:07:24.646 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 2/134 2023-11-28T11:07:24.646 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 3/134 2023-11-28T11:07:24.646 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 4/134 2023-11-28T11:07:24.646 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 5/134 2023-11-28T11:07:24.646 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 6/134 2023-11-28T11:07:24.646 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 7/134 2023-11-28T11:07:24.646 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 8/134 2023-11-28T11:07:24.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 9/134 2023-11-28T11:07:24.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 10/134 2023-11-28T11:07:24.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 11/134 2023-11-28T11:07:24.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 12/134 2023-11-28T11:07:24.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 13/134 2023-11-28T11:07:24.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_ 14/134 2023-11-28T11:07:24.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 15/134 2023-11-28T11:07:24.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 16/134 2023-11-28T11:07:24.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_6 17/134 2023-11-28T11:07:24.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 18/134 2023-11-28T11:07:24.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 19/134 2023-11-28T11:07:24.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el 20/134 2023-11-28T11:07:24.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8. 21/134 2023-11-28T11:07:24.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_6 22/134 2023-11-28T11:07:24.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 23/134 2023-11-28T11:07:24.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 24/134 2023-11-28T11:07:24.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 25/134 2023-11-28T11:07:24.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 26/134 2023-11-28T11:07:24.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 27/134 2023-11-28T11:07:24.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 28/134 2023-11-28T11:07:24.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028. 29/134 2023-11-28T11:07:24.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 30/134 2023-11-28T11:07:24.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 31/134 2023-11-28T11:07:24.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 32/134 2023-11-28T11:07:24.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el 33/134 2023-11-28T11:07:24.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 34/134 2023-11-28T11:07:24.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.e 35/134 2023-11-28T11:07:24.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 36/134 2023-11-28T11:07:24.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 37/134 2023-11-28T11:07:24.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 38/134 2023-11-28T11:07:24.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-28T11:07:24.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-28T11:07:24.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-28T11:07:24.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-28T11:07:24.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-28T11:07:24.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-28T11:07:24.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-28T11:07:24.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-28T11:07:24.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-28T11:07:24.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-28T11:07:24.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-28T11:07:24.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-28T11:07:24.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-28T11:07:24.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-28T11:07:24.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-28T11:07:24.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-28T11:07:24.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-28T11:07:24.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-28T11:07:24.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-28T11:07:24.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-28T11:07:24.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-28T11:07:24.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-28T11:07:24.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-28T11:07:24.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-28T11:07:24.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-28T11:07:24.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-28T11:07:24.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-28T11:07:24.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-28T11:07:24.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-28T11:07:24.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-28T11:07:24.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-28T11:07:24.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-28T11:07:24.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-28T11:07:24.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-11-28T11:07:24.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-11-28T11:07:24.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-11-28T11:07:24.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-11-28T11:07:24.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-11-28T11:07:24.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-11-28T11:07:24.658 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-11-28T11:07:24.658 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-11-28T11:07:24.658 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-11-28T11:07:24.658 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-11-28T11:07:24.658 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-11-28T11:07:24.658 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-11-28T11:07:24.659 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-11-28T11:07:24.659 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-11-28T11:07:24.659 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-11-28T11:07:24.659 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-11-28T11:07:24.659 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-11-28T11:07:24.659 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-11-28T11:07:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-11-28T11:07:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-11-28T11:07:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-11-28T11:07:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-11-28T11:07:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-11-28T11:07:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-11-28T11:07:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-11-28T11:07:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-11-28T11:07:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-11-28T11:07:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-11-28T11:07:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-11-28T11:07:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-11-28T11:07:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-11-28T11:07:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-11-28T11:07:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-11-28T11:07:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-11-28T11:07:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-11-28T11:07:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-11-28T11:07:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-11-28T11:07:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 129/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 131/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-28T11:07:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-28T11:07:27.404 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-28T11:07:27.405 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:02:04 ago on Tue 28 Nov 2023 11:05:23 AM UTC. 2023-11-28T11:07:30.165 INFO:teuthology.orchestra.run.smithi167.stdout:Installed products updated. 2023-11-28T11:07:30.389 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:30.389 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2023-11-28T11:07:30.389 INFO:teuthology.orchestra.run.smithi167.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-28T11:07:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.390 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2023-11-28T11:07:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-28T11:07:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.1-7.el8.noarch 2023-11-28T11:07:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.0.4-10.el8.x86_64 2023-11-28T11:07:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T11:07:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-28T11:07:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.1-9.el8.x86_64 2023-11-28T11:07:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-28T11:07:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-28T11:07:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: jq-1.6-3.el8.x86_64 2023-11-28T11:07:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-28T11:07:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-28T11:07:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-28T11:07:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-28T11:07:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-28T11:07:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-28T11:07:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: libpq-13.5-1.el8.x86_64 2023-11-28T11:07:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-28T11:07:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-28T11:07:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-28T11:07:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-28T11:07:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-28T11:07:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-28T11:07:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-28T11:07:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-28T11:07:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-28T11:07:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-28T11:07:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-28T11:07:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-28T11:07:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-28T11:07:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-28T11:07:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-28T11:07:30.402 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-28T11:07:30.402 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-28T11:07:30.402 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-28T11:07:30.402 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-28T11:07:30.402 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-28T11:07:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-28T11:07:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-28T11:07:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-28T11:07:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-28T11:07:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-28T11:07:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-28T11:07:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-28T11:07:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-28T11:07:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-28T11:07:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-28T11:07:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-28T11:07:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-28T11:07:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-28T11:07:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-28T11:07:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-28T11:07:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-28T11:07:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-28T11:07:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-28T11:07:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-28T11:07:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-28T11:07:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-28T11:07:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-28T11:07:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-28T11:07:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-28T11:07:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-28T11:07:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-28T11:07:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-28T11:07:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-2.6-1.el8.noarch 2023-11-28T11:07:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-28T11:07:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-28T11:07:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-28T11:07:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-28T11:07:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-28T11:07:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-28T11:07:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-28T11:07:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-28T11:07:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-28T11:07:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-28T11:07:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-28T11:07:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-28T11:07:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-28T11:07:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-28T11:07:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-28T11:07:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-28T11:07:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-28T11:07:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-28T11:07:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-28T11:07:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-28T11:07:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-28T11:07:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T11:07:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-28T11:07:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-28T11:07:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-28T11:07:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-28T11:07:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-28T11:07:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-28T11:07:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:30.417 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-11-28T11:07:30.578 DEBUG:teuthology.parallel:result is None 2023-11-28T11:07:30.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:07:30.804 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-28T11:07:30.838 INFO:teuthology.orchestra.run.smithi125.stdout:18.0.0-2697.g2f5f6028.el8 2023-11-28T11:07:30.841 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697.g2f5f6028.el8 2023-11-28T11:07:30.841 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697.g2f5f6028 is installed. 2023-11-28T11:07:30.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:07:30.986 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-28T11:07:31.010 INFO:teuthology.orchestra.run.smithi167.stdout:18.0.0-2697.g2f5f6028.el8 2023-11-28T11:07:31.010 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697.g2f5f6028.el8 2023-11-28T11:07:31.010 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697.g2f5f6028 is installed. 2023-11-28T11:07:31.010 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T11:07:31.011 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:07:31.011 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T11:07:31.058 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:07:31.059 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T11:07:31.101 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T11:07:31.101 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:07:31.101 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T11:07:31.130 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T11:07:31.201 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:07:31.201 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T11:07:31.227 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T11:07:31.294 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T11:07:31.294 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:07:31.294 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T11:07:31.321 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T11:07:31.388 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:07:31.388 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T11:07:31.414 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T11:07:31.481 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T11:07:31.481 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:07:31.481 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T11:07:31.507 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T11:07:31.573 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:07:31.574 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T11:07:31.599 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T11:07:31.665 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T11:07:31.735 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T11:07:31.735 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 777 /var/log/ceph 2023-11-28T11:07:31.738 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2023-11-28T11:07:31.764 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T11:07:31.765 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T11:07:31.805 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T11:07:31.830 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T11:07:31.831 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T11:07:31.870 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T11:07:31.902 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T11:07:31.903 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T11:07:31.903 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T11:07:31.903 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:07:31.903 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T11:07:31.951 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T11:07:32.099 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-28T11:07:32.125 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:07:32.126 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T11:07:32.144 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T11:07:32.351 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-28T11:07:32.384 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T11:07:32.384 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T11:07:32.384 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954', 'branch': 'wip-neesingh-testing-231123', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7469954', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-231123'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'issue_54557', 'sha1': 'e67b67438c1e5e13734a7203ff9e57e30b8e4d32'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 10, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9437, 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'issue_54557', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_e67b67438c1e5e13734a7203ff9e57e30b8e4d32/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': 'e67b67438c1e5e13734a7203ff9e57e30b8e4d32', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi125.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_10:48:03', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T11:07:32.385 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T11:07:32.388 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T11:07:32.435 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T11:07:32.444 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T11:07:32.503 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:07:32.503 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T11:07:32.525 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T11:07:32.525 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_1 2023-11-28T11:07:32.583 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T11:07:32.583 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:07:32.583 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 387651 Links: 1 2023-11-28T11:07:32.583 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:07:32.583 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T11:07:32.584 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-11-28 11:07:16.604899798 +0000 2023-11-28T11:07:32.584 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-11-28 11:03:59.206477866 +0000 2023-11-28T11:07:32.584 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-11-28 11:03:59.206477866 +0000 2023-11-28T11:07:32.584 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-11-28T11:07:32.585 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T11:07:32.648 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-11-28T11:07:32.648 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-11-28T11:07:32.648 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000221756 s, 2.3 MB/s 2023-11-28T11:07:32.649 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T11:07:32.706 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_2 2023-11-28T11:07:32.764 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T11:07:32.764 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:07:32.764 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 392564 Links: 1 2023-11-28T11:07:32.764 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:07:32.764 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T11:07:32.764 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-11-28 11:07:16.604899798 +0000 2023-11-28T11:07:32.764 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-11-28 11:03:59.736468360 +0000 2023-11-28T11:07:32.765 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-11-28 11:03:59.736468360 +0000 2023-11-28T11:07:32.765 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-11-28T11:07:32.765 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T11:07:32.828 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-11-28T11:07:32.828 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-11-28T11:07:32.829 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000213105 s, 2.4 MB/s 2023-11-28T11:07:32.830 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T11:07:32.887 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_3 2023-11-28T11:07:32.944 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T11:07:32.945 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:07:32.945 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 391623 Links: 1 2023-11-28T11:07:32.945 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:07:32.945 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T11:07:32.946 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-11-28 11:07:16.604899798 +0000 2023-11-28T11:07:32.946 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-11-28 11:04:00.322457850 +0000 2023-11-28T11:07:32.946 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-11-28 11:04:00.322457850 +0000 2023-11-28T11:07:32.947 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-11-28T11:07:32.947 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T11:07:33.009 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-11-28T11:07:33.009 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-11-28T11:07:33.009 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000194792 s, 2.6 MB/s 2023-11-28T11:07:33.010 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T11:07:33.068 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_4 2023-11-28T11:07:33.125 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T11:07:33.125 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:07:33.125 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 389479 Links: 1 2023-11-28T11:07:33.125 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:07:33.125 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T11:07:33.125 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-11-28 11:07:16.605899780 +0000 2023-11-28T11:07:33.125 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-11-28 11:04:00.872447985 +0000 2023-11-28T11:07:33.125 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-11-28 11:04:00.872447985 +0000 2023-11-28T11:07:33.125 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-11-28T11:07:33.126 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T11:07:33.190 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-11-28T11:07:33.190 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-11-28T11:07:33.190 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000208645 s, 2.5 MB/s 2023-11-28T11:07:33.191 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T11:07:33.249 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:07:33.249 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:07:33.249 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T11:07:33.267 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T11:07:33.268 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2023-11-28T11:07:33.326 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T11:07:33.326 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:07:33.326 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 386973 Links: 1 2023-11-28T11:07:33.326 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:07:33.327 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T11:07:33.327 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-28 11:07:24.328162591 +0000 2023-11-28T11:07:33.327 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-28 11:04:33.242758473 +0000 2023-11-28T11:07:33.327 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-28 11:04:33.242758473 +0000 2023-11-28T11:07:33.327 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2023-11-28T11:07:33.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T11:07:33.393 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-28T11:07:33.393 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-28T11:07:33.393 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000279211 s, 1.8 MB/s 2023-11-28T11:07:33.394 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T11:07:33.452 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2023-11-28T11:07:33.510 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T11:07:33.510 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:07:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 387021 Links: 1 2023-11-28T11:07:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:07:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T11:07:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-28 11:07:24.328162591 +0000 2023-11-28T11:07:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-28 11:04:33.756749519 +0000 2023-11-28T11:07:33.511 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-28 11:04:33.756749519 +0000 2023-11-28T11:07:33.511 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2023-11-28T11:07:33.511 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T11:07:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-28T11:07:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-28T11:07:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000274787 s, 1.9 MB/s 2023-11-28T11:07:33.578 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T11:07:33.636 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2023-11-28T11:07:33.694 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T11:07:33.694 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:07:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 394253 Links: 1 2023-11-28T11:07:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:07:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T11:07:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-28 11:07:24.328162591 +0000 2023-11-28T11:07:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-28 11:04:34.288740251 +0000 2023-11-28T11:07:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-28 11:04:34.288740251 +0000 2023-11-28T11:07:33.694 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2023-11-28T11:07:33.695 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T11:07:33.759 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-28T11:07:33.759 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-28T11:07:33.759 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000216329 s, 2.4 MB/s 2023-11-28T11:07:33.760 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T11:07:33.818 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2023-11-28T11:07:33.875 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T11:07:33.875 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:07:33.875 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 391652 Links: 1 2023-11-28T11:07:33.875 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:07:33.875 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T11:07:33.876 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-28 11:07:24.328162591 +0000 2023-11-28T11:07:33.876 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-28 11:04:34.825730896 +0000 2023-11-28T11:07:33.876 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-28 11:04:34.825730896 +0000 2023-11-28T11:07:33.876 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2023-11-28T11:07:33.876 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T11:07:33.942 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-28T11:07:33.942 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-28T11:07:33.942 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000193199 s, 2.7 MB/s 2023-11-28T11:07:33.943 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T11:07:34.000 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:07:34.000 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T11:07:34.001 INFO:tasks.ceph:Generating config... 2023-11-28T11:07:34.002 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T11:07:34.002 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T11:07:34.002 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T11:07:34.002 INFO:tasks.ceph:[client] pid file = 2023-11-28T11:07:34.002 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T11:07:34.003 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T11:07:34.003 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T11:07:34.003 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T11:07:34.003 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T11:07:34.003 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T11:07:34.003 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T11:07:34.003 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T11:07:34.003 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T11:07:34.004 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T11:07:34.004 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T11:07:34.004 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T11:07:34.004 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T11:07:34.004 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T11:07:34.004 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T11:07:34.005 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T11:07:34.005 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T11:07:34.005 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T11:07:34.005 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-28T11:07:34.005 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-28T11:07:34.005 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-28T11:07:34.005 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T11:07:34.006 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T11:07:34.006 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-28T11:07:34.006 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-28T11:07:34.006 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T11:07:34.006 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T11:07:34.006 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-28T11:07:34.007 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T11:07:34.007 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T11:07:34.007 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T11:07:34.007 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T11:07:34.007 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T11:07:34.007 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T11:07:34.008 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T11:07:34.008 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T11:07:34.066 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T11:07:34.069 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T11:07:34.118 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T11:07:34.146 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.125'), ('mon.b', '172.21.15.167'), ('mon.c', '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]')] 2023-11-28T11:07:34.147 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.125,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T11:07:34.147 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:07:34.148 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T11:07:34.204 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.125 --add b 172.21.15.167 --addv c '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:07:34.292 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:07:34.293 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: generated fsid 1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea 2023-11-28T11:07:34.293 INFO:teuthology.orchestra.run.smithi125.stdout:setting min_mon_release = pacific 2023-11-28T11:07:34.293 INFO:teuthology.orchestra.run.smithi125.stdout:epoch 0 2023-11-28T11:07:34.293 INFO:teuthology.orchestra.run.smithi125.stdout:fsid 1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea 2023-11-28T11:07:34.293 INFO:teuthology.orchestra.run.smithi125.stdout:last_changed 2023-11-28T11:07:34.292752+0000 2023-11-28T11:07:34.293 INFO:teuthology.orchestra.run.smithi125.stdout:created 2023-11-28T11:07:34.292752+0000 2023-11-28T11:07:34.293 INFO:teuthology.orchestra.run.smithi125.stdout:min_mon_release 16 (pacific) 2023-11-28T11:07:34.293 INFO:teuthology.orchestra.run.smithi125.stdout:election_strategy: 1 2023-11-28T11:07:34.293 INFO:teuthology.orchestra.run.smithi125.stdout:0: [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] mon.a 2023-11-28T11:07:34.294 INFO:teuthology.orchestra.run.smithi125.stdout:1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2023-11-28T11:07:34.294 INFO:teuthology.orchestra.run.smithi125.stdout:2: [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] mon.c 2023-11-28T11:07:34.295 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T11:07:34.296 DEBUG:teuthology.orchestra.run.smithi125:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T11:07:34.314 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea... 2023-11-28T11:07:34.315 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T11:07:34.356 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T11:07:34.398 INFO:teuthology.orchestra.run.smithi125.stdout:[global] 2023-11-28T11:07:34.399 INFO:teuthology.orchestra.run.smithi125.stdout: chdir = "" 2023-11-28T11:07:34.399 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T11:07:34.399 INFO:teuthology.orchestra.run.smithi125.stdout: auth supported = cephx 2023-11-28T11:07:34.399 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.399 INFO:teuthology.orchestra.run.smithi125.stdout: filestore xattr use omap = true 2023-11-28T11:07:34.399 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.399 INFO:teuthology.orchestra.run.smithi125.stdout: mon clock drift allowed = 1.000 2023-11-28T11:07:34.399 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.399 INFO:teuthology.orchestra.run.smithi125.stdout: osd crush chooseleaf type = 0 2023-11-28T11:07:34.399 INFO:teuthology.orchestra.run.smithi125.stdout: auth debug = true 2023-11-28T11:07:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on old message = true 2023-11-28T11:07:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on bug = true 2023-11-28T11:07:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T11:07:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: mon pg warn max object skew = 0 2023-11-28T11:07:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T11:07:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T11:07:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.400 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default size = 2 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow primary affinity = true 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow pg remap = true 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on legacy crush tunables = false 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on crush straw calc version zero = false 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on no sortbitwise = false 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on osd down out interval zero = false 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on too few osds = false 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: mon_allow_pool_size_one = true 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.401 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T11:07:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: osd default data pool replay window = 5 2023-11-28T11:07:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: mon allow pool delete = true 2023-11-28T11:07:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: mon cluster log file level = debug 2023-11-28T11:07:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: debug asserts on shutdown = true 2023-11-28T11:07:34.402 INFO:teuthology.orchestra.run.smithi125.stdout: mon health detail to clog = false 2023-11-28T11:07:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: mon host = "172.21.15.125,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2023-11-28T11:07:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: fsid = 1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea 2023-11-28T11:07:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.403 INFO:teuthology.orchestra.run.smithi125.stdout:[osd] 2023-11-28T11:07:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: osd journal size = 100 2023-11-28T11:07:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub load threshold = 5.0 2023-11-28T11:07:34.403 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub max interval = 600 2023-11-28T11:07:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: osd recover clone overlap = true 2023-11-28T11:07:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: osd recovery max chunk = 1048576 2023-11-28T11:07:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug shutdown = true 2023-11-28T11:07:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug op order = true 2023-11-28T11:07:34.404 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug verify stray on activate = true 2023-11-28T11:07:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: osd open classes on start = true 2023-11-28T11:07:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug pg log writeout = true 2023-11-28T11:07:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: osd deep scrub update digest min age = 30 2023-11-28T11:07:34.405 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.406 INFO:teuthology.orchestra.run.smithi125.stdout: osd map max advance = 10 2023-11-28T11:07:34.406 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.406 INFO:teuthology.orchestra.run.smithi125.stdout: journal zero on create = true 2023-11-28T11:07:34.406 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.406 INFO:teuthology.orchestra.run.smithi125.stdout: filestore ondisk finisher threads = 3 2023-11-28T11:07:34.406 INFO:teuthology.orchestra.run.smithi125.stdout: filestore apply finisher threads = 3 2023-11-28T11:07:34.407 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.407 INFO:teuthology.orchestra.run.smithi125.stdout: bdev debug aio = true 2023-11-28T11:07:34.408 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug misdirected ops = true 2023-11-28T11:07:34.408 INFO:teuthology.orchestra.run.smithi125.stdout: bdev async discard = True 2023-11-28T11:07:34.408 INFO:teuthology.orchestra.run.smithi125.stdout: bdev enable discard = True 2023-11-28T11:07:34.408 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore allocator = bitmap 2023-11-28T11:07:34.408 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore block size = 96636764160 2023-11-28T11:07:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore fsck on mount = True 2023-11-28T11:07:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluefs = 1/20 2023-11-28T11:07:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluestore = 1/20 2023-11-28T11:07:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-28T11:07:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: debug osd = 20 2023-11-28T11:07:34.409 INFO:teuthology.orchestra.run.smithi125.stdout: debug rocksdb = 4/10 2023-11-28T11:07:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T11:07:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd full ratio = 0.9 2023-11-28T11:07:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd nearfull ratio = 0.8 2023-11-28T11:07:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: osd failsafe full ratio = 0.95 2023-11-28T11:07:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: osd objectstore = bluestore 2023-11-28T11:07:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-11-28T11:07:34.410 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.411 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr] 2023-11-28T11:07:34.411 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-28T11:07:34.411 INFO:teuthology.orchestra.run.smithi125.stdout: debug mgr = 20 2023-11-28T11:07:34.411 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-11-28T11:07:34.411 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-11-28T11:07:34.411 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:07:34.412 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:07:34.412 INFO:teuthology.orchestra.run.smithi125.stdout: mgr/telemetry/nag = false 2023-11-28T11:07:34.412 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.412 INFO:teuthology.orchestra.run.smithi125.stdout:[mon] 2023-11-28T11:07:34.412 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-28T11:07:34.412 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-11-28T11:07:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: debug paxos = 20 2023-11-28T11:07:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-11-28T11:07:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: mon data avail warn = 5 2023-11-28T11:07:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: mon mgr mkfs grace = 240 2023-11-28T11:07:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:07:34.413 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd reporter subtree level = osd 2023-11-28T11:07:34.414 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd prime pg temp = true 2023-11-28T11:07:34.414 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:07:34.414 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.414 INFO:teuthology.orchestra.run.smithi125.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T11:07:34.414 INFO:teuthology.orchestra.run.smithi125.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T11:07:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T11:07:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T11:07:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T11:07:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T11:07:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: # 1m isn't quite enough 2023-11-28T11:07:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: mon_down_mkfs_grace = 2m 2023-11-28T11:07:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_filestore_osds = false 2023-11-28T11:07:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: mon op complaint time = 120 2023-11-28T11:07:34.416 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:07:34.417 INFO:teuthology.orchestra.run.smithi125.stdout:[client] 2023-11-28T11:07:34.417 INFO:teuthology.orchestra.run.smithi125.stdout: rgw cache enabled = true 2023-11-28T11:07:34.417 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable ops log = true 2023-11-28T11:07:34.417 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable usage log = true 2023-11-28T11:07:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T11:07:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T11:07:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: client mount timeout = 600 2023-11-28T11:07:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: debug client = 20 2023-11-28T11:07:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-28T11:07:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = "" 2023-11-28T11:07:34.418 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.a] 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.b] 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.c] 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.c] 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.d] 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout:[mds] 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds = 20 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds balancer = 20 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-28T11:07:34.419 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug frag = True 2023-11-28T11:07:34.420 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug scatterstat = True 2023-11-28T11:07:34.420 INFO:teuthology.orchestra.run.smithi125.stdout: mds op complaint time = 180 2023-11-28T11:07:34.420 INFO:teuthology.orchestra.run.smithi125.stdout: mds verify scatter = True 2023-11-28T11:07:34.420 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-11-28T11:07:34.420 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-11-28T11:07:34.420 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-11-28T11:07:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2023-11-28T11:07:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2023-11-28T11:07:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T11:07:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2023-11-28T11:07:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2023-11-28T11:07:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2023-11-28T11:07:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2023-11-28T11:07:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2023-11-28T11:07:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.125,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = 1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2023-11-28T11:07:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2023-11-28T11:07:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2023-11-28T11:07:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2023-11-28T11:07:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2023-11-28T11:07:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2023-11-28T11:07:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2023-11-28T11:07:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2023-11-28T11:07:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2023-11-28T11:07:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2023-11-28T11:07:34.427 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.428 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2023-11-28T11:07:34.428 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2023-11-28T11:07:34.428 INFO:teuthology.orchestra.run.smithi167.stdout: bdev async discard = True 2023-11-28T11:07:34.428 INFO:teuthology.orchestra.run.smithi167.stdout: bdev enable discard = True 2023-11-28T11:07:34.428 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore allocator = bitmap 2023-11-28T11:07:34.428 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2023-11-28T11:07:34.428 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 1/20 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 1/20 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 4/10 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2023-11-28T11:07:34.429 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-28T11:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-11-28T11:07:34.431 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2023-11-28T11:07:34.431 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-11-28T11:07:34.431 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2023-11-28T11:07:34.431 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2023-11-28T11:07:34.431 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:07:34.431 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2023-11-28T11:07:34.431 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2023-11-28T11:07:34.431 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:07:34.431 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.431 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T11:07:34.431 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2023-11-28T11:07:34.432 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2023-11-28T11:07:34.433 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2023-11-28T11:07:34.434 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2023-11-28T11:07:34.435 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2023-11-28T11:07:34.435 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2023-11-28T11:07:34.435 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2023-11-28T11:07:34.435 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2023-11-28T11:07:34.435 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T11:07:34.435 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T11:07:34.518 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T11:07:34.518 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:07:34.519 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T11:07:34.536 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:07:34.536 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T11:07:34.593 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:07:34.594 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:07:34.594 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T11:07:34.594 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T11:07:34.670 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:07:34.670 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:07:34.728 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:07:34.728 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:07:34.728 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T11:07:34.728 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T11:07:34.766 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:07:34.766 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:07:34.823 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T11:07:34.823 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T11:07:34.823 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T11:07:34.876 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T11:07:34.879 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T11:07:34.943 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T11:07:34.946 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T11:07:34.946 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T11:07:35.000 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T11:07:35.002 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T11:07:35.028 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T11:07:35.121 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T11:07:35.123 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T11:07:35.152 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T11:07:35.206 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T11:07:35.208 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T11:07:35.235 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T11:07:35.327 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T11:07:35.330 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T11:07:35.356 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T11:07:35.357 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T11:07:35.402 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T11:07:35.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-28T11:07:35.458 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-28T11:07:35.471 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-28T11:07:35.514 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-28T11:07:35.527 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-28T11:07:35.611 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-28T11:07:35.624 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T11:07:35.624 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T11:07:35.624 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T11:07:35.651 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:07:35.651 INFO:tasks.ceph:role: osd.0 2023-11-28T11:07:35.652 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:07:35.652 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T11:07:35.725 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:07:35.725 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:07:35.725 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:07:35.726 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T11:07:35.726 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:07:35.726 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:07:35.727 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:07:35.727 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:07:35.727 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:07:35.727 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:07:36.159 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-11-28T11:07:36.161 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-11-28T11:07:36.161 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T11:07:36.317 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T11:07:36.354 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T11:07:36.423 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:07:36.423 INFO:tasks.ceph:role: osd.1 2023-11-28T11:07:36.423 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:07:36.424 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T11:07:36.498 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:07:36.498 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:07:36.498 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:07:36.498 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T11:07:36.498 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:07:36.498 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:07:36.499 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:07:36.499 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:07:36.499 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:07:36.499 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:07:36.928 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-11-28T11:07:36.930 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-11-28T11:07:36.930 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T11:07:37.045 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T11:07:37.082 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T11:07:37.155 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:07:37.155 INFO:tasks.ceph:role: osd.2 2023-11-28T11:07:37.155 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:07:37.155 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T11:07:37.234 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:07:37.235 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:07:37.235 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:07:37.235 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T11:07:37.235 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:07:37.235 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:07:37.235 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:07:37.235 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:07:37.235 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:07:37.235 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:07:37.678 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-11-28T11:07:37.680 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-11-28T11:07:37.680 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T11:07:37.834 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T11:07:37.874 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T11:07:37.945 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:07:37.945 INFO:tasks.ceph:role: osd.3 2023-11-28T11:07:37.945 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:07:37.945 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T11:07:38.022 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:07:38.022 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:07:38.022 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:07:38.022 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T11:07:38.022 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:07:38.023 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:07:38.023 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:07:38.023 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:07:38.023 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:07:38.023 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:07:38.468 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-11-28T11:07:38.470 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-11-28T11:07:38.470 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T11:07:38.636 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T11:07:38.675 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:07:38.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:38.795+0000 7f1663d7a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T11:07:38.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:38.795+0000 7f1663d7a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T11:07:38.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:38.795+0000 7f1663d7a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T11:07:38.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:38.795+0000 7f1663d7a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T11:07:38.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:38.795+0000 7f1663d7a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T11:07:38.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:38.796+0000 7f1663d7a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T11:07:41.664 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T11:07:41.698 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:07:41.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:41.792+0000 7f3f3d45e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T11:07:41.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:41.792+0000 7f3f3d45e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T11:07:41.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:41.792+0000 7f3f3d45e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T11:07:41.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:41.792+0000 7f3f3d45e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T11:07:41.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:41.792+0000 7f3f3d45e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T11:07:41.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:41.793+0000 7f3f3d45e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T11:07:44.658 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T11:07:44.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:07:44.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:44.783+0000 7fddd6ab5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T11:07:44.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:44.783+0000 7fddd6ab5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T11:07:44.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:44.783+0000 7fddd6ab5640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T11:07:44.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:44.783+0000 7fddd6ab5640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T11:07:44.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:44.783+0000 7fddd6ab5640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T11:07:44.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:44.783+0000 7fddd6ab5640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T11:07:47.650 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T11:07:47.683 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:07:47.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:47.779+0000 7f6ec20e0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T11:07:47.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:47.779+0000 7f6ec20e0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T11:07:47.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:47.779+0000 7f6ec20e0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T11:07:47.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:47.779+0000 7f6ec20e0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T11:07:47.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:47.779+0000 7f6ec20e0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T11:07:47.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:07:47.780+0000 7f6ec20e0640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T11:07:50.657 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T11:07:50.689 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T11:07:50.722 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:07:50.722 INFO:tasks.ceph:role: osd.4 2023-11-28T11:07:50.722 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:07:50.722 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T11:07:50.801 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:07:50.801 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:07:50.801 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:07:50.801 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T11:07:50.801 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:07:50.801 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:07:50.801 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:07:50.802 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:07:50.802 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:07:50.802 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:07:51.238 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-28T11:07:51.239 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-28T11:07:51.240 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T11:07:51.412 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T11:07:51.450 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T11:07:51.518 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:07:51.519 INFO:tasks.ceph:role: osd.5 2023-11-28T11:07:51.519 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:07:51.519 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T11:07:51.595 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:07:51.595 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:07:51.595 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:07:51.595 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T11:07:51.595 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:07:51.595 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:07:51.595 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:07:51.595 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:07:51.595 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:07:51.595 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:07:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-28T11:07:52.022 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-28T11:07:52.023 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T11:07:52.209 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T11:07:52.244 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T11:07:52.315 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:07:52.315 INFO:tasks.ceph:role: osd.6 2023-11-28T11:07:52.315 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:07:52.315 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T11:07:52.392 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:07:52.392 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:07:52.393 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:07:52.393 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T11:07:52.393 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:07:52.393 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:07:52.394 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:07:52.394 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:07:52.394 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:07:52.394 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:07:52.838 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-28T11:07:52.840 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-28T11:07:52.841 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T11:07:53.031 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T11:07:53.071 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T11:07:53.142 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:07:53.142 INFO:tasks.ceph:role: osd.7 2023-11-28T11:07:53.142 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:07:53.142 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T11:07:53.218 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:07:53.219 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:07:53.219 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:07:53.219 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T11:07:53.219 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:07:53.219 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:07:53.219 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:07:53.219 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:07:53.219 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:07:53.219 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:07:53.654 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-28T11:07:53.656 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-28T11:07:53.656 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T11:07:53.783 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T11:07:53.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:07:53.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:53.925+0000 7f4a35f4f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T11:07:53.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:53.925+0000 7f4a35f4f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T11:07:53.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:53.925+0000 7f4a35f4f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T11:07:53.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:53.925+0000 7f4a35f4f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T11:07:53.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:53.925+0000 7f4a35f4f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T11:07:53.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:53.925+0000 7f4a35f4f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T11:07:56.811 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T11:07:56.842 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:07:56.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:56.933+0000 7f6f60473640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T11:07:56.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:56.934+0000 7f6f60473640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T11:07:56.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:56.934+0000 7f6f60473640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T11:07:56.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:56.934+0000 7f6f60473640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T11:07:56.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:56.934+0000 7f6f60473640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T11:07:56.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:56.934+0000 7f6f60473640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T11:07:59.802 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T11:07:59.833 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:07:59.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:59.924+0000 7f04cc868640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T11:07:59.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:59.924+0000 7f04cc868640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T11:07:59.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:59.924+0000 7f04cc868640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T11:07:59.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:59.924+0000 7f04cc868640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T11:07:59.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:59.924+0000 7f04cc868640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T11:07:59.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:07:59.925+0000 7f04cc868640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T11:08:02.386 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:08:02.389 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:08:02.791 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T11:08:02.823 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:08:02.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:02.914+0000 7f0adfc8d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T11:08:02.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:02.915+0000 7f0adfc8d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T11:08:02.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:02.915+0000 7f0adfc8d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T11:08:02.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:02.915+0000 7f0adfc8d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T11:08:02.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:02.915+0000 7f0adfc8d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T11:08:02.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:02.915+0000 7f0adfc8d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T11:08:05.782 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T11:08:08.957 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T11:08:08.992 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:08.992 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T11:08:09.025 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:09.026 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T11:08:09.097 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:09.098 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T11:08:09.170 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:09.170 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T11:08:09.242 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:09.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T11:08:09.314 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:09.314 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T11:08:09.386 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:09.386 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T11:08:09.459 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:09.459 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T11:08:09.491 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:09.491 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T11:08:09.560 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:09.560 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T11:08:09.628 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:09.628 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T11:08:09.696 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:09.697 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T11:08:09.764 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:09.764 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T11:08:09.830 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:09.831 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T11:08:09.897 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:09.897 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T11:08:09.918 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:09.918 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-28T11:08:09.978 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:09.978 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-28T11:08:09.995 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:09.995 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-28T11:08:10.052 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T11:08:10.052 DEBUG:teuthology.orchestra.run.smithi125:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T11:08:10.055 DEBUG:teuthology.orchestra.run.smithi167:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T11:08:10.095 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr.y] 2023-11-28T11:08:10.095 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD2yWVldPhFNBAA/wTA2fq+CmRAx3pWX82SkA== 2023-11-28T11:08:10.095 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2023-11-28T11:08:10.095 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD3yWVlKEkAABAAXjMnHGmTU8Gdre/P6kooJw== 2023-11-28T11:08:10.095 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.c] 2023-11-28T11:08:10.095 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD3yWVltF09BxAAjhpf029IQe6awVbeYEV8qQ== 2023-11-28T11:08:10.095 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.0] 2023-11-28T11:08:10.095 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD6yWVlZHGALxAAwg7519g4L+22B6q8avNECw== 2023-11-28T11:08:10.096 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.1] 2023-11-28T11:08:10.096 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD9yWVlxElTLxAAWU/HwnR+qTecCapxOKTCBQ== 2023-11-28T11:08:10.096 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.2] 2023-11-28T11:08:10.096 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAAymVllpzBLhAA1iR/VKxQoh+ekp0oO6Ku2g== 2023-11-28T11:08:10.096 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.3] 2023-11-28T11:08:10.096 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQADymVl9jx+LhAAG+PnOiHMTWVr0p98muHA1Q== 2023-11-28T11:08:10.096 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr.x] 2023-11-28T11:08:10.096 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD2yWVlf7E9OBAAT4ET3xArqHRvXN3Y+fN/hQ== 2023-11-28T11:08:10.097 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2023-11-28T11:08:10.097 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD3yWVlxhVJDBAAxVivRKj7W5EO227bsIQ1dA== 2023-11-28T11:08:10.097 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.d] 2023-11-28T11:08:10.097 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD3yWVl3cCKExAAWAOqQnPUf3vKABnsfyJTKQ== 2023-11-28T11:08:10.097 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.4] 2023-11-28T11:08:10.097 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAJymVlCGY+NxAAO5zScvdHMyOEFJcLjlY6qQ== 2023-11-28T11:08:10.097 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.5] 2023-11-28T11:08:10.097 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAMymVlkPG0NxAAL9zxg4JfD/Gm7bVEY8aEzA== 2023-11-28T11:08:10.097 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.6] 2023-11-28T11:08:10.098 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAPymVlh0cjNxAACCUdBgzqGw/yMw7P5RKBlQ== 2023-11-28T11:08:10.098 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.7] 2023-11-28T11:08:10.098 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQASymVltqqRNhAACw31V5Uw92UYbsoOFAt4NA== 2023-11-28T11:08:10.098 INFO:teuthology.orchestra.run.smithi125.stdout:[client.0] 2023-11-28T11:08:10.098 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD3yWVlAiP9FxAAuKva+izyr8tPFad19nH2Pg== 2023-11-28T11:08:10.098 INFO:teuthology.orchestra.run.smithi125.stdout:[client.2] 2023-11-28T11:08:10.098 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD3yWVlzC5aGxAA+1p7VO2KIABIvIQUxsEpkw== 2023-11-28T11:08:10.098 INFO:teuthology.orchestra.run.smithi125.stdout:[client.1] 2023-11-28T11:08:10.099 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD3yWVlcuuuHhAAxxFaW2Ya8S/0QqSKt6+irw== 2023-11-28T11:08:10.099 INFO:teuthology.orchestra.run.smithi125.stdout:[client.3] 2023-11-28T11:08:10.099 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQD3yWVl0A9rJBAAbjYfiY1Ya0jOeM20lriemg== 2023-11-28T11:08:10.116 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.y] 2023-11-28T11:08:10.116 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD2yWVldPhFNBAA/wTA2fq+CmRAx3pWX82SkA== 2023-11-28T11:08:10.117 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2023-11-28T11:08:10.117 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD3yWVlKEkAABAAXjMnHGmTU8Gdre/P6kooJw== 2023-11-28T11:08:10.117 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2023-11-28T11:08:10.117 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD3yWVltF09BxAAjhpf029IQe6awVbeYEV8qQ== 2023-11-28T11:08:10.117 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.0] 2023-11-28T11:08:10.117 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD6yWVlZHGALxAAwg7519g4L+22B6q8avNECw== 2023-11-28T11:08:10.117 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.1] 2023-11-28T11:08:10.117 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD9yWVlxElTLxAAWU/HwnR+qTecCapxOKTCBQ== 2023-11-28T11:08:10.117 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.2] 2023-11-28T11:08:10.117 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQAAymVllpzBLhAA1iR/VKxQoh+ekp0oO6Ku2g== 2023-11-28T11:08:10.117 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.3] 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQADymVl9jx+LhAAG+PnOiHMTWVr0p98muHA1Q== 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.x] 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD2yWVlf7E9OBAAT4ET3xArqHRvXN3Y+fN/hQ== 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD3yWVlxhVJDBAAxVivRKj7W5EO227bsIQ1dA== 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD3yWVl3cCKExAAWAOqQnPUf3vKABnsfyJTKQ== 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.4] 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQAJymVlCGY+NxAAO5zScvdHMyOEFJcLjlY6qQ== 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.5] 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQAMymVlkPG0NxAAL9zxg4JfD/Gm7bVEY8aEzA== 2023-11-28T11:08:10.118 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.6] 2023-11-28T11:08:10.119 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQAPymVlh0cjNxAACCUdBgzqGw/yMw7P5RKBlQ== 2023-11-28T11:08:10.119 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.7] 2023-11-28T11:08:10.119 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQASymVltqqRNhAACw31V5Uw92UYbsoOFAt4NA== 2023-11-28T11:08:10.119 INFO:teuthology.orchestra.run.smithi167.stdout:[client.0] 2023-11-28T11:08:10.119 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD3yWVlAiP9FxAAuKva+izyr8tPFad19nH2Pg== 2023-11-28T11:08:10.119 INFO:teuthology.orchestra.run.smithi167.stdout:[client.2] 2023-11-28T11:08:10.119 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD3yWVlzC5aGxAA+1p7VO2KIABIvIQUxsEpkw== 2023-11-28T11:08:10.119 INFO:teuthology.orchestra.run.smithi167.stdout:[client.1] 2023-11-28T11:08:10.119 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD3yWVlcuuuHhAAxxFaW2Ya8S/0QqSKt6+irw== 2023-11-28T11:08:10.119 INFO:teuthology.orchestra.run.smithi167.stdout:[client.3] 2023-11-28T11:08:10.119 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD3yWVl0A9rJBAAbjYfiY1Ya0jOeM20lriemg== 2023-11-28T11:08:10.120 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:08:10.143 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:08:10.214 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:08:10.216 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:08:10.280 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:08:10.283 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:08:10.346 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.348 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.402 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.405 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.457 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.513 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.515 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.568 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:08:10.570 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:08:10.623 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:08:10.625 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:08:10.681 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:08:10.684 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:08:10.740 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.795 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.798 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.850 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.852 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.905 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.908 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:08:10.960 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:08:10.963 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:08:11.019 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:08:11.021 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:08:11.077 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:08:11.079 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:08:11.135 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:08:11.137 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:08:11.192 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T11:08:11.193 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T11:08:11.219 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T11:08:11.317 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T11:08:11.357 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T11:08:11.389 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T11:08:11.494 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T11:08:11.526 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T11:08:11.598 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T11:08:11.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T11:08:11.728 DEBUG:teuthology.orchestra.run.smithi125:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:08:11.734 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:08:11.787 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T11:08:11.788 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T11:08:11.788 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T11:08:11.791 INFO:tasks.ceph.mon.a:Started 2023-11-28T11:08:11.791 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T11:08:11.791 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T11:08:11.830 INFO:tasks.ceph.mon.b:Started 2023-11-28T11:08:11.830 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T11:08:11.831 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T11:08:11.833 INFO:tasks.ceph.mon.c:Started 2023-11-28T11:08:11.833 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T11:08:11.833 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T11:08:11.833 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T11:08:11.839 INFO:tasks.ceph.mgr.y:Started 2023-11-28T11:08:11.839 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T11:08:11.839 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T11:08:11.841 INFO:tasks.ceph.mgr.x:Started 2023-11-28T11:08:11.841 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T11:08:11.842 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T11:08:11.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.962+0000 7f8cb5db5700 1 Processor -- start 2023-11-28T11:08:11.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.962+0000 7f8cb5db5700 1 -- start start 2023-11-28T11:08:11.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.963+0000 7f8cb5db5700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8cb015a5f0 0x7f8cb00d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:11.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.963+0000 7f8cb5db5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8cb00cc200 0x7f8cb00b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:11.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.963+0000 7f8cb5db5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb015a9c0 con 0x7f8cb00b2d10 2023-11-28T11:08:11.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.963+0000 7f8cb5db5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb00b3190 con 0x7f8cb00cc200 2023-11-28T11:08:11.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.963+0000 7f8cb5db5700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb00c7b80 con 0x7f8cb015a5f0 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.963+0000 7f8caeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8cb00cc200 0x7f8cb00b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.963+0000 7f8caeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8cb00cc200 0x7f8cb00b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56002/0 (socket says 172.21.15.125:56002) 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.963+0000 7f8caeffd700 1 -- 172.21.15.125:0/665006241 learned_addr learned my addr 172.21.15.125:0/665006241 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.963+0000 7f8caf7fe700 1 --2- 172.21.15.125:0/665006241 >> v2:172.21.15.167:3300/0 conn(0x7f8cb015a5f0 0x7f8cb00d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.964+0000 7f8caeffd700 1 -- 172.21.15.125:0/665006241 >> v2:172.21.15.125:3300/0 conn(0x7f8cb00cc200 msgr2=0x7f8cb00b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.964+0000 7f8caeffd700 1 -- 172.21.15.125:0/665006241 >> v2:172.21.15.125:3300/0 conn(0x7f8cb00cc200 msgr2=0x7f8cb00b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.964+0000 7f8caeffd700 1 --2- 172.21.15.125:0/665006241 >> v2:172.21.15.125:3300/0 conn(0x7f8cb00cc200 0x7f8cb00b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.964+0000 7f8caeffd700 1 --2- 172.21.15.125:0/665006241 >> v2:172.21.15.125:3300/0 conn(0x7f8cb00cc200 0x7f8cb00b27d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.964+0000 7f8caf7fe700 1 -- 172.21.15.125:0/665006241 >> v2:172.21.15.167:3300/0 conn(0x7f8cb015a5f0 msgr2=0x7f8cb00d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.964+0000 7f8caf7fe700 1 -- 172.21.15.125:0/665006241 >> v2:172.21.15.167:3300/0 conn(0x7f8cb015a5f0 msgr2=0x7f8cb00d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.964+0000 7f8caf7fe700 1 --2- 172.21.15.125:0/665006241 >> v2:172.21.15.167:3300/0 conn(0x7f8cb015a5f0 0x7f8cb00d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:08:11.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:11.964+0000 7f8caf7fe700 1 --2- 172.21.15.125:0/665006241 >> v2:172.21.15.167:3300/0 conn(0x7f8cb015a5f0 0x7f8cb00d0ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:08:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.159+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059610850 0 0) 0x7f8cb015a9c0 con 0x7f8cb00b2d10 2023-11-28T11:08:12.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.159+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c9c0035b0 con 0x7f8cb00b2d10 2023-11-28T11:08:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2023963199 0 0) 0x7f8c9c0035b0 con 0x7f8cb00b2d10 2023-11-28T11:08:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 >> v2:172.21.15.167:3300/0 conn(0x7f8cb015a5f0 msgr2=0x7f8cb00d0ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:08:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 --2- 172.21.15.125:0/665006241 >> v2:172.21.15.167:3300/0 conn(0x7f8cb015a5f0 0x7f8cb00d0ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 >> v2:172.21.15.125:3300/0 conn(0x7f8cb00cc200 msgr2=0x7f8cb00b27d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:08:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 --2- 172.21.15.125:0/665006241 >> v2:172.21.15.125:3300/0 conn(0x7f8cb00cc200 0x7f8cb00b27d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb00cc990 con 0x7f8cb00b2d10 2023-11-28T11:08:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f8ca80019f0 con 0x7f8cb00b2d10 2023-11-28T11:08:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 >> v1:172.21.15.125:6789/0 conn(0x7f8cb00b2d10 legacy=0x7f8cb015e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:12.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 --2- 172.21.15.125:0/665006241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c003a00 0x7f8c9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:12.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 --2- 172.21.15.125:0/665006241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9c004850 0x7f8c9c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:12.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 --2- 172.21.15.125:0/665006241 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c9c005200 0x7f8c9c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:12.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00b3190 con 0x7f8c9c005200 2023-11-28T11:08:12.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00c7b80 con 0x7f8c9c004850 2023-11-28T11:08:12.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.160+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c00c0e0 con 0x7f8c9c003a00 2023-11-28T11:08:12.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8caffff700 1 --2- 172.21.15.125:0/665006241 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c9c005200 0x7f8c9c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:12.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8caf7fe700 1 --2- 172.21.15.125:0/665006241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c003a00 0x7f8c9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:12.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8caeffd700 1 --2- 172.21.15.125:0/665006241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9c004850 0x7f8c9c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:12.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8caffff700 1 -- 172.21.15.125:0/665006241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c003a00 msgr2=0x7f8c9c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:12.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8caffff700 1 --2- 172.21.15.125:0/665006241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c003a00 0x7f8c9c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8caffff700 1 -- 172.21.15.125:0/665006241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9c004850 msgr2=0x7f8c9c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:12.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8caffff700 1 --2- 172.21.15.125:0/665006241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9c004850 0x7f8c9c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8caffff700 1 -- 172.21.15.125:0/665006241 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0035b0 con 0x7f8c9c005200 2023-11-28T11:08:12.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8caffff700 1 -- 172.21.15.125:0/665006241 reap_dead start 2023-11-28T11:08:12.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8caffff700 1 --2- 172.21.15.125:0/665006241 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c9c005200 0x7f8c9c00ba10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800a890 tx=0x7f8c9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aeaca072d44d53 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:12.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca800a350 con 0x7f8c9c005200 2023-11-28T11:08:12.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca8012640 con 0x7f8c9c005200 2023-11-28T11:08:12.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.161+0000 7f8cae7fc700 1 -- 172.21.15.125:0/665006241 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80129f0 con 0x7f8c9c005200 2023-11-28T11:08:12.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.162+0000 7f8cb5db5700 1 -- 172.21.15.125:0/665006241 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c9c005200 msgr2=0x7f8c9c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:12.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.162+0000 7f8cb5db5700 1 --2- 172.21.15.125:0/665006241 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c9c005200 0x7f8c9c00ba10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800a890 tx=0x7f8c9c005880 comp rx=0 tx=0).stop 2023-11-28T11:08:12.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.162+0000 7f8cb5db5700 1 -- 172.21.15.125:0/665006241 shutdown_connections 2023-11-28T11:08:12.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.162+0000 7f8cb5db5700 1 --2- 172.21.15.125:0/665006241 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c9c005200 0x7f8c9c00ba10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.162+0000 7f8cb5db5700 1 -- 172.21.15.125:0/665006241 >> 172.21.15.125:0/665006241 conn(0x7f8cb006ea80 msgr2=0x7f8cb006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:12.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.162+0000 7f8cb5db5700 1 -- 172.21.15.125:0/665006241 shutdown_connections 2023-11-28T11:08:12.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.162+0000 7f8cb5db5700 1 -- 172.21.15.125:0/665006241 wait complete. 2023-11-28T11:08:12.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.164+0000 7f8cb5db5700 1 Processor -- start 2023-11-28T11:08:12.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.164+0000 7f8cb5db5700 1 -- start start 2023-11-28T11:08:12.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.165+0000 7f8cb5db5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c005200 0x7f8cb014f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:12.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.165+0000 7f8cb5db5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cb00b6180 0x7f8cb00c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:12.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.165+0000 7f8cb5db5700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00c6720 0x7f8cb00c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:12.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.165+0000 7f8cb5db5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0150c80 con 0x7f8cb00b6180 2023-11-28T11:08:12.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.165+0000 7f8cb5db5700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00c70e0 con 0x7f8cb00c6720 2023-11-28T11:08:12.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.165+0000 7f8cb5db5700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0150070 con 0x7f8c9c005200 2023-11-28T11:08:12.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cb00b6180 0x7f8cb00c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:12.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caf7fe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c005200 0x7f8cb014f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cb00b6180 0x7f8cb00c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56032/0 (socket says 172.21.15.125:56032) 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caeffd700 1 -- 172.21.15.125:0/937290064 learned_addr learned my addr 172.21.15.125:0/937290064 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caffff700 1 --2- 172.21.15.125:0/937290064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00c6720 0x7f8cb00c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caf7fe700 1 -- 172.21.15.125:0/937290064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00c6720 msgr2=0x7f8cb00c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caf7fe700 1 --2- 172.21.15.125:0/937290064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00c6720 0x7f8cb00c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caf7fe700 1 -- 172.21.15.125:0/937290064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cb00b6180 msgr2=0x7f8cb00c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caf7fe700 1 --2- 172.21.15.125:0/937290064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cb00b6180 0x7f8cb00c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caf7fe700 1 -- 172.21.15.125:0/937290064 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb00ccf50 con 0x7f8c9c005200 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caffff700 1 --2- 172.21.15.125:0/937290064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00c6720 0x7f8cb00c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caeffd700 1 --2- 172.21.15.125:0/937290064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cb00b6180 0x7f8cb00c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.166+0000 7f8caf7fe700 1 --2- 172.21.15.125:0/937290064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c005200 0x7f8cb014f820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0010890 tx=0x7f8ca0010ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:12.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.168+0000 7f8ca7fff700 1 -- 172.21.15.125:0/937290064 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0006ea0 con 0x7f8c9c005200 2023-11-28T11:08:12.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.168+0000 7f8ca7fff700 1 -- 172.21.15.125:0/937290064 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca0015940 con 0x7f8c9c005200 2023-11-28T11:08:12.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.168+0000 7f8cb5db5700 1 -- 172.21.15.125:0/937290064 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb00ccc70 con 0x7f8c9c005200 2023-11-28T11:08:12.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.168+0000 7f8ca7fff700 1 -- 172.21.15.125:0/937290064 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0015cf0 con 0x7f8c9c005200 2023-11-28T11:08:12.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.168+0000 7f8cb5db5700 1 -- 172.21.15.125:0/937290064 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb00cd230 con 0x7f8c9c005200 2023-11-28T11:08:12.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.168+0000 7f8ca7fff700 1 -- 172.21.15.125:0/937290064 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f8ca0026070 con 0x7f8c9c005200 2023-11-28T11:08:12.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.168+0000 7f8ca7fff700 1 -- 172.21.15.125:0/937290064 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8ca0016c70 con 0x7f8c9c005200 2023-11-28T11:08:12.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.169+0000 7f8cb5db5700 1 -- 172.21.15.125:0/937290064 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb0150f60 con 0x7f8c9c005200 2023-11-28T11:08:12.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.171+0000 7f8ca7fff700 1 -- 172.21.15.125:0/937290064 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f8ca003eb00 con 0x7f8c9c005200 2023-11-28T11:08:12.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.246+0000 7f8cb5db5700 1 -- 172.21.15.125:0/937290064 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8cb00743f0 con 0x7f8c9c005200 2023-11-28T11:08:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.255+0000 7f8ca7fff700 1 -- 172.21.15.125:0/937290064 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8ca002d020 con 0x7f8c9c005200 2023-11-28T11:08:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.256+0000 7f8cb5db5700 1 -- 172.21.15.125:0/937290064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c005200 msgr2=0x7f8cb014f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.256+0000 7f8cb5db5700 1 --2- 172.21.15.125:0/937290064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c005200 0x7f8cb014f820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0010890 tx=0x7f8ca0010ba0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.256+0000 7f8cb5db5700 1 -- 172.21.15.125:0/937290064 shutdown_connections 2023-11-28T11:08:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.256+0000 7f8cb5db5700 1 --2- 172.21.15.125:0/937290064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00c6720 0x7f8cb00c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.256+0000 7f8cb5db5700 1 --2- 172.21.15.125:0/937290064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c005200 0x7f8cb014f820 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.256+0000 7f8cb5db5700 1 --2- 172.21.15.125:0/937290064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cb00b6180 0x7f8cb00c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.256+0000 7f8cb5db5700 1 -- 172.21.15.125:0/937290064 >> 172.21.15.125:0/937290064 conn(0x7f8cb006ea80 msgr2=0x7f8cb00cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.256+0000 7f8cb5db5700 1 -- 172.21.15.125:0/937290064 shutdown_connections 2023-11-28T11:08:12.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:12.256+0000 7f8cb5db5700 1 -- 172.21.15.125:0/937290064 wait complete. 2023-11-28T11:08:12.259 INFO:teuthology.orchestra.run.smithi125.stderr:adjusted tunables profile to default 2023-11-28T11:08:12.269 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T11:08:12.269 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T11:08:12.270 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:12.270 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T11:08:12.279 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:12.278+0000 7fb4fcd5d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T11:08:12.282 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:12.281+0000 7f669b719200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T11:08:12.295 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:12.295 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T11:08:12.347 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:12.346+0000 7f669b719200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T11:08:12.347 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:12.346+0000 7fb4fcd5d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T11:08:12.362 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:12.362 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T11:08:12.421 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:12.420+0000 7f669b719200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T11:08:12.429 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:08:12.429 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T11:08:12.430 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:12.429+0000 7fb4fcd5d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T11:08:12.457 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:12.457 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T11:08:12.484 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:12.484 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T11:08:12.502 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:12.502+0000 7f669b719200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T11:08:12.515 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:12.514+0000 7fb4fcd5d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T11:08:12.530 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:12.530 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T11:08:12.596 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:08:12.597 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T11:08:12.651 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:12.650+0000 7f669b719200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T11:08:12.657 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:12.654+0000 7fb4fcd5d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T11:08:12.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 73a843a4-1543-4cbf-8ac3-6f56ccfff058 0 2023-11-28T11:08:12.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.822+0000 7fb1bfa1a700 1 Processor -- start 2023-11-28T11:08:12.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.822+0000 7fb1bfa1a700 1 -- start start 2023-11-28T11:08:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.823+0000 7fb1bfa1a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 0x7fb1b80b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.823+0000 7fb1bfa1a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b8159ec0 con 0x7fb1b81599b0 2023-11-28T11:08:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.823+0000 7fb1bfa1a700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b815aa60 con 0x7fb1b80af0a0 2023-11-28T11:08:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.823+0000 7fb1bfa1a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80b1f60 con 0x7fb1b80b1650 2023-11-28T11:08:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.823+0000 7fb1bd7b6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 0x7fb1b80b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.823+0000 7fb1bdfb7700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb1b80af0a0 0x7fb1b815a350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40042/0 (socket says 172.21.15.167:40042) 2023-11-28T11:08:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.823+0000 7fb1bdfb7700 1 -- 172.21.15.167:0/3949035050 learned_addr learned my addr 172.21.15.167:0/3949035050 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T11:08:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.824+0000 7fb1bd7b6700 1 -- 172.21.15.167:0/3949035050 >> v1:172.21.15.167:6789/0 conn(0x7fb1b80af0a0 legacy=0x7fb1b815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.824+0000 7fb1bd7b6700 1 -- 172.21.15.167:0/3949035050 >> v1:172.21.15.125:6789/0 conn(0x7fb1b81599b0 legacy=0x7fb1b815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.824+0000 7fb1affff700 1 -- 172.21.15.167:0/3949035050 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438342118 0 0) 0x7fb1b815aa60 con 0x7fb1b80af0a0 2023-11-28T11:08:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.824+0000 7fb1bd7b6700 1 -- 172.21.15.167:0/3949035050 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b815d8a0 con 0x7fb1b80b1650 2023-11-28T11:08:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.824+0000 7fb1bd7b6700 1 --2- 172.21.15.167:0/3949035050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 0x7fb1b80b1a20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009870 tx=0x7fb1b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac5e171cf9094361 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.824+0000 7fb1affff700 1 -- 172.21.15.167:0/3949035050 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b400f8a0 con 0x7fb1b80b1650 2023-11-28T11:08:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.824+0000 7fb1affff700 1 -- 172.21.15.167:0/3949035050 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b400fa00 con 0x7fb1b80b1650 2023-11-28T11:08:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.824+0000 7fb1affff700 1 -- 172.21.15.167:0/3949035050 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b400fd90 con 0x7fb1b80b1650 2023-11-28T11:08:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.825+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/3949035050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 msgr2=0x7fb1b80b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.825+0000 7fb1bfa1a700 1 --2- 172.21.15.167:0/3949035050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 0x7fb1b80b1a20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009870 tx=0x7fb1b4009b80 comp rx=0 tx=0).stop 2023-11-28T11:08:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.825+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/3949035050 shutdown_connections 2023-11-28T11:08:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.825+0000 7fb1bfa1a700 1 --2- 172.21.15.167:0/3949035050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 0x7fb1b80b1a20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.825+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/3949035050 >> 172.21.15.167:0/3949035050 conn(0x7fb1b806c010 msgr2=0x7fb1b80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.825+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/3949035050 shutdown_connections 2023-11-28T11:08:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.825+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/3949035050 wait complete. 2023-11-28T11:08:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.826+0000 7fb1bfa1a700 1 Processor -- start 2023-11-28T11:08:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.826+0000 7fb1bfa1a700 1 -- start start 2023-11-28T11:08:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bfa1a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1b80af0a0 0x7fb1b8154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bfa1a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 0x7fb1b80b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bfa1a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80c4660 0x7fb1b80b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bfa1a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8155750 con 0x7fb1b80af0a0 2023-11-28T11:08:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bfa1a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80c41d0 con 0x7fb1b80c4660 2023-11-28T11:08:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bfa1a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b81551b0 con 0x7fb1b80b1650 2023-11-28T11:08:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bcfb5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 0x7fb1b80b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bdfb7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80c4660 0x7fb1b80b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bcfb5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 0x7fb1b80b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44406/0 (socket says 172.21.15.167:44406) 2023-11-28T11:08:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bcfb5700 1 -- 172.21.15.167:0/627726366 learned_addr learned my addr 172.21.15.167:0/627726366 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T11:08:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bdfb7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80c4660 0x7fb1b80b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53548/0 (socket says 172.21.15.167:53548) 2023-11-28T11:08:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bd7b6700 1 --2- 172.21.15.167:0/627726366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1b80af0a0 0x7fb1b8154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bcfb5700 1 -- 172.21.15.167:0/627726366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80c4660 msgr2=0x7fb1b80b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bcfb5700 1 --2- 172.21.15.167:0/627726366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80c4660 0x7fb1b80b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bcfb5700 1 -- 172.21.15.167:0/627726366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1b80af0a0 msgr2=0x7fb1b8154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bcfb5700 1 --2- 172.21.15.167:0/627726366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1b80af0a0 0x7fb1b8154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bcfb5700 1 -- 172.21.15.167:0/627726366 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b40094a0 con 0x7fb1b80b1650 2023-11-28T11:08:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bdfb7700 1 --2- 172.21.15.167:0/627726366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80c4660 0x7fb1b80b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:12.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bcfb5700 1 --2- 172.21.15.167:0/627726366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 0x7fb1b80b09a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800c450 tx=0x7fb1a800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:12.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1adffb700 1 -- 172.21.15.167:0/627726366 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80052d0 con 0x7fb1b80b1650 2023-11-28T11:08:12.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1adffb700 1 -- 172.21.15.167:0/627726366 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a8005430 con 0x7fb1b80b1650 2023-11-28T11:08:12.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/627726366 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b815de60 con 0x7fb1b80b1650 2023-11-28T11:08:12.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.827+0000 7fb1adffb700 1 -- 172.21.15.167:0/627726366 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80038c0 con 0x7fb1b80b1650 2023-11-28T11:08:12.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.828+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/627726366 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b815db80 con 0x7fb1b80b1650 2023-11-28T11:08:12.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.828+0000 7fb1adffb700 1 -- 172.21.15.167:0/627726366 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb1a8019030 con 0x7fb1b80b1650 2023-11-28T11:08:12.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.828+0000 7fb1adffb700 1 -- 172.21.15.167:0/627726366 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb1a8011a60 con 0x7fb1b80b1650 2023-11-28T11:08:12.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.828+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/627726366 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b80b0780 con 0x7fb1b80b1650 2023-11-28T11:08:12.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.831+0000 7fb1adffb700 1 -- 172.21.15.167:0/627726366 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb1a8017070 con 0x7fb1b80b1650 2023-11-28T11:08:12.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.913+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/627726366 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "73a843a4-1543-4cbf-8ac3-6f56ccfff058", "id": 0} v 0) v1 -- 0x7fb1b80c4340 con 0x7fb1b80b1650 2023-11-28T11:08:12.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.919+0000 7fb1adffb700 1 -- 172.21.15.167:0/627726366 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "73a843a4-1543-4cbf-8ac3-6f56ccfff058", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb1a800ce20 con 0x7fb1b80b1650 2023-11-28T11:08:12.919 INFO:teuthology.orchestra.run.smithi167.stdout:0 2023-11-28T11:08:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.920+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/627726366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 msgr2=0x7fb1b80b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.920+0000 7fb1bfa1a700 1 --2- 172.21.15.167:0/627726366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 0x7fb1b80b09a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800c450 tx=0x7fb1a800c760 comp rx=0 tx=0).stop 2023-11-28T11:08:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.920+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/627726366 shutdown_connections 2023-11-28T11:08:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.920+0000 7fb1bfa1a700 1 --2- 172.21.15.167:0/627726366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80c4660 0x7fb1b80b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.920+0000 7fb1bfa1a700 1 --2- 172.21.15.167:0/627726366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1b80af0a0 0x7fb1b8154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.920+0000 7fb1bfa1a700 1 --2- 172.21.15.167:0/627726366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b80b1650 0x7fb1b80b09a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.920+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/627726366 >> 172.21.15.167:0/627726366 conn(0x7fb1b806c010 msgr2=0x7fb1b8157510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.920+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/627726366 shutdown_connections 2023-11-28T11:08:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:12.920+0000 7fb1bfa1a700 1 -- 172.21.15.167:0/627726366 wait complete. 2023-11-28T11:08:12.933 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new a0488802-feba-40b2-a1e8-2ebd429f574c 1 2023-11-28T11:08:13.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.052+0000 7f40777e1700 1 Processor -- start 2023-11-28T11:08:13.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.052+0000 7f40777e1700 1 -- start start 2023-11-28T11:08:13.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f40777e1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f40700b1650 0x7f40700b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f40777e1700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f40700af0a0 0x7f407015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f40777e1700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4070159ec0 con 0x7f40701599b0 2023-11-28T11:08:13.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f40777e1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40700b1f60 con 0x7f40700b1650 2023-11-28T11:08:13.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f40777e1700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407015d8a0 con 0x7f40700af0a0 2023-11-28T11:08:13.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f4075d7e700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f40700af0a0 0x7f407015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f4074d7c700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f40701599b0 0x7f407015d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40050/0 (socket says 172.21.15.167:40050) 2023-11-28T11:08:13.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f4074d7c700 1 -- 172.21.15.167:0/2389498775 learned_addr learned my addr 172.21.15.167:0/2389498775 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T11:08:13.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f407557d700 1 --2- 172.21.15.167:0/2389498775 >> v2:172.21.15.125:3300/0 conn(0x7f40700b1650 0x7f40700b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f4075d7e700 1 -- 172.21.15.167:0/2389498775 >> v2:172.21.15.125:3300/0 conn(0x7f40700b1650 msgr2=0x7f40700b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:13.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f4075d7e700 1 --2- 172.21.15.167:0/2389498775 >> v2:172.21.15.125:3300/0 conn(0x7f40700b1650 0x7f40700b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f4075d7e700 1 -- 172.21.15.167:0/2389498775 >> v1:172.21.15.167:6789/0 conn(0x7f40701599b0 legacy=0x7f407015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f4075d7e700 1 -- 172.21.15.167:0/2389498775 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407015db80 con 0x7f40700af0a0 2023-11-28T11:08:13.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f4067fff700 1 -- 172.21.15.167:0/2389498775 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842464214 0 0) 0x7f4070159ec0 con 0x7f40701599b0 2023-11-28T11:08:13.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f4075d7e700 1 --2- 172.21.15.167:0/2389498775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40700af0a0 0x7f407015a350 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f407006e010 tx=0x7f406800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dab7aa923563b6b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:13.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.053+0000 7f4067fff700 1 -- 172.21.15.167:0/2389498775 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406800e070 con 0x7f40700af0a0 2023-11-28T11:08:13.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.054+0000 7f4067fff700 1 -- 172.21.15.167:0/2389498775 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406800bb20 con 0x7f40700af0a0 2023-11-28T11:08:13.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.054+0000 7f4067fff700 1 -- 172.21.15.167:0/2389498775 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4068012430 con 0x7f40700af0a0 2023-11-28T11:08:13.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.054+0000 7f40777e1700 1 -- 172.21.15.167:0/2389498775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40700af0a0 msgr2=0x7f407015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.054+0000 7f40777e1700 1 --2- 172.21.15.167:0/2389498775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40700af0a0 0x7f407015a350 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f407006e010 tx=0x7f406800b330 comp rx=0 tx=0).stop 2023-11-28T11:08:13.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.054+0000 7f40777e1700 1 -- 172.21.15.167:0/2389498775 shutdown_connections 2023-11-28T11:08:13.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.054+0000 7f40777e1700 1 --2- 172.21.15.167:0/2389498775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40700af0a0 0x7f407015a350 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.054+0000 7f40777e1700 1 --2- 172.21.15.167:0/2389498775 >> v2:172.21.15.125:3300/0 conn(0x7f40700b1650 0x7f40700b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.054+0000 7f40777e1700 1 -- 172.21.15.167:0/2389498775 >> 172.21.15.167:0/2389498775 conn(0x7f407006c010 msgr2=0x7f40700cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:13.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.054+0000 7f40777e1700 1 -- 172.21.15.167:0/2389498775 shutdown_connections 2023-11-28T11:08:13.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.054+0000 7f40777e1700 1 -- 172.21.15.167:0/2389498775 wait complete. 2023-11-28T11:08:13.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.055+0000 7f40777e1700 1 Processor -- start 2023-11-28T11:08:13.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.055+0000 7f40777e1700 1 -- start start 2023-11-28T11:08:13.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.056+0000 7f40777e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40700af0a0 0x7f40701531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.056+0000 7f40777e1700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40700b1650 0x7f4070158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.056+0000 7f40777e1700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070158560 0x7f40700b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.056+0000 7f40777e1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40701589d0 con 0x7f40700af0a0 2023-11-28T11:08:13.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.056+0000 7f40777e1700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40700b3980 con 0x7f4070158560 2023-11-28T11:08:13.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.056+0000 7f40777e1700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40700b3c60 con 0x7f40700b1650 2023-11-28T11:08:13.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.056+0000 7f4075d7e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070158560 0x7f40700b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.056+0000 7f4075d7e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070158560 0x7f40700b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53558/0 (socket says 172.21.15.167:53558) 2023-11-28T11:08:13.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.056+0000 7f4074d7c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40700b1650 0x7f4070158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.056+0000 7f4075d7e700 1 -- 172.21.15.167:0/3605253648 learned_addr learned my addr 172.21.15.167:0/3605253648 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T11:08:13.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.056+0000 7f407557d700 1 --2- 172.21.15.167:0/3605253648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40700af0a0 0x7f40701531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4074d7c700 1 -- 172.21.15.167:0/3605253648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070158560 msgr2=0x7f40700b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4074d7c700 1 --2- 172.21.15.167:0/3605253648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070158560 0x7f40700b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4074d7c700 1 -- 172.21.15.167:0/3605253648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40700af0a0 msgr2=0x7f40701531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4074d7c700 1 --2- 172.21.15.167:0/3605253648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40700af0a0 0x7f40701531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4074d7c700 1 -- 172.21.15.167:0/3605253648 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4068009a70 con 0x7f40700b1650 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4075d7e700 1 --2- 172.21.15.167:0/3605253648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070158560 0x7f40700b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f407557d700 1 --2- 172.21.15.167:0/3605253648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40700af0a0 0x7f40701531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4074d7c700 1 --2- 172.21.15.167:0/3605253648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40700b1650 0x7f4070158020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f406000c3e0 tx=0x7f406000c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4065ffb700 1 -- 172.21.15.167:0/3605253648 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060004a70 con 0x7f40700b1650 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4065ffb700 1 -- 172.21.15.167:0/3605253648 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4060004bd0 con 0x7f40700b1650 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f40777e1700 1 -- 172.21.15.167:0/3605253648 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407015a890 con 0x7f40700b1650 2023-11-28T11:08:13.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4065ffb700 1 -- 172.21.15.167:0/3605253648 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600070d0 con 0x7f40700b1650 2023-11-28T11:08:13.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4065ffb700 1 -- 172.21.15.167:0/3605253648 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f406001a020 con 0x7f40700b1650 2023-11-28T11:08:13.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f40777e1700 1 -- 172.21.15.167:0/3605253648 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407015de60 con 0x7f40700b1650 2023-11-28T11:08:13.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.057+0000 7f4065ffb700 1 -- 172.21.15.167:0/3605253648 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f4060013420 con 0x7f40700b1650 2023-11-28T11:08:13.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.058+0000 7f40777e1700 1 -- 172.21.15.167:0/3605253648 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407015aa20 con 0x7f40700b1650 2023-11-28T11:08:13.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.060+0000 7f4065ffb700 1 -- 172.21.15.167:0/3605253648 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f4060013870 con 0x7f40700b1650 2023-11-28T11:08:13.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.143+0000 7f40777e1700 1 -- 172.21.15.167:0/3605253648 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a0488802-feba-40b2-a1e8-2ebd429f574c", "id": 1} v 0) v1 -- 0x7f4070068450 con 0x7f40700b1650 2023-11-28T11:08:13.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.151+0000 7f4065ffb700 1 -- 172.21.15.167:0/3605253648 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a0488802-feba-40b2-a1e8-2ebd429f574c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4060013a10 con 0x7f40700b1650 2023-11-28T11:08:13.152 INFO:teuthology.orchestra.run.smithi167.stdout:1 2023-11-28T11:08:13.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.152+0000 7f40777e1700 1 -- 172.21.15.167:0/3605253648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40700b1650 msgr2=0x7f4070158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.152+0000 7f40777e1700 1 --2- 172.21.15.167:0/3605253648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40700b1650 0x7f4070158020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f406000c3e0 tx=0x7f406000c6f0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.152+0000 7f40777e1700 1 -- 172.21.15.167:0/3605253648 shutdown_connections 2023-11-28T11:08:13.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.152+0000 7f40777e1700 1 --2- 172.21.15.167:0/3605253648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070158560 0x7f40700b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.152+0000 7f40777e1700 1 --2- 172.21.15.167:0/3605253648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40700af0a0 0x7f40701531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.152+0000 7f40777e1700 1 --2- 172.21.15.167:0/3605253648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40700b1650 0x7f4070158020 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.152+0000 7f40777e1700 1 -- 172.21.15.167:0/3605253648 >> 172.21.15.167:0/3605253648 conn(0x7f407006c010 msgr2=0x7f407006cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:13.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.152+0000 7f40777e1700 1 -- 172.21.15.167:0/3605253648 shutdown_connections 2023-11-28T11:08:13.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.152+0000 7f40777e1700 1 -- 172.21.15.167:0/3605253648 wait complete. 2023-11-28T11:08:13.164 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 3d8343cb-9b4b-4743-8414-4749e4f1398d 2 2023-11-28T11:08:13.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.284+0000 7f3aa54aa700 1 Processor -- start 2023-11-28T11:08:13.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.285+0000 7f3aa54aa700 1 -- start start 2023-11-28T11:08:13.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.285+0000 7f3aa54aa700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa015c810 0x7f3aa0160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.285+0000 7f3aa54aa700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3aa006a270 0x7f3aa006a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.285+0000 7f3aa54aa700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa006ac10 con 0x7f3aa00718e0 2023-11-28T11:08:13.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.285+0000 7f3aa54aa700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa015cbe0 con 0x7f3aa006a270 2023-11-28T11:08:13.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.285+0000 7f3aa54aa700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa01607a0 con 0x7f3aa015c810 2023-11-28T11:08:13.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.285+0000 7f3a9effd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa015c810 0x7f3aa0160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.285+0000 7f3a9f7fe700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3aa006a270 0x7f3aa006a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.285+0000 7f3a9e7fc700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3aa00718e0 0x7f3aa006c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40060/0 (socket says 172.21.15.167:40060) 2023-11-28T11:08:13.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.286+0000 7f3a9e7fc700 1 -- 172.21.15.167:0/1031711567 learned_addr learned my addr 172.21.15.167:0/1031711567 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T11:08:13.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.286+0000 7f3a9effd700 1 -- 172.21.15.167:0/1031711567 >> v2:172.21.15.167:3300/0 conn(0x7f3aa006a270 msgr2=0x7f3aa006a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:13.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.286+0000 7f3a9effd700 1 --2- 172.21.15.167:0/1031711567 >> v2:172.21.15.167:3300/0 conn(0x7f3aa006a270 0x7f3aa006a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.286+0000 7f3a9effd700 1 -- 172.21.15.167:0/1031711567 >> v1:172.21.15.167:6789/0 conn(0x7f3aa00718e0 legacy=0x7f3aa006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.286+0000 7f3a9effd700 1 -- 172.21.15.167:0/1031711567 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0160a50 con 0x7f3aa015c810 2023-11-28T11:08:13.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.286+0000 7f3a9f7fe700 1 --2- 172.21.15.167:0/1031711567 >> v2:172.21.15.167:3300/0 conn(0x7f3aa006a270 0x7f3aa006a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:13.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.286+0000 7f3a9effd700 1 --2- 172.21.15.167:0/1031711567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa015c810 0x7f3aa0160260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009840 tx=0x7f3a90009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fae0bebb86a9ef6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:13.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.286+0000 7f3a9dffb700 1 -- 172.21.15.167:0/1031711567 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90011830 con 0x7f3aa015c810 2023-11-28T11:08:13.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.286+0000 7f3a9dffb700 1 -- 172.21.15.167:0/1031711567 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a90011990 con 0x7f3aa015c810 2023-11-28T11:08:13.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.286+0000 7f3a9dffb700 1 -- 172.21.15.167:0/1031711567 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90011d20 con 0x7f3aa015c810 2023-11-28T11:08:13.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.287+0000 7f3aa54aa700 1 -- 172.21.15.167:0/1031711567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa015c810 msgr2=0x7f3aa0160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.287+0000 7f3aa54aa700 1 --2- 172.21.15.167:0/1031711567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa015c810 0x7f3aa0160260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009840 tx=0x7f3a90009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:13.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.287+0000 7f3aa54aa700 1 -- 172.21.15.167:0/1031711567 shutdown_connections 2023-11-28T11:08:13.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.287+0000 7f3aa54aa700 1 --2- 172.21.15.167:0/1031711567 >> v2:172.21.15.167:3300/0 conn(0x7f3aa006a270 0x7f3aa006a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.287+0000 7f3aa54aa700 1 --2- 172.21.15.167:0/1031711567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa015c810 0x7f3aa0160260 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.287+0000 7f3aa54aa700 1 -- 172.21.15.167:0/1031711567 >> 172.21.15.167:0/1031711567 conn(0x7f3aa006c010 msgr2=0x7f3aa00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:13.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.287+0000 7f3aa54aa700 1 -- 172.21.15.167:0/1031711567 shutdown_connections 2023-11-28T11:08:13.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.287+0000 7f3aa54aa700 1 -- 172.21.15.167:0/1031711567 wait complete. 2023-11-28T11:08:13.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.288+0000 7f3aa54aa700 1 Processor -- start 2023-11-28T11:08:13.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.288+0000 7f3aa54aa700 1 -- start start 2023-11-28T11:08:13.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3aa54aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa006a270 0x7f3aa01f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3aa54aa700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa00718e0 0x7f3aa00b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3aa54aa700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3aa015c810 0x7f3aa00b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3aa54aa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa01f5a00 con 0x7f3aa006a270 2023-11-28T11:08:13.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3aa54aa700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa01f5ce0 con 0x7f3aa015c810 2023-11-28T11:08:13.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3aa54aa700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa01f5fc0 con 0x7f3aa00718e0 2023-11-28T11:08:13.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3a9e7fc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa00718e0 0x7f3aa00b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3a9f7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3aa015c810 0x7f3aa00b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3a9e7fc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa00718e0 0x7f3aa00b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44428/0 (socket says 172.21.15.167:44428) 2023-11-28T11:08:13.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3a9e7fc700 1 -- 172.21.15.167:0/2566092021 learned_addr learned my addr 172.21.15.167:0/2566092021 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T11:08:13.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3a9f7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3aa015c810 0x7f3aa00b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53570/0 (socket says 172.21.15.167:53570) 2023-11-28T11:08:13.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.289+0000 7f3a9effd700 1 --2- 172.21.15.167:0/2566092021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa006a270 0x7f3aa01f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a9f7fe700 1 -- 172.21.15.167:0/2566092021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa00718e0 msgr2=0x7f3aa00b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a9f7fe700 1 --2- 172.21.15.167:0/2566092021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa00718e0 0x7f3aa00b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a9f7fe700 1 -- 172.21.15.167:0/2566092021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa006a270 msgr2=0x7f3aa01f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a9f7fe700 1 --2- 172.21.15.167:0/2566092021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa006a270 0x7f3aa01f1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a9f7fe700 1 -- 172.21.15.167:0/2566092021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98009a70 con 0x7f3aa015c810 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a9e7fc700 1 --2- 172.21.15.167:0/2566092021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa00718e0 0x7f3aa00b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a9f7fe700 1 --2- 172.21.15.167:0/2566092021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3aa015c810 0x7f3aa00b0920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800efc0 tx=0x7f3a9800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a877fe700 1 -- 172.21.15.167:0/2566092021 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800ca90 con 0x7f3aa015c810 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a877fe700 1 -- 172.21.15.167:0/2566092021 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9800f040 con 0x7f3aa015c810 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3aa54aa700 1 -- 172.21.15.167:0/2566092021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a900094a0 con 0x7f3aa015c810 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a877fe700 1 -- 172.21.15.167:0/2566092021 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800ce30 con 0x7f3aa015c810 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3aa54aa700 1 -- 172.21.15.167:0/2566092021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa0161010 con 0x7f3aa015c810 2023-11-28T11:08:13.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a877fe700 1 -- 172.21.15.167:0/2566092021 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f3a98003a20 con 0x7f3aa015c810 2023-11-28T11:08:13.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.290+0000 7f3a877fe700 1 -- 172.21.15.167:0/2566092021 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3a98004700 con 0x7f3aa015c810 2023-11-28T11:08:13.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.291+0000 7f3aa54aa700 1 -- 172.21.15.167:0/2566092021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa0160d30 con 0x7f3aa015c810 2023-11-28T11:08:13.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.293+0000 7f3a877fe700 1 -- 172.21.15.167:0/2566092021 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f3a98018030 con 0x7f3aa015c810 2023-11-28T11:08:13.332 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:13.331+0000 7fb4fcd5d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T11:08:13.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.378+0000 7f3aa54aa700 1 -- 172.21.15.167:0/2566092021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3d8343cb-9b4b-4743-8414-4749e4f1398d", "id": 2} v 0) v1 -- 0x7f3aa00ceb20 con 0x7f3aa015c810 2023-11-28T11:08:13.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.385+0000 7f3a877fe700 1 -- 172.21.15.167:0/2566092021 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3d8343cb-9b4b-4743-8414-4749e4f1398d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a9802b0b0 con 0x7f3aa015c810 2023-11-28T11:08:13.387 INFO:teuthology.orchestra.run.smithi167.stdout:2 2023-11-28T11:08:13.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.386+0000 7f3aa54aa700 1 -- 172.21.15.167:0/2566092021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3aa015c810 msgr2=0x7f3aa00b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.386+0000 7f3aa54aa700 1 --2- 172.21.15.167:0/2566092021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3aa015c810 0x7f3aa00b0920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800efc0 tx=0x7f3a9800c3a0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.386+0000 7f3aa54aa700 1 -- 172.21.15.167:0/2566092021 shutdown_connections 2023-11-28T11:08:13.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.386+0000 7f3aa54aa700 1 --2- 172.21.15.167:0/2566092021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3aa015c810 0x7f3aa00b0920 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.386+0000 7f3aa54aa700 1 --2- 172.21.15.167:0/2566092021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3aa006a270 0x7f3aa01f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.386+0000 7f3aa54aa700 1 --2- 172.21.15.167:0/2566092021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3aa00718e0 0x7f3aa00b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.386+0000 7f3aa54aa700 1 -- 172.21.15.167:0/2566092021 >> 172.21.15.167:0/2566092021 conn(0x7f3aa006c010 msgr2=0x7f3aa00ad810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:13.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.386+0000 7f3aa54aa700 1 -- 172.21.15.167:0/2566092021 shutdown_connections 2023-11-28T11:08:13.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.386+0000 7f3aa54aa700 1 -- 172.21.15.167:0/2566092021 wait complete. 2023-11-28T11:08:13.399 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 4af8f54c-cfd4-4a71-9484-2ff65e59f020 3 2023-11-28T11:08:13.407 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:13.406+0000 7fb4fcd5d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T11:08:13.425 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:13.424+0000 7f669b719200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T11:08:13.483 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:13.481+0000 7fb4fcd5d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T11:08:13.504 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:13.503+0000 7f669b719200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T11:08:13.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.520+0000 7f3efabd2700 1 Processor -- start 2023-11-28T11:08:13.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.520+0000 7f3efabd2700 1 -- start start 2023-11-28T11:08:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.521+0000 7f3efabd2700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3ef41599b0 0x7f3ef415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.521+0000 7f3efabd2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ef40af0a0 0x7f3ef415a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.521+0000 7f3efabd2700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef4159ec0 con 0x7f3ef40b1650 2023-11-28T11:08:13.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.521+0000 7f3efabd2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef415d8a0 con 0x7f3ef40af0a0 2023-11-28T11:08:13.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.521+0000 7f3efabd2700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef415db80 con 0x7f3ef41599b0 2023-11-28T11:08:13.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.521+0000 7f3ef3fff700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3ef41599b0 0x7f3ef415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.521+0000 7f3ef896e700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3ef40b1650 0x7f3ef40b1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40072/0 (socket says 172.21.15.167:40072) 2023-11-28T11:08:13.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.521+0000 7f3ef896e700 1 -- 172.21.15.167:0/739524531 learned_addr learned my addr 172.21.15.167:0/739524531 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T11:08:13.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.521+0000 7f3ef916f700 1 --2- 172.21.15.167:0/739524531 >> v2:172.21.15.125:3300/0 conn(0x7f3ef40af0a0 0x7f3ef415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.521+0000 7f3ef37fe700 1 -- 172.21.15.167:0/739524531 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649696537 0 0) 0x7f3ef4159ec0 con 0x7f3ef40b1650 2023-11-28T11:08:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.521+0000 7f3ef37fe700 1 -- 172.21.15.167:0/739524531 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee40035b0 con 0x7f3ef40b1650 2023-11-28T11:08:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.522+0000 7f3ef3fff700 1 -- 172.21.15.167:0/739524531 >> v2:172.21.15.125:3300/0 conn(0x7f3ef40af0a0 msgr2=0x7f3ef415a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.522+0000 7f3ef3fff700 1 --2- 172.21.15.167:0/739524531 >> v2:172.21.15.125:3300/0 conn(0x7f3ef40af0a0 0x7f3ef415a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.522+0000 7f3ef3fff700 1 -- 172.21.15.167:0/739524531 >> v1:172.21.15.167:6789/0 conn(0x7f3ef40b1650 legacy=0x7f3ef40b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.522+0000 7f3ef3fff700 1 -- 172.21.15.167:0/739524531 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef415de60 con 0x7f3ef41599b0 2023-11-28T11:08:13.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.522+0000 7f3ef3fff700 1 --2- 172.21.15.167:0/739524531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ef41599b0 0x7f3ef415d050 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ef406c730 tx=0x7f3ee0009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=545eb29458c2f991 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:13.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.522+0000 7f3ef37fe700 1 -- 172.21.15.167:0/739524531 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011830 con 0x7f3ef41599b0 2023-11-28T11:08:13.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.522+0000 7f3ef37fe700 1 -- 172.21.15.167:0/739524531 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0011990 con 0x7f3ef41599b0 2023-11-28T11:08:13.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.522+0000 7f3ef37fe700 1 -- 172.21.15.167:0/739524531 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011d20 con 0x7f3ef41599b0 2023-11-28T11:08:13.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.523+0000 7f3efabd2700 1 -- 172.21.15.167:0/739524531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ef41599b0 msgr2=0x7f3ef415d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.523+0000 7f3efabd2700 1 --2- 172.21.15.167:0/739524531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ef41599b0 0x7f3ef415d050 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ef406c730 tx=0x7f3ee0009b20 comp rx=0 tx=0).stop 2023-11-28T11:08:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.523+0000 7f3efabd2700 1 -- 172.21.15.167:0/739524531 shutdown_connections 2023-11-28T11:08:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.523+0000 7f3efabd2700 1 --2- 172.21.15.167:0/739524531 >> v2:172.21.15.125:3300/0 conn(0x7f3ef40af0a0 0x7f3ef415a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.523+0000 7f3efabd2700 1 --2- 172.21.15.167:0/739524531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ef41599b0 0x7f3ef415d050 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.523+0000 7f3efabd2700 1 -- 172.21.15.167:0/739524531 >> 172.21.15.167:0/739524531 conn(0x7f3ef406c010 msgr2=0x7f3ef40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.523+0000 7f3efabd2700 1 -- 172.21.15.167:0/739524531 shutdown_connections 2023-11-28T11:08:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.523+0000 7f3efabd2700 1 -- 172.21.15.167:0/739524531 wait complete. 2023-11-28T11:08:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.524+0000 7f3efabd2700 1 Processor -- start 2023-11-28T11:08:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.524+0000 7f3efabd2700 1 -- start start 2023-11-28T11:08:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3efabd2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef40af0a0 0x7f3ef40c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3efabd2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ef40b1650 0x7f3ef4157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3efabd2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ef414ff50 0x7f3ef4153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3efabd2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef40b31a0 con 0x7f3ef40af0a0 2023-11-28T11:08:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3efabd2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef4158610 con 0x7f3ef40b1650 2023-11-28T11:08:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3efabd2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef41588f0 con 0x7f3ef414ff50 2023-11-28T11:08:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3ef3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ef40b1650 0x7f3ef4157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3ef916f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ef414ff50 0x7f3ef4153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3ef916f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ef414ff50 0x7f3ef4153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44442/0 (socket says 172.21.15.167:44442) 2023-11-28T11:08:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3ef3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ef40b1650 0x7f3ef4157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53580/0 (socket says 172.21.15.167:53580) 2023-11-28T11:08:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3ef916f700 1 -- 172.21.15.167:0/2589279652 learned_addr learned my addr 172.21.15.167:0/2589279652 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T11:08:13.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3ef896e700 1 --2- 172.21.15.167:0/2589279652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef40af0a0 0x7f3ef40c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3ef916f700 1 -- 172.21.15.167:0/2589279652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ef40b1650 msgr2=0x7f3ef4157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3ef916f700 1 --2- 172.21.15.167:0/2589279652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ef40b1650 0x7f3ef4157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3ef916f700 1 -- 172.21.15.167:0/2589279652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef40af0a0 msgr2=0x7f3ef40c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3ef916f700 1 --2- 172.21.15.167:0/2589279652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef40af0a0 0x7f3ef40c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.525+0000 7f3ef916f700 1 -- 172.21.15.167:0/2589279652 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee00094a0 con 0x7f3ef414ff50 2023-11-28T11:08:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.526+0000 7f3ef3fff700 1 --2- 172.21.15.167:0/2589279652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ef40b1650 0x7f3ef4157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.526+0000 7f3ef916f700 1 --2- 172.21.15.167:0/2589279652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ef414ff50 0x7f3ef4153e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00efc0 tx=0x7f3eec00c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.526+0000 7f3ef17fa700 1 -- 172.21.15.167:0/2589279652 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec00cad0 con 0x7f3ef414ff50 2023-11-28T11:08:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.526+0000 7f3ef17fa700 1 -- 172.21.15.167:0/2589279652 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec00f040 con 0x7f3ef414ff50 2023-11-28T11:08:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.526+0000 7f3efabd2700 1 -- 172.21.15.167:0/2589279652 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef415a890 con 0x7f3ef414ff50 2023-11-28T11:08:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.526+0000 7f3ef17fa700 1 -- 172.21.15.167:0/2589279652 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec00ce70 con 0x7f3ef414ff50 2023-11-28T11:08:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.526+0000 7f3efabd2700 1 -- 172.21.15.167:0/2589279652 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef415d590 con 0x7f3ef414ff50 2023-11-28T11:08:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.526+0000 7f3ef17fa700 1 -- 172.21.15.167:0/2589279652 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f3eec014480 con 0x7f3ef414ff50 2023-11-28T11:08:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.526+0000 7f3ef17fa700 1 -- 172.21.15.167:0/2589279652 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f3eec014ba0 con 0x7f3ef414ff50 2023-11-28T11:08:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.527+0000 7f3efabd2700 1 -- 172.21.15.167:0/2589279652 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef415aa20 con 0x7f3ef414ff50 2023-11-28T11:08:13.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.531+0000 7f3ef17fa700 1 -- 172.21.15.167:0/2589279652 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f3eec018020 con 0x7f3ef414ff50 2023-11-28T11:08:13.603 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:13.602+0000 7f669b719200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T11:08:13.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.614+0000 7f3efabd2700 1 -- 172.21.15.167:0/2589279652 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4af8f54c-cfd4-4a71-9484-2ff65e59f020", "id": 3} v 0) v1 -- 0x7f3ef40743f0 con 0x7f3ef414ff50 2023-11-28T11:08:13.618 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:13.617+0000 7fb4fcd5d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T11:08:13.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.622+0000 7f3ef17fa700 1 -- 172.21.15.167:0/2589279652 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4af8f54c-cfd4-4a71-9484-2ff65e59f020", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3eec0147e0 con 0x7f3ef414ff50 2023-11-28T11:08:13.623 INFO:teuthology.orchestra.run.smithi167.stdout:3 2023-11-28T11:08:13.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.623+0000 7f3efabd2700 1 -- 172.21.15.167:0/2589279652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ef414ff50 msgr2=0x7f3ef4153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.623+0000 7f3efabd2700 1 --2- 172.21.15.167:0/2589279652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ef414ff50 0x7f3ef4153e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00efc0 tx=0x7f3eec00c0c0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.623+0000 7f3efabd2700 1 -- 172.21.15.167:0/2589279652 shutdown_connections 2023-11-28T11:08:13.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.623+0000 7f3efabd2700 1 --2- 172.21.15.167:0/2589279652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ef414ff50 0x7f3ef4153e30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.623+0000 7f3efabd2700 1 --2- 172.21.15.167:0/2589279652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef40af0a0 0x7f3ef40c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.623+0000 7f3efabd2700 1 --2- 172.21.15.167:0/2589279652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ef40b1650 0x7f3ef4157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.623+0000 7f3efabd2700 1 -- 172.21.15.167:0/2589279652 >> 172.21.15.167:0/2589279652 conn(0x7f3ef406c010 msgr2=0x7f3ef40b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.623+0000 7f3efabd2700 1 -- 172.21.15.167:0/2589279652 shutdown_connections 2023-11-28T11:08:13.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.623+0000 7f3efabd2700 1 -- 172.21.15.167:0/2589279652 wait complete. 2023-11-28T11:08:13.636 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new ec19c071-e5ec-49e5-9f16-f734f48c73ce 4 2023-11-28T11:08:13.747 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:13.746+0000 7f669b719200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T11:08:13.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.797+0000 7ffb41221700 1 Processor -- start 2023-11-28T11:08:13.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.797+0000 7ffb41221700 1 -- start start 2023-11-28T11:08:13.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb41221700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffb3c0b2ee0 0x7ffb3c0b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb41221700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3c161370 con 0x7ffb3c06d170 2023-11-28T11:08:13.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb41221700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3c0cf700 con 0x7ffb3c15fe50 2023-11-28T11:08:13.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb41221700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3c06d5c0 con 0x7ffb3c0b2ee0 2023-11-28T11:08:13.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb3ad9d700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ffb3c15fe50 0x7ffb3c160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40084/0 (socket says 172.21.15.167:40084) 2023-11-28T11:08:13.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb3ad9d700 1 -- 172.21.15.167:0/2127961470 learned_addr learned my addr 172.21.15.167:0/2127961470 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T11:08:13.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb3b59e700 1 --2- 172.21.15.167:0/2127961470 >> v2:172.21.15.125:3300/0 conn(0x7ffb3c0b2ee0 0x7ffb3c0b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb39d9b700 1 -- 172.21.15.167:0/2127961470 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21170333 0 0) 0x7ffb3c0cf700 con 0x7ffb3c15fe50 2023-11-28T11:08:13.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb39d9b700 1 -- 172.21.15.167:0/2127961470 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb240035b0 con 0x7ffb3c15fe50 2023-11-28T11:08:13.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb3b59e700 1 -- 172.21.15.167:0/2127961470 >> v1:172.21.15.167:6789/0 conn(0x7ffb3c15fe50 legacy=0x7ffb3c160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb3b59e700 1 -- 172.21.15.167:0/2127961470 >> v1:172.21.15.125:6789/0 conn(0x7ffb3c06d170 legacy=0x7ffb3c0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb3b59e700 1 -- 172.21.15.167:0/2127961470 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c0cedd0 con 0x7ffb3c0b2ee0 2023-11-28T11:08:13.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.798+0000 7ffb3b59e700 1 --2- 172.21.15.167:0/2127961470 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb3c0b2ee0 0x7ffb3c0b3b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009d90 tx=0x7ffb3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6301f3149e220e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:13.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.799+0000 7ffb39d9b700 1 -- 172.21.15.167:0/2127961470 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3400e070 con 0x7ffb3c0b2ee0 2023-11-28T11:08:13.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.799+0000 7ffb39d9b700 1 -- 172.21.15.167:0/2127961470 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3400bb20 con 0x7ffb3c0b2ee0 2023-11-28T11:08:13.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.799+0000 7ffb39d9b700 1 -- 172.21.15.167:0/2127961470 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34012430 con 0x7ffb3c0b2ee0 2023-11-28T11:08:13.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.799+0000 7ffb41221700 1 -- 172.21.15.167:0/2127961470 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb3c0b2ee0 msgr2=0x7ffb3c0b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.799+0000 7ffb41221700 1 --2- 172.21.15.167:0/2127961470 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb3c0b2ee0 0x7ffb3c0b3b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009d90 tx=0x7ffb3400b330 comp rx=0 tx=0).stop 2023-11-28T11:08:13.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.799+0000 7ffb41221700 1 -- 172.21.15.167:0/2127961470 shutdown_connections 2023-11-28T11:08:13.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.799+0000 7ffb41221700 1 --2- 172.21.15.167:0/2127961470 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb3c0b2ee0 0x7ffb3c0b3b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.799+0000 7ffb41221700 1 -- 172.21.15.167:0/2127961470 >> 172.21.15.167:0/2127961470 conn(0x7ffb3c06ea80 msgr2=0x7ffb3c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:13.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.799+0000 7ffb41221700 1 -- 172.21.15.167:0/2127961470 shutdown_connections 2023-11-28T11:08:13.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.799+0000 7ffb41221700 1 -- 172.21.15.167:0/2127961470 wait complete. 2023-11-28T11:08:13.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.801+0000 7ffb41221700 1 Processor -- start 2023-11-28T11:08:13.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.801+0000 7ffb41221700 1 -- start start 2023-11-28T11:08:13.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb41221700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb3c06d170 0x7ffb3c155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb41221700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c0b2ee0 0x7ffb3c154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb41221700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb3c15fe50 0x7ffb3c15ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:13.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb41221700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c15b390 con 0x7ffb3c06d170 2023-11-28T11:08:13.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb41221700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c0cd4c0 con 0x7ffb3c0b2ee0 2023-11-28T11:08:13.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb41221700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c0ccf00 con 0x7ffb3c15fe50 2023-11-28T11:08:13.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3b59e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb3c15fe50 0x7ffb3c15ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3a59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c0b2ee0 0x7ffb3c154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3b59e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb3c15fe50 0x7ffb3c15ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44454/0 (socket says 172.21.15.167:44454) 2023-11-28T11:08:13.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3b59e700 1 -- 172.21.15.167:0/3210134125 learned_addr learned my addr 172.21.15.167:0/3210134125 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T11:08:13.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3ad9d700 1 --2- 172.21.15.167:0/3210134125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb3c06d170 0x7ffb3c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:13.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3b59e700 1 -- 172.21.15.167:0/3210134125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c0b2ee0 msgr2=0x7ffb3c154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3b59e700 1 --2- 172.21.15.167:0/3210134125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c0b2ee0 0x7ffb3c154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3b59e700 1 -- 172.21.15.167:0/3210134125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb3c06d170 msgr2=0x7ffb3c155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3b59e700 1 --2- 172.21.15.167:0/3210134125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb3c06d170 0x7ffb3c155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3b59e700 1 -- 172.21.15.167:0/3210134125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb34009a70 con 0x7ffb3c15fe50 2023-11-28T11:08:13.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3ad9d700 1 --2- 172.21.15.167:0/3210134125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb3c06d170 0x7ffb3c155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:13.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3a59c700 1 --2- 172.21.15.167:0/3210134125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c0b2ee0 0x7ffb3c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:13.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb3b59e700 1 --2- 172.21.15.167:0/3210134125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb3c15fe50 0x7ffb3c15ae50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffb34013000 tx=0x7ffb34004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:13.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb237fe700 1 -- 172.21.15.167:0/3210134125 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34012430 con 0x7ffb3c15fe50 2023-11-28T11:08:13.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb237fe700 1 -- 172.21.15.167:0/3210134125 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb34020070 con 0x7ffb3c15fe50 2023-11-28T11:08:13.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb41221700 1 -- 172.21.15.167:0/3210134125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3c0cf390 con 0x7ffb3c15fe50 2023-11-28T11:08:13.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb237fe700 1 -- 172.21.15.167:0/3210134125 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34004280 con 0x7ffb3c15fe50 2023-11-28T11:08:13.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.802+0000 7ffb41221700 1 -- 172.21.15.167:0/3210134125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3c0cf0b0 con 0x7ffb3c15fe50 2023-11-28T11:08:13.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.803+0000 7ffb237fe700 1 -- 172.21.15.167:0/3210134125 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7ffb3402e070 con 0x7ffb3c15fe50 2023-11-28T11:08:13.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.803+0000 7ffb237fe700 1 -- 172.21.15.167:0/3210134125 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ffb34022070 con 0x7ffb3c15fe50 2023-11-28T11:08:13.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.803+0000 7ffb41221700 1 -- 172.21.15.167:0/3210134125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3c0cfb90 con 0x7ffb3c15fe50 2023-11-28T11:08:13.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.805+0000 7ffb237fe700 1 -- 172.21.15.167:0/3210134125 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ffb3402c060 con 0x7ffb3c15fe50 2023-11-28T11:08:13.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.888+0000 7ffb41221700 1 -- 172.21.15.167:0/3210134125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ec19c071-e5ec-49e5-9f16-f734f48c73ce", "id": 4} v 0) v1 -- 0x7ffb3c0743f0 con 0x7ffb3c15fe50 2023-11-28T11:08:13.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.895+0000 7ffb237fe700 1 -- 172.21.15.167:0/3210134125 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ec19c071-e5ec-49e5-9f16-f734f48c73ce", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffb34004860 con 0x7ffb3c15fe50 2023-11-28T11:08:13.897 INFO:teuthology.orchestra.run.smithi167.stdout:4 2023-11-28T11:08:13.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.896+0000 7ffb41221700 1 -- 172.21.15.167:0/3210134125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb3c15fe50 msgr2=0x7ffb3c15ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:13.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.896+0000 7ffb41221700 1 --2- 172.21.15.167:0/3210134125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb3c15fe50 0x7ffb3c15ae50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffb34013000 tx=0x7ffb34004ad0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.896+0000 7ffb41221700 1 -- 172.21.15.167:0/3210134125 shutdown_connections 2023-11-28T11:08:13.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.896+0000 7ffb41221700 1 --2- 172.21.15.167:0/3210134125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb3c15fe50 0x7ffb3c15ae50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.896+0000 7ffb41221700 1 --2- 172.21.15.167:0/3210134125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb3c06d170 0x7ffb3c155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.896+0000 7ffb41221700 1 --2- 172.21.15.167:0/3210134125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c0b2ee0 0x7ffb3c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:13.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.896+0000 7ffb41221700 1 -- 172.21.15.167:0/3210134125 >> 172.21.15.167:0/3210134125 conn(0x7ffb3c06ea80 msgr2=0x7ffb3c0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:13.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.897+0000 7ffb41221700 1 -- 172.21.15.167:0/3210134125 shutdown_connections 2023-11-28T11:08:13.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:13.897+0000 7ffb41221700 1 -- 172.21.15.167:0/3210134125 wait complete. 2023-11-28T11:08:13.909 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 7e9e2115-bf6e-41a9-bbe6-05da61ac870d 5 2023-11-28T11:08:14.005 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:14.003+0000 7fb4fcd5d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T11:08:14.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.031+0000 7ff1d05bd700 1 Processor -- start 2023-11-28T11:08:14.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.031+0000 7ff1d05bd700 1 -- start start 2023-11-28T11:08:14.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.032+0000 7ff1d05bd700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff1c8160cb0 0x7ff1c806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.032+0000 7ff1d05bd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c80d2d30 con 0x7ff1c815c8c0 2023-11-28T11:08:14.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.032+0000 7ff1d05bd700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c80d0b40 con 0x7ff1c806b050 2023-11-28T11:08:14.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.032+0000 7ff1d05bd700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c806b490 con 0x7ff1c8160cb0 2023-11-28T11:08:14.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.032+0000 7ff1cdb58700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff1c8160cb0 0x7ff1c806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.032+0000 7ff1ceb5a700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff1c806b050 0x7ff1c80d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40100/0 (socket says 172.21.15.167:40100) 2023-11-28T11:08:14.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.032+0000 7ff1ceb5a700 1 -- 172.21.15.167:0/3419381909 learned_addr learned my addr 172.21.15.167:0/3419381909 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T11:08:14.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.033+0000 7ff1cdb58700 1 -- 172.21.15.167:0/3419381909 >> v1:172.21.15.167:6789/0 conn(0x7ff1c806b050 legacy=0x7ff1c80d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.033+0000 7ff1cdb58700 1 -- 172.21.15.167:0/3419381909 >> v1:172.21.15.125:6789/0 conn(0x7ff1c815c8c0 legacy=0x7ff1c80b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.033+0000 7ff1cd357700 1 -- 172.21.15.167:0/3419381909 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252199183 0 0) 0x7ff1c80d0b40 con 0x7ff1c806b050 2023-11-28T11:08:14.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.033+0000 7ff1cdb58700 1 -- 172.21.15.167:0/3419381909 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c80d2a50 con 0x7ff1c8160cb0 2023-11-28T11:08:14.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.033+0000 7ff1cdb58700 1 --2- 172.21.15.167:0/3419381909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c8160cb0 0x7ff1c806ab10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009840 tx=0x7ff1b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=267a70b0470f4da4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:14.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.033+0000 7ff1cd357700 1 -- 172.21.15.167:0/3419381909 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8011830 con 0x7ff1c8160cb0 2023-11-28T11:08:14.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.033+0000 7ff1cd357700 1 -- 172.21.15.167:0/3419381909 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b8011990 con 0x7ff1c8160cb0 2023-11-28T11:08:14.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.033+0000 7ff1cd357700 1 -- 172.21.15.167:0/3419381909 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8011d20 con 0x7ff1c8160cb0 2023-11-28T11:08:14.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.034+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3419381909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c8160cb0 msgr2=0x7ff1c806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.034+0000 7ff1d05bd700 1 --2- 172.21.15.167:0/3419381909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c8160cb0 0x7ff1c806ab10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009840 tx=0x7ff1b8009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:14.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.034+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3419381909 shutdown_connections 2023-11-28T11:08:14.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.034+0000 7ff1d05bd700 1 --2- 172.21.15.167:0/3419381909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c8160cb0 0x7ff1c806ab10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.034+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3419381909 >> 172.21.15.167:0/3419381909 conn(0x7ff1c806c520 msgr2=0x7ff1c806c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:14.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.034+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3419381909 shutdown_connections 2023-11-28T11:08:14.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.034+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3419381909 wait complete. 2023-11-28T11:08:14.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.035+0000 7ff1d05bd700 1 Processor -- start 2023-11-28T11:08:14.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.035+0000 7ff1d05bd700 1 -- start start 2023-11-28T11:08:14.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1d05bd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c806b050 0x7ff1c80cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1d05bd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c815c8c0 0x7ff1c8155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1d05bd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c8160cb0 0x7ff1c815ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1d05bd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80c6f80 con 0x7ff1c815c8c0 2023-11-28T11:08:14.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1d05bd700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80c7260 con 0x7ff1c8160cb0 2023-11-28T11:08:14.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1d05bd700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80c7540 con 0x7ff1c806b050 2023-11-28T11:08:14.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1ce359700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c806b050 0x7ff1c80cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1ceb5a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c8160cb0 0x7ff1c815ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1ce359700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c806b050 0x7ff1c80cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44462/0 (socket says 172.21.15.167:44462) 2023-11-28T11:08:14.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1ceb5a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c8160cb0 0x7ff1c815ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53606/0 (socket says 172.21.15.167:53606) 2023-11-28T11:08:14.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1ce359700 1 -- 172.21.15.167:0/3321302821 learned_addr learned my addr 172.21.15.167:0/3321302821 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T11:08:14.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.036+0000 7ff1cdb58700 1 --2- 172.21.15.167:0/3321302821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c815c8c0 0x7ff1c8155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1ceb5a700 1 -- 172.21.15.167:0/3321302821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c806b050 msgr2=0x7ff1c80cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1ceb5a700 1 --2- 172.21.15.167:0/3321302821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c806b050 0x7ff1c80cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1ceb5a700 1 -- 172.21.15.167:0/3321302821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c815c8c0 msgr2=0x7ff1c8155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1ceb5a700 1 --2- 172.21.15.167:0/3321302821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c815c8c0 0x7ff1c8155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1ceb5a700 1 -- 172.21.15.167:0/3321302821 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80094a0 con 0x7ff1c8160cb0 2023-11-28T11:08:14.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1cdb58700 1 --2- 172.21.15.167:0/3321302821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c815c8c0 0x7ff1c8155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:14.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1ceb5a700 1 --2- 172.21.15.167:0/3321302821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c8160cb0 0x7ff1c815ee60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000cb30 tx=0x7ff1c000ce40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:14.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1beffd700 1 -- 172.21.15.167:0/3321302821 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000a9e0 con 0x7ff1c8160cb0 2023-11-28T11:08:14.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1beffd700 1 -- 172.21.15.167:0/3321302821 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000ab40 con 0x7ff1c8160cb0 2023-11-28T11:08:14.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3321302821 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c80cda40 con 0x7ff1c8160cb0 2023-11-28T11:08:14.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1beffd700 1 -- 172.21.15.167:0/3321302821 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00070d0 con 0x7ff1c8160cb0 2023-11-28T11:08:14.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3321302821 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c80cd760 con 0x7ff1c8160cb0 2023-11-28T11:08:14.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1beffd700 1 -- 172.21.15.167:0/3321302821 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7ff1c001a030 con 0x7ff1c8160cb0 2023-11-28T11:08:14.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.037+0000 7ff1beffd700 1 -- 172.21.15.167:0/3321302821 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff1c001c930 con 0x7ff1c8160cb0 2023-11-28T11:08:14.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.038+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3321302821 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c8161120 con 0x7ff1c8160cb0 2023-11-28T11:08:14.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.040+0000 7ff1beffd700 1 -- 172.21.15.167:0/3321302821 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ff1c0018070 con 0x7ff1c8160cb0 2023-11-28T11:08:14.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.123+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3321302821 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e9e2115-bf6e-41a9-bbe6-05da61ac870d", "id": 5} v 0) v1 -- 0x7ff1c8067d70 con 0x7ff1c8160cb0 2023-11-28T11:08:14.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.131+0000 7ff1beffd700 1 -- 172.21.15.167:0/3321302821 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e9e2115-bf6e-41a9-bbe6-05da61ac870d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff1c001cc80 con 0x7ff1c8160cb0 2023-11-28T11:08:14.132 INFO:teuthology.orchestra.run.smithi167.stdout:5 2023-11-28T11:08:14.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.131+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3321302821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c8160cb0 msgr2=0x7ff1c815ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.131+0000 7ff1d05bd700 1 --2- 172.21.15.167:0/3321302821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c8160cb0 0x7ff1c815ee60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000cb30 tx=0x7ff1c000ce40 comp rx=0 tx=0).stop 2023-11-28T11:08:14.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.132+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3321302821 shutdown_connections 2023-11-28T11:08:14.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.132+0000 7ff1d05bd700 1 --2- 172.21.15.167:0/3321302821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c8160cb0 0x7ff1c815ee60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.132+0000 7ff1d05bd700 1 --2- 172.21.15.167:0/3321302821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c806b050 0x7ff1c80cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.132+0000 7ff1d05bd700 1 --2- 172.21.15.167:0/3321302821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c815c8c0 0x7ff1c8155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.132+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3321302821 >> 172.21.15.167:0/3321302821 conn(0x7ff1c806c520 msgr2=0x7ff1c80b8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:14.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.132+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3321302821 shutdown_connections 2023-11-28T11:08:14.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.132+0000 7ff1d05bd700 1 -- 172.21.15.167:0/3321302821 wait complete. 2023-11-28T11:08:14.145 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 61ecacef-15ca-45eb-b8dd-d9ca291ef525 6 2023-11-28T11:08:14.159 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:14.158+0000 7f669b719200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T11:08:14.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.266+0000 7f01794e1700 1 Processor -- start 2023-11-28T11:08:14.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.266+0000 7f01794e1700 1 -- start start 2023-11-28T11:08:14.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.266+0000 7f01794e1700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0174071890 0x7f01740ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.266+0000 7f01794e1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017415cc10 con 0x7f01740cf710 2023-11-28T11:08:14.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.266+0000 7f01794e1700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017406c9b0 con 0x7f017406a980 2023-11-28T11:08:14.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.266+0000 7f01794e1700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017406cc90 con 0x7f0174071890 2023-11-28T11:08:14.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f01737fe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0174071890 0x7f01740ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f01727fc700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f017406a980 0x7f0174160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40108/0 (socket says 172.21.15.167:40108) 2023-11-28T11:08:14.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f01727fc700 1 -- 172.21.15.167:0/796224634 learned_addr learned my addr 172.21.15.167:0/796224634 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T11:08:14.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f0171ffb700 1 -- 172.21.15.167:0/796224634 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726741435 0 0) 0x7f017406c9b0 con 0x7f017406a980 2023-11-28T11:08:14.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f0171ffb700 1 -- 172.21.15.167:0/796224634 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f015c0035b0 con 0x7f017406a980 2023-11-28T11:08:14.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f01737fe700 1 -- 172.21.15.167:0/796224634 >> v1:172.21.15.167:6789/0 conn(0x7f017406a980 legacy=0x7f0174160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f01737fe700 1 -- 172.21.15.167:0/796224634 >> v1:172.21.15.125:6789/0 conn(0x7f01740cf710 legacy=0x7f017406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f01737fe700 1 -- 172.21.15.167:0/796224634 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017406cf70 con 0x7f0174071890 2023-11-28T11:08:14.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f01737fe700 1 --2- 172.21.15.167:0/796224634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0174071890 0x7f01740ce740 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f016c009dc0 tx=0x7f016c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=164faf11b99f29be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:14.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f0171ffb700 1 -- 172.21.15.167:0/796224634 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c00e070 con 0x7f0174071890 2023-11-28T11:08:14.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f0171ffb700 1 -- 172.21.15.167:0/796224634 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c00bb20 con 0x7f0174071890 2023-11-28T11:08:14.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.267+0000 7f0171ffb700 1 -- 172.21.15.167:0/796224634 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c012430 con 0x7f0174071890 2023-11-28T11:08:14.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.268+0000 7f01794e1700 1 -- 172.21.15.167:0/796224634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0174071890 msgr2=0x7f01740ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.268+0000 7f01794e1700 1 --2- 172.21.15.167:0/796224634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0174071890 0x7f01740ce740 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f016c009dc0 tx=0x7f016c00b330 comp rx=0 tx=0).stop 2023-11-28T11:08:14.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.268+0000 7f01794e1700 1 -- 172.21.15.167:0/796224634 shutdown_connections 2023-11-28T11:08:14.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.268+0000 7f01794e1700 1 --2- 172.21.15.167:0/796224634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0174071890 0x7f01740ce740 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.268+0000 7f01794e1700 1 -- 172.21.15.167:0/796224634 >> 172.21.15.167:0/796224634 conn(0x7f017406c010 msgr2=0x7f01740cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:14.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.268+0000 7f01794e1700 1 -- 172.21.15.167:0/796224634 shutdown_connections 2023-11-28T11:08:14.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.268+0000 7f01794e1700 1 -- 172.21.15.167:0/796224634 wait complete. 2023-11-28T11:08:14.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.269+0000 7f01794e1700 1 Processor -- start 2023-11-28T11:08:14.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.269+0000 7f01794e1700 1 -- start start 2023-11-28T11:08:14.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f01794e1700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f017406a980 0x7f017415e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f01794e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0174071890 0x7f0174155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f01794e1700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01740cf710 0x7f017415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f01794e1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017415e220 con 0x7f0174071890 2023-11-28T11:08:14.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f01794e1700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017415d610 con 0x7f017406a980 2023-11-28T11:08:14.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f01794e1700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017415d8f0 con 0x7f01740cf710 2023-11-28T11:08:14.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f0172ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f017406a980 0x7f017415e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f01737fe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01740cf710 0x7f017415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f01737fe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01740cf710 0x7f017415cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44476/0 (socket says 172.21.15.167:44476) 2023-11-28T11:08:14.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f0172ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f017406a980 0x7f017415e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53612/0 (socket says 172.21.15.167:53612) 2023-11-28T11:08:14.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f01737fe700 1 -- 172.21.15.167:0/1148297950 learned_addr learned my addr 172.21.15.167:0/1148297950 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T11:08:14.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f01727fc700 1 --2- 172.21.15.167:0/1148297950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0174071890 0x7f0174155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f0172ffd700 1 -- 172.21.15.167:0/1148297950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01740cf710 msgr2=0x7f017415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f0172ffd700 1 --2- 172.21.15.167:0/1148297950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01740cf710 0x7f017415cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f0172ffd700 1 -- 172.21.15.167:0/1148297950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0174071890 msgr2=0x7f0174155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f0172ffd700 1 --2- 172.21.15.167:0/1148297950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0174071890 0x7f0174155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f0172ffd700 1 -- 172.21.15.167:0/1148297950 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c009a70 con 0x7f017406a980 2023-11-28T11:08:14.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.270+0000 7f01737fe700 1 --2- 172.21.15.167:0/1148297950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01740cf710 0x7f017415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:14.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.271+0000 7f0172ffd700 1 --2- 172.21.15.167:0/1148297950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f017406a980 0x7f017415e6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0164000f60 tx=0x7f016400c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:14.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.271+0000 7f015b7fe700 1 -- 172.21.15.167:0/1148297950 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640052d0 con 0x7f017406a980 2023-11-28T11:08:14.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.271+0000 7f015b7fe700 1 -- 172.21.15.167:0/1148297950 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0164005430 con 0x7f017406a980 2023-11-28T11:08:14.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.271+0000 7f01794e1700 1 -- 172.21.15.167:0/1148297950 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017406d530 con 0x7f017406a980 2023-11-28T11:08:14.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.271+0000 7f015b7fe700 1 -- 172.21.15.167:0/1148297950 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640038c0 con 0x7f017406a980 2023-11-28T11:08:14.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.271+0000 7f01794e1700 1 -- 172.21.15.167:0/1148297950 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017406d250 con 0x7f017406a980 2023-11-28T11:08:14.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.271+0000 7f015b7fe700 1 -- 172.21.15.167:0/1148297950 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f0164019030 con 0x7f017406a980 2023-11-28T11:08:14.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.271+0000 7f015b7fe700 1 -- 172.21.15.167:0/1148297950 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f016401b9a0 con 0x7f017406a980 2023-11-28T11:08:14.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.272+0000 7f01794e1700 1 -- 172.21.15.167:0/1148297950 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017406c9b0 con 0x7f017406a980 2023-11-28T11:08:14.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.274+0000 7f015b7fe700 1 -- 172.21.15.167:0/1148297950 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f0164017070 con 0x7f017406a980 2023-11-28T11:08:14.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.357+0000 7f01794e1700 1 -- 172.21.15.167:0/1148297950 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "61ecacef-15ca-45eb-b8dd-d9ca291ef525", "id": 6} v 0) v1 -- 0x7f01740743f0 con 0x7f017406a980 2023-11-28T11:08:14.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.365+0000 7f015b7fe700 1 -- 172.21.15.167:0/1148297950 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "61ecacef-15ca-45eb-b8dd-d9ca291ef525", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f016401c440 con 0x7f017406a980 2023-11-28T11:08:14.366 INFO:teuthology.orchestra.run.smithi167.stdout:6 2023-11-28T11:08:14.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.366+0000 7f01794e1700 1 -- 172.21.15.167:0/1148297950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f017406a980 msgr2=0x7f017415e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.366+0000 7f01794e1700 1 --2- 172.21.15.167:0/1148297950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f017406a980 0x7f017415e6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0164000f60 tx=0x7f016400c6e0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.366+0000 7f01794e1700 1 -- 172.21.15.167:0/1148297950 shutdown_connections 2023-11-28T11:08:14.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.366+0000 7f01794e1700 1 --2- 172.21.15.167:0/1148297950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01740cf710 0x7f017415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.366+0000 7f01794e1700 1 --2- 172.21.15.167:0/1148297950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f017406a980 0x7f017415e6b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.366+0000 7f01794e1700 1 --2- 172.21.15.167:0/1148297950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0174071890 0x7f0174155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.366+0000 7f01794e1700 1 -- 172.21.15.167:0/1148297950 >> 172.21.15.167:0/1148297950 conn(0x7f017406c010 msgr2=0x7f017406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:14.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.366+0000 7f01794e1700 1 -- 172.21.15.167:0/1148297950 shutdown_connections 2023-11-28T11:08:14.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.366+0000 7f01794e1700 1 -- 172.21.15.167:0/1148297950 wait complete. 2023-11-28T11:08:14.379 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new f4090465-2f84-435b-aa4f-1a5e18d61e93 7 2023-11-28T11:08:14.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.541+0000 7f6fa534e700 1 Processor -- start 2023-11-28T11:08:14.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.541+0000 7f6fa534e700 1 -- start start 2023-11-28T11:08:14.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.542+0000 7f6fa534e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6fa01599b0 0x7f6fa015d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.542+0000 7f6fa534e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00af0a0 0x7f6fa015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.542+0000 7f6fa534e700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa0159ec0 con 0x7f6fa00b1650 2023-11-28T11:08:14.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.542+0000 7f6fa534e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa015d8a0 con 0x7f6fa01599b0 2023-11-28T11:08:14.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.542+0000 7f6fa534e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa015db80 con 0x7f6fa00af0a0 2023-11-28T11:08:14.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.542+0000 7f6f9effd700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6fa00b1650 0x7f6fa00b1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40118/0 (socket says 172.21.15.167:40118) 2023-11-28T11:08:14.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.542+0000 7f6f9effd700 1 -- 172.21.15.167:0/767502177 learned_addr learned my addr 172.21.15.167:0/767502177 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T11:08:14.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.542+0000 7f6f9f7fe700 1 --2- 172.21.15.167:0/767502177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00af0a0 0x7f6fa015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.542+0000 7f6f9e7fc700 1 --2- 172.21.15.167:0/767502177 >> v2:172.21.15.125:3300/0 conn(0x7f6fa01599b0 0x7f6fa015d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.542+0000 7f6f9dffb700 1 -- 172.21.15.167:0/767502177 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835781118 0 0) 0x7f6fa0159ec0 con 0x7f6fa00b1650 2023-11-28T11:08:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.543+0000 7f6f9dffb700 1 -- 172.21.15.167:0/767502177 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f880035b0 con 0x7f6fa00b1650 2023-11-28T11:08:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.543+0000 7f6f9f7fe700 1 -- 172.21.15.167:0/767502177 >> v2:172.21.15.125:3300/0 conn(0x7f6fa01599b0 msgr2=0x7f6fa015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.543+0000 7f6f9f7fe700 1 --2- 172.21.15.167:0/767502177 >> v2:172.21.15.125:3300/0 conn(0x7f6fa01599b0 0x7f6fa015d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.543+0000 7f6f9f7fe700 1 -- 172.21.15.167:0/767502177 >> v1:172.21.15.167:6789/0 conn(0x7f6fa00b1650 legacy=0x7f6fa00b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.543+0000 7f6f9f7fe700 1 -- 172.21.15.167:0/767502177 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa015de60 con 0x7f6fa00af0a0 2023-11-28T11:08:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.543+0000 7f6f9f7fe700 1 --2- 172.21.15.167:0/767502177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00af0a0 0x7f6fa015a350 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009d90 tx=0x7f6f9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37dd45e4e0bb1fcc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.543+0000 7f6f9dffb700 1 -- 172.21.15.167:0/767502177 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800e070 con 0x7f6fa00af0a0 2023-11-28T11:08:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.543+0000 7f6f9dffb700 1 -- 172.21.15.167:0/767502177 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9800bb20 con 0x7f6fa00af0a0 2023-11-28T11:08:14.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.543+0000 7f6f9dffb700 1 -- 172.21.15.167:0/767502177 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98012430 con 0x7f6fa00af0a0 2023-11-28T11:08:14.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.544+0000 7f6fa534e700 1 -- 172.21.15.167:0/767502177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00af0a0 msgr2=0x7f6fa015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.544+0000 7f6fa534e700 1 --2- 172.21.15.167:0/767502177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00af0a0 0x7f6fa015a350 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009d90 tx=0x7f6f9800b330 comp rx=0 tx=0).stop 2023-11-28T11:08:14.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.544+0000 7f6fa534e700 1 -- 172.21.15.167:0/767502177 shutdown_connections 2023-11-28T11:08:14.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.544+0000 7f6fa534e700 1 --2- 172.21.15.167:0/767502177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00af0a0 0x7f6fa015a350 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.544+0000 7f6fa534e700 1 --2- 172.21.15.167:0/767502177 >> v2:172.21.15.125:3300/0 conn(0x7f6fa01599b0 0x7f6fa015d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.544+0000 7f6fa534e700 1 -- 172.21.15.167:0/767502177 >> 172.21.15.167:0/767502177 conn(0x7f6fa006c010 msgr2=0x7f6fa00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:14.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.544+0000 7f6fa534e700 1 -- 172.21.15.167:0/767502177 shutdown_connections 2023-11-28T11:08:14.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.544+0000 7f6fa534e700 1 -- 172.21.15.167:0/767502177 wait complete. 2023-11-28T11:08:14.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.545+0000 7f6fa534e700 1 Processor -- start 2023-11-28T11:08:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.545+0000 7f6fa534e700 1 -- start start 2023-11-28T11:08:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6fa534e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa00af0a0 0x7f6fa00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6fa534e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00b1650 0x7f6fa0157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6fa534e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fa01578d0 0x7f6fa00cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6fa534e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0071980 con 0x7f6fa00af0a0 2023-11-28T11:08:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6fa534e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0070d70 con 0x7f6fa01578d0 2023-11-28T11:08:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6fa534e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0071050 con 0x7f6fa00b1650 2023-11-28T11:08:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6f9e7fc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00b1650 0x7f6fa0157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6f9e7fc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00b1650 0x7f6fa0157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44486/0 (socket says 172.21.15.167:44486) 2023-11-28T11:08:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6f9f7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fa01578d0 0x7f6fa00cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6f9e7fc700 1 -- 172.21.15.167:0/3013766931 learned_addr learned my addr 172.21.15.167:0/3013766931 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6f9effd700 1 --2- 172.21.15.167:0/3013766931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa00af0a0 0x7f6fa00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6f9f7fe700 1 -- 172.21.15.167:0/3013766931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00b1650 msgr2=0x7f6fa0157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6f9f7fe700 1 --2- 172.21.15.167:0/3013766931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00b1650 0x7f6fa0157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6f9f7fe700 1 -- 172.21.15.167:0/3013766931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa00af0a0 msgr2=0x7f6fa00b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6f9f7fe700 1 --2- 172.21.15.167:0/3013766931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa00af0a0 0x7f6fa00b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.546+0000 7f6f9f7fe700 1 -- 172.21.15.167:0/3013766931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98009a70 con 0x7f6fa01578d0 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.547+0000 7f6f9f7fe700 1 --2- 172.21.15.167:0/3013766931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fa01578d0 0x7f6fa00cb0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6f98016000 tx=0x7f6f98004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.547+0000 7f6f877fe700 1 -- 172.21.15.167:0/3013766931 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98012430 con 0x7f6fa01578d0 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.547+0000 7f6f877fe700 1 -- 172.21.15.167:0/3013766931 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f98020070 con 0x7f6fa01578d0 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.547+0000 7f6f877fe700 1 -- 172.21.15.167:0/3013766931 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f980098f0 con 0x7f6fa01578d0 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.547+0000 7f6fa534e700 1 -- 172.21.15.167:0/3013766931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa015a890 con 0x7f6fa01578d0 2023-11-28T11:08:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.547+0000 7f6fa534e700 1 -- 172.21.15.167:0/3013766931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa015d590 con 0x7f6fa01578d0 2023-11-28T11:08:14.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.547+0000 7f6f877fe700 1 -- 172.21.15.167:0/3013766931 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f6f9802e070 con 0x7f6fa01578d0 2023-11-28T11:08:14.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.547+0000 7f6f877fe700 1 -- 172.21.15.167:0/3013766931 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6f98022070 con 0x7f6fa01578d0 2023-11-28T11:08:14.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.548+0000 7f6fa534e700 1 -- 172.21.15.167:0/3013766931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa015aa20 con 0x7f6fa01578d0 2023-11-28T11:08:14.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.550+0000 7f6f877fe700 1 -- 172.21.15.167:0/3013766931 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f6f9802c060 con 0x7f6fa01578d0 2023-11-28T11:08:14.563 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:14.562+0000 7fb4fcd5d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-28T11:08:14.632 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:14.630+0000 7fb4fcd5d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T11:08:14.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.666+0000 7f6fa534e700 1 -- 172.21.15.167:0/3013766931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f4090465-2f84-435b-aa4f-1a5e18d61e93", "id": 7} v 0) v1 -- 0x7f6fa0071190 con 0x7f6fa01578d0 2023-11-28T11:08:14.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.675+0000 7f6f877fe700 1 -- 172.21.15.167:0/3013766931 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4090465-2f84-435b-aa4f-1a5e18d61e93", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6fa0071190 con 0x7f6fa01578d0 2023-11-28T11:08:14.676 INFO:teuthology.orchestra.run.smithi167.stdout:7 2023-11-28T11:08:14.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.676+0000 7f6fa534e700 1 -- 172.21.15.167:0/3013766931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fa01578d0 msgr2=0x7f6fa00cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.676+0000 7f6fa534e700 1 --2- 172.21.15.167:0/3013766931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fa01578d0 0x7f6fa00cb0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6f98016000 tx=0x7f6f98004ad0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.676+0000 7f6fa534e700 1 -- 172.21.15.167:0/3013766931 shutdown_connections 2023-11-28T11:08:14.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.676+0000 7f6fa534e700 1 --2- 172.21.15.167:0/3013766931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fa01578d0 0x7f6fa00cb0b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.676+0000 7f6fa534e700 1 --2- 172.21.15.167:0/3013766931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6fa00af0a0 0x7f6fa00b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.676+0000 7f6fa534e700 1 --2- 172.21.15.167:0/3013766931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6fa00b1650 0x7f6fa0157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.676+0000 7f6fa534e700 1 -- 172.21.15.167:0/3013766931 >> 172.21.15.167:0/3013766931 conn(0x7f6fa006c010 msgr2=0x7f6fa00cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:14.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.676+0000 7f6fa534e700 1 -- 172.21.15.167:0/3013766931 shutdown_connections 2023-11-28T11:08:14.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T11:08:14.676+0000 7f6fa534e700 1 -- 172.21.15.167:0/3013766931 wait complete. 2023-11-28T11:08:14.689 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T11:08:14.689 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T11:08:14.691 INFO:tasks.ceph.osd.0:Started 2023-11-28T11:08:14.691 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T11:08:14.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T11:08:14.693 INFO:tasks.ceph.osd.1:Started 2023-11-28T11:08:14.693 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T11:08:14.693 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T11:08:14.695 INFO:tasks.ceph.osd.2:Started 2023-11-28T11:08:14.695 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T11:08:14.696 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T11:08:14.697 INFO:tasks.ceph.osd.3:Started 2023-11-28T11:08:14.698 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T11:08:14.698 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T11:08:14.701 INFO:tasks.ceph.osd.4:Started 2023-11-28T11:08:14.701 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T11:08:14.701 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T11:08:14.707 INFO:tasks.ceph.osd.5:Started 2023-11-28T11:08:14.707 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T11:08:14.708 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T11:08:14.709 INFO:tasks.ceph.osd.6:Started 2023-11-28T11:08:14.710 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T11:08:14.710 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T11:08:14.713 INFO:tasks.ceph.osd.7:Started 2023-11-28T11:08:14.714 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:14.750 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:14.750+0000 7f669b719200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-28T11:08:14.830 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:14.829+0000 7f669b719200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T11:08:14.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.870+0000 7f66f9dbe700 1 Processor -- start 2023-11-28T11:08:14.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.870+0000 7f66f9dbe700 1 -- start start 2023-11-28T11:08:14.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f9dbe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66f40ce040 0x7f66f415d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f9dbe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f4142db0 0x7f66f413ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f9dbe700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f413fc90 con 0x7f66f40b1770 2023-11-28T11:08:14.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f9dbe700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f413f6d0 con 0x7f66f40ce040 2023-11-28T11:08:14.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f9dbe700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f413f9b0 con 0x7f66f4142db0 2023-11-28T11:08:14.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66f40ce040 0x7f66f415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66f40ce040 0x7f66f415d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56060/0 (socket says 172.21.15.125:56060) 2023-11-28T11:08:14.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f37fe700 1 -- 172.21.15.125:0/1086039174 learned_addr learned my addr 172.21.15.125:0/1086039174 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:14.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f2ffd700 1 --2- 172.21.15.125:0/1086039174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f4142db0 0x7f66f413ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f37fe700 1 -- 172.21.15.125:0/1086039174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f4142db0 msgr2=0x7f66f413ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:14.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f37fe700 1 --2- 172.21.15.125:0/1086039174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f4142db0 0x7f66f413ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f37fe700 1 -- 172.21.15.125:0/1086039174 >> v1:172.21.15.167:6789/0 conn(0x7f66f40b1770 legacy=0x7f66f413cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f37fe700 1 -- 172.21.15.125:0/1086039174 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f415d100 con 0x7f66f40ce040 2023-11-28T11:08:14.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.871+0000 7f66f37fe700 1 --2- 172.21.15.125:0/1086039174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f40ce040 0x7f66f415d900 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f66e40098f0 tx=0x7f66e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfb10cffa2dfd90 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:14.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.872+0000 7f66f27fc700 1 -- 172.21.15.125:0/1086039174 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4011830 con 0x7f66f40ce040 2023-11-28T11:08:14.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.872+0000 7f66f27fc700 1 -- 172.21.15.125:0/1086039174 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4011990 con 0x7f66f40ce040 2023-11-28T11:08:14.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.872+0000 7f66f27fc700 1 -- 172.21.15.125:0/1086039174 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4011d20 con 0x7f66f40ce040 2023-11-28T11:08:14.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.872+0000 7f66f9dbe700 1 -- 172.21.15.125:0/1086039174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f40ce040 msgr2=0x7f66f415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.872+0000 7f66f9dbe700 1 --2- 172.21.15.125:0/1086039174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f40ce040 0x7f66f415d900 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f66e40098f0 tx=0x7f66e4009c00 comp rx=0 tx=0).stop 2023-11-28T11:08:14.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.872+0000 7f66f9dbe700 1 -- 172.21.15.125:0/1086039174 shutdown_connections 2023-11-28T11:08:14.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.872+0000 7f66f9dbe700 1 --2- 172.21.15.125:0/1086039174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f40ce040 0x7f66f415d900 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.872+0000 7f66f9dbe700 1 --2- 172.21.15.125:0/1086039174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f4142db0 0x7f66f413ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.872+0000 7f66f9dbe700 1 -- 172.21.15.125:0/1086039174 >> 172.21.15.125:0/1086039174 conn(0x7f66f406c010 msgr2=0x7f66f40cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:14.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.872+0000 7f66f9dbe700 1 -- 172.21.15.125:0/1086039174 shutdown_connections 2023-11-28T11:08:14.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.872+0000 7f66f9dbe700 1 -- 172.21.15.125:0/1086039174 wait complete. 2023-11-28T11:08:14.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.873+0000 7f66f9dbe700 1 Processor -- start 2023-11-28T11:08:14.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.874+0000 7f66f9dbe700 1 -- start start 2023-11-28T11:08:14.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.874+0000 7f66f9dbe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f40b1770 0x7f66f41f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.874+0000 7f66f9dbe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66f40ce040 0x7f66f406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.874+0000 7f66f9dbe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f4142db0 0x7f66f406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:14.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.874+0000 7f66f9dbe700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f40c4bf0 con 0x7f66f40b1770 2023-11-28T11:08:14.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.874+0000 7f66f9dbe700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41f2950 con 0x7f66f40ce040 2023-11-28T11:08:14.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.874+0000 7f66f9dbe700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f40c5bb0 con 0x7f66f4142db0 2023-11-28T11:08:14.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.874+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f40b1770 0x7f66f41f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.874+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f40b1770 0x7f66f41f2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56066/0 (socket says 172.21.15.125:56066) 2023-11-28T11:08:14.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.874+0000 7f66f37fe700 1 -- 172.21.15.125:0/2595601515 learned_addr learned my addr 172.21.15.125:0/2595601515 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:14.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66f3fff700 1 --2- 172.21.15.125:0/2595601515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f4142db0 0x7f66f406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66f2ffd700 1 --2- 172.21.15.125:0/2595601515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66f40ce040 0x7f66f406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:14.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66f37fe700 1 -- 172.21.15.125:0/2595601515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f4142db0 msgr2=0x7f66f406d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66f37fe700 1 --2- 172.21.15.125:0/2595601515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f4142db0 0x7f66f406d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66f37fe700 1 -- 172.21.15.125:0/2595601515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66f40ce040 msgr2=0x7f66f406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66f37fe700 1 --2- 172.21.15.125:0/2595601515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66f40ce040 0x7f66f406ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66f37fe700 1 -- 172.21.15.125:0/2595601515 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e4009550 con 0x7f66f40b1770 2023-11-28T11:08:14.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66f37fe700 1 --2- 172.21.15.125:0/2595601515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f40b1770 0x7f66f41f2410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66e4000c00 tx=0x7f66e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:14.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66dbfff700 1 -- 172.21.15.125:0/2595601515 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4004400 con 0x7f66f40b1770 2023-11-28T11:08:14.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66dbfff700 1 -- 172.21.15.125:0/2595601515 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e401f070 con 0x7f66f40b1770 2023-11-28T11:08:14.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66f9dbe700 1 -- 172.21.15.125:0/2595601515 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f40ce410 con 0x7f66f40b1770 2023-11-28T11:08:14.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66dbfff700 1 -- 172.21.15.125:0/2595601515 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40038e0 con 0x7f66f40b1770 2023-11-28T11:08:14.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66f9dbe700 1 -- 172.21.15.125:0/2595601515 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f415d3e0 con 0x7f66f40b1770 2023-11-28T11:08:14.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66dbfff700 1 -- 172.21.15.125:0/2595601515 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f66e402a020 con 0x7f66f40b1770 2023-11-28T11:08:14.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.875+0000 7f66dbfff700 1 -- 172.21.15.125:0/2595601515 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f66e401ad00 con 0x7f66f40b1770 2023-11-28T11:08:14.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.876+0000 7f66f9dbe700 1 -- 172.21.15.125:0/2595601515 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f40ce5a0 con 0x7f66f40b1770 2023-11-28T11:08:14.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.878+0000 7f66dbfff700 1 -- 172.21.15.125:0/2595601515 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f66e4015020 con 0x7f66f40b1770 2023-11-28T11:08:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.947+0000 7f66f9dbe700 1 -- 172.21.15.125:0/2595601515 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66f406c510 con 0x7f66f40b1770 2023-11-28T11:08:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.948+0000 7f66dbfff700 1 -- 172.21.15.125:0/2595601515 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f66e4003a40 con 0x7f66f40b1770 2023-11-28T11:08:14.950 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:14.950 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":10,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:14.668319+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:14.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.949+0000 7f66f9dbe700 1 -- 172.21.15.125:0/2595601515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f40b1770 msgr2=0x7f66f41f2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:14.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.949+0000 7f66f9dbe700 1 --2- 172.21.15.125:0/2595601515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f40b1770 0x7f66f41f2410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66e4000c00 tx=0x7f66e4004750 comp rx=0 tx=0).stop 2023-11-28T11:08:14.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.949+0000 7f66f9dbe700 1 -- 172.21.15.125:0/2595601515 shutdown_connections 2023-11-28T11:08:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.949+0000 7f66f9dbe700 1 --2- 172.21.15.125:0/2595601515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f4142db0 0x7f66f406d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.949+0000 7f66f9dbe700 1 --2- 172.21.15.125:0/2595601515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66f40b1770 0x7f66f41f2410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.949+0000 7f66f9dbe700 1 --2- 172.21.15.125:0/2595601515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66f40ce040 0x7f66f406ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.949+0000 7f66f9dbe700 1 -- 172.21.15.125:0/2595601515 >> 172.21.15.125:0/2595601515 conn(0x7f66f406c010 msgr2=0x7f66f415bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.949+0000 7f66f9dbe700 1 -- 172.21.15.125:0/2595601515 shutdown_connections 2023-11-28T11:08:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:14.949+0000 7f66f9dbe700 1 -- 172.21.15.125:0/2595601515 wait complete. 2023-11-28T11:08:14.963 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T11:08:14.963 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T11:08:15.307 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-11-28T11:08:15.305+0000 7fd13b7fb640 -1 Falling back to public interface 2023-11-28T11:08:15.317 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-11-28T11:08:15.314+0000 7fa4881e0640 -1 Falling back to public interface 2023-11-28T11:08:15.319 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-11-28T11:08:15.318+0000 7f14d7c87640 -1 Falling back to public interface 2023-11-28T11:08:15.329 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-11-28T11:08:15.328+0000 7efef965e640 -1 Falling back to public interface 2023-11-28T11:08:15.330 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-11-28T11:08:15.329+0000 7ffa6dcba640 -1 Falling back to public interface 2023-11-28T11:08:15.332 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-11-28T11:08:15.331+0000 7ff5bd2aa640 -1 Falling back to public interface 2023-11-28T11:08:15.337 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-11-28T11:08:15.337+0000 7f03d5b98640 -1 Falling back to public interface 2023-11-28T11:08:15.340 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-11-28T11:08:15.339+0000 7fd184fac640 -1 Falling back to public interface 2023-11-28T11:08:15.349 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:15.347+0000 7fb4fcd5d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:08:15.425 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:15.424+0000 7fb4fcd5d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T11:08:15.515 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:15.514+0000 7f669b719200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:08:15.563 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:15.562+0000 7fb4fcd5d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:08:15.592 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:15.591+0000 7f669b719200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T11:08:15.733 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:15.732+0000 7f669b719200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:08:15.769 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:15.865 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:15.863+0000 7fb4fcd5d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T11:08:15.881 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.879+0000 7f6504647700 1 Processor -- start 2023-11-28T11:08:15.881 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.879+0000 7f6504647700 1 -- start start 2023-11-28T11:08:15.883 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.880+0000 7f6504647700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64fc06e400 0x7f64fc06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:15.883 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.880+0000 7f6504647700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64fc0d15f0 0x7f64fc15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:15.883 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.880+0000 7f6504647700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc15af30 con 0x7f64fc15e010 2023-11-28T11:08:15.883 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.880+0000 7f6504647700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc15a9d0 con 0x7f64fc06e400 2023-11-28T11:08:15.883 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.880+0000 7f6504647700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc1584e0 con 0x7f64fc0d15f0 2023-11-28T11:08:15.883 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.880+0000 7f65023e3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64fc06e400 0x7f64fc06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:15.883 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.880+0000 7f65023e3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64fc06e400 0x7f64fc06e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56072/0 (socket says 172.21.15.125:56072) 2023-11-28T11:08:15.884 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.880+0000 7f65023e3700 1 -- 172.21.15.125:0/2338044021 learned_addr learned my addr 172.21.15.125:0/2338044021 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:15.884 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.881+0000 7f6501be2700 1 --2- 172.21.15.125:0/2338044021 >> v2:172.21.15.167:3300/0 conn(0x7f64fc0d15f0 0x7f64fc15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:15.884 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.881+0000 7f65023e3700 1 -- 172.21.15.125:0/2338044021 >> v2:172.21.15.167:3300/0 conn(0x7f64fc0d15f0 msgr2=0x7f64fc15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:15.884 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.881+0000 7f65023e3700 1 --2- 172.21.15.125:0/2338044021 >> v2:172.21.15.167:3300/0 conn(0x7f64fc0d15f0 0x7f64fc15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:15.884 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.881+0000 7f65023e3700 1 -- 172.21.15.125:0/2338044021 >> v1:172.21.15.167:6789/0 conn(0x7f64fc15e010 legacy=0x7f64fc0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:15.884 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.881+0000 7f65023e3700 1 -- 172.21.15.125:0/2338044021 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc15ef40 con 0x7f64fc06e400 2023-11-28T11:08:15.884 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.881+0000 7f65023e3700 1 --2- 172.21.15.125:0/2338044021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64fc06e400 0x7f64fc06e7d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0ce6e0 tx=0x7f64ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2df7f3552da33f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:15.884 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.881+0000 7f65013e1700 1 -- 172.21.15.125:0/2338044021 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00b870 con 0x7f64fc06e400 2023-11-28T11:08:15.884 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.881+0000 7f65013e1700 1 -- 172.21.15.125:0/2338044021 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec00b9d0 con 0x7f64fc06e400 2023-11-28T11:08:15.885 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.881+0000 7f65013e1700 1 -- 172.21.15.125:0/2338044021 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00bd60 con 0x7f64fc06e400 2023-11-28T11:08:15.888 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.882+0000 7f6504647700 1 -- 172.21.15.125:0/2338044021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64fc06e400 msgr2=0x7f64fc06e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:15.888 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.882+0000 7f6504647700 1 --2- 172.21.15.125:0/2338044021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64fc06e400 0x7f64fc06e7d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0ce6e0 tx=0x7f64ec009bd0 comp rx=0 tx=0).stop 2023-11-28T11:08:15.888 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.882+0000 7f6504647700 1 -- 172.21.15.125:0/2338044021 shutdown_connections 2023-11-28T11:08:15.888 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.882+0000 7f6504647700 1 --2- 172.21.15.125:0/2338044021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64fc06e400 0x7f64fc06e7d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:15.888 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.882+0000 7f6504647700 1 --2- 172.21.15.125:0/2338044021 >> v2:172.21.15.167:3300/0 conn(0x7f64fc0d15f0 0x7f64fc15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:15.888 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.882+0000 7f6504647700 1 -- 172.21.15.125:0/2338044021 >> 172.21.15.125:0/2338044021 conn(0x7f64fc06a270 msgr2=0x7f64fc06a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:15.889 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.882+0000 7f6504647700 1 -- 172.21.15.125:0/2338044021 shutdown_connections 2023-11-28T11:08:15.889 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.882+0000 7f6504647700 1 -- 172.21.15.125:0/2338044021 wait complete. 2023-11-28T11:08:15.889 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.883+0000 7f6504647700 1 Processor -- start 2023-11-28T11:08:15.889 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.883+0000 7f6504647700 1 -- start start 2023-11-28T11:08:15.889 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f6504647700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64fc06e400 0x7f64fc1f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:15.889 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f6504647700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64fc0d15f0 0x7f64fc15d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:15.889 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f6504647700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64fc15e010 0x7f64fc0cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:15.889 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f6504647700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc1f1b40 con 0x7f64fc06e400 2023-11-28T11:08:15.890 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f6504647700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc15dd60 con 0x7f64fc15e010 2023-11-28T11:08:15.890 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f6504647700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc152be0 con 0x7f64fc0d15f0 2023-11-28T11:08:15.890 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f65023e3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64fc06e400 0x7f64fc1f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:15.890 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f65023e3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64fc06e400 0x7f64fc1f1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56078/0 (socket says 172.21.15.125:56078) 2023-11-28T11:08:15.890 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f65023e3700 1 -- 172.21.15.125:0/607019312 learned_addr learned my addr 172.21.15.125:0/607019312 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:15.890 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f6501be2700 1 --2- 172.21.15.125:0/607019312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64fc0d15f0 0x7f64fc15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:15.890 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f6502be4700 1 --2- 172.21.15.125:0/607019312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64fc15e010 0x7f64fc0cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:15.890 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f65023e3700 1 -- 172.21.15.125:0/607019312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64fc0d15f0 msgr2=0x7f64fc15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:15.890 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f65023e3700 1 --2- 172.21.15.125:0/607019312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64fc0d15f0 0x7f64fc15d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:15.891 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f65023e3700 1 -- 172.21.15.125:0/607019312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64fc15e010 msgr2=0x7f64fc0cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:15.891 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f65023e3700 1 --2- 172.21.15.125:0/607019312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64fc15e010 0x7f64fc0cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:15.891 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f65023e3700 1 -- 172.21.15.125:0/607019312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec009550 con 0x7f64fc06e400 2023-11-28T11:08:15.891 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.884+0000 7f65023e3700 1 --2- 172.21.15.125:0/607019312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64fc06e400 0x7f64fc1f1600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f64ec000c00 tx=0x7f64ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:15.891 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.885+0000 7f64f2ffd700 1 -- 172.21.15.125:0/607019312 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec004540 con 0x7f64fc06e400 2023-11-28T11:08:15.891 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.885+0000 7f64f2ffd700 1 -- 172.21.15.125:0/607019312 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec0036a0 con 0x7f64fc06e400 2023-11-28T11:08:15.891 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.885+0000 7f6504647700 1 -- 172.21.15.125:0/607019312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc15e980 con 0x7f64fc06e400 2023-11-28T11:08:15.891 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.885+0000 7f64f2ffd700 1 -- 172.21.15.125:0/607019312 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec003a50 con 0x7f64fc06e400 2023-11-28T11:08:15.891 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.885+0000 7f6504647700 1 -- 172.21.15.125:0/607019312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc06ed10 con 0x7f64fc06e400 2023-11-28T11:08:15.891 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.885+0000 7f64f2ffd700 1 -- 172.21.15.125:0/607019312 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f64ec00f050 con 0x7f64fc06e400 2023-11-28T11:08:15.891 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.885+0000 7f64f2ffd700 1 -- 172.21.15.125:0/607019312 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f64ec01b430 con 0x7f64fc06e400 2023-11-28T11:08:15.892 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.886+0000 7f6504647700 1 -- 172.21.15.125:0/607019312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64fc15ec60 con 0x7f64fc06e400 2023-11-28T11:08:15.892 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.888+0000 7f64f2ffd700 1 -- 172.21.15.125:0/607019312 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f64ec015020 con 0x7f64fc06e400 2023-11-28T11:08:15.959 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.958+0000 7f6504647700 1 -- 172.21.15.125:0/607019312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64fc0743f0 con 0x7f64fc06e400 2023-11-28T11:08:15.960 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.958+0000 7f64f2ffd700 1 -- 172.21.15.125:0/607019312 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f64ec003bb0 con 0x7f64fc06e400 2023-11-28T11:08:15.960 INFO:teuthology.misc.health.smithi125.stdout: 2023-11-28T11:08:15.960 INFO:teuthology.misc.health.smithi125.stdout:{"epoch":10,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:14.668319+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:15.961 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.959+0000 7f6504647700 1 -- 172.21.15.125:0/607019312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64fc06e400 msgr2=0x7f64fc1f1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:15.961 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.959+0000 7f6504647700 1 --2- 172.21.15.125:0/607019312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64fc06e400 0x7f64fc1f1600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f64ec000c00 tx=0x7f64ec004750 comp rx=0 tx=0).stop 2023-11-28T11:08:15.961 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.959+0000 7f6504647700 1 -- 172.21.15.125:0/607019312 shutdown_connections 2023-11-28T11:08:15.961 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.959+0000 7f6504647700 1 --2- 172.21.15.125:0/607019312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64fc15e010 0x7f64fc0cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:15.962 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.959+0000 7f6504647700 1 --2- 172.21.15.125:0/607019312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64fc06e400 0x7f64fc1f1600 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:15.962 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.959+0000 7f6504647700 1 --2- 172.21.15.125:0/607019312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64fc0d15f0 0x7f64fc15d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:15.962 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.959+0000 7f6504647700 1 -- 172.21.15.125:0/607019312 >> 172.21.15.125:0/607019312 conn(0x7f64fc06a270 msgr2=0x7f64fc150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:15.962 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.959+0000 7f6504647700 1 -- 172.21.15.125:0/607019312 shutdown_connections 2023-11-28T11:08:15.962 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:15.960+0000 7f6504647700 1 -- 172.21.15.125:0/607019312 wait complete. 2023-11-28T11:08:15.972 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T11:08:16.005 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:16.003+0000 7fb4fcd5d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T11:08:16.041 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:16.039+0000 7f669b719200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T11:08:16.175 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:16.174+0000 7f669b719200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T11:08:16.220 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:16.218+0000 7fb4fcd5d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T11:08:16.373 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:16.371+0000 7fb4fcd5d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T11:08:16.391 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:16.390+0000 7f669b719200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T11:08:16.487 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:16.486+0000 7fb4fcd5d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T11:08:16.547 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:16.546+0000 7f669b719200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T11:08:16.660 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:16.659+0000 7f669b719200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T11:08:16.804 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:16.803+0000 7fb4fcd5d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T11:08:16.902 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:16.900+0000 7fb4fcd5d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T11:08:16.983 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:16.983+0000 7f669b719200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T11:08:17.084 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:17.083+0000 7f669b719200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T11:08:17.084 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:17.082+0000 7fb4fcd5d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T11:08:17.269 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:17.268+0000 7f669b719200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T11:08:17.599 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:17.598+0000 7fb4fcd5d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T11:08:17.800 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-11-28T11:08:17.799+0000 7f669b719200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T11:08:18.625 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:18.623+0000 7fb4b3f8b700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T11:08:18.625 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-11-28T11:08:18.623+0000 7fb4b3f8b700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T11:08:18.826 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-11-28T11:08:18.821+0000 7fa4881e0640 -1 osd.2 0 log_to_monitors true 2023-11-28T11:08:18.826 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-11-28T11:08:18.825+0000 7ffa6dcba640 -1 osd.1 0 log_to_monitors true 2023-11-28T11:08:18.830 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-11-28T11:08:18.828+0000 7fd13b7fb640 -1 osd.3 0 log_to_monitors true 2023-11-28T11:08:18.834 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-11-28T11:08:18.832+0000 7f14d7c87640 -1 osd.0 0 log_to_monitors true 2023-11-28T11:08:18.845 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-11-28T11:08:18.844+0000 7ff5bd2aa640 -1 osd.6 0 log_to_monitors true 2023-11-28T11:08:18.858 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-11-28T11:08:18.857+0000 7efef965e640 -1 osd.4 0 log_to_monitors true 2023-11-28T11:08:18.888 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-11-28T11:08:18.887+0000 7f03d5b98640 -1 osd.5 0 log_to_monitors true 2023-11-28T11:08:18.888 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-11-28T11:08:18.887+0000 7fd184fac640 -1 osd.7 0 log_to_monitors true 2023-11-28T11:08:22.675 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-11-28T11:08:22.673+0000 7f03c974f700 -1 osd.5 0 waiting for initial osdmap 2023-11-28T11:08:22.675 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-11-28T11:08:22.673+0000 7fd178b63700 -1 osd.7 0 waiting for initial osdmap 2023-11-28T11:08:22.683 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-11-28T11:08:22.682+0000 7efeed215700 -1 osd.4 0 waiting for initial osdmap 2023-11-28T11:08:22.685 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-11-28T11:08:22.685+0000 7f03c1b2a700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:08:22.686 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-11-28T11:08:22.685+0000 7ffa61871700 -1 osd.1 0 waiting for initial osdmap 2023-11-28T11:08:22.686 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-11-28T11:08:22.686+0000 7fd170f3e700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:08:22.688 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-11-28T11:08:22.688+0000 7ff5b0e61700 -1 osd.6 0 waiting for initial osdmap 2023-11-28T11:08:22.702 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-11-28T11:08:22.700+0000 7efee55f0700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:08:22.702 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-11-28T11:08:22.700+0000 7ffa59c4c700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:08:22.703 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-11-28T11:08:22.703+0000 7ff5a923c700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:08:22.724 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-11-28T11:08:22.723+0000 7fa47bd97700 -1 osd.2 0 waiting for initial osdmap 2023-11-28T11:08:22.737 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-11-28T11:08:22.736+0000 7fd12f3b2700 -1 osd.3 0 waiting for initial osdmap 2023-11-28T11:08:22.741 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-11-28T11:08:22.740+0000 7fa474172700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:08:22.751 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-11-28T11:08:22.750+0000 7f14cb83e700 -1 osd.0 0 waiting for initial osdmap 2023-11-28T11:08:22.753 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-11-28T11:08:22.752+0000 7fd12778d700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:08:22.765 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-11-28T11:08:22.764+0000 7f14c3c19700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:08:22.778 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:22.889 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.888+0000 7f26af0c2700 1 Processor -- start 2023-11-28T11:08:22.889 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.888+0000 7f26af0c2700 1 -- start start 2023-11-28T11:08:22.893 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.888+0000 7f26af0c2700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26a815cc80 0x7f26a806de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:22.893 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.888+0000 7f26af0c2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a80b1810 con 0x7f26a806a270 2023-11-28T11:08:22.894 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.888+0000 7f26af0c2700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a80b1af0 con 0x7f26a806e3a0 2023-11-28T11:08:22.894 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.888+0000 7f26af0c2700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a80b2490 con 0x7f26a815cc80 2023-11-28T11:08:22.894 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26ace5e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f26a806a270 0x7f26a806a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40308/0 (socket says 172.21.15.125:40308) 2023-11-28T11:08:22.894 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26ace5e700 1 -- 172.21.15.125:0/2786553125 learned_addr learned my addr 172.21.15.125:0/2786553125 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:22.894 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a7fff700 1 --2- 172.21.15.125:0/2786553125 >> v2:172.21.15.167:3300/0 conn(0x7f26a815cc80 0x7f26a806de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:22.894 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612925414 0 0) 0x7f26a80b1810 con 0x7f26a806a270 2023-11-28T11:08:22.894 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26980035b0 con 0x7f26a806a270 2023-11-28T11:08:22.894 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946994716 0 0) 0x7f26a80b1af0 con 0x7f26a806e3a0 2023-11-28T11:08:22.894 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a80b1810 con 0x7f26a806e3a0 2023-11-28T11:08:22.894 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2932861577 0 0) 0x7f26980035b0 con 0x7f26a806a270 2023-11-28T11:08:22.894 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 >> v2:172.21.15.167:3300/0 conn(0x7f26a815cc80 msgr2=0x7f26a806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:22.895 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 --2- 172.21.15.125:0/2786553125 >> v2:172.21.15.167:3300/0 conn(0x7f26a815cc80 0x7f26a806de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:22.895 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 >> v1:172.21.15.167:6789/0 conn(0x7f26a806e3a0 legacy=0x7f26a8070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:22.895 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a80b1dd0 con 0x7f26a806a270 2023-11-28T11:08:22.895 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f269c001670 con 0x7f26a806a270 2023-11-28T11:08:22.895 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 >> v1:172.21.15.125:6789/0 conn(0x7f26a806a270 legacy=0x7f26a806a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:22.895 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 --2- 172.21.15.125:0/2786553125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2698003b90 0x7f2698003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:22.895 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 --2- 172.21.15.125:0/2786553125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 0x7f2698004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:22.895 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 --2- 172.21.15.125:0/2786553125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2698005270 0x7f269800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:22.895 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80b2490 con 0x7f2698004850 2023-11-28T11:08:22.895 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269800c1b0 con 0x7f2698003b90 2023-11-28T11:08:22.895 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269800c370 con 0x7f2698005270 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a7fff700 1 --2- 172.21.15.125:0/2786553125 >> v2:172.21.15.167:3300/0 conn(0x7f26a815cc80 0x7f26a806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26a7fff700 1 --2- 172.21.15.125:0/2786553125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 0x7f2698004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26ace5e700 1 --2- 172.21.15.125:0/2786553125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2698003b90 0x7f2698003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.889+0000 7f26ad65f700 1 --2- 172.21.15.125:0/2786553125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2698005270 0x7f269800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26a7fff700 1 -- 172.21.15.125:0/2786553125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2698005270 msgr2=0x7f269800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26a7fff700 1 --2- 172.21.15.125:0/2786553125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2698005270 0x7f269800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26a7fff700 1 -- 172.21.15.125:0/2786553125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2698003b90 msgr2=0x7f2698003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26a7fff700 1 --2- 172.21.15.125:0/2786553125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2698003b90 0x7f2698003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26a7fff700 1 -- 172.21.15.125:0/2786553125 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26980035b0 con 0x7f2698004850 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26ad65f700 1 -- 172.21.15.125:0/2786553125 reap_dead start 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26a7fff700 1 --2- 172.21.15.125:0/2786553125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 0x7f2698004cc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2694009d10 tx=0x7f2698005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4501612c2720e819 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:22.896 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694009e60 con 0x7f2698004850 2023-11-28T11:08:22.897 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269400e9a0 con 0x7f2698004850 2023-11-28T11:08:22.897 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26a77fe700 1 -- 172.21.15.125:0/2786553125 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400ed10 con 0x7f2698004850 2023-11-28T11:08:22.897 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26af0c2700 1 -- 172.21.15.125:0/2786553125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 msgr2=0x7f2698004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:22.897 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26af0c2700 1 --2- 172.21.15.125:0/2786553125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 0x7f2698004cc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2694009d10 tx=0x7f2698005880 comp rx=0 tx=0).stop 2023-11-28T11:08:22.897 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26af0c2700 1 -- 172.21.15.125:0/2786553125 shutdown_connections 2023-11-28T11:08:22.897 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26af0c2700 1 --2- 172.21.15.125:0/2786553125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 0x7f2698004cc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:22.897 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26af0c2700 1 -- 172.21.15.125:0/2786553125 >> 172.21.15.125:0/2786553125 conn(0x7f26a806c010 msgr2=0x7f26a80cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:22.897 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26af0c2700 1 -- 172.21.15.125:0/2786553125 shutdown_connections 2023-11-28T11:08:22.897 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.890+0000 7f26af0c2700 1 -- 172.21.15.125:0/2786553125 wait complete. 2023-11-28T11:08:22.897 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.892+0000 7f26af0c2700 1 Processor -- start 2023-11-28T11:08:22.897 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.892+0000 7f26af0c2700 1 -- start start 2023-11-28T11:08:22.900 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26af0c2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 0x7f26a8153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:22.900 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26af0c2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a815ec20 0x7f26a815f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:22.900 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26af0c2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a80ca880 0x7f26a80cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:22.900 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26af0c2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8157ec0 con 0x7f2698004850 2023-11-28T11:08:22.900 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26af0c2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8153770 con 0x7f26a80ca880 2023-11-28T11:08:22.901 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26af0c2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a815f5d0 con 0x7f26a815ec20 2023-11-28T11:08:22.901 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26ace5e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 0x7f26a8153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:22.901 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26ace5e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 0x7f26a8153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56196/0 (socket says 172.21.15.125:56196) 2023-11-28T11:08:22.901 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26ace5e700 1 -- 172.21.15.125:0/3210749761 learned_addr learned my addr 172.21.15.125:0/3210749761 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:22.901 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26a7fff700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a815ec20 0x7f26a815f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:22.901 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26ad65f700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a80ca880 0x7f26a80cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:22.901 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26ace5e700 1 -- 172.21.15.125:0/3210749761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a815ec20 msgr2=0x7f26a815f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:22.901 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26ace5e700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a815ec20 0x7f26a815f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:22.901 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26ace5e700 1 -- 172.21.15.125:0/3210749761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a80ca880 msgr2=0x7f26a80cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:22.901 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26ace5e700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a80ca880 0x7f26a80cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:22.901 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26ace5e700 1 -- 172.21.15.125:0/3210749761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a806e7c0 con 0x7f2698004850 2023-11-28T11:08:22.902 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26ace5e700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 0x7f26a8153230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f269c007370 tx=0x7f269c007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:22.902 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26a57fa700 1 -- 172.21.15.125:0/3210749761 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c00f6c0 con 0x7f2698004850 2023-11-28T11:08:22.902 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26a57fa700 1 -- 172.21.15.125:0/3210749761 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c00f840 con 0x7f2698004850 2023-11-28T11:08:22.902 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26af0c2700 1 -- 172.21.15.125:0/3210749761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a80b20b0 con 0x7f2698004850 2023-11-28T11:08:22.902 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26a57fa700 1 -- 172.21.15.125:0/3210749761 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c00fbf0 con 0x7f2698004850 2023-11-28T11:08:22.902 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.893+0000 7f26af0c2700 1 -- 172.21.15.125:0/3210749761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a80cc570 con 0x7f2698004850 2023-11-28T11:08:22.902 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.894+0000 7f26af0c2700 1 -- 172.21.15.125:0/3210749761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a806e950 con 0x7f2698004850 2023-11-28T11:08:22.902 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.895+0000 7f26a57fa700 1 -- 172.21.15.125:0/3210749761 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7f269c01c030 con 0x7f2698004850 2023-11-28T11:08:22.902 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.895+0000 7f26a57fa700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f268c0682a0 0x7f268c06a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:22.902 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.895+0000 7f26a57fa700 1 -- 172.21.15.125:0/3210749761 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f269c084510 con 0x7f2698004850 2023-11-28T11:08:22.903 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.895+0000 7f26a7fff700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f268c0682a0 0x7f268c06a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:22.903 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.895+0000 7f26a7fff700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f268c0682a0 0x7f268c06a750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f26940090b0 tx=0x7f269401e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:22.905 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:22.899+0000 7f26a57fa700 1 -- 172.21.15.125:0/3210749761 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f26a806e950 con 0x7f2698004850 2023-11-28T11:08:23.086 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.085+0000 7f26af0c2700 1 -- 172.21.15.125:0/3210749761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26a806e950 con 0x7f2698004850 2023-11-28T11:08:23.087 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.085+0000 7f26a57fa700 1 -- 172.21.15.125:0/3210749761 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f26a806e950 con 0x7f2698004850 2023-11-28T11:08:23.087 INFO:teuthology.misc.health.smithi125.stdout: 2023-11-28T11:08:23.087 INFO:teuthology.misc.health.smithi125.stdout:{"epoch":12,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:20.620516+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:23.089 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 -- 172.21.15.125:0/3210749761 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f268c0682a0 msgr2=0x7f268c06a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:23.089 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f268c0682a0 0x7f268c06a750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f26940090b0 tx=0x7f269401e040 comp rx=0 tx=0).stop 2023-11-28T11:08:23.089 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 -- 172.21.15.125:0/3210749761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 msgr2=0x7f26a8153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:23.090 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 0x7f26a8153230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f269c007370 tx=0x7f269c007680 comp rx=0 tx=0).stop 2023-11-28T11:08:23.090 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 -- 172.21.15.125:0/3210749761 shutdown_connections 2023-11-28T11:08:23.090 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a80ca880 0x7f26a80cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:23.090 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2698004850 0x7f26a8153230 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:23.090 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f268c0682a0 0x7f268c06a750 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:23.090 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 --2- 172.21.15.125:0/3210749761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a815ec20 0x7f26a815f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:23.090 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 -- 172.21.15.125:0/3210749761 >> 172.21.15.125:0/3210749761 conn(0x7f26a806c010 msgr2=0x7f26a80b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:23.090 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 -- 172.21.15.125:0/3210749761 shutdown_connections 2023-11-28T11:08:23.090 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:23.087+0000 7f26af0c2700 1 -- 172.21.15.125:0/3210749761 wait complete. 2023-11-28T11:08:23.100 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T11:08:29.907 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:30.029 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.027+0000 7f9b0054a700 1 Processor -- start 2023-11-28T11:08:30.029 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.027+0000 7f9b0054a700 1 -- start start 2023-11-28T11:08:30.031 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.028+0000 7f9b0054a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9af8142db0 0x7f9af813ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.031 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.028+0000 7f9b0054a700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9af80b1770 0x7f9af80b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.031 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.028+0000 7f9b0054a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af815e010 con 0x7f9af80ce040 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.028+0000 7f9b0054a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af813fc90 con 0x7f9af8142db0 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.028+0000 7f9b0054a700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af80b20d0 con 0x7f9af80b1770 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.028+0000 7f9afdae5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9af8142db0 0x7f9af813ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afdae5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9af8142db0 0x7f9af813ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56426/0 (socket says 172.21.15.125:56426) 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afe2e6700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9af80ce040 0x7f9af815d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40554/0 (socket says 172.21.15.125:40554) 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afdae5700 1 -- 172.21.15.125:0/1327717442 learned_addr learned my addr 172.21.15.125:0/1327717442 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afeae7700 1 --2- 172.21.15.125:0/1327717442 >> v2:172.21.15.167:3300/0 conn(0x7f9af80b1770 0x7f9af80b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afdae5700 1 -- 172.21.15.125:0/1327717442 >> v2:172.21.15.167:3300/0 conn(0x7f9af80b1770 msgr2=0x7f9af80b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afd2e4700 1 -- 172.21.15.125:0/1327717442 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270008995 0 0) 0x7f9ae8001110 con 0x7f9af80ce040 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afdae5700 1 --2- 172.21.15.125:0/1327717442 >> v2:172.21.15.167:3300/0 conn(0x7f9af80b1770 0x7f9af80b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afdae5700 1 -- 172.21.15.125:0/1327717442 >> v1:172.21.15.125:6789/0 conn(0x7f9af80ce040 legacy=0x7f9af815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.032 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afdae5700 1 -- 172.21.15.125:0/1327717442 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af813f6d0 con 0x7f9af8142db0 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afdae5700 1 --2- 172.21.15.125:0/1327717442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9af8142db0 0x7f9af813ed70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9af8142cd0 tx=0x7f9af4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ff5206e4c802a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afd2e4700 1 -- 172.21.15.125:0/1327717442 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4011830 con 0x7f9af8142db0 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afd2e4700 1 -- 172.21.15.125:0/1327717442 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af4011990 con 0x7f9af8142db0 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.029+0000 7f9afd2e4700 1 -- 172.21.15.125:0/1327717442 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4011d20 con 0x7f9af8142db0 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.030+0000 7f9b0054a700 1 -- 172.21.15.125:0/1327717442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9af8142db0 msgr2=0x7f9af813ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.030+0000 7f9b0054a700 1 --2- 172.21.15.125:0/1327717442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9af8142db0 0x7f9af813ed70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9af8142cd0 tx=0x7f9af4009bd0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.030+0000 7f9b0054a700 1 -- 172.21.15.125:0/1327717442 shutdown_connections 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.030+0000 7f9b0054a700 1 --2- 172.21.15.125:0/1327717442 >> v2:172.21.15.167:3300/0 conn(0x7f9af80b1770 0x7f9af80b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.030+0000 7f9b0054a700 1 --2- 172.21.15.125:0/1327717442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9af8142db0 0x7f9af813ed70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.030+0000 7f9b0054a700 1 -- 172.21.15.125:0/1327717442 >> 172.21.15.125:0/1327717442 conn(0x7f9af806c010 msgr2=0x7f9af80cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.030+0000 7f9b0054a700 1 -- 172.21.15.125:0/1327717442 shutdown_connections 2023-11-28T11:08:30.033 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.030+0000 7f9b0054a700 1 -- 172.21.15.125:0/1327717442 wait complete. 2023-11-28T11:08:30.036 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.031+0000 7f9b0054a700 1 Processor -- start 2023-11-28T11:08:30.036 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.031+0000 7f9b0054a700 1 -- start start 2023-11-28T11:08:30.036 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9b0054a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af80b1770 0x7f9af8154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.036 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9b0054a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9af80ce040 0x7f9af80b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.037 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9b0054a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9af8142db0 0x7f9af80b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.037 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9b0054a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af81efc80 con 0x7f9af80ce040 2023-11-28T11:08:30.037 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9b0054a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af8155490 con 0x7f9af8142db0 2023-11-28T11:08:30.037 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9b0054a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af80c6fd0 con 0x7f9af80b1770 2023-11-28T11:08:30.037 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afdae5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9af80ce040 0x7f9af80b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.037 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afdae5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9af80ce040 0x7f9af80b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56434/0 (socket says 172.21.15.125:56434) 2023-11-28T11:08:30.037 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afdae5700 1 -- 172.21.15.125:0/85878535 learned_addr learned my addr 172.21.15.125:0/85878535 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:30.037 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afe2e6700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af80b1770 0x7f9af8154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.037 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afeae7700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9af8142db0 0x7f9af80b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.037 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afdae5700 1 -- 172.21.15.125:0/85878535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af80b1770 msgr2=0x7f9af8154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.037 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afdae5700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af80b1770 0x7f9af8154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afdae5700 1 -- 172.21.15.125:0/85878535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9af8142db0 msgr2=0x7f9af80b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afdae5700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9af8142db0 0x7f9af80b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afdae5700 1 -- 172.21.15.125:0/85878535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4009550 con 0x7f9af80ce040 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afe2e6700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af80b1770 0x7f9af8154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afeae7700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9af8142db0 0x7f9af80b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9afdae5700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9af80ce040 0x7f9af80b3ef0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009f20 tx=0x7f9af4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9aeeffd700 1 -- 172.21.15.125:0/85878535 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4004590 con 0x7f9af80ce040 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9aeeffd700 1 -- 172.21.15.125:0/85878535 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af40036a0 con 0x7f9af80ce040 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9aeeffd700 1 -- 172.21.15.125:0/85878535 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4003a10 con 0x7f9af80ce040 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.032+0000 7f9b0054a700 1 -- 172.21.15.125:0/85878535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af815d100 con 0x7f9af80ce040 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.033+0000 7f9b0054a700 1 -- 172.21.15.125:0/85878535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af813f9b0 con 0x7f9af80ce040 2023-11-28T11:08:30.038 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.033+0000 7f9b0054a700 1 -- 172.21.15.125:0/85878535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af815d3e0 con 0x7f9af80ce040 2023-11-28T11:08:30.039 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.034+0000 7f9aeeffd700 1 -- 172.21.15.125:0/85878535 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9af4023070 con 0x7f9af80ce040 2023-11-28T11:08:30.039 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.034+0000 7f9aeeffd700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9adc0682f0 0x7f9adc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.039 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.034+0000 7f9aeeffd700 1 -- 172.21.15.125:0/85878535 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9af4086e70 con 0x7f9af80ce040 2023-11-28T11:08:30.039 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.034+0000 7f9afe2e6700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9adc0682f0 0x7f9adc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.039 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.034+0000 7f9afe2e6700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9adc0682f0 0x7f9adc06a7a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000f60 tx=0x7f9ae8007ae0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:30.040 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.039+0000 7f9aeeffd700 1 -- 172.21.15.125:0/85878535 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9af4053b80 con 0x7f9af80ce040 2023-11-28T11:08:30.224 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.223+0000 7f9b0054a700 1 -- 172.21.15.125:0/85878535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9af81efdc0 con 0x7f9af80ce040 2023-11-28T11:08:30.225 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.224+0000 7f9aeeffd700 1 -- 172.21.15.125:0/85878535 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12526 (secure 0 0 0) 0x7f9af81efdc0 con 0x7f9af80ce040 2023-11-28T11:08:30.225 INFO:teuthology.misc.health.smithi125.stdout: 2023-11-28T11:08:30.226 INFO:teuthology.misc.health.smithi125.stdout:{"epoch":17,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:27.768093+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:30.228 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 -- 172.21.15.125:0/85878535 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9adc0682f0 msgr2=0x7f9adc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.228 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9adc0682f0 0x7f9adc06a7a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000f60 tx=0x7f9ae8007ae0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.228 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 -- 172.21.15.125:0/85878535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9af80ce040 msgr2=0x7f9af80b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.228 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9af80ce040 0x7f9af80b3ef0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009f20 tx=0x7f9af4004750 comp rx=0 tx=0).stop 2023-11-28T11:08:30.228 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 -- 172.21.15.125:0/85878535 shutdown_connections 2023-11-28T11:08:30.229 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9af8142db0 0x7f9af80b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.229 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9adc0682f0 0x7f9adc06a7a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.229 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af80b1770 0x7f9af8154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.230 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 --2- 172.21.15.125:0/85878535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9af80ce040 0x7f9af80b3ef0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.230 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 -- 172.21.15.125:0/85878535 >> 172.21.15.125:0/85878535 conn(0x7f9af806c010 msgr2=0x7f9af8071510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:30.230 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 -- 172.21.15.125:0/85878535 shutdown_connections 2023-11-28T11:08:30.230 INFO:teuthology.misc.health.smithi125.stderr:2023-11-28T11:08:30.226+0000 7f9b0054a700 1 -- 172.21.15.125:0/85878535 wait complete. 2023-11-28T11:08:30.239 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T11:08:30.239 INFO:tasks.ceph:Creating RBD pool 2023-11-28T11:08:30.239 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-28T11:08:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.356+0000 7fd9f99e9700 1 Processor -- start 2023-11-28T11:08:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.356+0000 7fd9f99e9700 1 -- start start 2023-11-28T11:08:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f99e9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9f40cec00 0x7fd9f4065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f99e9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd9f40cac90 0x7fd9f40cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f99e9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f415ceb0 con 0x7fd9f4160300 2023-11-28T11:08:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f99e9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f40cb650 con 0x7fd9f40cac90 2023-11-28T11:08:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f99e9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41608c0 con 0x7fd9f40cec00 2023-11-28T11:08:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd9f40cac90 0x7fd9f40cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f27fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd9f4160300 0x7fd9f415d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40566/0 (socket says 172.21.15.125:40566) 2023-11-28T11:08:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f27fc700 1 -- 172.21.15.125:0/1145625483 learned_addr learned my addr 172.21.15.125:0/1145625483 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f2ffd700 1 --2- 172.21.15.125:0/1145625483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9f40cec00 0x7fd9f4065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f37fe700 1 -- 172.21.15.125:0/1145625483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9f40cec00 msgr2=0x7fd9f4065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f37fe700 1 --2- 172.21.15.125:0/1145625483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9f40cec00 0x7fd9f4065fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f37fe700 1 -- 172.21.15.125:0/1145625483 >> v1:172.21.15.125:6789/0 conn(0x7fd9f4160300 legacy=0x7fd9f415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f37fe700 1 -- 172.21.15.125:0/1145625483 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4160ba0 con 0x7fd9f40cac90 2023-11-28T11:08:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f1ffb700 1 -- 172.21.15.125:0/1145625483 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429881584 0 0) 0x7fd9f415ceb0 con 0x7fd9f4160300 2023-11-28T11:08:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.357+0000 7fd9f37fe700 1 --2- 172.21.15.125:0/1145625483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9f40cac90 0x7fd9f40cb110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009d90 tx=0x7fd9e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6485b109787829e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.358+0000 7fd9f1ffb700 1 -- 172.21.15.125:0/1145625483 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e400e070 con 0x7fd9f40cac90 2023-11-28T11:08:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.358+0000 7fd9f1ffb700 1 -- 172.21.15.125:0/1145625483 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e400bb20 con 0x7fd9f40cac90 2023-11-28T11:08:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.358+0000 7fd9f1ffb700 1 -- 172.21.15.125:0/1145625483 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4012430 con 0x7fd9f40cac90 2023-11-28T11:08:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.358+0000 7fd9f99e9700 1 -- 172.21.15.125:0/1145625483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9f40cac90 msgr2=0x7fd9f40cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.358+0000 7fd9f99e9700 1 --2- 172.21.15.125:0/1145625483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9f40cac90 0x7fd9f40cb110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009d90 tx=0x7fd9e400b330 comp rx=0 tx=0).stop 2023-11-28T11:08:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.358+0000 7fd9f99e9700 1 -- 172.21.15.125:0/1145625483 shutdown_connections 2023-11-28T11:08:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.358+0000 7fd9f99e9700 1 --2- 172.21.15.125:0/1145625483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9f40cac90 0x7fd9f40cb110 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.358+0000 7fd9f99e9700 1 --2- 172.21.15.125:0/1145625483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9f40cec00 0x7fd9f4065fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.358+0000 7fd9f99e9700 1 -- 172.21.15.125:0/1145625483 >> 172.21.15.125:0/1145625483 conn(0x7fd9f40cf400 msgr2=0x7fd9f40cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.358+0000 7fd9f99e9700 1 -- 172.21.15.125:0/1145625483 shutdown_connections 2023-11-28T11:08:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.358+0000 7fd9f99e9700 1 -- 172.21.15.125:0/1145625483 wait complete. 2023-11-28T11:08:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.359+0000 7fd9f99e9700 1 Processor -- start 2023-11-28T11:08:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.360+0000 7fd9f99e9700 1 -- start start 2023-11-28T11:08:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.360+0000 7fd9f99e9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f40cac90 0x7fd9f4154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.360+0000 7fd9f99e9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9f40cec00 0x7fd9f40add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.360+0000 7fd9f99e9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9f4160300 0x7fd9f4155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.360+0000 7fd9f99e9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40ae8d0 con 0x7fd9f4160300 2023-11-28T11:08:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.360+0000 7fd9f99e9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40ae270 con 0x7fd9f40cac90 2023-11-28T11:08:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.360+0000 7fd9f99e9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40acd80 con 0x7fd9f40cec00 2023-11-28T11:08:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.360+0000 7fd9f37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9f4160300 0x7fd9f4155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.360+0000 7fd9f37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9f4160300 0x7fd9f4155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56450/0 (socket says 172.21.15.125:56450) 2023-11-28T11:08:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.360+0000 7fd9f37fe700 1 -- 172.21.15.125:0/2999192121 learned_addr learned my addr 172.21.15.125:0/2999192121 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f37fe700 1 -- 172.21.15.125:0/2999192121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9f40cec00 msgr2=0x7fd9f40add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f2ffd700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f40cac90 0x7fd9f4154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f27fc700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9f40cec00 0x7fd9f40add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f37fe700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9f40cec00 0x7fd9f40add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f37fe700 1 -- 172.21.15.125:0/2999192121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f40cac90 msgr2=0x7fd9f4154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f37fe700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f40cac90 0x7fd9f4154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f37fe700 1 -- 172.21.15.125:0/2999192121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e4009a70 con 0x7fd9f4160300 2023-11-28T11:08:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f2ffd700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f40cac90 0x7fd9f4154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f27fc700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9f40cec00 0x7fd9f40add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f37fe700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9f4160300 0x7fd9f4155340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd9f406beb0 tx=0x7fd9e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9dbfff700 1 -- 172.21.15.125:0/2999192121 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4012430 con 0x7fd9f4160300 2023-11-28T11:08:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9dbfff700 1 -- 172.21.15.125:0/2999192121 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e4020070 con 0x7fd9f4160300 2023-11-28T11:08:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f99e9700 1 -- 172.21.15.125:0/2999192121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f4161160 con 0x7fd9f4160300 2023-11-28T11:08:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9dbfff700 1 -- 172.21.15.125:0/2999192121 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4004280 con 0x7fd9f4160300 2023-11-28T11:08:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.361+0000 7fd9f99e9700 1 -- 172.21.15.125:0/2999192121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f4160e80 con 0x7fd9f4160300 2023-11-28T11:08:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.362+0000 7fd9f99e9700 1 -- 172.21.15.125:0/2999192121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f4066510 con 0x7fd9f4160300 2023-11-28T11:08:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.362+0000 7fd9dbfff700 1 -- 172.21.15.125:0/2999192121 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd9e40043e0 con 0x7fd9f4160300 2023-11-28T11:08:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.363+0000 7fd9dbfff700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9e00682f0 0x7fd9e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.363+0000 7fd9f2ffd700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9e00682f0 0x7fd9e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.363+0000 7fd9dbfff700 1 -- 172.21.15.125:0/2999192121 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd9e4022070 con 0x7fd9f4160300 2023-11-28T11:08:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.363+0000 7fd9f2ffd700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9e00682f0 0x7fd9e006a7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9f415c840 tx=0x7fd9ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:30.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.367+0000 7fd9dbfff700 1 -- 172.21.15.125:0/2999192121 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd9e40548a0 con 0x7fd9f4160300 2023-11-28T11:08:30.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.550+0000 7fd9f99e9700 1 -- 172.21.15.125:0/2999192121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fd9f40aea10 con 0x7fd9f4160300 2023-11-28T11:08:30.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.780+0000 7fd9dbfff700 1 -- 172.21.15.125:0/2999192121 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fd9e4057ec0 con 0x7fd9f4160300 2023-11-28T11:08:30.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 -- 172.21.15.125:0/2999192121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9e00682f0 msgr2=0x7fd9e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9e00682f0 0x7fd9e006a7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9f415c840 tx=0x7fd9ec008040 comp rx=0 tx=0).stop 2023-11-28T11:08:30.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 -- 172.21.15.125:0/2999192121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9f4160300 msgr2=0x7fd9f4155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9f4160300 0x7fd9f4155340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd9f406beb0 tx=0x7fd9e4004ad0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 -- 172.21.15.125:0/2999192121 shutdown_connections 2023-11-28T11:08:30.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9f4160300 0x7fd9f4155340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f40cac90 0x7fd9f4154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9e00682f0 0x7fd9e006a7a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 --2- 172.21.15.125:0/2999192121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9f40cec00 0x7fd9f40add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 -- 172.21.15.125:0/2999192121 >> 172.21.15.125:0/2999192121 conn(0x7fd9f40cf400 msgr2=0x7fd9f415f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:30.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 -- 172.21.15.125:0/2999192121 shutdown_connections 2023-11-28T11:08:30.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.782+0000 7fd9f99e9700 1 -- 172.21.15.125:0/2999192121 wait complete. 2023-11-28T11:08:30.786 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'rbd' created 2023-11-28T11:08:30.796 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-28T11:08:30.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.916+0000 7f409f88a700 1 Processor -- start 2023-11-28T11:08:30.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.916+0000 7f409f88a700 1 -- start start 2023-11-28T11:08:30.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.917+0000 7f409f88a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40980ceea0 0x7f409815a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.917+0000 7f409f88a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40980cea10 con 0x7f409806ba90 2023-11-28T11:08:30.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.917+0000 7f409f88a700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40980cbd10 con 0x7f409815e070 2023-11-28T11:08:30.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.917+0000 7f409f88a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409815ae80 con 0x7f40980ceea0 2023-11-28T11:08:30.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.917+0000 7f409ce25700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f409806ba90 0x7f409815a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40578/0 (socket says 172.21.15.125:40578) 2023-11-28T11:08:30.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.917+0000 7f409ce25700 1 -- 172.21.15.125:0/414846530 learned_addr learned my addr 172.21.15.125:0/414846530 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:30.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.917+0000 7f409de27700 1 --2- 172.21.15.125:0/414846530 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40980ceea0 0x7f409815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.917+0000 7f408ffff700 1 -- 172.21.15.125:0/414846530 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476181827 0 0) 0x7f40980cea10 con 0x7f409806ba90 2023-11-28T11:08:30.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.917+0000 7f408ffff700 1 -- 172.21.15.125:0/414846530 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40840035b0 con 0x7f409806ba90 2023-11-28T11:08:30.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.918+0000 7f408ffff700 1 -- 172.21.15.125:0/414846530 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514837205 0 0) 0x7f40980cbd10 con 0x7f409815e070 2023-11-28T11:08:30.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.918+0000 7f408ffff700 1 -- 172.21.15.125:0/414846530 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40980cea10 con 0x7f409815e070 2023-11-28T11:08:30.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.918+0000 7f409de27700 1 -- 172.21.15.125:0/414846530 >> v1:172.21.15.167:6789/0 conn(0x7f409815e070 legacy=0x7f409806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.918+0000 7f409de27700 1 -- 172.21.15.125:0/414846530 >> v1:172.21.15.125:6789/0 conn(0x7f409806ba90 legacy=0x7f409815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.918+0000 7f409de27700 1 -- 172.21.15.125:0/414846530 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40980ce0e0 con 0x7f40980ceea0 2023-11-28T11:08:30.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.918+0000 7f409de27700 1 --2- 172.21.15.125:0/414846530 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40980ceea0 0x7f409815a860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4090009dc0 tx=0x7f409000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60c36366745998fb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:30.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.918+0000 7f408ffff700 1 -- 172.21.15.125:0/414846530 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409000bd20 con 0x7f40980ceea0 2023-11-28T11:08:30.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.918+0000 7f408ffff700 1 -- 172.21.15.125:0/414846530 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409000be80 con 0x7f40980ceea0 2023-11-28T11:08:30.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.918+0000 7f408ffff700 1 -- 172.21.15.125:0/414846530 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090010710 con 0x7f40980ceea0 2023-11-28T11:08:30.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.919+0000 7f409f88a700 1 -- 172.21.15.125:0/414846530 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40980ceea0 msgr2=0x7f409815a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.919+0000 7f409f88a700 1 --2- 172.21.15.125:0/414846530 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40980ceea0 0x7f409815a860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4090009dc0 tx=0x7f409000b330 comp rx=0 tx=0).stop 2023-11-28T11:08:30.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.919+0000 7f409f88a700 1 -- 172.21.15.125:0/414846530 shutdown_connections 2023-11-28T11:08:30.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.919+0000 7f409f88a700 1 --2- 172.21.15.125:0/414846530 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40980ceea0 0x7f409815a860 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.919+0000 7f409f88a700 1 -- 172.21.15.125:0/414846530 >> 172.21.15.125:0/414846530 conn(0x7f40980cfc30 msgr2=0x7f40980d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:30.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.919+0000 7f409f88a700 1 -- 172.21.15.125:0/414846530 shutdown_connections 2023-11-28T11:08:30.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.919+0000 7f409f88a700 1 -- 172.21.15.125:0/414846530 wait complete. 2023-11-28T11:08:30.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.920+0000 7f409f88a700 1 Processor -- start 2023-11-28T11:08:30.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.920+0000 7f409f88a700 1 -- start start 2023-11-28T11:08:30.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409f88a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f409806ba90 0x7f409813f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409f88a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40980ceea0 0x7f40981ef750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409f88a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f409815e070 0x7f409815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409f88a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409814d560 con 0x7f409806ba90 2023-11-28T11:08:30.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409f88a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409814d840 con 0x7f40980ceea0 2023-11-28T11:08:30.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409f88a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409814db20 con 0x7f409815e070 2023-11-28T11:08:30.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409d626700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f409806ba90 0x7f409813f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409d626700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f409806ba90 0x7f409813f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56462/0 (socket says 172.21.15.125:56462) 2023-11-28T11:08:30.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409d626700 1 -- 172.21.15.125:0/872067977 learned_addr learned my addr 172.21.15.125:0/872067977 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:30.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409ce25700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40980ceea0 0x7f40981ef750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409de27700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f409815e070 0x7f409815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409d626700 1 -- 172.21.15.125:0/872067977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f409815e070 msgr2=0x7f409815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409d626700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f409815e070 0x7f409815b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409d626700 1 -- 172.21.15.125:0/872067977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40980ceea0 msgr2=0x7f40981ef750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:30.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409d626700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40980ceea0 0x7f40981ef750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:30.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409d626700 1 -- 172.21.15.125:0/872067977 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090009a70 con 0x7f409806ba90 2023-11-28T11:08:30.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409de27700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f409815e070 0x7f409815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:30.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409ce25700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40980ceea0 0x7f40981ef750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:30.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.921+0000 7f409d626700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f409806ba90 0x7f409813f960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f409400c500 tx=0x7f409400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:30.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.922+0000 7f408dffb700 1 -- 172.21.15.125:0/872067977 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940052d0 con 0x7f409806ba90 2023-11-28T11:08:30.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.922+0000 7f408dffb700 1 -- 172.21.15.125:0/872067977 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4094005450 con 0x7f409806ba90 2023-11-28T11:08:30.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.922+0000 7f408dffb700 1 -- 172.21.15.125:0/872067977 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940038c0 con 0x7f409806ba90 2023-11-28T11:08:30.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.922+0000 7f409f88a700 1 -- 172.21.15.125:0/872067977 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40980ce6a0 con 0x7f409806ba90 2023-11-28T11:08:30.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.922+0000 7f409f88a700 1 -- 172.21.15.125:0/872067977 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40980ce3c0 con 0x7f409806ba90 2023-11-28T11:08:30.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.923+0000 7f409f88a700 1 -- 172.21.15.125:0/872067977 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4098150080 con 0x7f409806ba90 2023-11-28T11:08:30.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.923+0000 7f408dffb700 1 -- 172.21.15.125:0/872067977 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4094019030 con 0x7f409806ba90 2023-11-28T11:08:30.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.923+0000 7f408dffb700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f407c0682f0 0x7f407c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:30.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.923+0000 7f408dffb700 1 -- 172.21.15.125:0/872067977 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f4094084ca0 con 0x7f409806ba90 2023-11-28T11:08:30.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.924+0000 7f409ce25700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f407c0682f0 0x7f407c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:30.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.924+0000 7f409ce25700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f407c0682f0 0x7f407c06a7a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f409806ede0 tx=0x7f4088009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:30.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:30.928+0000 7f408dffb700 1 -- 172.21.15.125:0/872067977 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4094089070 con 0x7f409806ba90 2023-11-28T11:08:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.114+0000 7f409f88a700 1 -- 172.21.15.125:0/872067977 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f40980743f0 con 0x7f409806ba90 2023-11-28T11:08:31.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.781+0000 7f408dffb700 1 -- 172.21.15.125:0/872067977 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4094051860 con 0x7f409806ba90 2023-11-28T11:08:31.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 -- 172.21.15.125:0/872067977 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f407c0682f0 msgr2=0x7f407c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:31.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f407c0682f0 0x7f407c06a7a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f409806ede0 tx=0x7f4088009040 comp rx=0 tx=0).stop 2023-11-28T11:08:31.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 -- 172.21.15.125:0/872067977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f409806ba90 msgr2=0x7f409813f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:31.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f409806ba90 0x7f409813f960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f409400c500 tx=0x7f409400c8c0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 -- 172.21.15.125:0/872067977 shutdown_connections 2023-11-28T11:08:31.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f407c0682f0 0x7f407c06a7a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f409815e070 0x7f409815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f409806ba90 0x7f409813f960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 --2- 172.21.15.125:0/872067977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40980ceea0 0x7f40981ef750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 -- 172.21.15.125:0/872067977 >> 172.21.15.125:0/872067977 conn(0x7f40980cfc30 msgr2=0x7f40980c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:31.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 -- 172.21.15.125:0/872067977 shutdown_connections 2023-11-28T11:08:31.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.785+0000 7f409f88a700 1 -- 172.21.15.125:0/872067977 wait complete. 2023-11-28T11:08:31.790 INFO:teuthology.orchestra.run.smithi125.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-28T11:08:31.804 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T11:08:31.804 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:08:31.805 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:08:31.807 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:08:31.807 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:08:31.808 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:08:31.809 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:08:31.810 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:08:31.810 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:08:31.812 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:08:31.812 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:08:31.812 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:08:31.814 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:08:31.815 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T11:08:31.815 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:31.892 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-11-28T11:08:31.892 INFO:tasks.ceph.mds.c.smithi125.stdout:starting mds.c at 2023-11-28T11:08:31.900 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2023-11-28T11:08:31.901 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2023-11-28T11:08:31.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.947+0000 7fe45d935700 1 Processor -- start 2023-11-28T11:08:31.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.947+0000 7fe45d935700 1 -- start start 2023-11-28T11:08:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe45d935700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45806ab10 0x7fe45806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe45d935700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4580cd5a0 0x7fe458160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe45d935700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe4580b22a0 0x7fe458160840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe45d935700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4580d1ee0 con 0x7fe4580cd5a0 2023-11-28T11:08:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe45d935700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45806b420 con 0x7fe4580b22a0 2023-11-28T11:08:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe45d935700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4580cdb10 con 0x7fe45806ab10 2023-11-28T11:08:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe4567fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4580cd5a0 0x7fe458160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe4567fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4580cd5a0 0x7fe458160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56496/0 (socket says 172.21.15.125:56496) 2023-11-28T11:08:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe4567fc700 1 -- 172.21.15.125:0/3688177479 learned_addr learned my addr 172.21.15.125:0/3688177479 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe456ffd700 1 --2- 172.21.15.125:0/3688177479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45806ab10 0x7fe45806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe4577fe700 1 --2- 172.21.15.125:0/3688177479 >> v2:172.21.15.167:3300/0 conn(0x7fe4580b22a0 0x7fe458160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe4567fc700 1 -- 172.21.15.125:0/3688177479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45806ab10 msgr2=0x7fe45806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe4567fc700 1 --2- 172.21.15.125:0/3688177479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45806ab10 0x7fe45806aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe4567fc700 1 -- 172.21.15.125:0/3688177479 >> v2:172.21.15.167:3300/0 conn(0x7fe4580b22a0 msgr2=0x7fe458160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe4567fc700 1 --2- 172.21.15.125:0/3688177479 >> v2:172.21.15.167:3300/0 conn(0x7fe4580b22a0 0x7fe458160840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe4567fc700 1 -- 172.21.15.125:0/3688177479 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4580d1890 con 0x7fe4580cd5a0 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.948+0000 7fe4567fc700 1 --2- 172.21.15.125:0/3688177479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4580cd5a0 0x7fe458160300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe45806a940 tx=0x7fe440009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2991e3c5abe2551 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe455ffb700 1 -- 172.21.15.125:0/3688177479 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44000b870 con 0x7fe4580cd5a0 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe455ffb700 1 -- 172.21.15.125:0/3688177479 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44000b9d0 con 0x7fe4580cd5a0 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe455ffb700 1 -- 172.21.15.125:0/3688177479 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44000bd60 con 0x7fe4580cd5a0 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe45d935700 1 -- 172.21.15.125:0/3688177479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4580cd5a0 msgr2=0x7fe458160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe45d935700 1 --2- 172.21.15.125:0/3688177479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4580cd5a0 0x7fe458160300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe45806a940 tx=0x7fe440009bd0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe45d935700 1 -- 172.21.15.125:0/3688177479 shutdown_connections 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe45d935700 1 --2- 172.21.15.125:0/3688177479 >> v2:172.21.15.167:3300/0 conn(0x7fe4580b22a0 0x7fe458160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe45d935700 1 --2- 172.21.15.125:0/3688177479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45806ab10 0x7fe45806aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe45d935700 1 --2- 172.21.15.125:0/3688177479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4580cd5a0 0x7fe458160300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe45d935700 1 -- 172.21.15.125:0/3688177479 >> 172.21.15.125:0/3688177479 conn(0x7fe45806c520 msgr2=0x7fe45806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:31.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe45d935700 1 -- 172.21.15.125:0/3688177479 shutdown_connections 2023-11-28T11:08:31.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.949+0000 7fe45d935700 1 -- 172.21.15.125:0/3688177479 wait complete. 2023-11-28T11:08:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.951+0000 7fe45d935700 1 Processor -- start 2023-11-28T11:08:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.951+0000 7fe45d935700 1 -- start start 2023-11-28T11:08:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe45d935700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe45806ab10 0x7fe4581503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe45d935700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4580b22a0 0x7fe4580cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe45d935700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4580cd5a0 0x7fe4581597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe45d935700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4581593b0 con 0x7fe4580cd5a0 2023-11-28T11:08:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe45d935700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe458150d80 con 0x7fe45806ab10 2023-11-28T11:08:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe45d935700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4580cc250 con 0x7fe4580b22a0 2023-11-28T11:08:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe4577fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4580cd5a0 0x7fe4581597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe4577fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4580cd5a0 0x7fe4581597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56504/0 (socket says 172.21.15.125:56504) 2023-11-28T11:08:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe4577fe700 1 -- 172.21.15.125:0/2812858067 learned_addr learned my addr 172.21.15.125:0/2812858067 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe456ffd700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe45806ab10 0x7fe4581503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe4567fc700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4580b22a0 0x7fe4580cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:31.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe4577fe700 1 -- 172.21.15.125:0/2812858067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4580b22a0 msgr2=0x7fe4580cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe4577fe700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4580b22a0 0x7fe4580cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe4577fe700 1 -- 172.21.15.125:0/2812858067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe45806ab10 msgr2=0x7fe4581503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe4577fe700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe45806ab10 0x7fe4581503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe4577fe700 1 -- 172.21.15.125:0/2812858067 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe440009550 con 0x7fe4580cd5a0 2023-11-28T11:08:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe4577fe700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4580cd5a0 0x7fe4581597d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe450007e40 tx=0x7fe45000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe44ffff700 1 -- 172.21.15.125:0/2812858067 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000ed30 con 0x7fe4580cd5a0 2023-11-28T11:08:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe44ffff700 1 -- 172.21.15.125:0/2812858067 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe450014420 con 0x7fe4580cd5a0 2023-11-28T11:08:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe45d935700 1 -- 172.21.15.125:0/2812858067 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45815cad0 con 0x7fe4580cd5a0 2023-11-28T11:08:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.952+0000 7fe44ffff700 1 -- 172.21.15.125:0/2812858067 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500147d0 con 0x7fe4580cd5a0 2023-11-28T11:08:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.953+0000 7fe45d935700 1 -- 172.21.15.125:0/2812858067 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4580d1b70 con 0x7fe4580cd5a0 2023-11-28T11:08:31.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.953+0000 7fe45d935700 1 -- 172.21.15.125:0/2812858067 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4580b1ec0 con 0x7fe4580cd5a0 2023-11-28T11:08:31.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.954+0000 7fe44ffff700 1 -- 172.21.15.125:0/2812858067 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe450012050 con 0x7fe4580cd5a0 2023-11-28T11:08:31.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.954+0000 7fe44ffff700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4380682f0 0x7fe43806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:31.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.954+0000 7fe44ffff700 1 -- 172.21.15.125:0/2812858067 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe450085ec0 con 0x7fe4580cd5a0 2023-11-28T11:08:31.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.954+0000 7fe456ffd700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4380682f0 0x7fe43806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:31.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.955+0000 7fe456ffd700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4380682f0 0x7fe43806a7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe4580cba90 tx=0x7fe448008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:31.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:31.958+0000 7fe44ffff700 1 -- 172.21.15.125:0/2812858067 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe4500529e0 con 0x7fe4580cd5a0 2023-11-28T11:08:32.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.141+0000 7fe45d935700 1 -- 172.21.15.125:0/2812858067 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4580d2c80 con 0x7fe4580cd5a0 2023-11-28T11:08:32.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.142+0000 7fe44ffff700 1 -- 172.21.15.125:0/2812858067 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14325 (secure 0 0 0) 0x7fe450056000 con 0x7fe4580cd5a0 2023-11-28T11:08:32.145 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:32.145 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:31.776326+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:32.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 -- 172.21.15.125:0/2812858067 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4380682f0 msgr2=0x7fe43806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4380682f0 0x7fe43806a7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe4580cba90 tx=0x7fe448008040 comp rx=0 tx=0).stop 2023-11-28T11:08:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 -- 172.21.15.125:0/2812858067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4580cd5a0 msgr2=0x7fe4581597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4580cd5a0 0x7fe4581597d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe450007e40 tx=0x7fe45000e3c0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 -- 172.21.15.125:0/2812858067 shutdown_connections 2023-11-28T11:08:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4580cd5a0 0x7fe4581597d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe45806ab10 0x7fe4581503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4380682f0 0x7fe43806a7a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 --2- 172.21.15.125:0/2812858067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4580b22a0 0x7fe4580cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 -- 172.21.15.125:0/2812858067 >> 172.21.15.125:0/2812858067 conn(0x7fe45806c520 msgr2=0x7fe458156230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:32.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 -- 172.21.15.125:0/2812858067 shutdown_connections 2023-11-28T11:08:32.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.144+0000 7fe45d935700 1 -- 172.21.15.125:0/2812858067 wait complete. 2023-11-28T11:08:32.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:08:32.158 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:08:32.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.285+0000 7f054d9a3700 1 Processor -- start 2023-11-28T11:08:32.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.285+0000 7f054d9a3700 1 -- start start 2023-11-28T11:08:32.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.285+0000 7f054d9a3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0548158980 0x7f05480ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.285+0000 7f054d9a3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0548158d50 0x7f05480cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.285+0000 7f054d9a3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f054806d4e0 0x7f05480ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.285+0000 7f054d9a3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054806d170 con 0x7f054806d4e0 2023-11-28T11:08:32.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.285+0000 7f054d9a3700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05480cdf00 con 0x7f0548158980 2023-11-28T11:08:32.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.285+0000 7f054d9a3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05480ce8d0 con 0x7f0548158d50 2023-11-28T11:08:32.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f05477fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f054806d4e0 0x7f05480ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f0546ffd700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0548158980 0x7f05480ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f05467fc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0548158d50 0x7f05480cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f05477fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f054806d4e0 0x7f05480ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56512/0 (socket says 172.21.15.125:56512) 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f05477fe700 1 -- 172.21.15.125:0/593152803 learned_addr learned my addr 172.21.15.125:0/593152803 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f05477fe700 1 -- 172.21.15.125:0/593152803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0548158d50 msgr2=0x7f05480cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f05477fe700 1 --2- 172.21.15.125:0/593152803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0548158d50 0x7f05480cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f05477fe700 1 -- 172.21.15.125:0/593152803 >> v2:172.21.15.167:3300/0 conn(0x7f0548158980 msgr2=0x7f05480ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f05477fe700 1 --2- 172.21.15.125:0/593152803 >> v2:172.21.15.167:3300/0 conn(0x7f0548158980 0x7f05480ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f05477fe700 1 -- 172.21.15.125:0/593152803 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05480c9110 con 0x7f054806d4e0 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f0546ffd700 1 --2- 172.21.15.125:0/593152803 >> v2:172.21.15.167:3300/0 conn(0x7f0548158980 0x7f05480ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f05477fe700 1 --2- 172.21.15.125:0/593152803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f054806d4e0 0x7f05480ccbd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f054806d470 tx=0x7f054000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed918b442674c09 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f0545ffb700 1 -- 172.21.15.125:0/593152803 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054000e070 con 0x7f054806d4e0 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f0545ffb700 1 -- 172.21.15.125:0/593152803 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054000b910 con 0x7f054806d4e0 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.286+0000 7f0545ffb700 1 -- 172.21.15.125:0/593152803 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054000bcc0 con 0x7f054806d4e0 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.287+0000 7f054d9a3700 1 -- 172.21.15.125:0/593152803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f054806d4e0 msgr2=0x7f05480ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.287+0000 7f054d9a3700 1 --2- 172.21.15.125:0/593152803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f054806d4e0 0x7f05480ccbd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f054806d470 tx=0x7f054000b330 comp rx=0 tx=0).stop 2023-11-28T11:08:32.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.287+0000 7f054d9a3700 1 -- 172.21.15.125:0/593152803 shutdown_connections 2023-11-28T11:08:32.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.287+0000 7f054d9a3700 1 --2- 172.21.15.125:0/593152803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f054806d4e0 0x7f05480ccbd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.287+0000 7f054d9a3700 1 --2- 172.21.15.125:0/593152803 >> v2:172.21.15.167:3300/0 conn(0x7f0548158980 0x7f05480ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.287+0000 7f054d9a3700 1 --2- 172.21.15.125:0/593152803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0548158d50 0x7f05480cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.287+0000 7f054d9a3700 1 -- 172.21.15.125:0/593152803 >> 172.21.15.125:0/593152803 conn(0x7f05480cb540 msgr2=0x7f05480cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:32.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.287+0000 7f054d9a3700 1 -- 172.21.15.125:0/593152803 shutdown_connections 2023-11-28T11:08:32.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.287+0000 7f054d9a3700 1 -- 172.21.15.125:0/593152803 wait complete. 2023-11-28T11:08:32.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.288+0000 7f054d9a3700 1 Processor -- start 2023-11-28T11:08:32.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.288+0000 7f054d9a3700 1 -- start start 2023-11-28T11:08:32.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f054d9a3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f054806d4e0 0x7f05481f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f054d9a3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0548158980 0x7f05480ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f054d9a3700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0548158d50 0x7f0548070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f054d9a3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480acd00 con 0x7f054806d4e0 2023-11-28T11:08:32.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f054d9a3700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05481f2f10 con 0x7f0548158d50 2023-11-28T11:08:32.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f054d9a3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05481f31f0 con 0x7f0548158980 2023-11-28T11:08:32.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f0546ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f054806d4e0 0x7f05481f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f0546ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f054806d4e0 0x7f05481f25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56514/0 (socket says 172.21.15.125:56514) 2023-11-28T11:08:32.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f0546ffd700 1 -- 172.21.15.125:0/2669810867 learned_addr learned my addr 172.21.15.125:0/2669810867 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f05477fe700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0548158d50 0x7f0548070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f05467fc700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0548158980 0x7f05480ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f0546ffd700 1 -- 172.21.15.125:0/2669810867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0548158980 msgr2=0x7f05480ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f0546ffd700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0548158980 0x7f05480ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f0546ffd700 1 -- 172.21.15.125:0/2669810867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0548158d50 msgr2=0x7f0548070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f0546ffd700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0548158d50 0x7f0548070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f0546ffd700 1 -- 172.21.15.125:0/2669810867 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05380094a0 con 0x7f054806d4e0 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.289+0000 7f0546ffd700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f054806d4e0 0x7f05481f25c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f053800ebe0 tx=0x7f053800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.290+0000 7f052ffff700 1 -- 172.21.15.125:0/2669810867 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053800c850 con 0x7f054806d4e0 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.290+0000 7f052ffff700 1 -- 172.21.15.125:0/2669810867 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053800c9b0 con 0x7f054806d4e0 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.290+0000 7f054d9a3700 1 -- 172.21.15.125:0/2669810867 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0540009b30 con 0x7f054806d4e0 2023-11-28T11:08:32.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.290+0000 7f052ffff700 1 -- 172.21.15.125:0/2669810867 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053800cd40 con 0x7f054806d4e0 2023-11-28T11:08:32.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.290+0000 7f054d9a3700 1 -- 172.21.15.125:0/2669810867 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05480cd8b0 con 0x7f054806d4e0 2023-11-28T11:08:32.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.291+0000 7f054d9a3700 1 -- 172.21.15.125:0/2669810867 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05480c93f0 con 0x7f054806d4e0 2023-11-28T11:08:32.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.291+0000 7f052ffff700 1 -- 172.21.15.125:0/2669810867 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0538019030 con 0x7f054806d4e0 2023-11-28T11:08:32.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.291+0000 7f052ffff700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05340682f0 0x7f053406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.291+0000 7f052ffff700 1 -- 172.21.15.125:0/2669810867 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f05380858f0 con 0x7f054806d4e0 2023-11-28T11:08:32.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.291+0000 7f05467fc700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05340682f0 0x7f053406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.292+0000 7f05467fc700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05340682f0 0x7f053406a7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f05480c6320 tx=0x7f053c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:32.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.295+0000 7f052ffff700 1 -- 172.21.15.125:0/2669810867 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0538052420 con 0x7f054806d4e0 2023-11-28T11:08:32.465 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:08:32.467 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:08:32.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.481+0000 7f054d9a3700 1 -- 172.21.15.125:0/2669810867 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05480cdb90 con 0x7f054806d4e0 2023-11-28T11:08:32.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.482+0000 7f052ffff700 1 -- 172.21.15.125:0/2669810867 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f053800cea0 con 0x7f054806d4e0 2023-11-28T11:08:32.483 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:08:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 -- 172.21.15.125:0/2669810867 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05340682f0 msgr2=0x7f053406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05340682f0 0x7f053406a7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f05480c6320 tx=0x7f053c009210 comp rx=0 tx=0).stop 2023-11-28T11:08:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 -- 172.21.15.125:0/2669810867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f054806d4e0 msgr2=0x7f05481f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f054806d4e0 0x7f05481f25c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f053800ebe0 tx=0x7f053800eef0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 -- 172.21.15.125:0/2669810867 shutdown_connections 2023-11-28T11:08:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0548158d50 0x7f0548070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f054806d4e0 0x7f05481f25c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05340682f0 0x7f053406a7a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 --2- 172.21.15.125:0/2669810867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0548158980 0x7f05480ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 -- 172.21.15.125:0/2669810867 >> 172.21.15.125:0/2669810867 conn(0x7f05480cb540 msgr2=0x7f05480ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:32.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 -- 172.21.15.125:0/2669810867 shutdown_connections 2023-11-28T11:08:32.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.484+0000 7f054d9a3700 1 -- 172.21.15.125:0/2669810867 wait complete. 2023-11-28T11:08:32.498 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:08:32.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.688+0000 7fb81646f700 1 Processor -- start 2023-11-28T11:08:32.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.688+0000 7fb81646f700 1 -- start start 2023-11-28T11:08:32.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.688+0000 7fb81646f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb81015c810 0x7fb810160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.688+0000 7fb81646f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb8100718e0 0x7fb81006c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.688+0000 7fb81646f700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8101607a0 con 0x7fb81006cdc0 2023-11-28T11:08:32.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.688+0000 7fb81646f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81015cbe0 con 0x7fb8100718e0 2023-11-28T11:08:32.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.688+0000 7fb81646f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb810160a50 con 0x7fb81015c810 2023-11-28T11:08:32.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.688+0000 7fb80f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb8100718e0 0x7fb81006c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.689+0000 7fb80f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb8100718e0 0x7fb81006c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56522/0 (socket says 172.21.15.125:56522) 2023-11-28T11:08:32.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.689+0000 7fb80f7fe700 1 -- 172.21.15.125:0/2882770968 learned_addr learned my addr 172.21.15.125:0/2882770968 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:32.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.689+0000 7fb80ffff700 1 --2- 172.21.15.125:0/2882770968 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb81015c810 0x7fb810160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.689+0000 7fb80f7fe700 1 -- 172.21.15.125:0/2882770968 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb81015c810 msgr2=0x7fb810160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:32.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.689+0000 7fb80f7fe700 1 --2- 172.21.15.125:0/2882770968 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb81015c810 0x7fb810160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.689+0000 7fb80f7fe700 1 -- 172.21.15.125:0/2882770968 >> v1:172.21.15.167:6789/0 conn(0x7fb81006cdc0 legacy=0x7fb81006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.689+0000 7fb80f7fe700 1 -- 172.21.15.125:0/2882770968 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810160d30 con 0x7fb8100718e0 2023-11-28T11:08:32.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.689+0000 7fb80f7fe700 1 --2- 172.21.15.125:0/2882770968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8100718e0 0x7fb81006c880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8040098f0 tx=0x7fb804009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90ff45ee8acaf9a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:32.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.689+0000 7fb80effd700 1 -- 172.21.15.125:0/2882770968 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80400b8a0 con 0x7fb8100718e0 2023-11-28T11:08:32.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.689+0000 7fb80effd700 1 -- 172.21.15.125:0/2882770968 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80400ba00 con 0x7fb8100718e0 2023-11-28T11:08:32.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.689+0000 7fb80effd700 1 -- 172.21.15.125:0/2882770968 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80400bd90 con 0x7fb8100718e0 2023-11-28T11:08:32.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.690+0000 7fb81646f700 1 -- 172.21.15.125:0/2882770968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8100718e0 msgr2=0x7fb81006c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.690+0000 7fb81646f700 1 --2- 172.21.15.125:0/2882770968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8100718e0 0x7fb81006c880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8040098f0 tx=0x7fb804009c00 comp rx=0 tx=0).stop 2023-11-28T11:08:32.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.690+0000 7fb81646f700 1 -- 172.21.15.125:0/2882770968 shutdown_connections 2023-11-28T11:08:32.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.690+0000 7fb81646f700 1 --2- 172.21.15.125:0/2882770968 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb81015c810 0x7fb810160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.690+0000 7fb81646f700 1 --2- 172.21.15.125:0/2882770968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8100718e0 0x7fb81006c880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.690+0000 7fb81646f700 1 -- 172.21.15.125:0/2882770968 >> 172.21.15.125:0/2882770968 conn(0x7fb81006c010 msgr2=0x7fb8100cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:32.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.690+0000 7fb81646f700 1 -- 172.21.15.125:0/2882770968 shutdown_connections 2023-11-28T11:08:32.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.690+0000 7fb81646f700 1 -- 172.21.15.125:0/2882770968 wait complete. 2023-11-28T11:08:32.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.691+0000 7fb81646f700 1 Processor -- start 2023-11-28T11:08:32.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.691+0000 7fb81646f700 1 -- start start 2023-11-28T11:08:32.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb81646f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81006cdc0 0x7fb8100b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb81646f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8100718e0 0x7fb8100d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb81646f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb81015c810 0x7fb8100d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb81646f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100b5860 con 0x7fb81015c810 2023-11-28T11:08:32.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb81646f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100b33e0 con 0x7fb81006cdc0 2023-11-28T11:08:32.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb81646f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100b4be0 con 0x7fb8100718e0 2023-11-28T11:08:32.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb814a0c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb81015c810 0x7fb8100d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb814a0c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb81015c810 0x7fb8100d06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56532/0 (socket says 172.21.15.125:56532) 2023-11-28T11:08:32.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb814a0c700 1 -- 172.21.15.125:0/3771084340 learned_addr learned my addr 172.21.15.125:0/3771084340 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:32.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb80ffff700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81006cdc0 0x7fb8100b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb80f7fe700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8100718e0 0x7fb8100d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb814a0c700 1 -- 172.21.15.125:0/3771084340 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8100718e0 msgr2=0x7fb8100d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb814a0c700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8100718e0 0x7fb8100d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb814a0c700 1 -- 172.21.15.125:0/3771084340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81006cdc0 msgr2=0x7fb8100b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb814a0c700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81006cdc0 0x7fb8100b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb814a0c700 1 -- 172.21.15.125:0/3771084340 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804009550 con 0x7fb81015c810 2023-11-28T11:08:32.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb814a0c700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb81015c810 0x7fb8100d06f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb80800caf0 tx=0x7fb80800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:32.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb80cff9700 1 -- 172.21.15.125:0/3771084340 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808003c00 con 0x7fb81015c810 2023-11-28T11:08:32.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb80cff9700 1 -- 172.21.15.125:0/3771084340 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb808003d60 con 0x7fb81015c810 2023-11-28T11:08:32.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.692+0000 7fb81646f700 1 -- 172.21.15.125:0/3771084340 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8100ceb20 con 0x7fb81015c810 2023-11-28T11:08:32.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.693+0000 7fb80cff9700 1 -- 172.21.15.125:0/3771084340 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800a9c0 con 0x7fb81015c810 2023-11-28T11:08:32.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.693+0000 7fb81646f700 1 -- 172.21.15.125:0/3771084340 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb810161010 con 0x7fb81015c810 2023-11-28T11:08:32.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.694+0000 7fb81646f700 1 -- 172.21.15.125:0/3771084340 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8100ce740 con 0x7fb81015c810 2023-11-28T11:08:32.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.694+0000 7fb80cff9700 1 -- 172.21.15.125:0/3771084340 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb808010050 con 0x7fb81015c810 2023-11-28T11:08:32.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.694+0000 7fb80cff9700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb7fc0682f0 0x7fb7fc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:32.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.694+0000 7fb80cff9700 1 -- 172.21.15.125:0/3771084340 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb808085630 con 0x7fb81015c810 2023-11-28T11:08:32.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.694+0000 7fb80ffff700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb7fc0682f0 0x7fb7fc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:32.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.695+0000 7fb80ffff700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb7fc0682f0 0x7fb7fc06a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8000099d0 tx=0x7fb800008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:32.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.698+0000 7fb80cff9700 1 -- 172.21.15.125:0/3771084340 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb8080521e0 con 0x7fb81015c810 2023-11-28T11:08:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.880+0000 7fb81646f700 1 -- 172.21.15.125:0/3771084340 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb8100743f0 con 0x7fb81015c810 2023-11-28T11:08:32.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.880+0000 7fb80cff9700 1 -- 172.21.15.125:0/3771084340 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb808085020 con 0x7fb81015c810 2023-11-28T11:08:32.882 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:08:32.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.882+0000 7fb81646f700 1 -- 172.21.15.125:0/3771084340 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb7fc0682f0 msgr2=0x7fb7fc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.882+0000 7fb81646f700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb7fc0682f0 0x7fb7fc06a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8000099d0 tx=0x7fb800008040 comp rx=0 tx=0).stop 2023-11-28T11:08:32.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.882+0000 7fb81646f700 1 -- 172.21.15.125:0/3771084340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb81015c810 msgr2=0x7fb8100d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:32.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.882+0000 7fb81646f700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb81015c810 0x7fb8100d06f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb80800caf0 tx=0x7fb80800ce00 comp rx=0 tx=0).stop 2023-11-28T11:08:32.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.882+0000 7fb81646f700 1 -- 172.21.15.125:0/3771084340 shutdown_connections 2023-11-28T11:08:32.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.882+0000 7fb81646f700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb81015c810 0x7fb8100d06f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.882+0000 7fb81646f700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81006cdc0 0x7fb8100b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.882+0000 7fb81646f700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb7fc0682f0 0x7fb7fc06a7a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.882+0000 7fb81646f700 1 --2- 172.21.15.125:0/3771084340 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8100718e0 0x7fb8100d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:32.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.882+0000 7fb81646f700 1 -- 172.21.15.125:0/3771084340 >> 172.21.15.125:0/3771084340 conn(0x7fb81006c010 msgr2=0x7fb8100ac9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:32.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.883+0000 7fb81646f700 1 -- 172.21.15.125:0/3771084340 shutdown_connections 2023-11-28T11:08:32.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:32.883+0000 7fb81646f700 1 -- 172.21.15.125:0/3771084340 wait complete. 2023-11-28T11:08:32.896 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:08:33.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.014+0000 7ffa92af2700 1 Processor -- start 2023-11-28T11:08:33.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.014+0000 7ffa92af2700 1 -- start start 2023-11-28T11:08:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa92af2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa8c06a270 0x7ffa8c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa92af2700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffa8c070d90 0x7ffa8c0711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa92af2700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8c151a50 con 0x7ffa8c06da40 2023-11-28T11:08:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa92af2700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8c15f0c0 con 0x7ffa8c070d90 2023-11-28T11:08:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa92af2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c15b440 con 0x7ffa8c06a270 2023-11-28T11:08:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa8bfff700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffa8c070d90 0x7ffa8c0711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa9088e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa8c06a270 0x7ffa8c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa8bfff700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffa8c070d90 0x7ffa8c0711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:53270/0 (socket says 172.21.15.125:53270) 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa8bfff700 1 -- 172.21.15.125:0/1608580048 learned_addr learned my addr 172.21.15.125:0/1608580048 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa9108f700 1 --1- 172.21.15.125:0/1608580048 >> v1:172.21.15.167:6789/0 conn(0x7ffa8c06da40 0x7ffa8c06dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:43466/0 (socket says 172.21.15.125:43466) 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa8bfff700 1 -- 172.21.15.125:0/1608580048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa8c06a270 msgr2=0x7ffa8c06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa8bfff700 1 --2- 172.21.15.125:0/1608580048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa8c06a270 0x7ffa8c06a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa8bfff700 1 -- 172.21.15.125:0/1608580048 >> v1:172.21.15.167:6789/0 conn(0x7ffa8c06da40 legacy=0x7ffa8c06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa8bfff700 1 -- 172.21.15.125:0/1608580048 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c06ab80 con 0x7ffa8c070d90 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa8b7fe700 1 -- 172.21.15.125:0/1608580048 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450554197 0 0) 0x7ffa8c151a50 con 0x7ffa8c06da40 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.015+0000 7ffa9088e700 1 --2- 172.21.15.125:0/1608580048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa8c06a270 0x7ffa8c06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa8bfff700 1 --2- 172.21.15.125:0/1608580048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa8c070d90 0x7ffa8c0711e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa780098f0 tx=0x7ffa78009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9428fbb1cce5084 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa8b7fe700 1 -- 172.21.15.125:0/1608580048 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78011830 con 0x7ffa8c070d90 2023-11-28T11:08:33.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa8b7fe700 1 -- 172.21.15.125:0/1608580048 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78011990 con 0x7ffa8c070d90 2023-11-28T11:08:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa8b7fe700 1 -- 172.21.15.125:0/1608580048 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78011d20 con 0x7ffa8c070d90 2023-11-28T11:08:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa92af2700 1 -- 172.21.15.125:0/1608580048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa8c070d90 msgr2=0x7ffa8c0711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa92af2700 1 --2- 172.21.15.125:0/1608580048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa8c070d90 0x7ffa8c0711e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa780098f0 tx=0x7ffa78009c00 comp rx=0 tx=0).stop 2023-11-28T11:08:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa92af2700 1 -- 172.21.15.125:0/1608580048 shutdown_connections 2023-11-28T11:08:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa92af2700 1 --2- 172.21.15.125:0/1608580048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa8c06a270 0x7ffa8c06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa92af2700 1 --2- 172.21.15.125:0/1608580048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa8c070d90 0x7ffa8c0711e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa92af2700 1 -- 172.21.15.125:0/1608580048 >> 172.21.15.125:0/1608580048 conn(0x7ffa8c06c010 msgr2=0x7ffa8c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa92af2700 1 -- 172.21.15.125:0/1608580048 shutdown_connections 2023-11-28T11:08:33.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.016+0000 7ffa92af2700 1 -- 172.21.15.125:0/1608580048 wait complete. 2023-11-28T11:08:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.017+0000 7ffa92af2700 1 Processor -- start 2023-11-28T11:08:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.018+0000 7ffa92af2700 1 -- start start 2023-11-28T11:08:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.018+0000 7ffa92af2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa8c06a270 0x7ffa8c151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.018+0000 7ffa92af2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa8c06da40 0x7ffa8c15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.018+0000 7ffa92af2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa8c070d90 0x7ffa8c0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.018+0000 7ffa92af2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c159590 con 0x7ffa8c06da40 2023-11-28T11:08:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.018+0000 7ffa92af2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0ce490 con 0x7ffa8c070d90 2023-11-28T11:08:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.018+0000 7ffa92af2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c1597e0 con 0x7ffa8c06a270 2023-11-28T11:08:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa8bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa8c06da40 0x7ffa8c15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa8bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa8c06da40 0x7ffa8c15a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56548/0 (socket says 172.21.15.125:56548) 2023-11-28T11:08:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa8bfff700 1 -- 172.21.15.125:0/3483621 learned_addr learned my addr 172.21.15.125:0/3483621 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa9088e700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa8c06a270 0x7ffa8c151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa9108f700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa8c070d90 0x7ffa8c0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa8bfff700 1 -- 172.21.15.125:0/3483621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa8c06a270 msgr2=0x7ffa8c151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa8bfff700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa8c06a270 0x7ffa8c151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa8bfff700 1 -- 172.21.15.125:0/3483621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa8c070d90 msgr2=0x7ffa8c0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa8bfff700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa8c070d90 0x7ffa8c0cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa8bfff700 1 -- 172.21.15.125:0/3483621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800094a0 con 0x7ffa8c06da40 2023-11-28T11:08:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa9108f700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa8c070d90 0x7ffa8c0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa8bfff700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa8c06da40 0x7ffa8c15a2c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa78014040 tx=0x7ffa78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa897fa700 1 -- 172.21.15.125:0/3483621 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780036a0 con 0x7ffa8c06da40 2023-11-28T11:08:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa92af2700 1 -- 172.21.15.125:0/3483621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa78009550 con 0x7ffa8c06da40 2023-11-28T11:08:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa897fa700 1 -- 172.21.15.125:0/3483621 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7801e070 con 0x7ffa8c06da40 2023-11-28T11:08:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa92af2700 1 -- 172.21.15.125:0/3483621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c15adf0 con 0x7ffa8c06da40 2023-11-28T11:08:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.019+0000 7ffa897fa700 1 -- 172.21.15.125:0/3483621 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78003a00 con 0x7ffa8c06da40 2023-11-28T11:08:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.020+0000 7ffa92af2700 1 -- 172.21.15.125:0/3483621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c0052f0 con 0x7ffa8c06da40 2023-11-28T11:08:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.020+0000 7ffa897fa700 1 -- 172.21.15.125:0/3483621 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ffa7800f050 con 0x7ffa8c06da40 2023-11-28T11:08:33.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.021+0000 7ffa897fa700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa700682f0 0x7ffa7006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.021+0000 7ffa9088e700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa700682f0 0x7ffa7006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.021+0000 7ffa897fa700 1 -- 172.21.15.125:0/3483621 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffa78086a40 con 0x7ffa8c06da40 2023-11-28T11:08:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.021+0000 7ffa9088e700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa700682f0 0x7ffa7006a7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009d00 tx=0x7ffa80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:33.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.025+0000 7ffa897fa700 1 -- 172.21.15.125:0/3483621 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ffa78053570 con 0x7ffa8c06da40 2023-11-28T11:08:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.252+0000 7ffa92af2700 1 -- 172.21.15.125:0/3483621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa6c005b20 con 0x7ffa8c06da40 2023-11-28T11:08:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.253+0000 7ffa897fa700 1 -- 172.21.15.125:0/3483621 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7ffa78020090 con 0x7ffa8c06da40 2023-11-28T11:08:33.255 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:33.255 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/678190712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":678190712},{"type":"v1","addr":"172.21.15.167:6835","nonce":678190712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2090095557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2090095557},{"type":"v1","addr":"172.21.15.167:6834","nonce":2090095557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3827244932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3827244932},{"type":"v1","addr":"172.21.15.125:6836","nonce":3827244932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/573741186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":573741186},{"type":"v1","addr":"172.21.15.125:6837","nonce":573741186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-11-28T11:08:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 -- 172.21.15.125:0/3483621 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa700682f0 msgr2=0x7ffa7006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa700682f0 0x7ffa7006a7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009d00 tx=0x7ffa80008040 comp rx=0 tx=0).stop 2023-11-28T11:08:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 -- 172.21.15.125:0/3483621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa8c06da40 msgr2=0x7ffa8c15a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa8c06da40 0x7ffa8c15a2c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa78014040 tx=0x7ffa78004750 comp rx=0 tx=0).stop 2023-11-28T11:08:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 -- 172.21.15.125:0/3483621 shutdown_connections 2023-11-28T11:08:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa8c070d90 0x7ffa8c0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa700682f0 0x7ffa7006a7a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa8c06a270 0x7ffa8c151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 --2- 172.21.15.125:0/3483621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa8c06da40 0x7ffa8c15a2c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 -- 172.21.15.125:0/3483621 >> 172.21.15.125:0/3483621 conn(0x7ffa8c06c010 msgr2=0x7ffa8c0b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:33.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 -- 172.21.15.125:0/3483621 shutdown_connections 2023-11-28T11:08:33.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.255+0000 7ffa92af2700 1 -- 172.21.15.125:0/3483621 wait complete. 2023-11-28T11:08:33.258 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 3 2023-11-28T11:08:33.269 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:33.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.387+0000 7fc583764700 1 Processor -- start 2023-11-28T11:08:33.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.387+0000 7fc583764700 1 -- start start 2023-11-28T11:08:33.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc583764700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c0ce040 0x7fc57c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc583764700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc57c142db0 0x7fc57c13ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc583764700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c13fc90 con 0x7fc57c0b1770 2023-11-28T11:08:33.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc583764700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c13f6d0 con 0x7fc57c142db0 2023-11-28T11:08:33.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc583764700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c13f9b0 con 0x7fc57c0ce040 2023-11-28T11:08:33.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc581d01700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc57c0b1770 0x7fc57c13cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40680/0 (socket says 172.21.15.125:40680) 2023-11-28T11:08:33.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc581d01700 1 -- 172.21.15.125:0/2769116187 learned_addr learned my addr 172.21.15.125:0/2769116187 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:33.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583526399 0 0) 0x7fc57c13fc90 con 0x7fc57c0b1770 2023-11-28T11:08:33.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc580cff700 1 --2- 172.21.15.125:0/2769116187 >> v2:172.21.15.167:3300/0 conn(0x7fc57c142db0 0x7fc57c13ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5680035b0 con 0x7fc57c0b1770 2023-11-28T11:08:33.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc581500700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c0ce040 0x7fc57c15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3044798403 0 0) 0x7fc5680035b0 con 0x7fc57c0b1770 2023-11-28T11:08:33.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c0ce040 msgr2=0x7fc57c15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:33.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c0ce040 0x7fc57c15d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 >> v2:172.21.15.167:3300/0 conn(0x7fc57c142db0 msgr2=0x7fc57c13ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:33.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 --2- 172.21.15.125:0/2769116187 >> v2:172.21.15.167:3300/0 conn(0x7fc57c142db0 0x7fc57c13ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c15d100 con 0x7fc57c0b1770 2023-11-28T11:08:33.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fc5740019f0 con 0x7fc57c0b1770 2023-11-28T11:08:33.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 >> v1:172.21.15.125:6789/0 conn(0x7fc57c0b1770 legacy=0x7fc57c13cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc568003a00 0x7fc568003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc568004430 0x7fc5680048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c0ce040 0x7fc568004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c13f6d0 con 0x7fc568003a00 2023-11-28T11:08:33.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c13f9b0 con 0x7fc568004430 2023-11-28T11:08:33.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56800ba10 con 0x7fc57c0ce040 2023-11-28T11:08:33.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc581500700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc568003a00 0x7fc568003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc580cff700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc568004430 0x7fc5680048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.388+0000 7fc581d01700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c0ce040 0x7fc568004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc581500700 1 -- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c0ce040 msgr2=0x7fc568004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:33.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc581500700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c0ce040 0x7fc568004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc581500700 1 -- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc568004430 msgr2=0x7fc5680048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:33.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc581500700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc568004430 0x7fc5680048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc581500700 1 -- 172.21.15.125:0/2769116187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680035b0 con 0x7fc568003a00 2023-11-28T11:08:33.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc580cff700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc568004430 0x7fc5680048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:33.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc581d01700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c0ce040 0x7fc568004fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:33.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc581500700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc568003a00 0x7fc568003e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc578009b60 tx=0x7fc568005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7000467604247b3d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:33.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57800e6c0 con 0x7fc568003a00 2023-11-28T11:08:33.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57800e820 con 0x7fc568003a00 2023-11-28T11:08:33.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc573fff700 1 -- 172.21.15.125:0/2769116187 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57800eb90 con 0x7fc568003a00 2023-11-28T11:08:33.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc583764700 1 -- 172.21.15.125:0/2769116187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc568003a00 msgr2=0x7fc568003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc583764700 1 --2- 172.21.15.125:0/2769116187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc568003a00 0x7fc568003e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc578009b60 tx=0x7fc568005880 comp rx=0 tx=0).stop 2023-11-28T11:08:33.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.389+0000 7fc581d01700 1 -- 172.21.15.125:0/2769116187 reap_dead start 2023-11-28T11:08:33.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.390+0000 7fc583764700 1 -- 172.21.15.125:0/2769116187 shutdown_connections 2023-11-28T11:08:33.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.390+0000 7fc583764700 1 -- 172.21.15.125:0/2769116187 >> 172.21.15.125:0/2769116187 conn(0x7fc57c06c010 msgr2=0x7fc57c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:33.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.390+0000 7fc583764700 1 -- 172.21.15.125:0/2769116187 shutdown_connections 2023-11-28T11:08:33.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.390+0000 7fc583764700 1 -- 172.21.15.125:0/2769116187 wait complete. 2023-11-28T11:08:33.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.391+0000 7fc583764700 1 Processor -- start 2023-11-28T11:08:33.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.391+0000 7fc583764700 1 -- start start 2023-11-28T11:08:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc583764700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc568003a00 0x7fc57c154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc583764700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc57c140b30 0x7fc57c159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc583764700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c140fa0 0x7fc57c15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc583764700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c1425c0 con 0x7fc57c140b30 2023-11-28T11:08:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc583764700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c154aa0 con 0x7fc568003a00 2023-11-28T11:08:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc583764700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c141520 con 0x7fc57c140fa0 2023-11-28T11:08:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc580cff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc57c140b30 0x7fc57c159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc580cff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc57c140b30 0x7fc57c159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56566/0 (socket says 172.21.15.125:56566) 2023-11-28T11:08:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc580cff700 1 -- 172.21.15.125:0/2052511840 learned_addr learned my addr 172.21.15.125:0/2052511840 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc581500700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc568003a00 0x7fc57c154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc581d01700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c140fa0 0x7fc57c15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc580cff700 1 -- 172.21.15.125:0/2052511840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c140fa0 msgr2=0x7fc57c15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc580cff700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c140fa0 0x7fc57c15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc580cff700 1 -- 172.21.15.125:0/2052511840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc568003a00 msgr2=0x7fc57c154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc580cff700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc568003a00 0x7fc57c154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc580cff700 1 -- 172.21.15.125:0/2052511840 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0ce410 con 0x7fc57c140b30 2023-11-28T11:08:33.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc580cff700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc57c140b30 0x7fc57c159cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc56c011900 tx=0x7fc56c011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc571ffb700 1 -- 172.21.15.125:0/2052511840 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c004220 con 0x7fc57c140b30 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.392+0000 7fc571ffb700 1 -- 172.21.15.125:0/2052511840 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c004380 con 0x7fc57c140b30 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.393+0000 7fc583764700 1 -- 172.21.15.125:0/2052511840 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c15d3e0 con 0x7fc57c140b30 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.393+0000 7fc571ffb700 1 -- 172.21.15.125:0/2052511840 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c0036a0 con 0x7fc57c140b30 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.393+0000 7fc583764700 1 -- 172.21.15.125:0/2052511840 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c0ce5a0 con 0x7fc57c140b30 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.394+0000 7fc583764700 1 -- 172.21.15.125:0/2052511840 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c0743f0 con 0x7fc57c140b30 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.394+0000 7fc571ffb700 1 -- 172.21.15.125:0/2052511840 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc56c024070 con 0x7fc57c140b30 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.395+0000 7fc571ffb700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc560068320 0x7fc56006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.395+0000 7fc571ffb700 1 -- 172.21.15.125:0/2052511840 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc56c085fe0 con 0x7fc57c140b30 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.395+0000 7fc581500700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc560068320 0x7fc56006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.395+0000 7fc581500700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc560068320 0x7fc56006a7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5780090b0 tx=0x7fc578008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:33.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.399+0000 7fc571ffb700 1 -- 172.21.15.125:0/2052511840 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc56c052b20 con 0x7fc57c140b30 2023-11-28T11:08:33.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.581+0000 7fc583764700 1 -- 172.21.15.125:0/2052511840 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc57c0b5c70 con 0x7fc57c140b30 2023-11-28T11:08:33.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.582+0000 7fc571ffb700 1 -- 172.21.15.125:0/2052511840 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14312 (secure 0 0 0) 0x7fc56c022090 con 0x7fc57c140b30 2023-11-28T11:08:33.583 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:33.583 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":20,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:32.777799+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:33.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 -- 172.21.15.125:0/2052511840 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc560068320 msgr2=0x7fc56006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc560068320 0x7fc56006a7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5780090b0 tx=0x7fc578008030 comp rx=0 tx=0).stop 2023-11-28T11:08:33.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 -- 172.21.15.125:0/2052511840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc57c140b30 msgr2=0x7fc57c159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc57c140b30 0x7fc57c159cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc56c011900 tx=0x7fc56c011c10 comp rx=0 tx=0).stop 2023-11-28T11:08:33.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 -- 172.21.15.125:0/2052511840 shutdown_connections 2023-11-28T11:08:33.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc560068320 0x7fc56006a7d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57c140fa0 0x7fc57c15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc568003a00 0x7fc57c154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 --2- 172.21.15.125:0/2052511840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc57c140b30 0x7fc57c159cc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 -- 172.21.15.125:0/2052511840 >> 172.21.15.125:0/2052511840 conn(0x7fc57c06c010 msgr2=0x7fc57c0cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:33.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 -- 172.21.15.125:0/2052511840 shutdown_connections 2023-11-28T11:08:33.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.584+0000 7fc583764700 1 -- 172.21.15.125:0/2052511840 wait complete. 2023-11-28T11:08:33.597 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:08:33.598 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:08:33.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.719+0000 7f9b685c0700 1 Processor -- start 2023-11-28T11:08:33.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.719+0000 7f9b685c0700 1 -- start start 2023-11-28T11:08:33.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.720+0000 7f9b685c0700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9b600b1650 0x7f9b600b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.720+0000 7f9b685c0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b600af0a0 0x7f9b6015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.720+0000 7f9b685c0700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b60159ec0 con 0x7f9b601599b0 2023-11-28T11:08:33.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.720+0000 7f9b685c0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b600b1f60 con 0x7f9b600af0a0 2023-11-28T11:08:33.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.720+0000 7f9b685c0700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6015d8a0 con 0x7f9b600b1650 2023-11-28T11:08:33.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.720+0000 7f9b66b5d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b600af0a0 0x7f9b6015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.721+0000 7f9b66b5d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b600af0a0 0x7f9b6015a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56576/0 (socket says 172.21.15.125:56576) 2023-11-28T11:08:33.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.721+0000 7f9b66b5d700 1 -- 172.21.15.125:0/2229684287 learned_addr learned my addr 172.21.15.125:0/2229684287 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:33.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.721+0000 7f9b6635c700 1 --2- 172.21.15.125:0/2229684287 >> v2:172.21.15.167:3300/0 conn(0x7f9b600b1650 0x7f9b600b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.721+0000 7f9b66b5d700 1 -- 172.21.15.125:0/2229684287 >> v2:172.21.15.167:3300/0 conn(0x7f9b600b1650 msgr2=0x7f9b600b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:33.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.721+0000 7f9b66b5d700 1 --2- 172.21.15.125:0/2229684287 >> v2:172.21.15.167:3300/0 conn(0x7f9b600b1650 0x7f9b600b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.721+0000 7f9b66b5d700 1 -- 172.21.15.125:0/2229684287 >> v1:172.21.15.167:6789/0 conn(0x7f9b601599b0 legacy=0x7f9b6015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.721+0000 7f9b66b5d700 1 -- 172.21.15.125:0/2229684287 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6015db80 con 0x7f9b600af0a0 2023-11-28T11:08:33.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.721+0000 7f9b66b5d700 1 --2- 172.21.15.125:0/2229684287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b600af0a0 0x7f9b6015a350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b60067310 tx=0x7f9b5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05909ab69b1fe18 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:33.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.721+0000 7f9b6535a700 1 -- 172.21.15.125:0/2229684287 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800e070 con 0x7f9b600af0a0 2023-11-28T11:08:33.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.721+0000 7f9b6535a700 1 -- 172.21.15.125:0/2229684287 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5800b9c0 con 0x7f9b600af0a0 2023-11-28T11:08:33.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.721+0000 7f9b6535a700 1 -- 172.21.15.125:0/2229684287 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800bd70 con 0x7f9b600af0a0 2023-11-28T11:08:33.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.722+0000 7f9b685c0700 1 -- 172.21.15.125:0/2229684287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b600af0a0 msgr2=0x7f9b6015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.722+0000 7f9b685c0700 1 --2- 172.21.15.125:0/2229684287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b600af0a0 0x7f9b6015a350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b60067310 tx=0x7f9b5800b330 comp rx=0 tx=0).stop 2023-11-28T11:08:33.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.722+0000 7f9b685c0700 1 -- 172.21.15.125:0/2229684287 shutdown_connections 2023-11-28T11:08:33.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.722+0000 7f9b685c0700 1 --2- 172.21.15.125:0/2229684287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b600af0a0 0x7f9b6015a350 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.722+0000 7f9b685c0700 1 --2- 172.21.15.125:0/2229684287 >> v2:172.21.15.167:3300/0 conn(0x7f9b600b1650 0x7f9b600b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.722+0000 7f9b685c0700 1 -- 172.21.15.125:0/2229684287 >> 172.21.15.125:0/2229684287 conn(0x7f9b6006c010 msgr2=0x7f9b600cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:33.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.722+0000 7f9b685c0700 1 -- 172.21.15.125:0/2229684287 shutdown_connections 2023-11-28T11:08:33.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.722+0000 7f9b685c0700 1 -- 172.21.15.125:0/2229684287 wait complete. 2023-11-28T11:08:33.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.723+0000 7f9b685c0700 1 Processor -- start 2023-11-28T11:08:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.723+0000 7f9b685c0700 1 -- start start 2023-11-28T11:08:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b685c0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b600af0a0 0x7f9b60150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b685c0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b600b1650 0x7f9b6014fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b685c0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b600b3fd0 0x7f9b60153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b685c0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b60159740 con 0x7f9b600b3fd0 2023-11-28T11:08:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b685c0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6014efe0 con 0x7f9b600b1650 2023-11-28T11:08:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b685c0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6014ff70 con 0x7f9b600af0a0 2023-11-28T11:08:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b66b5d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b600b3fd0 0x7f9b60153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b66b5d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b600b3fd0 0x7f9b60153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56582/0 (socket says 172.21.15.125:56582) 2023-11-28T11:08:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b66b5d700 1 -- 172.21.15.125:0/3828105822 learned_addr learned my addr 172.21.15.125:0/3828105822 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b6635c700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b600af0a0 0x7f9b60150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b66b5d700 1 -- 172.21.15.125:0/3828105822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b600af0a0 msgr2=0x7f9b60150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b65b5b700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b600b1650 0x7f9b6014fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b66b5d700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b600af0a0 0x7f9b60150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b66b5d700 1 -- 172.21.15.125:0/3828105822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b600b1650 msgr2=0x7f9b6014fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b66b5d700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b600b1650 0x7f9b6014fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b66b5d700 1 -- 172.21.15.125:0/3828105822 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b58009b30 con 0x7f9b600b3fd0 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.724+0000 7f9b6635c700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b600af0a0 0x7f9b60150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.725+0000 7f9b65b5b700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b600b1650 0x7f9b6014fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.725+0000 7f9b66b5d700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b600b3fd0 0x7f9b60153950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9b600708b0 tx=0x7f9b58004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.725+0000 7f9b56ffd700 1 -- 172.21.15.125:0/3828105822 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b580099b0 con 0x7f9b600b3fd0 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.725+0000 7f9b56ffd700 1 -- 172.21.15.125:0/3828105822 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b580092e0 con 0x7f9b600b3fd0 2023-11-28T11:08:33.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.725+0000 7f9b56ffd700 1 -- 172.21.15.125:0/3828105822 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5801c640 con 0x7f9b600b3fd0 2023-11-28T11:08:33.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.725+0000 7f9b685c0700 1 -- 172.21.15.125:0/3828105822 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6015a890 con 0x7f9b600b3fd0 2023-11-28T11:08:33.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.725+0000 7f9b685c0700 1 -- 172.21.15.125:0/3828105822 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6015de60 con 0x7f9b600b3fd0 2023-11-28T11:08:33.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.726+0000 7f9b685c0700 1 -- 172.21.15.125:0/3828105822 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6015aa20 con 0x7f9b600b3fd0 2023-11-28T11:08:33.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.726+0000 7f9b56ffd700 1 -- 172.21.15.125:0/3828105822 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9b58022030 con 0x7f9b600b3fd0 2023-11-28T11:08:33.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.726+0000 7f9b56ffd700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9b440682f0 0x7f9b4406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:33.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.726+0000 7f9b56ffd700 1 -- 172.21.15.125:0/3828105822 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9b58087210 con 0x7f9b600b3fd0 2023-11-28T11:08:33.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.727+0000 7f9b6635c700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9b440682f0 0x7f9b4406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:33.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.727+0000 7f9b6635c700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9b440682f0 0x7f9b4406a7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009a00 tx=0x7f9b50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:33.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.731+0000 7f9b56ffd700 1 -- 172.21.15.125:0/3828105822 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9b58053dc0 con 0x7f9b600b3fd0 2023-11-28T11:08:33.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.914+0000 7f9b685c0700 1 -- 172.21.15.125:0/3828105822 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b600743f0 con 0x7f9b600b3fd0 2023-11-28T11:08:33.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.915+0000 7f9b56ffd700 1 -- 172.21.15.125:0/3828105822 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b580573e0 con 0x7f9b600b3fd0 2023-11-28T11:08:33.916 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:08:33.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.916+0000 7f9b685c0700 1 -- 172.21.15.125:0/3828105822 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9b440682f0 msgr2=0x7f9b4406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.916+0000 7f9b685c0700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9b440682f0 0x7f9b4406a7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009a00 tx=0x7f9b50008040 comp rx=0 tx=0).stop 2023-11-28T11:08:33.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.917+0000 7f9b685c0700 1 -- 172.21.15.125:0/3828105822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b600b3fd0 msgr2=0x7f9b60153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:33.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.917+0000 7f9b685c0700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b600b3fd0 0x7f9b60153950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9b600708b0 tx=0x7f9b58004ad0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.917+0000 7f9b685c0700 1 -- 172.21.15.125:0/3828105822 shutdown_connections 2023-11-28T11:08:33.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.917+0000 7f9b685c0700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b600b3fd0 0x7f9b60153950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.917+0000 7f9b685c0700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9b440682f0 0x7f9b4406a7a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.917+0000 7f9b685c0700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b600af0a0 0x7f9b60150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.917+0000 7f9b685c0700 1 --2- 172.21.15.125:0/3828105822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b600b1650 0x7f9b6014fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:33.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.917+0000 7f9b685c0700 1 -- 172.21.15.125:0/3828105822 >> 172.21.15.125:0/3828105822 conn(0x7f9b6006c010 msgr2=0x7f9b600b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:33.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.917+0000 7f9b685c0700 1 -- 172.21.15.125:0/3828105822 shutdown_connections 2023-11-28T11:08:33.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:33.917+0000 7f9b685c0700 1 -- 172.21.15.125:0/3828105822 wait complete. 2023-11-28T11:08:33.930 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:08:34.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.051+0000 7f685a8f2700 1 Processor -- start 2023-11-28T11:08:34.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.051+0000 7f685a8f2700 1 -- start start 2023-11-28T11:08:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.052+0000 7f685a8f2700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f685415c810 0x7f6854160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.052+0000 7f685a8f2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f68540718e0 0x7f685406c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.052+0000 7f685a8f2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f685406cdc0 0x7f685406a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.052+0000 7f685a8f2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685415cbe0 con 0x7f68540718e0 2023-11-28T11:08:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.052+0000 7f685a8f2700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68541607a0 con 0x7f685415c810 2023-11-28T11:08:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.052+0000 7f685a8f2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6854160a50 con 0x7f685406cdc0 2023-11-28T11:08:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.052+0000 7f68537fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f68540718e0 0x7f685406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.052+0000 7f68537fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f68540718e0 0x7f685406c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56586/0 (socket says 172.21.15.125:56586) 2023-11-28T11:08:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.052+0000 7f68537fe700 1 -- 172.21.15.125:0/765559759 learned_addr learned my addr 172.21.15.125:0/765559759 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.052+0000 7f6853fff700 1 --2- 172.21.15.125:0/765559759 >> v2:172.21.15.167:3300/0 conn(0x7f685415c810 0x7f6854160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.052+0000 7f6858e8f700 1 --2- 172.21.15.125:0/765559759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f685406cdc0 0x7f685406a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f68537fe700 1 -- 172.21.15.125:0/765559759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f685406cdc0 msgr2=0x7f685406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f68537fe700 1 --2- 172.21.15.125:0/765559759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f685406cdc0 0x7f685406a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f68537fe700 1 -- 172.21.15.125:0/765559759 >> v2:172.21.15.167:3300/0 conn(0x7f685415c810 msgr2=0x7f6854160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f68537fe700 1 --2- 172.21.15.125:0/765559759 >> v2:172.21.15.167:3300/0 conn(0x7f685415c810 0x7f6854160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f68537fe700 1 -- 172.21.15.125:0/765559759 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854160d30 con 0x7f68540718e0 2023-11-28T11:08:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f6853fff700 1 --2- 172.21.15.125:0/765559759 >> v2:172.21.15.167:3300/0 conn(0x7f685415c810 0x7f6854160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f68537fe700 1 --2- 172.21.15.125:0/765559759 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68540718e0 0x7f685406c880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f68540b27c0 tx=0x7f6844009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a2300dcd7960c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f6852ffd700 1 -- 172.21.15.125:0/765559759 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400b870 con 0x7f68540718e0 2023-11-28T11:08:34.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f6852ffd700 1 -- 172.21.15.125:0/765559759 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684400b9d0 con 0x7f68540718e0 2023-11-28T11:08:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f6852ffd700 1 -- 172.21.15.125:0/765559759 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400bd60 con 0x7f68540718e0 2023-11-28T11:08:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f685a8f2700 1 -- 172.21.15.125:0/765559759 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68540718e0 msgr2=0x7f685406c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f685a8f2700 1 --2- 172.21.15.125:0/765559759 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68540718e0 0x7f685406c880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f68540b27c0 tx=0x7f6844009bd0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f685a8f2700 1 -- 172.21.15.125:0/765559759 shutdown_connections 2023-11-28T11:08:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f685a8f2700 1 --2- 172.21.15.125:0/765559759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f685406cdc0 0x7f685406a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f685a8f2700 1 --2- 172.21.15.125:0/765559759 >> v2:172.21.15.167:3300/0 conn(0x7f685415c810 0x7f6854160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f685a8f2700 1 --2- 172.21.15.125:0/765559759 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68540718e0 0x7f685406c880 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f685a8f2700 1 -- 172.21.15.125:0/765559759 >> 172.21.15.125:0/765559759 conn(0x7f685406c010 msgr2=0x7f68540cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.053+0000 7f685a8f2700 1 -- 172.21.15.125:0/765559759 shutdown_connections 2023-11-28T11:08:34.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.054+0000 7f685a8f2700 1 -- 172.21.15.125:0/765559759 wait complete. 2023-11-28T11:08:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.055+0000 7f685a8f2700 1 Processor -- start 2023-11-28T11:08:34.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.055+0000 7f685a8f2700 1 -- start start 2023-11-28T11:08:34.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.055+0000 7f685a8f2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685406cdc0 0x7f68541557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f685a8f2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68540718e0 0x7f68540c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f685a8f2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f685415c810 0x7f68540b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f685a8f2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68540b39a0 con 0x7f685415c810 2023-11-28T11:08:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f685a8f2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68540c5690 con 0x7f685406cdc0 2023-11-28T11:08:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f685a8f2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6854155d20 con 0x7f68540718e0 2023-11-28T11:08:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6858e8f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f685415c810 0x7f68540b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6858e8f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f685415c810 0x7f68540b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56594/0 (socket says 172.21.15.125:56594) 2023-11-28T11:08:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6858e8f700 1 -- 172.21.15.125:0/3919404750 learned_addr learned my addr 172.21.15.125:0/3919404750 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f68537fe700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68540718e0 0x7f68540c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6853fff700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685406cdc0 0x7f68541557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6858e8f700 1 -- 172.21.15.125:0/3919404750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68540718e0 msgr2=0x7f68540c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6858e8f700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68540718e0 0x7f68540c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6858e8f700 1 -- 172.21.15.125:0/3919404750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685406cdc0 msgr2=0x7f68541557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6858e8f700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685406cdc0 0x7f68541557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6858e8f700 1 -- 172.21.15.125:0/3919404750 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6844009550 con 0x7f685415c810 2023-11-28T11:08:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6853fff700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685406cdc0 0x7f68541557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6858e8f700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f685415c810 0x7f68540b2a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f684c007d90 tx=0x7f684c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6850ff9700 1 -- 172.21.15.125:0/3919404750 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c00ede0 con 0x7f685415c810 2023-11-28T11:08:34.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6850ff9700 1 -- 172.21.15.125:0/3919404750 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c014420 con 0x7f685415c810 2023-11-28T11:08:34.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f685a8f2700 1 -- 172.21.15.125:0/3919404750 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68540ceb20 con 0x7f685415c810 2023-11-28T11:08:34.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f6850ff9700 1 -- 172.21.15.125:0/3919404750 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c0147d0 con 0x7f685415c810 2023-11-28T11:08:34.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.056+0000 7f685a8f2700 1 -- 172.21.15.125:0/3919404750 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6854161010 con 0x7f685415c810 2023-11-28T11:08:34.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.057+0000 7f685a8f2700 1 -- 172.21.15.125:0/3919404750 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68540ce740 con 0x7f685415c810 2023-11-28T11:08:34.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.058+0000 7f6850ff9700 1 -- 172.21.15.125:0/3919404750 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f684c012050 con 0x7f685415c810 2023-11-28T11:08:34.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.058+0000 7f6850ff9700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68340682f0 0x7f683406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.058+0000 7f6850ff9700 1 -- 172.21.15.125:0/3919404750 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f684c085e80 con 0x7f685415c810 2023-11-28T11:08:34.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.058+0000 7f6853fff700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68340682f0 0x7f683406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.058+0000 7f6853fff700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68340682f0 0x7f683406a7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f683c0099b0 tx=0x7f683c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:34.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.062+0000 7f6850ff9700 1 -- 172.21.15.125:0/3919404750 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f684c052a30 con 0x7f685415c810 2023-11-28T11:08:34.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.245+0000 7f685a8f2700 1 -- 172.21.15.125:0/3919404750 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f68540c57d0 con 0x7f685415c810 2023-11-28T11:08:34.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.246+0000 7f6850ff9700 1 -- 172.21.15.125:0/3919404750 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f684c056050 con 0x7f685415c810 2023-11-28T11:08:34.247 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:08:34.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.247+0000 7f685a8f2700 1 -- 172.21.15.125:0/3919404750 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68340682f0 msgr2=0x7f683406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.247+0000 7f685a8f2700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68340682f0 0x7f683406a7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f683c0099b0 tx=0x7f683c008040 comp rx=0 tx=0).stop 2023-11-28T11:08:34.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.247+0000 7f685a8f2700 1 -- 172.21.15.125:0/3919404750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f685415c810 msgr2=0x7f68540b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.247+0000 7f685a8f2700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f685415c810 0x7f68540b2a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f684c007d90 tx=0x7f684c00e3c0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.248+0000 7f685a8f2700 1 -- 172.21.15.125:0/3919404750 shutdown_connections 2023-11-28T11:08:34.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.248+0000 7f685a8f2700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f685415c810 0x7f68540b2a00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.248+0000 7f685a8f2700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685406cdc0 0x7f68541557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.248+0000 7f685a8f2700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68340682f0 0x7f683406a7a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.248+0000 7f685a8f2700 1 --2- 172.21.15.125:0/3919404750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68540718e0 0x7f68540c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.248+0000 7f685a8f2700 1 -- 172.21.15.125:0/3919404750 >> 172.21.15.125:0/3919404750 conn(0x7f685406c010 msgr2=0x7f68540ac8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:34.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.248+0000 7f685a8f2700 1 -- 172.21.15.125:0/3919404750 shutdown_connections 2023-11-28T11:08:34.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.248+0000 7f685a8f2700 1 -- 172.21.15.125:0/3919404750 wait complete. 2023-11-28T11:08:34.261 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:08:34.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.378+0000 7f0bb1d3f700 1 Processor -- start 2023-11-28T11:08:34.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.378+0000 7f0bb1d3f700 1 -- start start 2023-11-28T11:08:34.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.379+0000 7f0bb1d3f700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0bac06a270 0x7f0bac06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.379+0000 7f0bb1d3f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac06e570 0x7f0bac070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.379+0000 7f0bb1d3f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bac06ab80 con 0x7f0bac15cc80 2023-11-28T11:08:34.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.379+0000 7f0bb1d3f700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bac0b2490 con 0x7f0bac06a270 2023-11-28T11:08:34.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.379+0000 7f0bb1d3f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0b1810 con 0x7f0bac06e570 2023-11-28T11:08:34.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.379+0000 7f0baaffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0bac15cc80 0x7f0bac06de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40722/0 (socket says 172.21.15.125:40722) 2023-11-28T11:08:34.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.379+0000 7f0baaffd700 1 -- 172.21.15.125:0/3638046316 learned_addr learned my addr 172.21.15.125:0/3638046316 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:34.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0babfff700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac06e570 0x7f0bac070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135080625 0 0) 0x7f0bac06ab80 con 0x7f0bac15cc80 2023-11-28T11:08:34.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0bab7fe700 1 --2- 172.21.15.125:0/3638046316 >> v2:172.21.15.167:3300/0 conn(0x7f0bac06a270 0x7f0bac06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b980035b0 con 0x7f0bac15cc80 2023-11-28T11:08:34.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2118166810 0 0) 0x7f0b980035b0 con 0x7f0bac15cc80 2023-11-28T11:08:34.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac06e570 msgr2=0x7f0bac070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:34.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac06e570 0x7f0bac070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 >> v2:172.21.15.167:3300/0 conn(0x7f0bac06a270 msgr2=0x7f0bac06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:34.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 --2- 172.21.15.125:0/3638046316 >> v2:172.21.15.167:3300/0 conn(0x7f0bac06a270 0x7f0bac06a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac0b1af0 con 0x7f0bac15cc80 2023-11-28T11:08:34.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f0b94001670 con 0x7f0bac15cc80 2023-11-28T11:08:34.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 >> v1:172.21.15.125:6789/0 conn(0x7f0bac15cc80 legacy=0x7f0bac06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac06e570 0x7f0b98003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 0x7f0b98004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b98004d90 0x7f0b98005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0b2490 con 0x7f0b98003f80 2023-11-28T11:08:34.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0b1810 con 0x7f0b98004d90 2023-11-28T11:08:34.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9800ba40 con 0x7f0bac06e570 2023-11-28T11:08:34.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baaffd700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 0x7f0b98004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0bab7fe700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac06e570 0x7f0b98003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0babfff700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b98004d90 0x7f0b98005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baaffd700 1 -- 172.21.15.125:0/3638046316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac06e570 msgr2=0x7f0b98003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:34.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baaffd700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac06e570 0x7f0b98003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baaffd700 1 -- 172.21.15.125:0/3638046316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b98004d90 msgr2=0x7f0b98005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:34.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baaffd700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b98004d90 0x7f0b98005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.380+0000 7f0baaffd700 1 -- 172.21.15.125:0/3638046316 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b980035b0 con 0x7f0b98003f80 2023-11-28T11:08:34.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.381+0000 7f0baaffd700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 0x7f0b98004850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400c2f0 tx=0x7f0b98005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca0d4777338ecd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:34.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.381+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94007c40 con 0x7f0b98003f80 2023-11-28T11:08:34.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.381+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9400cdd0 con 0x7f0b98003f80 2023-11-28T11:08:34.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.381+0000 7f0baa7fc700 1 -- 172.21.15.125:0/3638046316 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94005ba0 con 0x7f0b98003f80 2023-11-28T11:08:34.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.381+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/3638046316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 msgr2=0x7f0b98004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.381+0000 7f0bb1d3f700 1 --2- 172.21.15.125:0/3638046316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 0x7f0b98004850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400c2f0 tx=0x7f0b98005880 comp rx=0 tx=0).stop 2023-11-28T11:08:34.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.381+0000 7f0babfff700 1 -- 172.21.15.125:0/3638046316 reap_dead start 2023-11-28T11:08:34.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.381+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/3638046316 shutdown_connections 2023-11-28T11:08:34.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.381+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/3638046316 >> 172.21.15.125:0/3638046316 conn(0x7f0bac06c010 msgr2=0x7f0bac0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:34.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.381+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/3638046316 shutdown_connections 2023-11-28T11:08:34.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.381+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/3638046316 wait complete. 2023-11-28T11:08:34.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.382+0000 7f0bb1d3f700 1 Processor -- start 2023-11-28T11:08:34.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.383+0000 7f0bb1d3f700 1 -- start start 2023-11-28T11:08:34.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.383+0000 7f0bb1d3f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 0x7f0bac142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.383+0000 7f0bb1d3f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac1448c0 0x7f0bac0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.383+0000 7f0bb1d3f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac0c7300 0x7f0bac0c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.383+0000 7f0bb1d3f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0ca0b0 con 0x7f0b98003f80 2023-11-28T11:08:34.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.383+0000 7f0bb1d3f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0c7770 con 0x7f0bac1448c0 2023-11-28T11:08:34.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.383+0000 7f0bb1d3f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0c9dd0 con 0x7f0bac0c7300 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.383+0000 7f0bab7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 0x7f0bac142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.383+0000 7f0bab7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 0x7f0bac142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56610/0 (socket says 172.21.15.125:56610) 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.383+0000 7f0bab7fe700 1 -- 172.21.15.125:0/1539297145 learned_addr learned my addr 172.21.15.125:0/1539297145 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0babfff700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac0c7300 0x7f0bac0c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0baaffd700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac1448c0 0x7f0bac0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0bab7fe700 1 -- 172.21.15.125:0/1539297145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac0c7300 msgr2=0x7f0bac0c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0bab7fe700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac0c7300 0x7f0bac0c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0bab7fe700 1 -- 172.21.15.125:0/1539297145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac1448c0 msgr2=0x7f0bac0c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0bab7fe700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac1448c0 0x7f0bac0c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0bab7fe700 1 -- 172.21.15.125:0/1539297145 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac0b20b0 con 0x7f0b98003f80 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0bab7fe700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 0x7f0bac142b00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c011ad0 tx=0x7f0b9c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:34.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0ba3fff700 1 -- 172.21.15.125:0/1539297145 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c00f9a0 con 0x7f0b98003f80 2023-11-28T11:08:34.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0ba3fff700 1 -- 172.21.15.125:0/1539297145 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c00fb00 con 0x7f0b98003f80 2023-11-28T11:08:34.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/1539297145 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bac0b1dd0 con 0x7f0b98003f80 2023-11-28T11:08:34.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0ba3fff700 1 -- 172.21.15.125:0/1539297145 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c00feb0 con 0x7f0b98003f80 2023-11-28T11:08:34.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.384+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/1539297145 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac15daa0 con 0x7f0b98003f80 2023-11-28T11:08:34.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.385+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/1539297145 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bac0ccca0 con 0x7f0b98003f80 2023-11-28T11:08:34.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.385+0000 7f0ba3fff700 1 -- 172.21.15.125:0/1539297145 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0b9c014440 con 0x7f0b98003f80 2023-11-28T11:08:34.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.386+0000 7f0ba3fff700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 0x7f0b8c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.386+0000 7f0ba3fff700 1 -- 172.21.15.125:0/1539297145 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0b9c0861d0 con 0x7f0b98003f80 2023-11-28T11:08:34.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.386+0000 7f0baaffd700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 0x7f0b8c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.386+0000 7f0baaffd700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 0x7f0b8c06a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0bac153cd0 tx=0x7f0b9400a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:34.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.390+0000 7f0ba3fff700 1 -- 172.21.15.125:0/1539297145 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0b9c052de0 con 0x7f0b98003f80 2023-11-28T11:08:34.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.576+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/1539297145 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0bac0743f0 con 0x7f0b98003f80 2023-11-28T11:08:34.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.576+0000 7f0ba3fff700 1 -- 172.21.15.125:0/1539297145 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0b9c056400 con 0x7f0b98003f80 2023-11-28T11:08:34.578 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:34.578 INFO:teuthology.orchestra.run.smithi125.stdout:[ 2023-11-28T11:08:34.578 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:08:34.579 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 1, 2023-11-28T11:08:34.579 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": ".mgr" 2023-11-28T11:08:34.579 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:08:34.579 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:08:34.579 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 2, 2023-11-28T11:08:34.579 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": "rbd" 2023-11-28T11:08:34.579 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:08:34.579 INFO:teuthology.orchestra.run.smithi125.stdout:] 2023-11-28T11:08:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/1539297145 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 msgr2=0x7f0b8c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 0x7f0b8c06a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0bac153cd0 tx=0x7f0b9400a000 comp rx=0 tx=0).stop 2023-11-28T11:08:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/1539297145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 msgr2=0x7f0bac142b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 0x7f0bac142b00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c011ad0 tx=0x7f0b9c011e90 comp rx=0 tx=0).stop 2023-11-28T11:08:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/1539297145 shutdown_connections 2023-11-28T11:08:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 0x7f0b8c06a7a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac0c7300 0x7f0bac0c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b98003f80 0x7f0bac142b00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 --2- 172.21.15.125:0/1539297145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac1448c0 0x7f0bac0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/1539297145 >> 172.21.15.125:0/1539297145 conn(0x7f0bac06c010 msgr2=0x7f0bac0b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:34.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/1539297145 shutdown_connections 2023-11-28T11:08:34.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.578+0000 7f0bb1d3f700 1 -- 172.21.15.125:0/1539297145 wait complete. 2023-11-28T11:08:34.592 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:08:34.592 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:08:34.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.714+0000 7f0b52470700 1 Processor -- start 2023-11-28T11:08:34.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.714+0000 7f0b52470700 1 -- start start 2023-11-28T11:08:34.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.715+0000 7f0b52470700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15e070 0x7f0b4c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.715+0000 7f0b52470700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0b4c0ceea0 0x7f0b4c06b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.715+0000 7f0b52470700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c0cea10 con 0x7f0b4c15a150 2023-11-28T11:08:34.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.715+0000 7f0b52470700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4c15ae80 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.715+0000 7f0b52470700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0cbd10 con 0x7f0b4c15e070 2023-11-28T11:08:34.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4bfff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15e070 0x7f0b4c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4bfff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15e070 0x7f0b4c06b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:51626/0 (socket says 172.21.15.125:51626) 2023-11-28T11:08:34.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4bfff700 1 -- 172.21.15.125:0/3933849346 learned_addr learned my addr 172.21.15.125:0/3933849346 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:34.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4b7fe700 1 --2- 172.21.15.125:0/3933849346 >> v2:172.21.15.167:3300/0 conn(0x7f0b4c0ceea0 0x7f0b4c06b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4bfff700 1 -- 172.21.15.125:0/3933849346 >> v2:172.21.15.167:3300/0 conn(0x7f0b4c0ceea0 msgr2=0x7f0b4c06b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:34.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4bfff700 1 --2- 172.21.15.125:0/3933849346 >> v2:172.21.15.167:3300/0 conn(0x7f0b4c0ceea0 0x7f0b4c06b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4bfff700 1 -- 172.21.15.125:0/3933849346 >> v1:172.21.15.167:6789/0 conn(0x7f0b4c15a150 legacy=0x7f0b4c15a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4bfff700 1 -- 172.21.15.125:0/3933849346 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0ce0e0 con 0x7f0b4c15e070 2023-11-28T11:08:34.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4bfff700 1 --2- 172.21.15.125:0/3933849346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15e070 0x7f0b4c06b380 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0098f0 tx=0x7f0b3c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=796ecf774e33e3d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:34.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4affd700 1 -- 172.21.15.125:0/3933849346 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c011830 con 0x7f0b4c15e070 2023-11-28T11:08:34.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4affd700 1 -- 172.21.15.125:0/3933849346 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c011990 con 0x7f0b4c15e070 2023-11-28T11:08:34.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.716+0000 7f0b4affd700 1 -- 172.21.15.125:0/3933849346 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c011d20 con 0x7f0b4c15e070 2023-11-28T11:08:34.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.717+0000 7f0b52470700 1 -- 172.21.15.125:0/3933849346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15e070 msgr2=0x7f0b4c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.717+0000 7f0b52470700 1 --2- 172.21.15.125:0/3933849346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15e070 0x7f0b4c06b380 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0098f0 tx=0x7f0b3c009c00 comp rx=0 tx=0).stop 2023-11-28T11:08:34.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.717+0000 7f0b52470700 1 -- 172.21.15.125:0/3933849346 shutdown_connections 2023-11-28T11:08:34.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.717+0000 7f0b52470700 1 --2- 172.21.15.125:0/3933849346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15e070 0x7f0b4c06b380 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.717+0000 7f0b52470700 1 --2- 172.21.15.125:0/3933849346 >> v2:172.21.15.167:3300/0 conn(0x7f0b4c0ceea0 0x7f0b4c06b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.717+0000 7f0b52470700 1 -- 172.21.15.125:0/3933849346 >> 172.21.15.125:0/3933849346 conn(0x7f0b4c0cfc30 msgr2=0x7f0b4c0d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:34.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.717+0000 7f0b52470700 1 -- 172.21.15.125:0/3933849346 shutdown_connections 2023-11-28T11:08:34.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.717+0000 7f0b52470700 1 -- 172.21.15.125:0/3933849346 wait complete. 2023-11-28T11:08:34.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.718+0000 7f0b52470700 1 Processor -- start 2023-11-28T11:08:34.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.718+0000 7f0b52470700 1 -- start start 2023-11-28T11:08:34.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b52470700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b4c0ceea0 0x7f0b4c14d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b52470700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15a150 0x7f0b4c0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b52470700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b4c15e070 0x7f0b4c1448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b52470700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c14da20 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b52470700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0ad0c0 con 0x7f0b4c15e070 2023-11-28T11:08:34.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b52470700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0aee80 con 0x7f0b4c15a150 2023-11-28T11:08:34.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b4bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b4c0ceea0 0x7f0b4c14d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b4bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b4c0ceea0 0x7f0b4c14d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56624/0 (socket says 172.21.15.125:56624) 2023-11-28T11:08:34.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b4bfff700 1 -- 172.21.15.125:0/465941487 learned_addr learned my addr 172.21.15.125:0/465941487 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:34.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b4b7fe700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15a150 0x7f0b4c0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b50a0d700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b4c15e070 0x7f0b4c1448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b4bfff700 1 -- 172.21.15.125:0/465941487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15a150 msgr2=0x7f0b4c0acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b4bfff700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15a150 0x7f0b4c0acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b4bfff700 1 -- 172.21.15.125:0/465941487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b4c15e070 msgr2=0x7f0b4c1448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b4bfff700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b4c15e070 0x7f0b4c1448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b4bfff700 1 -- 172.21.15.125:0/465941487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c009550 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.719+0000 7f0b50a0d700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b4c15e070 0x7f0b4c1448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:34.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.720+0000 7f0b4bfff700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b4c0ceea0 0x7f0b4c14d4e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c014040 tx=0x7f0b3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:34.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.720+0000 7f0b48ff9700 1 -- 172.21.15.125:0/465941487 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c0038a0 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.720+0000 7f0b48ff9700 1 -- 172.21.15.125:0/465941487 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c01f070 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.720+0000 7f0b52470700 1 -- 172.21.15.125:0/465941487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4c0ce6a0 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.720+0000 7f0b48ff9700 1 -- 172.21.15.125:0/465941487 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c003c40 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.720+0000 7f0b52470700 1 -- 172.21.15.125:0/465941487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4c0ce3c0 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.721+0000 7f0b52470700 1 -- 172.21.15.125:0/465941487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c150080 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.721+0000 7f0b48ff9700 1 -- 172.21.15.125:0/465941487 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0b3c00f050 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.721+0000 7f0b48ff9700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b380682f0 0x7f0b3806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:34.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.721+0000 7f0b48ff9700 1 -- 172.21.15.125:0/465941487 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0b3c021070 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.721+0000 7f0b4b7fe700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b380682f0 0x7f0b3806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:34.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.722+0000 7f0b4b7fe700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b380682f0 0x7f0b3806a7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0ca1e0 tx=0x7f0b40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:34.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.725+0000 7f0b48ff9700 1 -- 172.21.15.125:0/465941487 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0b3c053ea0 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.909+0000 7f0b52470700 1 -- 172.21.15.125:0/465941487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0b4c14dc70 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.982+0000 7f0b48ff9700 1 -- 172.21.15.125:0/465941487 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0b3c0574c0 con 0x7f0b4c0ceea0 2023-11-28T11:08:34.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.985+0000 7f0b52470700 1 -- 172.21.15.125:0/465941487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b380682f0 msgr2=0x7f0b3806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.985+0000 7f0b52470700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b380682f0 0x7f0b3806a7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0ca1e0 tx=0x7f0b40008040 comp rx=0 tx=0).stop 2023-11-28T11:08:34.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.985+0000 7f0b52470700 1 -- 172.21.15.125:0/465941487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b4c0ceea0 msgr2=0x7f0b4c14d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:34.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.985+0000 7f0b52470700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b4c0ceea0 0x7f0b4c14d4e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c014040 tx=0x7f0b3c004750 comp rx=0 tx=0).stop 2023-11-28T11:08:34.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.986+0000 7f0b52470700 1 -- 172.21.15.125:0/465941487 shutdown_connections 2023-11-28T11:08:34.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.986+0000 7f0b52470700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b4c15e070 0x7f0b4c1448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.986+0000 7f0b52470700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b4c0ceea0 0x7f0b4c14d4e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.986+0000 7f0b52470700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b380682f0 0x7f0b3806a7a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.986+0000 7f0b52470700 1 --2- 172.21.15.125:0/465941487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4c15a150 0x7f0b4c0acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:34.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.986+0000 7f0b52470700 1 -- 172.21.15.125:0/465941487 >> 172.21.15.125:0/465941487 conn(0x7f0b4c0cfc30 msgr2=0x7f0b4c0d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:34.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.986+0000 7f0b52470700 1 -- 172.21.15.125:0/465941487 shutdown_connections 2023-11-28T11:08:34.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:34.986+0000 7f0b52470700 1 -- 172.21.15.125:0/465941487 wait complete. 2023-11-28T11:08:34.988 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' created 2023-11-28T11:08:35.000 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:08:35.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.124+0000 7f1434519700 1 Processor -- start 2023-11-28T11:08:35.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.124+0000 7f1434519700 1 -- start start 2023-11-28T11:08:35.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.125+0000 7f1434519700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f142c0cf710 0x7f142c0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:35.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.125+0000 7f1434519700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f142c06a980 0x7f142c071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:35.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.125+0000 7f1434519700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c15cc10 con 0x7f142c071890 2023-11-28T11:08:35.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.125+0000 7f1434519700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142c06c9b0 con 0x7f142c0cf710 2023-11-28T11:08:35.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.125+0000 7f1434519700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c06cc90 con 0x7f142c06a980 2023-11-28T11:08:35.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.125+0000 7f14322b5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f142c0cf710 0x7f142c0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:35.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.125+0000 7f1431ab4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f142c071890 0x7f142c06a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40760/0 (socket says 172.21.15.125:40760) 2023-11-28T11:08:35.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.125+0000 7f1431ab4700 1 -- 172.21.15.125:0/2419465703 learned_addr learned my addr 172.21.15.125:0/2419465703 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:35.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.125+0000 7f1432ab6700 1 --2- 172.21.15.125:0/2419465703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f142c06a980 0x7f142c071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:35.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f14322b5700 1 -- 172.21.15.125:0/2419465703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f142c06a980 msgr2=0x7f142c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:35.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f14322b5700 1 --2- 172.21.15.125:0/2419465703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f142c06a980 0x7f142c071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:35.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f14322b5700 1 -- 172.21.15.125:0/2419465703 >> v1:172.21.15.125:6789/0 conn(0x7f142c071890 legacy=0x7f142c06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:35.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f14312b3700 1 -- 172.21.15.125:0/2419465703 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725840955 0 0) 0x7f142c15cc10 con 0x7f142c071890 2023-11-28T11:08:35.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f14322b5700 1 -- 172.21.15.125:0/2419465703 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c06cf70 con 0x7f142c0cf710 2023-11-28T11:08:35.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f14322b5700 1 --2- 172.21.15.125:0/2419465703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f142c0cf710 0x7f142c0ce740 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1428009870 tx=0x7f1428009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd60853a421693eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:35.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f14312b3700 1 -- 172.21.15.125:0/2419465703 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428011830 con 0x7f142c0cf710 2023-11-28T11:08:35.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f14312b3700 1 -- 172.21.15.125:0/2419465703 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1428011990 con 0x7f142c0cf710 2023-11-28T11:08:35.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f14312b3700 1 -- 172.21.15.125:0/2419465703 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428011d20 con 0x7f142c0cf710 2023-11-28T11:08:35.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f1434519700 1 -- 172.21.15.125:0/2419465703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f142c0cf710 msgr2=0x7f142c0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:35.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f1434519700 1 --2- 172.21.15.125:0/2419465703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f142c0cf710 0x7f142c0ce740 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1428009870 tx=0x7f1428009b80 comp rx=0 tx=0).stop 2023-11-28T11:08:35.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f1434519700 1 -- 172.21.15.125:0/2419465703 shutdown_connections 2023-11-28T11:08:35.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f1434519700 1 --2- 172.21.15.125:0/2419465703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f142c06a980 0x7f142c071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:35.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f1434519700 1 --2- 172.21.15.125:0/2419465703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f142c0cf710 0x7f142c0ce740 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:35.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.126+0000 7f1434519700 1 -- 172.21.15.125:0/2419465703 >> 172.21.15.125:0/2419465703 conn(0x7f142c06c010 msgr2=0x7f142c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:35.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.127+0000 7f1434519700 1 -- 172.21.15.125:0/2419465703 shutdown_connections 2023-11-28T11:08:35.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.127+0000 7f1434519700 1 -- 172.21.15.125:0/2419465703 wait complete. 2023-11-28T11:08:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.128+0000 7f1434519700 1 Processor -- start 2023-11-28T11:08:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.128+0000 7f1434519700 1 -- start start 2023-11-28T11:08:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.128+0000 7f1434519700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f142c06a980 0x7f142c0b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.128+0000 7f1434519700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f142c071890 0x7f142c15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.128+0000 7f1434519700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f142c0cf710 0x7f142c147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.128+0000 7f1434519700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c148b60 con 0x7f142c0cf710 2023-11-28T11:08:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.128+0000 7f1434519700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c148e40 con 0x7f142c06a980 2023-11-28T11:08:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.128+0000 7f1434519700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c149120 con 0x7f142c071890 2023-11-28T11:08:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.128+0000 7f1432ab6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f142c0cf710 0x7f142c147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.128+0000 7f1432ab6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f142c0cf710 0x7f142c147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56642/0 (socket says 172.21.15.125:56642) 2023-11-28T11:08:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1432ab6700 1 -- 172.21.15.125:0/3219280605 learned_addr learned my addr 172.21.15.125:0/3219280605 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1431ab4700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f142c071890 0x7f142c15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f14322b5700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f142c06a980 0x7f142c0b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1432ab6700 1 -- 172.21.15.125:0/3219280605 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f142c071890 msgr2=0x7f142c15ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1432ab6700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f142c071890 0x7f142c15ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1432ab6700 1 -- 172.21.15.125:0/3219280605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f142c06a980 msgr2=0x7f142c0b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1432ab6700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f142c06a980 0x7f142c0b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1432ab6700 1 -- 172.21.15.125:0/3219280605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280094a0 con 0x7f142c0cf710 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1432ab6700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f142c0cf710 0x7f142c147b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f142400ef90 tx=0x7f142400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1422ffd700 1 -- 172.21.15.125:0/3219280605 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424009ca0 con 0x7f142c0cf710 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1422ffd700 1 -- 172.21.15.125:0/3219280605 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142400f040 con 0x7f142c0cf710 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1434519700 1 -- 172.21.15.125:0/3219280605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c06d530 con 0x7f142c0cf710 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1422ffd700 1 -- 172.21.15.125:0/3219280605 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424014480 con 0x7f142c0cf710 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.129+0000 7f1434519700 1 -- 172.21.15.125:0/3219280605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c06d250 con 0x7f142c0cf710 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.130+0000 7f1434519700 1 -- 172.21.15.125:0/3219280605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142c160480 con 0x7f142c0cf710 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.131+0000 7f1422ffd700 1 -- 172.21.15.125:0/3219280605 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f14240145e0 con 0x7f142c0cf710 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.131+0000 7f1422ffd700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14100682f0 0x7f141006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.131+0000 7f14322b5700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14100682f0 0x7f141006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.131+0000 7f1422ffd700 1 -- 172.21.15.125:0/3219280605 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f14240868d0 con 0x7f142c0cf710 2023-11-28T11:08:35.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.131+0000 7f14322b5700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14100682f0 0x7f141006a7a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14280090b0 tx=0x7f1428008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:35.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.136+0000 7f1422ffd700 1 -- 172.21.15.125:0/3219280605 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1424053310 con 0x7f142c0cf710 2023-11-28T11:08:35.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.316+0000 7f1434519700 1 -- 172.21.15.125:0/3219280605 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f142c0b0d50 con 0x7f142c0cf710 2023-11-28T11:08:35.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.988+0000 7f1422ffd700 1 -- 172.21.15.125:0/3219280605 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7f142c0b0d50 con 0x7f142c0cf710 2023-11-28T11:08:35.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.992+0000 7f1434519700 1 -- 172.21.15.125:0/3219280605 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14100682f0 msgr2=0x7f141006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:35.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.992+0000 7f1434519700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14100682f0 0x7f141006a7a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14280090b0 tx=0x7f1428008030 comp rx=0 tx=0).stop 2023-11-28T11:08:35.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.992+0000 7f1434519700 1 -- 172.21.15.125:0/3219280605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f142c0cf710 msgr2=0x7f142c147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:35.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.992+0000 7f1434519700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f142c0cf710 0x7f142c147b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f142400ef90 tx=0x7f142400c3a0 comp rx=0 tx=0).stop 2023-11-28T11:08:35.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.994+0000 7f1434519700 1 -- 172.21.15.125:0/3219280605 shutdown_connections 2023-11-28T11:08:35.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.994+0000 7f1434519700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f142c0cf710 0x7f142c147b50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.994+0000 7f1434519700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f142c06a980 0x7f142c0b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.994+0000 7f1434519700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14100682f0 0x7f141006a7a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.994+0000 7f1434519700 1 --2- 172.21.15.125:0/3219280605 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f142c071890 0x7f142c15ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.994+0000 7f1434519700 1 -- 172.21.15.125:0/3219280605 >> 172.21.15.125:0/3219280605 conn(0x7f142c06c010 msgr2=0x7f142c0ac8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.995+0000 7f1434519700 1 -- 172.21.15.125:0/3219280605 shutdown_connections 2023-11-28T11:08:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:35.995+0000 7f1434519700 1 -- 172.21.15.125:0/3219280605 wait complete. 2023-11-28T11:08:36.009 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' created 2023-11-28T11:08:36.019 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:08:36.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.143+0000 7fdbcf42f700 1 Processor -- start 2023-11-28T11:08:36.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.143+0000 7fdbcf42f700 1 -- start start 2023-11-28T11:08:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcf42f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbc8158e10 0x7fdbc80cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcf42f700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdbc806cb50 0x7fdbc8070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcf42f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc80ca140 con 0x7fdbc80ae850 2023-11-28T11:08:36.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcf42f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc806ac30 con 0x7fdbc8158e10 2023-11-28T11:08:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcf42f700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc80c9b80 con 0x7fdbc806cb50 2023-11-28T11:08:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcd1cb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbc8158e10 0x7fdbc80cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcc9ca700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdbc80ae850 0x7fdbc806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40772/0 (socket says 172.21.15.125:40772) 2023-11-28T11:08:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcd1cb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbc8158e10 0x7fdbc80cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56646/0 (socket says 172.21.15.125:56646) 2023-11-28T11:08:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcc9ca700 1 -- 172.21.15.125:0/3912533661 learned_addr learned my addr 172.21.15.125:0/3912533661 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcd9cc700 1 --2- 172.21.15.125:0/3912533661 >> v2:172.21.15.167:3300/0 conn(0x7fdbc806cb50 0x7fdbc8070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcd1cb700 1 -- 172.21.15.125:0/3912533661 >> v2:172.21.15.167:3300/0 conn(0x7fdbc806cb50 msgr2=0x7fdbc8070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcd1cb700 1 --2- 172.21.15.125:0/3912533661 >> v2:172.21.15.167:3300/0 conn(0x7fdbc806cb50 0x7fdbc8070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbcd1cb700 1 -- 172.21.15.125:0/3912533661 >> v1:172.21.15.125:6789/0 conn(0x7fdbc80ae850 legacy=0x7fdbc806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbcd1cb700 1 -- 172.21.15.125:0/3912533661 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc80c9e60 con 0x7fdbc8158e10 2023-11-28T11:08:36.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.144+0000 7fdbbffff700 1 -- 172.21.15.125:0/3912533661 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573061320 0 0) 0x7fdbc80ca140 con 0x7fdbc80ae850 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbcd9cc700 1 --2- 172.21.15.125:0/3912533661 >> v2:172.21.15.167:3300/0 conn(0x7fdbc806cb50 0x7fdbc8070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbcd1cb700 1 --2- 172.21.15.125:0/3912533661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc8158e10 0x7fdbc80cb5b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdbc815d860 tx=0x7fdbb8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145c3f0516ea1cfb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbbffff700 1 -- 172.21.15.125:0/3912533661 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8011830 con 0x7fdbc8158e10 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbbffff700 1 -- 172.21.15.125:0/3912533661 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb8011990 con 0x7fdbc8158e10 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbbffff700 1 -- 172.21.15.125:0/3912533661 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8011d20 con 0x7fdbc8158e10 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbcf42f700 1 -- 172.21.15.125:0/3912533661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc8158e10 msgr2=0x7fdbc80cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbcf42f700 1 --2- 172.21.15.125:0/3912533661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc8158e10 0x7fdbc80cb5b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdbc815d860 tx=0x7fdbb8009b20 comp rx=0 tx=0).stop 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbcf42f700 1 -- 172.21.15.125:0/3912533661 shutdown_connections 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbcf42f700 1 --2- 172.21.15.125:0/3912533661 >> v2:172.21.15.167:3300/0 conn(0x7fdbc806cb50 0x7fdbc8070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbcf42f700 1 --2- 172.21.15.125:0/3912533661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc8158e10 0x7fdbc80cb5b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbcf42f700 1 -- 172.21.15.125:0/3912533661 >> 172.21.15.125:0/3912533661 conn(0x7fdbc80cf400 msgr2=0x7fdbc80cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:36.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbcf42f700 1 -- 172.21.15.125:0/3912533661 shutdown_connections 2023-11-28T11:08:36.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.145+0000 7fdbcf42f700 1 -- 172.21.15.125:0/3912533661 wait complete. 2023-11-28T11:08:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.147+0000 7fdbcf42f700 1 Processor -- start 2023-11-28T11:08:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.147+0000 7fdbcf42f700 1 -- start start 2023-11-28T11:08:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.147+0000 7fdbcf42f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbc806cb50 0x7fdbc80c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.147+0000 7fdbcf42f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc80ae850 0x7fdbc80b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.147+0000 7fdbcf42f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbc8158e10 0x7fdbc8152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.147+0000 7fdbcf42f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80c57d0 con 0x7fdbc80ae850 2023-11-28T11:08:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.147+0000 7fdbcf42f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc815bef0 con 0x7fdbc806cb50 2023-11-28T11:08:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.147+0000 7fdbcf42f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc814e260 con 0x7fdbc8158e10 2023-11-28T11:08:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.147+0000 7fdbcc9ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc80ae850 0x7fdbc80b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.147+0000 7fdbcc9ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc80ae850 0x7fdbc80b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56654/0 (socket says 172.21.15.125:56654) 2023-11-28T11:08:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.147+0000 7fdbcc9ca700 1 -- 172.21.15.125:0/396722009 learned_addr learned my addr 172.21.15.125:0/396722009 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbcd1cb700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbc806cb50 0x7fdbc80c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbcd9cc700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbc8158e10 0x7fdbc8152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbcc9ca700 1 -- 172.21.15.125:0/396722009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbc8158e10 msgr2=0x7fdbc8152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbcc9ca700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbc8158e10 0x7fdbc8152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbcc9ca700 1 -- 172.21.15.125:0/396722009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbc806cb50 msgr2=0x7fdbc80c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbcc9ca700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbc806cb50 0x7fdbc80c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbcc9ca700 1 -- 172.21.15.125:0/396722009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb80094a0 con 0x7fdbc80ae850 2023-11-28T11:08:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbcc9ca700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc80ae850 0x7fdbc80b2250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c540 tx=0x7fdbc400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbbdffb700 1 -- 172.21.15.125:0/396722009 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4004c80 con 0x7fdbc80ae850 2023-11-28T11:08:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbbdffb700 1 -- 172.21.15.125:0/396722009 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc4004de0 con 0x7fdbc80ae850 2023-11-28T11:08:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbcf42f700 1 -- 172.21.15.125:0/396722009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc806b100 con 0x7fdbc80ae850 2023-11-28T11:08:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbbdffb700 1 -- 172.21.15.125:0/396722009 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4007310 con 0x7fdbc80ae850 2023-11-28T11:08:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.148+0000 7fdbcf42f700 1 -- 172.21.15.125:0/396722009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc806ae20 con 0x7fdbc80ae850 2023-11-28T11:08:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.149+0000 7fdbcf42f700 1 -- 172.21.15.125:0/396722009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc806b620 con 0x7fdbc80ae850 2023-11-28T11:08:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.149+0000 7fdbbdffb700 1 -- 172.21.15.125:0/396722009 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdbc401a020 con 0x7fdbc80ae850 2023-11-28T11:08:36.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.150+0000 7fdbbdffb700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbac0682f0 0x7fdbac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.150+0000 7fdbcd1cb700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbac0682f0 0x7fdbac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.150+0000 7fdbbdffb700 1 -- 172.21.15.125:0/396722009 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fdbc40858e0 con 0x7fdbc80ae850 2023-11-28T11:08:36.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.150+0000 7fdbcd1cb700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbac0682f0 0x7fdbac06a7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80090b0 tx=0x7fdbb801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:36.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.154+0000 7fdbbdffb700 1 -- 172.21.15.125:0/396722009 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdbc40521c0 con 0x7fdbc80ae850 2023-11-28T11:08:36.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.381+0000 7fdbcf42f700 1 -- 172.21.15.125:0/396722009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdbc80743f0 con 0x7fdbc80ae850 2023-11-28T11:08:36.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.386+0000 7fdbbdffb700 1 -- 172.21.15.125:0/396722009 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdbc40557e0 con 0x7fdbc80ae850 2023-11-28T11:08:36.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 -- 172.21.15.125:0/396722009 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbac0682f0 msgr2=0x7fdbac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbac0682f0 0x7fdbac06a7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80090b0 tx=0x7fdbb801c040 comp rx=0 tx=0).stop 2023-11-28T11:08:36.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 -- 172.21.15.125:0/396722009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc80ae850 msgr2=0x7fdbc80b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc80ae850 0x7fdbc80b2250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c540 tx=0x7fdbc400c900 comp rx=0 tx=0).stop 2023-11-28T11:08:36.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 -- 172.21.15.125:0/396722009 shutdown_connections 2023-11-28T11:08:36.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbac0682f0 0x7fdbac06a7a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbc8158e10 0x7fdbc8152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbc806cb50 0x7fdbc80c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 --2- 172.21.15.125:0/396722009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc80ae850 0x7fdbc80b2250 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 -- 172.21.15.125:0/396722009 >> 172.21.15.125:0/396722009 conn(0x7fdbc80cf400 msgr2=0x7fdbc80afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:36.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 -- 172.21.15.125:0/396722009 shutdown_connections 2023-11-28T11:08:36.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.390+0000 7fdbcf42f700 1 -- 172.21.15.125:0/396722009 wait complete. 2023-11-28T11:08:36.395 INFO:teuthology.orchestra.run.smithi125.stderr:new fs with metadata pool 3 and data pool 4 2023-11-28T11:08:36.416 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:36.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.533+0000 7f80c4072700 1 Processor -- start 2023-11-28T11:08:36.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.533+0000 7f80c4072700 1 -- start start 2023-11-28T11:08:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.534+0000 7f80c4072700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80bc142db0 0x7f80bc13ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.534+0000 7f80c4072700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80bc15e010 con 0x7f80bc0ce040 2023-11-28T11:08:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.534+0000 7f80c4072700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80bc13fc90 con 0x7f80bc0b1770 2023-11-28T11:08:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.534+0000 7f80c4072700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc13f6d0 con 0x7f80bc142db0 2023-11-28T11:08:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.534+0000 7f80c1e0e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f80bc0ce040 0x7f80bc15d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40796/0 (socket says 172.21.15.125:40796) 2023-11-28T11:08:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.534+0000 7f80c1e0e700 1 -- 172.21.15.125:0/1842132935 learned_addr learned my addr 172.21.15.125:0/1842132935 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c160d700 1 --2- 172.21.15.125:0/1842132935 >> v2:172.21.15.167:3300/0 conn(0x7f80bc142db0 0x7f80bc13ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423980273 0 0) 0x7f80ac001110 con 0x7f80bc0ce040 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a80035b0 con 0x7f80bc0ce040 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916384356 0 0) 0x7f80bc13fc90 con 0x7f80bc0b1770 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80ac001110 con 0x7f80bc0b1770 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 316716771 0 0) 0x7f80a80035b0 con 0x7f80bc0ce040 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 >> v2:172.21.15.167:3300/0 conn(0x7f80bc142db0 msgr2=0x7f80bc13ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 --2- 172.21.15.125:0/1842132935 >> v2:172.21.15.167:3300/0 conn(0x7f80bc142db0 0x7f80bc13ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 >> v1:172.21.15.167:6789/0 conn(0x7f80bc0b1770 legacy=0x7f80bc0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc13f9b0 con 0x7f80bc0ce040 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f80ac001800 con 0x7f80bc0ce040 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 >> v1:172.21.15.125:6789/0 conn(0x7f80bc0ce040 legacy=0x7f80bc15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 --2- 172.21.15.125:0/1842132935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 0x7f80a8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 --2- 172.21.15.125:0/1842132935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80a8004850 0x7f80a8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 --2- 172.21.15.125:0/1842132935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a8005200 0x7f80a800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc13f6d0 con 0x7f80a8003b90 2023-11-28T11:08:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a800e270 con 0x7f80a8005200 2023-11-28T11:08:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a800e430 con 0x7f80a8004850 2023-11-28T11:08:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c1e0e700 1 --2- 172.21.15.125:0/1842132935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 0x7f80a8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c160d700 1 --2- 172.21.15.125:0/1842132935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80a8004850 0x7f80a8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c260f700 1 --2- 172.21.15.125:0/1842132935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a8005200 0x7f80a800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c1e0e700 1 -- 172.21.15.125:0/1842132935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80a8004850 msgr2=0x7f80a8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c1e0e700 1 --2- 172.21.15.125:0/1842132935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80a8004850 0x7f80a8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c1e0e700 1 -- 172.21.15.125:0/1842132935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a8005200 msgr2=0x7f80a800dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:36.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c1e0e700 1 --2- 172.21.15.125:0/1842132935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a8005200 0x7f80a800dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c1e0e700 1 -- 172.21.15.125:0/1842132935 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a80035b0 con 0x7f80a8003b90 2023-11-28T11:08:36.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c260f700 1 -- 172.21.15.125:0/1842132935 reap_dead start 2023-11-28T11:08:36.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.535+0000 7f80c1e0e700 1 --2- 172.21.15.125:0/1842132935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 0x7f80a8003f80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c210 tx=0x7f80a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c032f865a3db137a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:36.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.536+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00cd50 con 0x7f80a8003b90 2023-11-28T11:08:36.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.536+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac001c80 con 0x7f80a8003b90 2023-11-28T11:08:36.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.536+0000 7f80c0e0c700 1 -- 172.21.15.125:0/1842132935 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac005ba0 con 0x7f80a8003b90 2023-11-28T11:08:36.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.536+0000 7f80c4072700 1 -- 172.21.15.125:0/1842132935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 msgr2=0x7f80a8003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.536+0000 7f80c4072700 1 --2- 172.21.15.125:0/1842132935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 0x7f80a8003f80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c210 tx=0x7f80a8005880 comp rx=0 tx=0).stop 2023-11-28T11:08:36.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.536+0000 7f80c4072700 1 -- 172.21.15.125:0/1842132935 shutdown_connections 2023-11-28T11:08:36.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.536+0000 7f80c4072700 1 --2- 172.21.15.125:0/1842132935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 0x7f80a8003f80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.536+0000 7f80c4072700 1 -- 172.21.15.125:0/1842132935 >> 172.21.15.125:0/1842132935 conn(0x7f80bc06c010 msgr2=0x7f80bc0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:36.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.536+0000 7f80c4072700 1 -- 172.21.15.125:0/1842132935 shutdown_connections 2023-11-28T11:08:36.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.536+0000 7f80c4072700 1 -- 172.21.15.125:0/1842132935 wait complete. 2023-11-28T11:08:36.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.538+0000 7f80c4072700 1 Processor -- start 2023-11-28T11:08:36.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.538+0000 7f80c4072700 1 -- start start 2023-11-28T11:08:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c4072700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 0x7f80bc157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c4072700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80bc154f20 0x7f80bc153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c4072700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80bc0c2390 0x7f80bc156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c4072700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc153c50 con 0x7f80a8003b90 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c4072700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc153e80 con 0x7f80bc154f20 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c4072700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc154160 con 0x7f80bc0c2390 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c1e0e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 0x7f80bc157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c1e0e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 0x7f80bc157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56684/0 (socket says 172.21.15.125:56684) 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c1e0e700 1 -- 172.21.15.125:0/2932488915 learned_addr learned my addr 172.21.15.125:0/2932488915 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c1e0e700 1 -- 172.21.15.125:0/2932488915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80bc0c2390 msgr2=0x7f80bc156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c260f700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80bc0c2390 0x7f80bc156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c160d700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80bc154f20 0x7f80bc153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c1e0e700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80bc0c2390 0x7f80bc156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c1e0e700 1 -- 172.21.15.125:0/2932488915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80bc154f20 msgr2=0x7f80bc153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c1e0e700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80bc154f20 0x7f80bc153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c1e0e700 1 -- 172.21.15.125:0/2932488915 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc15d3e0 con 0x7f80a8003b90 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c260f700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80bc0c2390 0x7f80bc156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c160d700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80bc154f20 0x7f80bc153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c1e0e700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 0x7f80bc157b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f80a800e240 tx=0x7f80ac001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80b27fc700 1 -- 172.21.15.125:0/2932488915 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0072d0 con 0x7f80a8003b90 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80b27fc700 1 -- 172.21.15.125:0/2932488915 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac007430 con 0x7f80a8003b90 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c4072700 1 -- 172.21.15.125:0/2932488915 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc15d100 con 0x7f80a8003b90 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80b27fc700 1 -- 172.21.15.125:0/2932488915 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0077c0 con 0x7f80a8003b90 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.539+0000 7f80c4072700 1 -- 172.21.15.125:0/2932488915 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc0ce410 con 0x7f80a8003b90 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.540+0000 7f80c4072700 1 -- 172.21.15.125:0/2932488915 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc0743f0 con 0x7f80a8003b90 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.541+0000 7f80b27fc700 1 -- 172.21.15.125:0/2932488915 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f80ac024030 con 0x7f80a8003b90 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.541+0000 7f80b27fc700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f80a00682f0 0x7f80a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.541+0000 7f80b27fc700 1 -- 172.21.15.125:0/2932488915 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80ac086bb0 con 0x7f80a8003b90 2023-11-28T11:08:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.541+0000 7f80c160d700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f80a00682f0 0x7f80a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.541+0000 7f80c160d700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f80a00682f0 0x7f80a006a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f80bc06ad00 tx=0x7f80b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:36.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.545+0000 7f80b27fc700 1 -- 172.21.15.125:0/2932488915 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f80ac08d080 con 0x7f80a8003b90 2023-11-28T11:08:36.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.731+0000 7f80c4072700 1 -- 172.21.15.125:0/2932488915 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80bc15e010 con 0x7f80a8003b90 2023-11-28T11:08:36.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.732+0000 7f80b27fc700 1 -- 172.21.15.125:0/2932488915 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17968 (secure 0 0 0) 0x7f80bc15e010 con 0x7f80a8003b90 2023-11-28T11:08:36.734 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:36.735 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":23,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:36.382867+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:36.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 -- 172.21.15.125:0/2932488915 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f80a00682f0 msgr2=0x7f80a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f80a00682f0 0x7f80a006a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f80bc06ad00 tx=0x7f80b8008040 comp rx=0 tx=0).stop 2023-11-28T11:08:36.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 -- 172.21.15.125:0/2932488915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 msgr2=0x7f80bc157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 0x7f80bc157b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f80a800e240 tx=0x7f80ac001b10 comp rx=0 tx=0).stop 2023-11-28T11:08:36.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 -- 172.21.15.125:0/2932488915 shutdown_connections 2023-11-28T11:08:36.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f80a00682f0 0x7f80a006a7a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80bc0c2390 0x7f80bc156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80a8003b90 0x7f80bc157b20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 --2- 172.21.15.125:0/2932488915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80bc154f20 0x7f80bc153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 -- 172.21.15.125:0/2932488915 >> 172.21.15.125:0/2932488915 conn(0x7f80bc06c010 msgr2=0x7f80bc06ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:36.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 -- 172.21.15.125:0/2932488915 shutdown_connections 2023-11-28T11:08:36.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.734+0000 7f80c4072700 1 -- 172.21.15.125:0/2932488915 wait complete. 2023-11-28T11:08:36.748 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:36.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.867+0000 7f06cbf58700 1 Processor -- start 2023-11-28T11:08:36.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.867+0000 7f06cbf58700 1 -- start start 2023-11-28T11:08:36.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06cbf58700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06c40d15f0 0x7f06c415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06cbf58700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f06c415e010 0x7f06c40ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06cbf58700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c415af30 con 0x7f06c406e400 2023-11-28T11:08:36.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06cbf58700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c415a9d0 con 0x7f06c40d15f0 2023-11-28T11:08:36.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06cbf58700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c41584e0 con 0x7f06c415e010 2023-11-28T11:08:36.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06c94f3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06c40d15f0 0x7f06c415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06c94f3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06c40d15f0 0x7f06c415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56694/0 (socket says 172.21.15.125:56694) 2023-11-28T11:08:36.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06c94f3700 1 -- 172.21.15.125:0/3378403365 learned_addr learned my addr 172.21.15.125:0/3378403365 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:36.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06c94f3700 1 -- 172.21.15.125:0/3378403365 >> v2:172.21.15.167:3300/0 conn(0x7f06c415e010 msgr2=0x7f06c40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:36.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06c94f3700 1 --2- 172.21.15.125:0/3378403365 >> v2:172.21.15.167:3300/0 conn(0x7f06c415e010 0x7f06c40ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06c94f3700 1 -- 172.21.15.125:0/3378403365 >> v1:172.21.15.167:6789/0 conn(0x7f06c406e400 legacy=0x7f06c406e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:36.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06c94f3700 1 -- 172.21.15.125:0/3378403365 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c415ef40 con 0x7f06c40d15f0 2023-11-28T11:08:36.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06c94f3700 1 --2- 172.21.15.125:0/3378403365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06c40d15f0 0x7f06c415b3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06c40b60f0 tx=0x7f06b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1252b4b01e5e9f52 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:36.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06c8cf2700 1 -- 172.21.15.125:0/3378403365 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b4004230 con 0x7f06c40d15f0 2023-11-28T11:08:36.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06c8cf2700 1 -- 172.21.15.125:0/3378403365 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b4004390 con 0x7f06c40d15f0 2023-11-28T11:08:36.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.868+0000 7f06c8cf2700 1 -- 172.21.15.125:0/3378403365 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b40036a0 con 0x7f06c40d15f0 2023-11-28T11:08:36.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.869+0000 7f06cbf58700 1 -- 172.21.15.125:0/3378403365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06c40d15f0 msgr2=0x7f06c415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.869+0000 7f06cbf58700 1 --2- 172.21.15.125:0/3378403365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06c40d15f0 0x7f06c415b3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06c40b60f0 tx=0x7f06b4009bd0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.869+0000 7f06cbf58700 1 -- 172.21.15.125:0/3378403365 shutdown_connections 2023-11-28T11:08:36.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.869+0000 7f06cbf58700 1 --2- 172.21.15.125:0/3378403365 >> v2:172.21.15.167:3300/0 conn(0x7f06c415e010 0x7f06c40ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.869+0000 7f06cbf58700 1 --2- 172.21.15.125:0/3378403365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06c40d15f0 0x7f06c415b3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.869+0000 7f06cbf58700 1 -- 172.21.15.125:0/3378403365 >> 172.21.15.125:0/3378403365 conn(0x7f06c406a270 msgr2=0x7f06c406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:36.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.869+0000 7f06cbf58700 1 -- 172.21.15.125:0/3378403365 shutdown_connections 2023-11-28T11:08:36.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.869+0000 7f06cbf58700 1 -- 172.21.15.125:0/3378403365 wait complete. 2023-11-28T11:08:36.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.870+0000 7f06cbf58700 1 Processor -- start 2023-11-28T11:08:36.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.870+0000 7f06cbf58700 1 -- start start 2023-11-28T11:08:36.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06cbf58700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06c406e400 0x7f06c413e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06cbf58700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06c40d15f0 0x7f06c41e3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06cbf58700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06c415e010 0x7f06c41e4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06cbf58700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c413eed0 con 0x7f06c415e010 2023-11-28T11:08:36.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06cbf58700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40b0b50 con 0x7f06c40d15f0 2023-11-28T11:08:36.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06cbf58700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c413ebc0 con 0x7f06c406e400 2023-11-28T11:08:36.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06ca4f5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06c415e010 0x7f06c41e4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06ca4f5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06c415e010 0x7f06c41e4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56702/0 (socket says 172.21.15.125:56702) 2023-11-28T11:08:36.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06ca4f5700 1 -- 172.21.15.125:0/1252025152 learned_addr learned my addr 172.21.15.125:0/1252025152 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:36.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06c94f3700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06c40d15f0 0x7f06c41e3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06c9cf4700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06c406e400 0x7f06c413e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06ca4f5700 1 -- 172.21.15.125:0/1252025152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06c406e400 msgr2=0x7f06c413e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06ca4f5700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06c406e400 0x7f06c413e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06ca4f5700 1 -- 172.21.15.125:0/1252025152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06c40d15f0 msgr2=0x7f06c41e3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:36.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06ca4f5700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06c40d15f0 0x7f06c41e3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:36.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06ca4f5700 1 -- 172.21.15.125:0/1252025152 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b4009550 con 0x7f06c415e010 2023-11-28T11:08:36.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.871+0000 7f06ca4f5700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06c415e010 0x7f06c41e4390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00b970 tx=0x7f06bc00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:36.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.872+0000 7f06ba7fc700 1 -- 172.21.15.125:0/1252025152 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00c9b0 con 0x7f06c415e010 2023-11-28T11:08:36.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.872+0000 7f06ba7fc700 1 -- 172.21.15.125:0/1252025152 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc00cb30 con 0x7f06c415e010 2023-11-28T11:08:36.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.872+0000 7f06cbf58700 1 -- 172.21.15.125:0/1252025152 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c415ec60 con 0x7f06c415e010 2023-11-28T11:08:36.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.872+0000 7f06ba7fc700 1 -- 172.21.15.125:0/1252025152 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc014440 con 0x7f06c415e010 2023-11-28T11:08:36.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.872+0000 7f06cbf58700 1 -- 172.21.15.125:0/1252025152 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c415e980 con 0x7f06c415e010 2023-11-28T11:08:36.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.873+0000 7f06cbf58700 1 -- 172.21.15.125:0/1252025152 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c415abc0 con 0x7f06c415e010 2023-11-28T11:08:36.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.873+0000 7f06ba7fc700 1 -- 172.21.15.125:0/1252025152 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f06bc01b030 con 0x7f06c415e010 2023-11-28T11:08:36.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.873+0000 7f06ba7fc700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06a80682f0 0x7f06a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:36.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.873+0000 7f06ba7fc700 1 -- 172.21.15.125:0/1252025152 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06bc085910 con 0x7f06c415e010 2023-11-28T11:08:36.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.873+0000 7f06c9cf4700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06a80682f0 0x7f06a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:36.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.874+0000 7f06c9cf4700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06a80682f0 0x7f06a806a7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f06c0001730 tx=0x7f06c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:36.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:36.878+0000 7f06ba7fc700 1 -- 172.21.15.125:0/1252025152 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f06bc052170 con 0x7f06c415e010 2023-11-28T11:08:36.907 INFO:tasks.ceph.mds.a.smithi125.stderr:2023-11-28T11:08:36.905+0000 7f9990892700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:08:37.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.063+0000 7f06cbf58700 1 -- 172.21.15.125:0/1252025152 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06c40b5e30 con 0x7f06c415e010 2023-11-28T11:08:37.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.064+0000 7f06ba7fc700 1 -- 172.21.15.125:0/1252025152 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17968 (secure 0 0 0) 0x7f06bc019090 con 0x7f06c415e010 2023-11-28T11:08:37.067 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:37.067 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":23,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:36.382867+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:37.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 -- 172.21.15.125:0/1252025152 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06a80682f0 msgr2=0x7f06a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:37.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06a80682f0 0x7f06a806a7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f06c0001730 tx=0x7f06c0009040 comp rx=0 tx=0).stop 2023-11-28T11:08:37.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 -- 172.21.15.125:0/1252025152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06c415e010 msgr2=0x7f06c41e4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:37.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06c415e010 0x7f06c41e4390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00b970 tx=0x7f06bc00bd30 comp rx=0 tx=0).stop 2023-11-28T11:08:37.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 -- 172.21.15.125:0/1252025152 shutdown_connections 2023-11-28T11:08:37.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06c415e010 0x7f06c41e4390 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:37.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06a80682f0 0x7f06a806a7a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:37.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06c406e400 0x7f06c413e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:37.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 --2- 172.21.15.125:0/1252025152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06c40d15f0 0x7f06c41e3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:37.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 -- 172.21.15.125:0/1252025152 >> 172.21.15.125:0/1252025152 conn(0x7f06c406a270 msgr2=0x7f06c406a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:37.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 -- 172.21.15.125:0/1252025152 shutdown_connections 2023-11-28T11:08:37.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.066+0000 7f06cbf58700 1 -- 172.21.15.125:0/1252025152 wait complete. 2023-11-28T11:08:37.080 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:08:37.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.203+0000 7f9449642700 1 Processor -- start 2023-11-28T11:08:37.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.203+0000 7f9449642700 1 -- start start 2023-11-28T11:08:37.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.203+0000 7f9449642700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f944415fe50 0x7f944406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:37.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.203+0000 7f9449642700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94440b3b80 0x7f9444160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:37.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.203+0000 7f9449642700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f94440b27d0 0x7f94440b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:37.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.203+0000 7f9449642700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94440b3190 con 0x7f94440b27d0 2023-11-28T11:08:37.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.203+0000 7f9449642700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9444160220 con 0x7f94440b3b80 2023-11-28T11:08:37.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.203+0000 7f9449642700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9444161370 con 0x7f944415fe50 2023-11-28T11:08:37.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.203+0000 7f94437fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f94440b27d0 0x7f94440b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f94437fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f94440b27d0 0x7f94440b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56706/0 (socket says 172.21.15.125:56706) 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f94437fe700 1 -- 172.21.15.125:0/1084943625 learned_addr learned my addr 172.21.15.125:0/1084943625 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f94427fc700 1 --2- 172.21.15.125:0/1084943625 >> v2:172.21.15.167:3300/0 conn(0x7f94440b3b80 0x7f9444160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f9442ffd700 1 --2- 172.21.15.125:0/1084943625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f944415fe50 0x7f944406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f94437fe700 1 -- 172.21.15.125:0/1084943625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f944415fe50 msgr2=0x7f944406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f94437fe700 1 --2- 172.21.15.125:0/1084943625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f944415fe50 0x7f944406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f94437fe700 1 -- 172.21.15.125:0/1084943625 >> v2:172.21.15.167:3300/0 conn(0x7f94440b3b80 msgr2=0x7f9444160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f94437fe700 1 --2- 172.21.15.125:0/1084943625 >> v2:172.21.15.167:3300/0 conn(0x7f94440b3b80 0x7f9444160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f94437fe700 1 -- 172.21.15.125:0/1084943625 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94440cf700 con 0x7f94440b27d0 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f94427fc700 1 --2- 172.21.15.125:0/1084943625 >> v2:172.21.15.167:3300/0 conn(0x7f94440b3b80 0x7f9444160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f9442ffd700 1 --2- 172.21.15.125:0/1084943625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f944415fe50 0x7f944406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:37.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f94437fe700 1 --2- 172.21.15.125:0/1084943625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94440b27d0 0x7f94440b2c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f94440719d0 tx=0x7f943c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13571d0c2b0bdef5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f9441ffb700 1 -- 172.21.15.125:0/1084943625 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00e070 con 0x7f94440b27d0 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f9441ffb700 1 -- 172.21.15.125:0/1084943625 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c00b980 con 0x7f94440b27d0 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.204+0000 7f9441ffb700 1 -- 172.21.15.125:0/1084943625 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00bd30 con 0x7f94440b27d0 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.205+0000 7f9449642700 1 -- 172.21.15.125:0/1084943625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94440b27d0 msgr2=0x7f94440b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.205+0000 7f9449642700 1 --2- 172.21.15.125:0/1084943625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94440b27d0 0x7f94440b2c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f94440719d0 tx=0x7f943c00b330 comp rx=0 tx=0).stop 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.205+0000 7f9449642700 1 -- 172.21.15.125:0/1084943625 shutdown_connections 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.205+0000 7f9449642700 1 --2- 172.21.15.125:0/1084943625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94440b27d0 0x7f94440b2c50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.205+0000 7f9449642700 1 --2- 172.21.15.125:0/1084943625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f944415fe50 0x7f944406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.205+0000 7f9449642700 1 --2- 172.21.15.125:0/1084943625 >> v2:172.21.15.167:3300/0 conn(0x7f94440b3b80 0x7f9444160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.205+0000 7f9449642700 1 -- 172.21.15.125:0/1084943625 >> 172.21.15.125:0/1084943625 conn(0x7f944406ea80 msgr2=0x7f944406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.205+0000 7f9449642700 1 -- 172.21.15.125:0/1084943625 shutdown_connections 2023-11-28T11:08:37.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.205+0000 7f9449642700 1 -- 172.21.15.125:0/1084943625 wait complete. 2023-11-28T11:08:37.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.206+0000 7f9449642700 1 Processor -- start 2023-11-28T11:08:37.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.206+0000 7f9449642700 1 -- start start 2023-11-28T11:08:37.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f9449642700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94440b27d0 0x7f94440cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:37.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f9449642700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94440b3b80 0x7f9444157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:37.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f9449642700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f944415fe50 0x7f94441f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:37.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f9449642700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440ccec0 con 0x7f94440b3b80 2023-11-28T11:08:37.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f9449642700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440acb00 con 0x7f944415fe50 2023-11-28T11:08:37.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f9449642700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94440cd440 con 0x7f94440b27d0 2023-11-28T11:08:37.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f94427fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94440b3b80 0x7f9444157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:37.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f94427fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94440b3b80 0x7f9444157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56714/0 (socket says 172.21.15.125:56714) 2023-11-28T11:08:37.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f94427fc700 1 -- 172.21.15.125:0/1820391683 learned_addr learned my addr 172.21.15.125:0/1820391683 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:37.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f9442ffd700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94440b27d0 0x7f94440cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:37.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f94437fe700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f944415fe50 0x7f94441f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:37.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f94427fc700 1 -- 172.21.15.125:0/1820391683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94440b27d0 msgr2=0x7f94440cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:37.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f94427fc700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94440b27d0 0x7f94440cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:37.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f94427fc700 1 -- 172.21.15.125:0/1820391683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f944415fe50 msgr2=0x7f94441f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:37.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f94427fc700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f944415fe50 0x7f94441f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:37.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f94427fc700 1 -- 172.21.15.125:0/1820391683 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c009b30 con 0x7f94440b3b80 2023-11-28T11:08:37.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f94427fc700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94440b3b80 0x7f9444157230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f943400c820 tx=0x7f943400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:37.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.207+0000 7f943b7fe700 1 -- 172.21.15.125:0/1820391683 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434011800 con 0x7f94440b3b80 2023-11-28T11:08:37.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.208+0000 7f943b7fe700 1 -- 172.21.15.125:0/1820391683 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9434011960 con 0x7f94440b3b80 2023-11-28T11:08:37.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.208+0000 7f943b7fe700 1 -- 172.21.15.125:0/1820391683 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434011cf0 con 0x7f94440b3b80 2023-11-28T11:08:37.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.208+0000 7f9449642700 1 -- 172.21.15.125:0/1820391683 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94440cedd0 con 0x7f94440b3b80 2023-11-28T11:08:37.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.208+0000 7f9449642700 1 -- 172.21.15.125:0/1820391683 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94440b3fd0 con 0x7f94440b3b80 2023-11-28T11:08:37.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.208+0000 7f9449642700 1 -- 172.21.15.125:0/1820391683 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94440cf0b0 con 0x7f94440b3b80 2023-11-28T11:08:37.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.209+0000 7f943b7fe700 1 -- 172.21.15.125:0/1820391683 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9434017030 con 0x7f94440b3b80 2023-11-28T11:08:37.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.209+0000 7f943b7fe700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94240682f0 0x7f942406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:37.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.209+0000 7f943b7fe700 1 -- 172.21.15.125:0/1820391683 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9434085d90 con 0x7f94440b3b80 2023-11-28T11:08:37.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.209+0000 7f9442ffd700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94240682f0 0x7f942406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:37.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.210+0000 7f9442ffd700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94240682f0 0x7f942406a7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f942c006fd0 tx=0x7f942c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:37.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.213+0000 7f943b7fe700 1 -- 172.21.15.125:0/1820391683 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9434052560 con 0x7f94440b3b80 2023-11-28T11:08:37.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:37.443+0000 7f9449642700 1 -- 172.21.15.125:0/1820391683 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f94440cd5b0 con 0x7f94440b3b80 2023-11-28T11:08:38.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.391+0000 7f943b7fe700 1 -- 172.21.15.125:0/1820391683 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f943401f0b0 con 0x7f94440b3b80 2023-11-28T11:08:38.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 -- 172.21.15.125:0/1820391683 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94240682f0 msgr2=0x7f942406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:38.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94240682f0 0x7f942406a7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f942c006fd0 tx=0x7f942c008040 comp rx=0 tx=0).stop 2023-11-28T11:08:38.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 -- 172.21.15.125:0/1820391683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94440b3b80 msgr2=0x7f9444157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:38.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94440b3b80 0x7f9444157230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f943400c820 tx=0x7f943400cb30 comp rx=0 tx=0).stop 2023-11-28T11:08:38.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 -- 172.21.15.125:0/1820391683 shutdown_connections 2023-11-28T11:08:38.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f944415fe50 0x7f94441f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:38.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94240682f0 0x7f942406a7a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:38.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94440b27d0 0x7f94440cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:38.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 --2- 172.21.15.125:0/1820391683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94440b3b80 0x7f9444157230 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:38.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 -- 172.21.15.125:0/1820391683 >> 172.21.15.125:0/1820391683 conn(0x7f944406ea80 msgr2=0x7f944406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:38.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 -- 172.21.15.125:0/1820391683 shutdown_connections 2023-11-28T11:08:38.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.394+0000 7f9449642700 1 -- 172.21.15.125:0/1820391683 wait complete. 2023-11-28T11:08:38.410 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T11:08:38.410 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:08:38.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.537+0000 7fd388646700 1 Processor -- start 2023-11-28T11:08:38.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.537+0000 7fd388646700 1 -- start start 2023-11-28T11:08:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd388646700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd38006a980 0x7fd3800ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd388646700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd380071890 0x7fd380071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd388646700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38015cc10 con 0x7fd3800cf710 2023-11-28T11:08:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd388646700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38006c9b0 con 0x7fd38006a980 2023-11-28T11:08:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd388646700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38006cc90 con 0x7fd380071890 2023-11-28T11:08:38.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd385be1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd38006a980 0x7fd3800ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd385be1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd38006a980 0x7fd3800ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56722/0 (socket says 172.21.15.125:56722) 2023-11-28T11:08:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd385be1700 1 -- 172.21.15.125:0/979168092 learned_addr learned my addr 172.21.15.125:0/979168092 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd386be3700 1 --2- 172.21.15.125:0/979168092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd380071890 0x7fd380071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd385be1700 1 -- 172.21.15.125:0/979168092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd380071890 msgr2=0x7fd380071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd385be1700 1 --2- 172.21.15.125:0/979168092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd380071890 0x7fd380071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd385be1700 1 -- 172.21.15.125:0/979168092 >> v1:172.21.15.167:6789/0 conn(0x7fd3800cf710 legacy=0x7fd38006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd385be1700 1 -- 172.21.15.125:0/979168092 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38006cf70 con 0x7fd38006a980 2023-11-28T11:08:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd385be1700 1 --2- 172.21.15.125:0/979168092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd38006a980 0x7fd3800ce740 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd3700098f0 tx=0x7fd370009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a064c5b96e518430 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.538+0000 7fd3853e0700 1 -- 172.21.15.125:0/979168092 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37000b8a0 con 0x7fd38006a980 2023-11-28T11:08:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.539+0000 7fd3853e0700 1 -- 172.21.15.125:0/979168092 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37000ba00 con 0x7fd38006a980 2023-11-28T11:08:38.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.539+0000 7fd3853e0700 1 -- 172.21.15.125:0/979168092 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37000bd90 con 0x7fd38006a980 2023-11-28T11:08:38.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.539+0000 7fd388646700 1 -- 172.21.15.125:0/979168092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd38006a980 msgr2=0x7fd3800ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:38.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.539+0000 7fd388646700 1 --2- 172.21.15.125:0/979168092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd38006a980 0x7fd3800ce740 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd3700098f0 tx=0x7fd370009c00 comp rx=0 tx=0).stop 2023-11-28T11:08:38.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.539+0000 7fd388646700 1 -- 172.21.15.125:0/979168092 shutdown_connections 2023-11-28T11:08:38.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.539+0000 7fd388646700 1 --2- 172.21.15.125:0/979168092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd380071890 0x7fd380071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:38.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.539+0000 7fd388646700 1 --2- 172.21.15.125:0/979168092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd38006a980 0x7fd3800ce740 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:38.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.539+0000 7fd388646700 1 -- 172.21.15.125:0/979168092 >> 172.21.15.125:0/979168092 conn(0x7fd38006c010 msgr2=0x7fd3800cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:38.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.539+0000 7fd388646700 1 -- 172.21.15.125:0/979168092 shutdown_connections 2023-11-28T11:08:38.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.539+0000 7fd388646700 1 -- 172.21.15.125:0/979168092 wait complete. 2023-11-28T11:08:38.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.541+0000 7fd388646700 1 Processor -- start 2023-11-28T11:08:38.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.541+0000 7fd388646700 1 -- start start 2023-11-28T11:08:38.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd388646700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd38006a980 0x7fd3801f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:38.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd388646700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd380071890 0x7fd38015da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:38.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd388646700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3800cf710 0x7fd3800b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:38.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd388646700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800aede0 con 0x7fd38006a980 2023-11-28T11:08:38.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd388646700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380159860 con 0x7fd380071890 2023-11-28T11:08:38.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd388646700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd380159b40 con 0x7fd3800cf710 2023-11-28T11:08:38.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd3863e2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd38006a980 0x7fd3801f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:38.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd3863e2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd38006a980 0x7fd3801f6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56726/0 (socket says 172.21.15.125:56726) 2023-11-28T11:08:38.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd3863e2700 1 -- 172.21.15.125:0/1752103465 learned_addr learned my addr 172.21.15.125:0/1752103465 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:38.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd3863e2700 1 -- 172.21.15.125:0/1752103465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3800cf710 msgr2=0x7fd3800b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:38.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd3863e2700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3800cf710 0x7fd3800b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:38.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd385be1700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd380071890 0x7fd38015da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:38.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd3863e2700 1 -- 172.21.15.125:0/1752103465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd380071890 msgr2=0x7fd38015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:38.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd3863e2700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd380071890 0x7fd38015da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:38.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd3863e2700 1 -- 172.21.15.125:0/1752103465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370009550 con 0x7fd38006a980 2023-11-28T11:08:38.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd3863e2700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd38006a980 0x7fd3801f6200 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00c450 tx=0x7fd37c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:38.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd376ffd700 1 -- 172.21.15.125:0/1752103465 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0052d0 con 0x7fd38006a980 2023-11-28T11:08:38.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd376ffd700 1 -- 172.21.15.125:0/1752103465 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c005430 con 0x7fd38006a980 2023-11-28T11:08:38.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd388646700 1 -- 172.21.15.125:0/1752103465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38006d530 con 0x7fd38006a980 2023-11-28T11:08:38.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd376ffd700 1 -- 172.21.15.125:0/1752103465 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0038c0 con 0x7fd38006a980 2023-11-28T11:08:38.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.542+0000 7fd388646700 1 -- 172.21.15.125:0/1752103465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38006d250 con 0x7fd38006a980 2023-11-28T11:08:38.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.543+0000 7fd388646700 1 -- 172.21.15.125:0/1752103465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd380160480 con 0x7fd38006a980 2023-11-28T11:08:38.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.544+0000 7fd376ffd700 1 -- 172.21.15.125:0/1752103465 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd37c019030 con 0x7fd38006a980 2023-11-28T11:08:38.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.544+0000 7fd376ffd700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3640682f0 0x7fd36406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:38.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.544+0000 7fd376ffd700 1 -- 172.21.15.125:0/1752103465 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd37c084e80 con 0x7fd38006a980 2023-11-28T11:08:38.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.544+0000 7fd385be1700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3640682f0 0x7fd36406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:38.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.544+0000 7fd385be1700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3640682f0 0x7fd36406a7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd370009c40 tx=0x7fd370008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:38.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.548+0000 7fd376ffd700 1 -- 172.21.15.125:0/1752103465 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd37c0516e0 con 0x7fd38006a980 2023-11-28T11:08:38.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:38.772+0000 7fd388646700 1 -- 172.21.15.125:0/1752103465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd380070b50 con 0x7fd38006a980 2023-11-28T11:08:39.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.392+0000 7fd376ffd700 1 -- 172.21.15.125:0/1752103465 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd37c054d00 con 0x7fd38006a980 2023-11-28T11:08:39.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.394+0000 7fd388646700 1 -- 172.21.15.125:0/1752103465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3640682f0 msgr2=0x7fd36406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.394+0000 7fd388646700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3640682f0 0x7fd36406a7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd370009c40 tx=0x7fd370008030 comp rx=0 tx=0).stop 2023-11-28T11:08:39.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.394+0000 7fd388646700 1 -- 172.21.15.125:0/1752103465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd38006a980 msgr2=0x7fd3801f6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.394+0000 7fd388646700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd38006a980 0x7fd3801f6200 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00c450 tx=0x7fd37c00c810 comp rx=0 tx=0).stop 2023-11-28T11:08:39.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.395+0000 7fd388646700 1 -- 172.21.15.125:0/1752103465 shutdown_connections 2023-11-28T11:08:39.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.395+0000 7fd388646700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3640682f0 0x7fd36406a7a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.395+0000 7fd388646700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3800cf710 0x7fd3800b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.395+0000 7fd388646700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd38006a980 0x7fd3801f6200 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.395+0000 7fd388646700 1 --2- 172.21.15.125:0/1752103465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd380071890 0x7fd38015da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.395+0000 7fd388646700 1 -- 172.21.15.125:0/1752103465 >> 172.21.15.125:0/1752103465 conn(0x7fd38006c010 msgr2=0x7fd3800b53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:39.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.395+0000 7fd388646700 1 -- 172.21.15.125:0/1752103465 shutdown_connections 2023-11-28T11:08:39.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.395+0000 7fd388646700 1 -- 172.21.15.125:0/1752103465 wait complete. 2023-11-28T11:08:39.409 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:08:39.409 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:08:39.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.528+0000 7f776a924700 1 Processor -- start 2023-11-28T11:08:39.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.528+0000 7f776a924700 1 -- start start 2023-11-28T11:08:39.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f776a924700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776406e400 0x7f77640b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f776a924700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776406e900 con 0x7f77640d0c60 2023-11-28T11:08:39.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f776a924700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7764160390 con 0x7f7764160e70 2023-11-28T11:08:39.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f776a924700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7764160670 con 0x7f776406e400 2023-11-28T11:08:39.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7763fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f77640d0c60 0x7f77640d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40858/0 (socket says 172.21.15.125:40858) 2023-11-28T11:08:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7763fff700 1 -- 172.21.15.125:0/519310695 learned_addr learned my addr 172.21.15.125:0/519310695 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160244460 0 0) 0x7f776406e900 con 0x7f77640d0c60 2023-11-28T11:08:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77500035b0 con 0x7f77640d0c60 2023-11-28T11:08:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f77637fe700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776406e400 0x7f77640b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 224929687 0 0) 0x7f77500035b0 con 0x7f77640d0c60 2023-11-28T11:08:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776406e400 msgr2=0x7f77640b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776406e400 0x7f77640b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 >> v1:172.21.15.167:6789/0 conn(0x7f7764160e70 legacy=0x7f776415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7764160950 con 0x7f77640d0c60 2023-11-28T11:08:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f7754001670 con 0x7f77640d0c60 2023-11-28T11:08:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f77637fe700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776406e400 0x7f77640b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 >> v1:172.21.15.125:6789/0 conn(0x7f77640d0c60 legacy=0x7f77640d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7750003a30 0x7f7750003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7750004850 0x7f7750004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776406e400 0x7f7750005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7764160670 con 0x7f7750003a30 2023-11-28T11:08:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775000baf0 con 0x7f7750004850 2023-11-28T11:08:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775000bcb0 con 0x7f776406e400 2023-11-28T11:08:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7763fff700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7750003a30 0x7f7750003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f77637fe700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7750004850 0x7f7750004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.529+0000 7f7768ec1700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776406e400 0x7f7750005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f7763fff700 1 -- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776406e400 msgr2=0x7f7750005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f7763fff700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776406e400 0x7f7750005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f7763fff700 1 -- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7750004850 msgr2=0x7f7750004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f7763fff700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7750004850 0x7f7750004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f7763fff700 1 -- 172.21.15.125:0/519310695 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77500035b0 con 0x7f7750003a30 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f7768ec1700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776406e400 0x7f7750005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f7763fff700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7750003a30 0x7f7750003e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f775400c240 tx=0x7f7750005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eac56ed6e640e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754007c10 con 0x7f7750003a30 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775400ce00 con 0x7f7750003a30 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f7762ffd700 1 -- 172.21.15.125:0/519310695 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754005ba0 con 0x7f7750003a30 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f776a924700 1 -- 172.21.15.125:0/519310695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7750003a30 msgr2=0x7f7750003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f776a924700 1 --2- 172.21.15.125:0/519310695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7750003a30 0x7f7750003e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f775400c240 tx=0x7f7750005880 comp rx=0 tx=0).stop 2023-11-28T11:08:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f7768ec1700 1 -- 172.21.15.125:0/519310695 reap_dead start 2023-11-28T11:08:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f776a924700 1 -- 172.21.15.125:0/519310695 shutdown_connections 2023-11-28T11:08:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f776a924700 1 -- 172.21.15.125:0/519310695 >> 172.21.15.125:0/519310695 conn(0x7f776406a270 msgr2=0x7f776406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f776a924700 1 -- 172.21.15.125:0/519310695 shutdown_connections 2023-11-28T11:08:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.530+0000 7f776a924700 1 -- 172.21.15.125:0/519310695 wait complete. 2023-11-28T11:08:39.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.532+0000 7f776a924700 1 Processor -- start 2023-11-28T11:08:39.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.532+0000 7f776a924700 1 -- start start 2023-11-28T11:08:39.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f776a924700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7750003a30 0x7f7764152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f776a924700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776415e240 0x7f77641e7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f776a924700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77641e8250 0x7f7764153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f776a924700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7764155c40 con 0x7f77641e8250 2023-11-28T11:08:39.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f776a924700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7764152dc0 con 0x7f7750003a30 2023-11-28T11:08:39.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f776a924700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776415e6b0 con 0x7f776415e240 2023-11-28T11:08:39.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f7768ec1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77641e8250 0x7f7764153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f7768ec1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77641e8250 0x7f7764153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56748/0 (socket says 172.21.15.125:56748) 2023-11-28T11:08:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f7768ec1700 1 -- 172.21.15.125:0/3304630438 learned_addr learned my addr 172.21.15.125:0/3304630438 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f7763fff700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7750003a30 0x7f7764152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f77637fe700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776415e240 0x7f77641e7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f7768ec1700 1 -- 172.21.15.125:0/3304630438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776415e240 msgr2=0x7f77641e7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f7768ec1700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776415e240 0x7f77641e7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f7768ec1700 1 -- 172.21.15.125:0/3304630438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7750003a30 msgr2=0x7f7764152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f7768ec1700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7750003a30 0x7f7764152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f7768ec1700 1 -- 172.21.15.125:0/3304630438 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640b5be0 con 0x7f77641e8250 2023-11-28T11:08:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.533+0000 7f7763fff700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7750003a30 0x7f7764152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.534+0000 7f7768ec1700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77641e8250 0x7f7764153730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77500047d0 tx=0x7f775c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.534+0000 7f7760ff9700 1 -- 172.21.15.125:0/3304630438 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c003c10 con 0x7f77641e8250 2023-11-28T11:08:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.534+0000 7f7760ff9700 1 -- 172.21.15.125:0/3304630438 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c003d90 con 0x7f77641e8250 2023-11-28T11:08:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.534+0000 7f776a924700 1 -- 172.21.15.125:0/3304630438 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77640d0740 con 0x7f77641e8250 2023-11-28T11:08:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.534+0000 7f7760ff9700 1 -- 172.21.15.125:0/3304630438 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c005310 con 0x7f77641e8250 2023-11-28T11:08:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.534+0000 7f776a924700 1 -- 172.21.15.125:0/3304630438 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77640b5d70 con 0x7f77641e8250 2023-11-28T11:08:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.535+0000 7f7760ff9700 1 -- 172.21.15.125:0/3304630438 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f775c005470 con 0x7f77641e8250 2023-11-28T11:08:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.535+0000 7f776a924700 1 -- 172.21.15.125:0/3304630438 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7764155d80 con 0x7f77641e8250 2023-11-28T11:08:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.535+0000 7f7760ff9700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77440682f0 0x7f774406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.535+0000 7f7760ff9700 1 -- 172.21.15.125:0/3304630438 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f775c085e10 con 0x7f77641e8250 2023-11-28T11:08:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.535+0000 7f7763fff700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77440682f0 0x7f774406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.536+0000 7f7763fff700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77440682f0 0x7f774406a7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7754015040 tx=0x7f7754007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.540+0000 7f7760ff9700 1 -- 172.21.15.125:0/3304630438 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7764155d80 con 0x7f77641e8250 2023-11-28T11:08:39.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.764+0000 7f776a924700 1 -- 172.21.15.125:0/3304630438 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7764155d80 con 0x7f77641e8250 2023-11-28T11:08:39.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.765+0000 7f7760ff9700 1 -- 172.21.15.125:0/3304630438 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f7764155d80 con 0x7f77641e8250 2023-11-28T11:08:39.766 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:39.767 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/678190712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":678190712},{"type":"v1","addr":"172.21.15.167:6835","nonce":678190712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2090095557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2090095557},{"type":"v1","addr":"172.21.15.167:6834","nonce":2090095557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3827244932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3827244932},{"type":"v1","addr":"172.21.15.125:6836","nonce":3827244932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:08:36.383224+0000","modified":"2023-11-28T11:08:39.391168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/573741186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":573741186},{"type":"v1","addr":"172.21.15.125:6837","nonce":573741186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:08:39.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 -- 172.21.15.125:0/3304630438 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77440682f0 msgr2=0x7f774406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77440682f0 0x7f774406a7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7754015040 tx=0x7f7754007000 comp rx=0 tx=0).stop 2023-11-28T11:08:39.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 -- 172.21.15.125:0/3304630438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77641e8250 msgr2=0x7f7764153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77641e8250 0x7f7764153730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77500047d0 tx=0x7f775c00ee70 comp rx=0 tx=0).stop 2023-11-28T11:08:39.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 -- 172.21.15.125:0/3304630438 shutdown_connections 2023-11-28T11:08:39.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77641e8250 0x7f7764153730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7750003a30 0x7f7764152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77440682f0 0x7f774406a7a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 --2- 172.21.15.125:0/3304630438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f776415e240 0x7f77641e7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 -- 172.21.15.125:0/3304630438 >> 172.21.15.125:0/3304630438 conn(0x7f776406a270 msgr2=0x7f77640b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:39.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 -- 172.21.15.125:0/3304630438 shutdown_connections 2023-11-28T11:08:39.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.767+0000 7f776a924700 1 -- 172.21.15.125:0/3304630438 wait complete. 2023-11-28T11:08:39.770 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-11-28T11:08:39.781 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.898+0000 7f8aab5cc700 1 Processor -- start 2023-11-28T11:08:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.899+0000 7f8aab5cc700 1 -- start start 2023-11-28T11:08:39.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.899+0000 7f8aab5cc700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8aa406e400 0x7f8aa406e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.899+0000 7f8aab5cc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa415af30 con 0x7f8aa415e010 2023-11-28T11:08:39.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aab5cc700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa415ef40 con 0x7f8aa40d15f0 2023-11-28T11:08:39.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aab5cc700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa415a9d0 con 0x7f8aa406e400 2023-11-28T11:08:39.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aa9b69700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8aa415e010 0x7f8aa40ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40882/0 (socket says 172.21.15.125:40882) 2023-11-28T11:08:39.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aa9b69700 1 -- 172.21.15.125:0/4239596327 learned_addr learned my addr 172.21.15.125:0/4239596327 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:39.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aa9368700 1 --2- 172.21.15.125:0/4239596327 >> v2:172.21.15.167:3300/0 conn(0x7f8aa406e400 0x7f8aa406e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898472940 0 0) 0x7f8aa415af30 con 0x7f8aa415e010 2023-11-28T11:08:39.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a900035b0 con 0x7f8aa415e010 2023-11-28T11:08:39.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 69931385 0 0) 0x7f8a900035b0 con 0x7f8aa415e010 2023-11-28T11:08:39.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 >> v2:172.21.15.167:3300/0 conn(0x7f8aa406e400 msgr2=0x7f8aa406e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:39.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 --2- 172.21.15.125:0/4239596327 >> v2:172.21.15.167:3300/0 conn(0x7f8aa406e400 0x7f8aa406e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 >> v1:172.21.15.167:6789/0 conn(0x7f8aa40d15f0 legacy=0x7f8aa415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa406ed10 con 0x7f8aa415e010 2023-11-28T11:08:39.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f8a9c0019f0 con 0x7f8aa415e010 2023-11-28T11:08:39.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 >> v1:172.21.15.125:6789/0 conn(0x7f8aa415e010 legacy=0x7f8aa40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 0x7f8a90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a90004850 0x7f8a90004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90005200 0x7f8a9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9000c050 con 0x7f8a90003a00 2023-11-28T11:08:39.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9000c1c0 con 0x7f8a90005200 2023-11-28T11:08:39.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9000c380 con 0x7f8a90004850 2023-11-28T11:08:39.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aa9368700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 0x7f8a90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aa8b67700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a90004850 0x7f8a90004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aa9b69700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90005200 0x7f8a9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aa9368700 1 -- 172.21.15.125:0/4239596327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a90004850 msgr2=0x7f8a90004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:39.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aa9368700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a90004850 0x7f8a90004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aa9368700 1 -- 172.21.15.125:0/4239596327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90005200 msgr2=0x7f8a9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:39.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aa9368700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90005200 0x7f8a9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.900+0000 7f8aa9368700 1 -- 172.21.15.125:0/4239596327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a900035b0 con 0x7f8a90003a00 2023-11-28T11:08:39.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8aa9b69700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90005200 0x7f8a9000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:39.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8aa9b69700 1 -- 172.21.15.125:0/4239596327 reap_dead start 2023-11-28T11:08:39.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8aa9368700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 0x7f8a90003e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009b60 tx=0x7f8a90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa557816f933efa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:39.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9400e6c0 con 0x7f8a90003a00 2023-11-28T11:08:39.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9400e820 con 0x7f8a90003a00 2023-11-28T11:08:39.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8a9bfff700 1 -- 172.21.15.125:0/4239596327 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9400eb90 con 0x7f8a90003a00 2023-11-28T11:08:39.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8aab5cc700 1 -- 172.21.15.125:0/4239596327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 msgr2=0x7f8a90003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8aab5cc700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 0x7f8a90003e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009b60 tx=0x7f8a90005880 comp rx=0 tx=0).stop 2023-11-28T11:08:39.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8aab5cc700 1 -- 172.21.15.125:0/4239596327 shutdown_connections 2023-11-28T11:08:39.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8aab5cc700 1 --2- 172.21.15.125:0/4239596327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 0x7f8a90003e10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8aab5cc700 1 -- 172.21.15.125:0/4239596327 >> 172.21.15.125:0/4239596327 conn(0x7f8aa406a270 msgr2=0x7f8aa406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:39.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8aab5cc700 1 -- 172.21.15.125:0/4239596327 shutdown_connections 2023-11-28T11:08:39.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.901+0000 7f8aab5cc700 1 -- 172.21.15.125:0/4239596327 wait complete. 2023-11-28T11:08:39.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.902+0000 7f8aab5cc700 1 Processor -- start 2023-11-28T11:08:39.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.903+0000 7f8aab5cc700 1 -- start start 2023-11-28T11:08:39.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.903+0000 7f8aab5cc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 0x7f8aa414c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.903+0000 7f8aab5cc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8aa4150a10 0x7f8aa4159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.903+0000 7f8aab5cc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8aa414cbd0 0x7f8aa41514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.903+0000 7f8aab5cc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40cbec0 con 0x7f8a90003a00 2023-11-28T11:08:39.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.903+0000 7f8aab5cc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa414ca10 con 0x7f8aa4150a10 2023-11-28T11:08:39.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.903+0000 7f8aab5cc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4158c50 con 0x7f8aa414cbd0 2023-11-28T11:08:39.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.903+0000 7f8aa9368700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 0x7f8aa414c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.903+0000 7f8aa9368700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 0x7f8aa414c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56766/0 (socket says 172.21.15.125:56766) 2023-11-28T11:08:39.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.903+0000 7f8aa9368700 1 -- 172.21.15.125:0/1325626970 learned_addr learned my addr 172.21.15.125:0/1325626970 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:39.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.903+0000 7f8aa9b69700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8aa414cbd0 0x7f8aa41514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8aa8b67700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8aa4150a10 0x7f8aa4159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8aa9368700 1 -- 172.21.15.125:0/1325626970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8aa414cbd0 msgr2=0x7f8aa41514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8aa9368700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8aa414cbd0 0x7f8aa41514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8aa9368700 1 -- 172.21.15.125:0/1325626970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8aa4150a10 msgr2=0x7f8aa4159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:39.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8aa9368700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8aa4150a10 0x7f8aa4159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:39.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8aa9368700 1 -- 172.21.15.125:0/1325626970 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa415ec60 con 0x7f8a90003a00 2023-11-28T11:08:39.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8aa9368700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 0x7f8aa414c4d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400e4b0 tx=0x7f8a940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:39.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8a99ffb700 1 -- 172.21.15.125:0/1325626970 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9400e6c0 con 0x7f8a90003a00 2023-11-28T11:08:39.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8a99ffb700 1 -- 172.21.15.125:0/1325626970 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a94003ad0 con 0x7f8a90003a00 2023-11-28T11:08:39.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8aab5cc700 1 -- 172.21.15.125:0/1325626970 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa415e980 con 0x7f8a90003a00 2023-11-28T11:08:39.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8a99ffb700 1 -- 172.21.15.125:0/1325626970 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94003e80 con 0x7f8a90003a00 2023-11-28T11:08:39.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.904+0000 7f8aab5cc700 1 -- 172.21.15.125:0/1325626970 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa415abc0 con 0x7f8a90003a00 2023-11-28T11:08:39.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.905+0000 7f8aab5cc700 1 -- 172.21.15.125:0/1325626970 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa4159d90 con 0x7f8a90003a00 2023-11-28T11:08:39.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.905+0000 7f8a99ffb700 1 -- 172.21.15.125:0/1325626970 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8a94019030 con 0x7f8a90003a00 2023-11-28T11:08:39.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.906+0000 7f8a99ffb700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8a880682f0 0x7f8a8806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:39.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.906+0000 7f8a99ffb700 1 -- 172.21.15.125:0/1325626970 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8a940872e0 con 0x7f8a90003a00 2023-11-28T11:08:39.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.906+0000 7f8aa8b67700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8a880682f0 0x7f8a8806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:39.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.906+0000 7f8aa8b67700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8a880682f0 0x7f8a8806a7a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4151110 tx=0x7f8aa0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:39.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:39.910+0000 7f8a99ffb700 1 -- 172.21.15.125:0/1325626970 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8a94053b40 con 0x7f8a90003a00 2023-11-28T11:08:40.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.093+0000 7f8aab5cc700 1 -- 172.21.15.125:0/1325626970 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8aa40743f0 con 0x7f8a90003a00 2023-11-28T11:08:40.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.094+0000 7f8a99ffb700 1 -- 172.21.15.125:0/1325626970 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f8a94057160 con 0x7f8a90003a00 2023-11-28T11:08:40.096 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:40.097 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:40.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 -- 172.21.15.125:0/1325626970 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8a880682f0 msgr2=0x7f8a8806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8a880682f0 0x7f8a8806a7a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4151110 tx=0x7f8aa0009040 comp rx=0 tx=0).stop 2023-11-28T11:08:40.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 -- 172.21.15.125:0/1325626970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 msgr2=0x7f8aa414c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 0x7f8aa414c4d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400e4b0 tx=0x7f8a940047c0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 -- 172.21.15.125:0/1325626970 shutdown_connections 2023-11-28T11:08:40.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8a880682f0 0x7f8a8806a7a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8aa414cbd0 0x7f8aa41514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a90003a00 0x7f8aa414c4d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 --2- 172.21.15.125:0/1325626970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8aa4150a10 0x7f8aa4159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 -- 172.21.15.125:0/1325626970 >> 172.21.15.125:0/1325626970 conn(0x7f8aa406a270 msgr2=0x7f8aa40d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:40.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 -- 172.21.15.125:0/1325626970 shutdown_connections 2023-11-28T11:08:40.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.096+0000 7f8aab5cc700 1 -- 172.21.15.125:0/1325626970 wait complete. 2023-11-28T11:08:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:08:40.110 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:08:40.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.228+0000 7fed6abcc700 1 Processor -- start 2023-11-28T11:08:40.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.228+0000 7fed6abcc700 1 -- start start 2023-11-28T11:08:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed6abcc700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed6415e010 0x7fed640ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed6abcc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6415af30 con 0x7fed640d15f0 2023-11-28T11:08:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed6abcc700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6415ef40 con 0x7fed6406e400 2023-11-28T11:08:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed6abcc700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6415a9d0 con 0x7fed6415e010 2023-11-28T11:08:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed63fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fed640d15f0 0x7fed6415b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40900/0 (socket says 172.21.15.125:40900) 2023-11-28T11:08:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed63fff700 1 -- 172.21.15.125:0/3472598333 learned_addr learned my addr 172.21.15.125:0/3472598333 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed69169700 1 --2- 172.21.15.125:0/3472598333 >> v2:172.21.15.167:3300/0 conn(0x7fed6415e010 0x7fed640ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972574302 0 0) 0x7fed6415af30 con 0x7fed640d15f0 2023-11-28T11:08:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed540035b0 con 0x7fed640d15f0 2023-11-28T11:08:40.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236557130 0 0) 0x7fed6415ef40 con 0x7fed6406e400 2023-11-28T11:08:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed6415af30 con 0x7fed6406e400 2023-11-28T11:08:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3862496237 0 0) 0x7fed540035b0 con 0x7fed640d15f0 2023-11-28T11:08:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 >> v2:172.21.15.167:3300/0 conn(0x7fed6415e010 msgr2=0x7fed640ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 --2- 172.21.15.125:0/3472598333 >> v2:172.21.15.167:3300/0 conn(0x7fed6415e010 0x7fed640ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 >> v1:172.21.15.167:6789/0 conn(0x7fed6406e400 legacy=0x7fed6406e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6415e980 con 0x7fed640d15f0 2023-11-28T11:08:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fed50001670 con 0x7fed640d15f0 2023-11-28T11:08:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed69169700 1 --2- 172.21.15.125:0/3472598333 >> v2:172.21.15.167:3300/0 conn(0x7fed6415e010 0x7fed640ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 >> v1:172.21.15.125:6789/0 conn(0x7fed640d15f0 legacy=0x7fed6415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed54003b90 0x7fed54003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.229+0000 7fed637fe700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed54004850 0x7fed54004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed637fe700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed54005200 0x7fed5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5400c030 con 0x7fed54004850 2023-11-28T11:08:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5400c1a0 con 0x7fed54003b90 2023-11-28T11:08:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5400c360 con 0x7fed54005200 2023-11-28T11:08:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed63fff700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed54004850 0x7fed54004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed68968700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed54003b90 0x7fed54003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed69169700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed54005200 0x7fed5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed63fff700 1 -- 172.21.15.125:0/3472598333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed54005200 msgr2=0x7fed5400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed63fff700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed54005200 0x7fed5400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed63fff700 1 -- 172.21.15.125:0/3472598333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed54003b90 msgr2=0x7fed54003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:40.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed63fff700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed54003b90 0x7fed54003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed63fff700 1 -- 172.21.15.125:0/3472598333 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540035b0 con 0x7fed54004850 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed69169700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed54005200 0x7fed5400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed69169700 1 -- 172.21.15.125:0/3472598333 reap_dead start 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed63fff700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed54004850 0x7fed54004cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed640d1a00 tx=0x7fed54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31aaf284d5bd4a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5000cd20 con 0x7fed54004850 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed50005960 con 0x7fed54004850 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.230+0000 7fed637fe700 1 -- 172.21.15.125:0/3472598333 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5000cea0 con 0x7fed54004850 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.231+0000 7fed6abcc700 1 -- 172.21.15.125:0/3472598333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed54004850 msgr2=0x7fed54004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.231+0000 7fed6abcc700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed54004850 0x7fed54004cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed640d1a00 tx=0x7fed54005880 comp rx=0 tx=0).stop 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.231+0000 7fed6abcc700 1 -- 172.21.15.125:0/3472598333 shutdown_connections 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.231+0000 7fed6abcc700 1 --2- 172.21.15.125:0/3472598333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed54004850 0x7fed54004cc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.231+0000 7fed6abcc700 1 -- 172.21.15.125:0/3472598333 >> 172.21.15.125:0/3472598333 conn(0x7fed6406a270 msgr2=0x7fed6406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.231+0000 7fed6abcc700 1 -- 172.21.15.125:0/3472598333 shutdown_connections 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.231+0000 7fed6abcc700 1 -- 172.21.15.125:0/3472598333 wait complete. 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.232+0000 7fed6abcc700 1 Processor -- start 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.232+0000 7fed6abcc700 1 -- start start 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed6abcc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed54004850 0x7fed640b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed6abcc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed640b5550 0x7fed64148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed6abcc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed6414a010 0x7fed641e6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed6abcc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed641e5130 con 0x7fed640b5550 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed6abcc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6415d290 con 0x7fed6414a010 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed6abcc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed640b5ce0 con 0x7fed54004850 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed63fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed640b5550 0x7fed64148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed63fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed640b5550 0x7fed64148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56788/0 (socket says 172.21.15.125:56788) 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed63fff700 1 -- 172.21.15.125:0/4115034712 learned_addr learned my addr 172.21.15.125:0/4115034712 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed68968700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed54004850 0x7fed640b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed69169700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed6414a010 0x7fed641e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed63fff700 1 -- 172.21.15.125:0/4115034712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed54004850 msgr2=0x7fed640b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed63fff700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed54004850 0x7fed640b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed63fff700 1 -- 172.21.15.125:0/4115034712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed6414a010 msgr2=0x7fed641e6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed63fff700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed6414a010 0x7fed641e6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed63fff700 1 -- 172.21.15.125:0/4115034712 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6415abc0 con 0x7fed640b5550 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed63fff700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed640b5550 0x7fed64148d30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fed5000c7d0 tx=0x7fed50001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed617fa700 1 -- 172.21.15.125:0/4115034712 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50004c80 con 0x7fed640b5550 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.233+0000 7fed617fa700 1 -- 172.21.15.125:0/4115034712 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed50004e00 con 0x7fed640b5550 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.234+0000 7fed6abcc700 1 -- 172.21.15.125:0/4115034712 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6415ec60 con 0x7fed640b5550 2023-11-28T11:08:40.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.234+0000 7fed617fa700 1 -- 172.21.15.125:0/4115034712 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50007310 con 0x7fed640b5550 2023-11-28T11:08:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.234+0000 7fed6abcc700 1 -- 172.21.15.125:0/4115034712 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6415e490 con 0x7fed640b5550 2023-11-28T11:08:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.234+0000 7fed6abcc700 1 -- 172.21.15.125:0/4115034712 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed641e52e0 con 0x7fed640b5550 2023-11-28T11:08:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.235+0000 7fed617fa700 1 -- 172.21.15.125:0/4115034712 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fed50010070 con 0x7fed640b5550 2023-11-28T11:08:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.235+0000 7fed617fa700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fed480682f0 0x7fed4806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.235+0000 7fed68968700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fed480682f0 0x7fed4806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.235+0000 7fed617fa700 1 -- 172.21.15.125:0/4115034712 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed50086920 con 0x7fed640b5550 2023-11-28T11:08:40.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.236+0000 7fed68968700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fed480682f0 0x7fed4806a7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed580010e0 tx=0x7fed58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:40.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.239+0000 7fed617fa700 1 -- 172.21.15.125:0/4115034712 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fed641e52e0 con 0x7fed640b5550 2023-11-28T11:08:40.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.421+0000 7fed6abcc700 1 -- 172.21.15.125:0/4115034712 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed641e52e0 con 0x7fed480682f0 2023-11-28T11:08:40.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.428+0000 7fed617fa700 1 -- 172.21.15.125:0/4115034712 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271989 (secure 0 0 0) 0x7fed641e52e0 con 0x7fed480682f0 2023-11-28T11:08:40.433 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:40.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.431+0000 7fed6abcc700 1 -- 172.21.15.125:0/4115034712 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fed480682f0 msgr2=0x7fed4806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.431+0000 7fed6abcc700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fed480682f0 0x7fed4806a7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed580010e0 tx=0x7fed58009040 comp rx=0 tx=0).stop 2023-11-28T11:08:40.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.431+0000 7fed6abcc700 1 -- 172.21.15.125:0/4115034712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed640b5550 msgr2=0x7fed64148d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.431+0000 7fed6abcc700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed640b5550 0x7fed64148d30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fed5000c7d0 tx=0x7fed50001980 comp rx=0 tx=0).stop 2023-11-28T11:08:40.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.431+0000 7fed6abcc700 1 -- 172.21.15.125:0/4115034712 shutdown_connections 2023-11-28T11:08:40.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.431+0000 7fed6abcc700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed6414a010 0x7fed641e6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.431+0000 7fed6abcc700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fed480682f0 0x7fed4806a7a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.431+0000 7fed6abcc700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed54004850 0x7fed640b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.431+0000 7fed6abcc700 1 --2- 172.21.15.125:0/4115034712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed640b5550 0x7fed64148d30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.431+0000 7fed6abcc700 1 -- 172.21.15.125:0/4115034712 >> 172.21.15.125:0/4115034712 conn(0x7fed6406a270 msgr2=0x7fed6406e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:40.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.432+0000 7fed6abcc700 1 -- 172.21.15.125:0/4115034712 shutdown_connections 2023-11-28T11:08:40.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.432+0000 7fed6abcc700 1 -- 172.21.15.125:0/4115034712 wait complete. 2023-11-28T11:08:40.437 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:08:40.445 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-28T11:08:39.622479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":64776,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":61952,"kb_avail":754909944,"statfs":{"total":773094113280,"available":773027782656,"internally_reserved":0,"allocated":2826240,"data_stored":1722328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":63438848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.642000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781405+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:08:32.781405+0000","last_peered":"2023-11-28T11:08:32.781405+0000","last_clean":"2023-11-28T11:08:32.781405+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:08:32.781405+0000","last_undegraded":"2023-11-28T11:08:32.781405+0000","last_fullsized":"2023-11-28T11:08:32.781405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.393552+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:08:33.393552+0000","last_peered":"2023-11-28T11:08:33.393552+0000","last_clean":"2023-11-28T11:08:33.393552+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:08:33.393552+0000","last_undegraded":"2023-11-28T11:08:33.393552+0000","last_fullsized":"2023-11-28T11:08:33.393552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.392922+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:08:33.392922+0000","last_peered":"2023-11-28T11:08:33.392922+0000","last_clean":"2023-11-28T11:08:33.392922+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:08:33.392922+0000","last_undegraded":"2023-11-28T11:08:33.392922+0000","last_fullsized":"2023-11-28T11:08:33.392922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.393564+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:08:33.393564+0000","last_peered":"2023-11-28T11:08:33.393564+0000","last_clean":"2023-11-28T11:08:33.393564+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:08:33.393564+0000","last_undegraded":"2023-11-28T11:08:33.393564+0000","last_fullsized":"2023-11-28T11:08:33.393564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T11:08:31.780560+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:08:31.780560+0000","last_peered":"2023-11-28T11:08:31.780560+0000","last_clean":"2023-11-28T11:08:31.780560+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:08:31.780560+0000","last_undegraded":"2023-11-28T11:08:31.780560+0000","last_fullsized":"2023-11-28T11:08:31.780560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781706+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:08:32.781706+0000","last_peered":"2023-11-28T11:08:32.781706+0000","last_clean":"2023-11-28T11:08:32.781706+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:08:32.781706+0000","last_undegraded":"2023-11-28T11:08:32.781706+0000","last_fullsized":"2023-11-28T11:08:32.781706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781745+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:08:32.781745+0000","last_peered":"2023-11-28T11:08:32.781745+0000","last_clean":"2023-11-28T11:08:32.781745+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:08:32.781745+0000","last_undegraded":"2023-11-28T11:08:32.781745+0000","last_fullsized":"2023-11-28T11:08:32.781745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781410+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:08:32.781410+0000","last_peered":"2023-11-28T11:08:32.781410+0000","last_clean":"2023-11-28T11:08:32.781410+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:08:32.781410+0000","last_undegraded":"2023-11-28T11:08:32.781410+0000","last_fullsized":"2023-11-28T11:08:32.781410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.393511+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:08:33.393511+0000","last_peered":"2023-11-28T11:08:33.393511+0000","last_clean":"2023-11-28T11:08:33.393511+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:08:33.393511+0000","last_undegraded":"2023-11-28T11:08:33.393511+0000","last_fullsized":"2023-11-28T11:08:33.393511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:08:40.450 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:08:40.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.604+0000 7fd276303700 1 Processor -- start 2023-11-28T11:08:40.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.604+0000 7fd276303700 1 -- start start 2023-11-28T11:08:40.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd276303700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd2700ce040 0x7fd27015d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd276303700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2700b1770 0x7fd2700b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd276303700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700b2110 con 0x7fd270142db0 2023-11-28T11:08:40.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd276303700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27013fc90 con 0x7fd2700ce040 2023-11-28T11:08:40.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd276303700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27013f480 con 0x7fd2700b1770 2023-11-28T11:08:40.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd26ffff700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd2700ce040 0x7fd27015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd26f7fe700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd270142db0 0x7fd27013ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:43722/0 (socket says 172.21.15.125:43722) 2023-11-28T11:08:40.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd26f7fe700 1 -- 172.21.15.125:0/2504999844 learned_addr learned my addr 172.21.15.125:0/2504999844 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:40.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd2748a0700 1 --2- 172.21.15.125:0/2504999844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2700b1770 0x7fd2700b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd26ffff700 1 -- 172.21.15.125:0/2504999844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2700b1770 msgr2=0x7fd2700b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:40.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd26ffff700 1 --2- 172.21.15.125:0/2504999844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2700b1770 0x7fd2700b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd26ffff700 1 -- 172.21.15.125:0/2504999844 >> v1:172.21.15.167:6789/0 conn(0x7fd270142db0 legacy=0x7fd27013ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd26effd700 1 -- 172.21.15.125:0/2504999844 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367385323 0 0) 0x7fd2700b2110 con 0x7fd270142db0 2023-11-28T11:08:40.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd26ffff700 1 -- 172.21.15.125:0/2504999844 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27013f6d0 con 0x7fd2700ce040 2023-11-28T11:08:40.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.605+0000 7fd2748a0700 1 --2- 172.21.15.125:0/2504999844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2700b1770 0x7fd2700b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:40.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd26ffff700 1 --2- 172.21.15.125:0/2504999844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2700ce040 0x7fd27015d900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd258009840 tx=0x7fd258009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e375f3d51bec365 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:40.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd26effd700 1 -- 172.21.15.125:0/2504999844 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd258011830 con 0x7fd2700ce040 2023-11-28T11:08:40.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd26effd700 1 -- 172.21.15.125:0/2504999844 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd258011990 con 0x7fd2700ce040 2023-11-28T11:08:40.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd26effd700 1 -- 172.21.15.125:0/2504999844 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd258011d20 con 0x7fd2700ce040 2023-11-28T11:08:40.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd276303700 1 -- 172.21.15.125:0/2504999844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2700ce040 msgr2=0x7fd27015d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd276303700 1 --2- 172.21.15.125:0/2504999844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2700ce040 0x7fd27015d900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd258009840 tx=0x7fd258009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:40.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd276303700 1 -- 172.21.15.125:0/2504999844 shutdown_connections 2023-11-28T11:08:40.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd276303700 1 --2- 172.21.15.125:0/2504999844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2700ce040 0x7fd27015d900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd276303700 1 --2- 172.21.15.125:0/2504999844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2700b1770 0x7fd2700b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd276303700 1 -- 172.21.15.125:0/2504999844 >> 172.21.15.125:0/2504999844 conn(0x7fd27006c010 msgr2=0x7fd2700cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:40.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd276303700 1 -- 172.21.15.125:0/2504999844 shutdown_connections 2023-11-28T11:08:40.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.606+0000 7fd276303700 1 -- 172.21.15.125:0/2504999844 wait complete. 2023-11-28T11:08:40.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.608+0000 7fd276303700 1 Processor -- start 2023-11-28T11:08:40.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.608+0000 7fd276303700 1 -- start start 2023-11-28T11:08:40.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd276303700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2700b1770 0x7fd2700b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd276303700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2700ce040 0x7fd270151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd276303700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd270142db0 0x7fd2700c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd276303700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700b5ae0 con 0x7fd2700b1770 2023-11-28T11:08:40.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd276303700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700c76e0 con 0x7fd270142db0 2023-11-28T11:08:40.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd276303700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd270159ab0 con 0x7fd2700ce040 2023-11-28T11:08:40.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd26ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2700b1770 0x7fd2700b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd26ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2700b1770 0x7fd2700b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56800/0 (socket says 172.21.15.125:56800) 2023-11-28T11:08:40.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd26ffff700 1 -- 172.21.15.125:0/4203295539 learned_addr learned my addr 172.21.15.125:0/4203295539 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:40.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd26f7fe700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2700ce040 0x7fd270151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd2748a0700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd270142db0 0x7fd2700c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd26ffff700 1 -- 172.21.15.125:0/4203295539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2700ce040 msgr2=0x7fd270151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd26ffff700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2700ce040 0x7fd270151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd26ffff700 1 -- 172.21.15.125:0/4203295539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd270142db0 msgr2=0x7fd2700c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd26ffff700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd270142db0 0x7fd2700c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd26ffff700 1 -- 172.21.15.125:0/4203295539 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd268009a70 con 0x7fd2700b1770 2023-11-28T11:08:40.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.609+0000 7fd2748a0700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd270142db0 0x7fd2700c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:40.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.610+0000 7fd26ffff700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2700b1770 0x7fd2700b4b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd258009fd0 tx=0x7fd258004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:40.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.610+0000 7fd26cff9700 1 -- 172.21.15.125:0/4203295539 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580036a0 con 0x7fd2700b1770 2023-11-28T11:08:40.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.610+0000 7fd26cff9700 1 -- 172.21.15.125:0/4203295539 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25801f070 con 0x7fd2700b1770 2023-11-28T11:08:40.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.610+0000 7fd26cff9700 1 -- 172.21.15.125:0/4203295539 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd258003a60 con 0x7fd2700b1770 2023-11-28T11:08:40.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.610+0000 7fd276303700 1 -- 172.21.15.125:0/4203295539 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2580094a0 con 0x7fd2700b1770 2023-11-28T11:08:40.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.610+0000 7fd276303700 1 -- 172.21.15.125:0/4203295539 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27015d100 con 0x7fd2700b1770 2023-11-28T11:08:40.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.611+0000 7fd2667fc700 1 -- 172.21.15.125:0/4203295539 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2480052f0 con 0x7fd2700b1770 2023-11-28T11:08:40.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.611+0000 7fd26cff9700 1 -- 172.21.15.125:0/4203295539 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd25800f050 con 0x7fd2700b1770 2023-11-28T11:08:40.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.611+0000 7fd26cff9700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 0x7fd25006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.611+0000 7fd26cff9700 1 -- 172.21.15.125:0/4203295539 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd258021070 con 0x7fd2700b1770 2023-11-28T11:08:40.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.611+0000 7fd26f7fe700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 0x7fd25006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.612+0000 7fd26f7fe700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 0x7fd25006a7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd27006e010 tx=0x7fd260007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:40.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.615+0000 7fd26cff9700 1 -- 172.21.15.125:0/4203295539 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd258053de0 con 0x7fd2700b1770 2023-11-28T11:08:40.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.794+0000 7fd2667fc700 1 -- 172.21.15.125:0/4203295539 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd248000bc0 con 0x7fd2500682f0 2023-11-28T11:08:40.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.801+0000 7fd26cff9700 1 -- 172.21.15.125:0/4203295539 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271989 (secure 0 0 0) 0x7fd248000bc0 con 0x7fd2500682f0 2023-11-28T11:08:40.805 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 -- 172.21.15.125:0/4203295539 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 msgr2=0x7fd25006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 0x7fd25006a7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd27006e010 tx=0x7fd260007be0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 -- 172.21.15.125:0/4203295539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2700b1770 msgr2=0x7fd2700b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2700b1770 0x7fd2700b4b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd258009fd0 tx=0x7fd258004750 comp rx=0 tx=0).stop 2023-11-28T11:08:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 -- 172.21.15.125:0/4203295539 shutdown_connections 2023-11-28T11:08:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd270142db0 0x7fd2700c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2700b1770 0x7fd2700b4b80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 0x7fd25006a7a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 --2- 172.21.15.125:0/4203295539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2700ce040 0x7fd270151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 -- 172.21.15.125:0/4203295539 >> 172.21.15.125:0/4203295539 conn(0x7fd27006c010 msgr2=0x7fd2700ca840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 -- 172.21.15.125:0/4203295539 shutdown_connections 2023-11-28T11:08:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.804+0000 7fd2667fc700 1 -- 172.21.15.125:0/4203295539 wait complete. 2023-11-28T11:08:40.809 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:08:40.818 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-28T11:08:39.622479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":64776,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":61952,"kb_avail":754909944,"statfs":{"total":773094113280,"available":773027782656,"internally_reserved":0,"allocated":2826240,"data_stored":1722328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":63438848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.642000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781405+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:08:32.781405+0000","last_peered":"2023-11-28T11:08:32.781405+0000","last_clean":"2023-11-28T11:08:32.781405+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:08:32.781405+0000","last_undegraded":"2023-11-28T11:08:32.781405+0000","last_fullsized":"2023-11-28T11:08:32.781405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.393552+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:08:33.393552+0000","last_peered":"2023-11-28T11:08:33.393552+0000","last_clean":"2023-11-28T11:08:33.393552+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:08:33.393552+0000","last_undegraded":"2023-11-28T11:08:33.393552+0000","last_fullsized":"2023-11-28T11:08:33.393552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.392922+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:08:33.392922+0000","last_peered":"2023-11-28T11:08:33.392922+0000","last_clean":"2023-11-28T11:08:33.392922+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:08:33.392922+0000","last_undegraded":"2023-11-28T11:08:33.392922+0000","last_fullsized":"2023-11-28T11:08:33.392922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.393564+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:08:33.393564+0000","last_peered":"2023-11-28T11:08:33.393564+0000","last_clean":"2023-11-28T11:08:33.393564+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:08:33.393564+0000","last_undegraded":"2023-11-28T11:08:33.393564+0000","last_fullsized":"2023-11-28T11:08:33.393564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T11:08:31.780560+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:08:31.780560+0000","last_peered":"2023-11-28T11:08:31.780560+0000","last_clean":"2023-11-28T11:08:31.780560+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:08:31.780560+0000","last_undegraded":"2023-11-28T11:08:31.780560+0000","last_fullsized":"2023-11-28T11:08:31.780560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781706+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:08:32.781706+0000","last_peered":"2023-11-28T11:08:32.781706+0000","last_clean":"2023-11-28T11:08:32.781706+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:08:32.781706+0000","last_undegraded":"2023-11-28T11:08:32.781706+0000","last_fullsized":"2023-11-28T11:08:32.781706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781745+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:08:32.781745+0000","last_peered":"2023-11-28T11:08:32.781745+0000","last_clean":"2023-11-28T11:08:32.781745+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:08:32.781745+0000","last_undegraded":"2023-11-28T11:08:32.781745+0000","last_fullsized":"2023-11-28T11:08:32.781745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781410+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:08:32.781410+0000","last_peered":"2023-11-28T11:08:32.781410+0000","last_clean":"2023-11-28T11:08:32.781410+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:08:32.781410+0000","last_undegraded":"2023-11-28T11:08:32.781410+0000","last_fullsized":"2023-11-28T11:08:32.781410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.393511+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:08:33.393511+0000","last_peered":"2023-11-28T11:08:33.393511+0000","last_clean":"2023-11-28T11:08:33.393511+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:08:33.393511+0000","last_undegraded":"2023-11-28T11:08:33.393511+0000","last_fullsized":"2023-11-28T11:08:33.393511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:08:40.822 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:08:40.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.976+0000 7fdc67a44700 1 Processor -- start 2023-11-28T11:08:40.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.976+0000 7fdc67a44700 1 -- start start 2023-11-28T11:08:40.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.977+0000 7fdc67a44700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdc60142db0 0x7fdc6013ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.977+0000 7fdc67a44700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc600b1770 0x7fdc600b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.977+0000 7fdc67a44700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6015e010 con 0x7fdc600ce040 2023-11-28T11:08:40.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.977+0000 7fdc67a44700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6013fc90 con 0x7fdc600b1770 2023-11-28T11:08:40.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.977+0000 7fdc67a44700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc600b20d0 con 0x7fdc60142db0 2023-11-28T11:08:40.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.977+0000 7fdc65fe1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc600b1770 0x7fdc600b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.977+0000 7fdc657e0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdc600ce040 0x7fdc6015d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40932/0 (socket says 172.21.15.125:40932) 2023-11-28T11:08:40.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.977+0000 7fdc657e0700 1 -- 172.21.15.125:0/4016832536 learned_addr learned my addr 172.21.15.125:0/4016832536 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:40.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc64fdf700 1 --2- 172.21.15.125:0/4016832536 >> v2:172.21.15.167:3300/0 conn(0x7fdc60142db0 0x7fdc6013ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc65fe1700 1 -- 172.21.15.125:0/4016832536 >> v2:172.21.15.167:3300/0 conn(0x7fdc60142db0 msgr2=0x7fdc6013ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:40.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc65fe1700 1 --2- 172.21.15.125:0/4016832536 >> v2:172.21.15.167:3300/0 conn(0x7fdc60142db0 0x7fdc6013ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc65fe1700 1 -- 172.21.15.125:0/4016832536 >> v1:172.21.15.125:6789/0 conn(0x7fdc600ce040 legacy=0x7fdc6015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc65fe1700 1 -- 172.21.15.125:0/4016832536 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6013f6d0 con 0x7fdc600b1770 2023-11-28T11:08:40.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc57fff700 1 -- 172.21.15.125:0/4016832536 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057669669 0 0) 0x7fdc50001110 con 0x7fdc600ce040 2023-11-28T11:08:40.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc64fdf700 1 --2- 172.21.15.125:0/4016832536 >> v2:172.21.15.167:3300/0 conn(0x7fdc60142db0 0x7fdc6013ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:40.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc65fe1700 1 --2- 172.21.15.125:0/4016832536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc600b1770 0x7fdc600b1b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdc600cfc20 tx=0x7fdc5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3144168415364df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:40.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc57fff700 1 -- 172.21.15.125:0/4016832536 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5800e070 con 0x7fdc600b1770 2023-11-28T11:08:40.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc57fff700 1 -- 172.21.15.125:0/4016832536 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5800bb70 con 0x7fdc600b1770 2023-11-28T11:08:40.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc57fff700 1 -- 172.21.15.125:0/4016832536 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58012430 con 0x7fdc600b1770 2023-11-28T11:08:40.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc67a44700 1 -- 172.21.15.125:0/4016832536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc600b1770 msgr2=0x7fdc600b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.978+0000 7fdc67a44700 1 --2- 172.21.15.125:0/4016832536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc600b1770 0x7fdc600b1b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdc600cfc20 tx=0x7fdc5800b330 comp rx=0 tx=0).stop 2023-11-28T11:08:40.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.979+0000 7fdc67a44700 1 -- 172.21.15.125:0/4016832536 shutdown_connections 2023-11-28T11:08:40.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.979+0000 7fdc67a44700 1 --2- 172.21.15.125:0/4016832536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc600b1770 0x7fdc600b1b90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.979+0000 7fdc67a44700 1 --2- 172.21.15.125:0/4016832536 >> v2:172.21.15.167:3300/0 conn(0x7fdc60142db0 0x7fdc6013ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.979+0000 7fdc67a44700 1 -- 172.21.15.125:0/4016832536 >> 172.21.15.125:0/4016832536 conn(0x7fdc6006c010 msgr2=0x7fdc600cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:40.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.979+0000 7fdc67a44700 1 -- 172.21.15.125:0/4016832536 shutdown_connections 2023-11-28T11:08:40.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.979+0000 7fdc67a44700 1 -- 172.21.15.125:0/4016832536 wait complete. 2023-11-28T11:08:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.980+0000 7fdc67a44700 1 Processor -- start 2023-11-28T11:08:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.980+0000 7fdc67a44700 1 -- start start 2023-11-28T11:08:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.980+0000 7fdc67a44700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc600b1770 0x7fdc600718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.980+0000 7fdc67a44700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc600ce040 0x7fdc60157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc67a44700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc60142db0 0x7fdc601581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc67a44700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60071de0 con 0x7fdc60142db0 2023-11-28T11:08:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc67a44700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600c51e0 con 0x7fdc600ce040 2023-11-28T11:08:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc67a44700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600c45d0 con 0x7fdc600b1770 2023-11-28T11:08:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc65fe1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc60142db0 0x7fdc601581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc65fe1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc60142db0 0x7fdc601581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56818/0 (socket says 172.21.15.125:56818) 2023-11-28T11:08:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc65fe1700 1 -- 172.21.15.125:0/2649334625 learned_addr learned my addr 172.21.15.125:0/2649334625 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc65fe1700 1 -- 172.21.15.125:0/2649334625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc600b1770 msgr2=0x7fdc600718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc65fe1700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc600b1770 0x7fdc600718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc65fe1700 1 -- 172.21.15.125:0/2649334625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc600ce040 msgr2=0x7fdc60157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:40.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc65fe1700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc600ce040 0x7fdc60157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:40.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc65fe1700 1 -- 172.21.15.125:0/2649334625 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc58009a70 con 0x7fdc60142db0 2023-11-28T11:08:40.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc65fe1700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc60142db0 0x7fdc601581b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc60070850 tx=0x7fdc58004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:40.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc55ffb700 1 -- 172.21.15.125:0/2649334625 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58012430 con 0x7fdc60142db0 2023-11-28T11:08:40.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc55ffb700 1 -- 172.21.15.125:0/2649334625 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc58020070 con 0x7fdc60142db0 2023-11-28T11:08:40.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc67a44700 1 -- 172.21.15.125:0/2649334625 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6015d100 con 0x7fdc60142db0 2023-11-28T11:08:40.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc55ffb700 1 -- 172.21.15.125:0/2649334625 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58004280 con 0x7fdc60142db0 2023-11-28T11:08:40.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.981+0000 7fdc67a44700 1 -- 172.21.15.125:0/2649334625 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6013f9b0 con 0x7fdc60142db0 2023-11-28T11:08:40.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.982+0000 7fdc67a44700 1 -- 172.21.15.125:0/2649334625 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6015d3e0 con 0x7fdc60142db0 2023-11-28T11:08:40.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.983+0000 7fdc55ffb700 1 -- 172.21.15.125:0/2649334625 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdc580043e0 con 0x7fdc60142db0 2023-11-28T11:08:40.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.983+0000 7fdc55ffb700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdc440682f0 0x7fdc4406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:40.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.983+0000 7fdc55ffb700 1 -- 172.21.15.125:0/2649334625 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc58022070 con 0x7fdc60142db0 2023-11-28T11:08:40.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.983+0000 7fdc657e0700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdc440682f0 0x7fdc4406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:40.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.983+0000 7fdc657e0700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdc440682f0 0x7fdc4406a7a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc600c67e0 tx=0x7fdc50001310 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:40.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:40.987+0000 7fdc55ffb700 1 -- 172.21.15.125:0/2649334625 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdc58054e20 con 0x7fdc60142db0 2023-11-28T11:08:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.167+0000 7fdc67a44700 1 -- 172.21.15.125:0/2649334625 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc600c5350 con 0x7fdc440682f0 2023-11-28T11:08:41.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.174+0000 7fdc55ffb700 1 -- 172.21.15.125:0/2649334625 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271989 (secure 0 0 0) 0x7fdc600c5350 con 0x7fdc440682f0 2023-11-28T11:08:41.179 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 -- 172.21.15.125:0/2649334625 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdc440682f0 msgr2=0x7fdc4406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdc440682f0 0x7fdc4406a7a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc600c67e0 tx=0x7fdc50001310 comp rx=0 tx=0).stop 2023-11-28T11:08:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 -- 172.21.15.125:0/2649334625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc60142db0 msgr2=0x7fdc601581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc60142db0 0x7fdc601581b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc60070850 tx=0x7fdc58004ad0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 -- 172.21.15.125:0/2649334625 shutdown_connections 2023-11-28T11:08:41.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc60142db0 0x7fdc601581b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdc440682f0 0x7fdc4406a7a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc600b1770 0x7fdc600718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 --2- 172.21.15.125:0/2649334625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc600ce040 0x7fdc60157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 -- 172.21.15.125:0/2649334625 >> 172.21.15.125:0/2649334625 conn(0x7fdc6006c010 msgr2=0x7fdc6006ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:41.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 -- 172.21.15.125:0/2649334625 shutdown_connections 2023-11-28T11:08:41.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.177+0000 7fdc67a44700 1 -- 172.21.15.125:0/2649334625 wait complete. 2023-11-28T11:08:41.182 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:08:41.190 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-28T11:08:39.622479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":64776,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":61952,"kb_avail":754909944,"statfs":{"total":773094113280,"available":773027782656,"internally_reserved":0,"allocated":2826240,"data_stored":1722328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":63438848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.642000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781405+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:08:32.781405+0000","last_peered":"2023-11-28T11:08:32.781405+0000","last_clean":"2023-11-28T11:08:32.781405+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:08:32.781405+0000","last_undegraded":"2023-11-28T11:08:32.781405+0000","last_fullsized":"2023-11-28T11:08:32.781405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.393552+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:08:33.393552+0000","last_peered":"2023-11-28T11:08:33.393552+0000","last_clean":"2023-11-28T11:08:33.393552+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:08:33.393552+0000","last_undegraded":"2023-11-28T11:08:33.393552+0000","last_fullsized":"2023-11-28T11:08:33.393552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.392922+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:08:33.392922+0000","last_peered":"2023-11-28T11:08:33.392922+0000","last_clean":"2023-11-28T11:08:33.392922+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:08:33.392922+0000","last_undegraded":"2023-11-28T11:08:33.392922+0000","last_fullsized":"2023-11-28T11:08:33.392922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.393564+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:08:33.393564+0000","last_peered":"2023-11-28T11:08:33.393564+0000","last_clean":"2023-11-28T11:08:33.393564+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:08:33.393564+0000","last_undegraded":"2023-11-28T11:08:33.393564+0000","last_fullsized":"2023-11-28T11:08:33.393564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T11:08:31.780560+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:08:31.780560+0000","last_peered":"2023-11-28T11:08:31.780560+0000","last_clean":"2023-11-28T11:08:31.780560+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:08:31.780560+0000","last_undegraded":"2023-11-28T11:08:31.780560+0000","last_fullsized":"2023-11-28T11:08:31.780560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781706+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:08:32.781706+0000","last_peered":"2023-11-28T11:08:32.781706+0000","last_clean":"2023-11-28T11:08:32.781706+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:08:32.781706+0000","last_undegraded":"2023-11-28T11:08:32.781706+0000","last_fullsized":"2023-11-28T11:08:32.781706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781745+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:08:32.781745+0000","last_peered":"2023-11-28T11:08:32.781745+0000","last_clean":"2023-11-28T11:08:32.781745+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:08:32.781745+0000","last_undegraded":"2023-11-28T11:08:32.781745+0000","last_fullsized":"2023-11-28T11:08:32.781745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:32.781410+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:08:32.781410+0000","last_peered":"2023-11-28T11:08:32.781410+0000","last_clean":"2023-11-28T11:08:32.781410+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:08:32.781410+0000","last_undegraded":"2023-11-28T11:08:32.781410+0000","last_fullsized":"2023-11-28T11:08:32.781410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T11:08:33.393511+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:08:33.393511+0000","last_peered":"2023-11-28T11:08:33.393511+0000","last_clean":"2023-11-28T11:08:33.393511+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:08:33.393511+0000","last_undegraded":"2023-11-28T11:08:33.393511+0000","last_fullsized":"2023-11-28T11:08:33.393511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:34.977874+0000","last_change":"2023-11-28T11:08:34.977874+0000","last_active":"2023-11-28T11:08:34.977874+0000","last_peered":"2023-11-28T11:08:34.977874+0000","last_clean":"2023-11-28T11:08:34.977874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:34.977874+0000","last_undegraded":"2023-11-28T11:08:34.977874+0000","last_fullsized":"2023-11-28T11:08:34.977874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:08:35.980071+0000","last_change":"2023-11-28T11:08:35.980071+0000","last_active":"2023-11-28T11:08:35.980071+0000","last_peered":"2023-11-28T11:08:35.980071+0000","last_clean":"2023-11-28T11:08:35.980071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:08:35.980071+0000","last_undegraded":"2023-11-28T11:08:35.980071+0000","last_fullsized":"2023-11-28T11:08:35.980071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:08:41.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-11-28T11:08:41.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-11-28T11:08:41.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-11-28T11:08:41.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-11-28T11:08:41.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-11-28T11:08:41.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-11-28T11:08:41.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-11-28T11:08:41.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-11-28T11:08:41.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-11-28T11:08:41.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-11-28T11:08:41.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-11-28T11:08:41.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-11-28T11:08:41.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-11-28T11:08:41.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-11-28T11:08:41.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-11-28T11:08:41.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-11-28T11:08:41.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-11-28T11:08:41.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-11-28T11:08:41.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-11-28T11:08:41.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-11-28T11:08:41.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-11-28T11:08:41.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-11-28T11:08:41.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-11-28T11:08:41.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-11-28T11:08:41.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-11-28T11:08:41.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-11-28T11:08:41.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-11-28T11:08:41.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-11-28T11:08:41.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-28T11:08:41.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-11-28T11:08:41.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-28T11:08:41.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-11-28T11:08:41.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-11-28T11:08:41.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-11-28T11:08:41.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-28T11:08:41.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-11-28T11:08:41.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-28T11:08:41.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-11-28T11:08:41.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-28T11:08:41.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-11-28T11:08:41.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-11-28T11:08:41.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-11-28T11:08:41.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-28T11:08:41.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-11-28T11:08:41.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-11-28T11:08:41.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-11-28T11:08:41.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-28T11:08:41.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-11-28T11:08:41.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-28T11:08:41.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-11-28T11:08:41.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-11-28T11:08:41.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-11-28T11:08:41.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-11-28T11:08:41.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-11-28T11:08:41.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-11-28T11:08:41.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-11-28T11:08:41.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-28T11:08:41.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-11-28T11:08:41.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-11-28T11:08:41.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-11-28T11:08:41.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-11-28T11:08:41.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-11-28T11:08:41.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-11-28T11:08:41.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-11-28T11:08:41.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-28T11:08:41.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-11-28T11:08:41.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-28T11:08:41.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-11-28T11:08:41.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-28T11:08:41.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-11-28T11:08:41.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-28T11:08:41.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-11-28T11:08:41.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-11-28T11:08:41.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-11-28T11:08:41.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-28T11:08:41.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-11-28T11:08:41.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-28T11:08:41.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-11-28T11:08:41.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-28T11:08:41.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-11-28T11:08:41.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-11-28T11:08:41.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-11-28T11:08:41.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-28T11:08:41.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-11-28T11:08:41.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-11-28T11:08:41.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-11-28T11:08:41.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-11-28T11:08:41.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-11-28T11:08:41.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-28T11:08:41.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-11-28T11:08:41.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:34.977874+0000', 'last_change': '2023-11-28T11:08:34.977874+0000', 'last_active': '2023-11-28T11:08:34.977874+0000', 'last_peered': '2023-11-28T11:08:34.977874+0000', 'last_clean': '2023-11-28T11:08:34.977874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:34.977874+0000', 'last_undegraded': '2023-11-28T11:08:34.977874+0000', 'last_fullsized': '2023-11-28T11:08:34.977874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:34.977874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-11-28T11:08:41.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-11-28T11:08:41.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-11-28T11:08:41.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-11-28T11:08:41.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-11-28T11:08:41.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-11-28T11:08:41.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:08:35.980071+0000', 'last_change': '2023-11-28T11:08:35.980071+0000', 'last_active': '2023-11-28T11:08:35.980071+0000', 'last_peered': '2023-11-28T11:08:35.980071+0000', 'last_clean': '2023-11-28T11:08:35.980071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:08:35.980071+0000', 'last_undegraded': '2023-11-28T11:08:35.980071+0000', 'last_fullsized': '2023-11-28T11:08:35.980071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'last_clean_scrub_stamp': '2023-11-28T11:08:35.980071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:08:41.219 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T11:08:41.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.347+0000 7ff316705700 1 Processor -- start 2023-11-28T11:08:41.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.347+0000 7ff316705700 1 -- start start 2023-11-28T11:08:41.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff316705700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff31006ab10 0x7ff31006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:41.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff316705700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3100d1ee0 con 0x7ff3100d0450 2023-11-28T11:08:41.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff316705700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff310161120 con 0x7ff3100cd5a0 2023-11-28T11:08:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff316705700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31006b420 con 0x7ff31006ab10 2023-11-28T11:08:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff314ca2700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff3100d0450 0x7ff310160a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40950/0 (socket says 172.21.15.125:40950) 2023-11-28T11:08:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff314ca2700 1 -- 172.21.15.125:0/4278114411 learned_addr learned my addr 172.21.15.125:0/4278114411 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff30ffff700 1 --2- 172.21.15.125:0/4278114411 >> v2:172.21.15.167:3300/0 conn(0x7ff31006ab10 0x7ff31006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff30effd700 1 -- 172.21.15.125:0/4278114411 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521408867 0 0) 0x7ff3100d1ee0 con 0x7ff3100d0450 2023-11-28T11:08:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff30effd700 1 -- 172.21.15.125:0/4278114411 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2fc0035b0 con 0x7ff3100d0450 2023-11-28T11:08:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff30effd700 1 -- 172.21.15.125:0/4278114411 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083402736 0 0) 0x7ff310161120 con 0x7ff3100cd5a0 2023-11-28T11:08:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff30effd700 1 -- 172.21.15.125:0/4278114411 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3100d1ee0 con 0x7ff3100cd5a0 2023-11-28T11:08:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff30effd700 1 -- 172.21.15.125:0/4278114411 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2711933038 0 0) 0x7ff2fc0035b0 con 0x7ff3100d0450 2023-11-28T11:08:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff30ffff700 1 -- 172.21.15.125:0/4278114411 >> v1:172.21.15.167:6789/0 conn(0x7ff3100cd5a0 legacy=0x7ff310160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff30ffff700 1 -- 172.21.15.125:0/4278114411 >> v1:172.21.15.125:6789/0 conn(0x7ff3100d0450 legacy=0x7ff310160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.348+0000 7ff30ffff700 1 -- 172.21.15.125:0/4278114411 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3100cdb10 con 0x7ff31006ab10 2023-11-28T11:08:41.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.349+0000 7ff30ffff700 1 --2- 172.21.15.125:0/4278114411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff31006ab10 0x7ff31006aee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009840 tx=0x7ff2f8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=990a1723e6c484ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:41.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.349+0000 7ff30effd700 1 -- 172.21.15.125:0/4278114411 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080019f0 con 0x7ff31006ab10 2023-11-28T11:08:41.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.349+0000 7ff30effd700 1 -- 172.21.15.125:0/4278114411 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f8004030 con 0x7ff31006ab10 2023-11-28T11:08:41.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.349+0000 7ff30effd700 1 -- 172.21.15.125:0/4278114411 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80043a0 con 0x7ff31006ab10 2023-11-28T11:08:41.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.349+0000 7ff316705700 1 -- 172.21.15.125:0/4278114411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff31006ab10 msgr2=0x7ff31006aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.349+0000 7ff316705700 1 --2- 172.21.15.125:0/4278114411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff31006ab10 0x7ff31006aee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009840 tx=0x7ff2f8009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:41.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.349+0000 7ff316705700 1 -- 172.21.15.125:0/4278114411 shutdown_connections 2023-11-28T11:08:41.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.349+0000 7ff316705700 1 --2- 172.21.15.125:0/4278114411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff31006ab10 0x7ff31006aee0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.349+0000 7ff316705700 1 -- 172.21.15.125:0/4278114411 >> 172.21.15.125:0/4278114411 conn(0x7ff31006c520 msgr2=0x7ff31006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:41.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.349+0000 7ff316705700 1 -- 172.21.15.125:0/4278114411 shutdown_connections 2023-11-28T11:08:41.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.349+0000 7ff316705700 1 -- 172.21.15.125:0/4278114411 wait complete. 2023-11-28T11:08:41.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.350+0000 7ff316705700 1 Processor -- start 2023-11-28T11:08:41.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.351+0000 7ff316705700 1 -- start start 2023-11-28T11:08:41.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.351+0000 7ff316705700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff31006ab10 0x7ff3101e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:41.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.351+0000 7ff316705700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3100cd5a0 0x7ff310153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:41.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.351+0000 7ff316705700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3100d0450 0x7ff3100b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.351+0000 7ff316705700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3101e8af0 con 0x7ff3100cd5a0 2023-11-28T11:08:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.351+0000 7ff316705700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3101e8120 con 0x7ff31006ab10 2023-11-28T11:08:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.351+0000 7ff316705700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3101f6a20 con 0x7ff3100d0450 2023-11-28T11:08:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.351+0000 7ff30f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3100cd5a0 0x7ff310153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3100cd5a0 0x7ff310153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56828/0 (socket says 172.21.15.125:56828) 2023-11-28T11:08:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30f7fe700 1 -- 172.21.15.125:0/1859779312 learned_addr learned my addr 172.21.15.125:0/1859779312 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff314ca2700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3100d0450 0x7ff3100b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30ffff700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff31006ab10 0x7ff3101e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30f7fe700 1 -- 172.21.15.125:0/1859779312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3100d0450 msgr2=0x7ff3100b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30f7fe700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3100d0450 0x7ff3100b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30f7fe700 1 -- 172.21.15.125:0/1859779312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff31006ab10 msgr2=0x7ff3101e85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30f7fe700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff31006ab10 0x7ff3101e85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30f7fe700 1 -- 172.21.15.125:0/1859779312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80094a0 con 0x7ff3100cd5a0 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30ffff700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff31006ab10 0x7ff3101e85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30f7fe700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3100cd5a0 0x7ff310153810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff30000c4c0 tx=0x7ff30000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30cff9700 1 -- 172.21.15.125:0/1859779312 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3000052d0 con 0x7ff3100cd5a0 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30cff9700 1 -- 172.21.15.125:0/1859779312 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff300005450 con 0x7ff3100cd5a0 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff316705700 1 -- 172.21.15.125:0/1859779312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3100d1b70 con 0x7ff3100cd5a0 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff30cff9700 1 -- 172.21.15.125:0/1859779312 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3000038c0 con 0x7ff3100cd5a0 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.352+0000 7ff316705700 1 -- 172.21.15.125:0/1859779312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3100d1890 con 0x7ff3100cd5a0 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.353+0000 7ff316705700 1 -- 172.21.15.125:0/1859779312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31015cad0 con 0x7ff3100cd5a0 2023-11-28T11:08:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.353+0000 7ff30cff9700 1 -- 172.21.15.125:0/1859779312 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff300019030 con 0x7ff3100cd5a0 2023-11-28T11:08:41.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.354+0000 7ff30cff9700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff2f00682c0 0x7ff2f006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:41.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.354+0000 7ff30cff9700 1 -- 172.21.15.125:0/1859779312 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff300084e50 con 0x7ff3100cd5a0 2023-11-28T11:08:41.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.354+0000 7ff30ffff700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff2f00682c0 0x7ff2f006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:41.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.354+0000 7ff30ffff700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff2f00682c0 0x7ff2f006a770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80090b0 tx=0x7ff2f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:41.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.358+0000 7ff30cff9700 1 -- 172.21.15.125:0/1859779312 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff30004b5e0 con 0x7ff3100cd5a0 2023-11-28T11:08:41.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.617+0000 7ff316705700 1 -- 172.21.15.125:0/1859779312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff3100b5420 con 0x7ff3100cd5a0 2023-11-28T11:08:41.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.617+0000 7ff30cff9700 1 -- 172.21.15.125:0/1859779312 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1020 (secure 0 0 0) 0x7ff300017410 con 0x7ff3100cd5a0 2023-11-28T11:08:41.619 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:41.619 INFO:teuthology.orchestra.run.smithi125.stdout:{"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":24,"num_osds":8,"num_up_osds":8,"osd_up_since":1701169703,"num_in_osds":8,"osd_in_since":1701169694,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":66330624,"bytes_avail":773027782656,"bytes_total":773094113280,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4299}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-11-28T11:08:12.143688+0000","services":{}},"progress_events":{}} 2023-11-28T11:08:41.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 -- 172.21.15.125:0/1859779312 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff2f00682c0 msgr2=0x7ff2f006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff2f00682c0 0x7ff2f006a770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80090b0 tx=0x7ff2f8008030 comp rx=0 tx=0).stop 2023-11-28T11:08:41.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 -- 172.21.15.125:0/1859779312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3100cd5a0 msgr2=0x7ff310153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3100cd5a0 0x7ff310153810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff30000c4c0 tx=0x7ff30000c7d0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 -- 172.21.15.125:0/1859779312 shutdown_connections 2023-11-28T11:08:41.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff2f00682c0 0x7ff2f006a770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3100d0450 0x7ff3100b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff31006ab10 0x7ff3101e85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 --2- 172.21.15.125:0/1859779312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3100cd5a0 0x7ff310153810 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 -- 172.21.15.125:0/1859779312 >> 172.21.15.125:0/1859779312 conn(0x7ff31006c520 msgr2=0x7ff3101573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:41.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 -- 172.21.15.125:0/1859779312 shutdown_connections 2023-11-28T11:08:41.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.619+0000 7ff316705700 1 -- 172.21.15.125:0/1859779312 wait complete. 2023-11-28T11:08:41.633 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T11:08:41.633 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:08:41.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31aaa6c700 1 Processor -- start 2023-11-28T11:08:41.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31aaa6c700 1 -- start start 2023-11-28T11:08:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31aaa6c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31a406a270 0x7f31a406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31aaa6c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31a415cc80 0x7f31a406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31aaa6c700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a406ab80 con 0x7f31a406e3a0 2023-11-28T11:08:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31aaa6c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a40b2490 con 0x7f31a415cc80 2023-11-28T11:08:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31aaa6c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a40b1810 con 0x7f31a406a270 2023-11-28T11:08:41.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31a415cc80 0x7f31a406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:41.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31a415cc80 0x7f31a406de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56838/0 (socket says 172.21.15.125:56838) 2023-11-28T11:08:41.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a3fff700 1 -- 172.21.15.125:0/2327149899 learned_addr learned my addr 172.21.15.125:0/2327149899 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:41.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a8808700 1 --2- 172.21.15.125:0/2327149899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31a406a270 0x7f31a406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:41.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a3fff700 1 -- 172.21.15.125:0/2327149899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31a406a270 msgr2=0x7f31a406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:41.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a3fff700 1 --2- 172.21.15.125:0/2327149899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31a406a270 0x7f31a406a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a3fff700 1 -- 172.21.15.125:0/2327149899 >> v1:172.21.15.167:6789/0 conn(0x7f31a406e3a0 legacy=0x7f31a406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a3fff700 1 -- 172.21.15.125:0/2327149899 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a40b1af0 con 0x7f31a415cc80 2023-11-28T11:08:41.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a3fff700 1 --2- 172.21.15.125:0/2327149899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a415cc80 0x7f31a406de60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31900098f0 tx=0x7f3190009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89407ce32c8e9af2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:41.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a37fe700 1 -- 172.21.15.125:0/2327149899 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000b8a0 con 0x7f31a415cc80 2023-11-28T11:08:41.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a37fe700 1 -- 172.21.15.125:0/2327149899 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319000ba00 con 0x7f31a415cc80 2023-11-28T11:08:41.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.752+0000 7f31a37fe700 1 -- 172.21.15.125:0/2327149899 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000bd90 con 0x7f31a415cc80 2023-11-28T11:08:41.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.753+0000 7f31aaa6c700 1 -- 172.21.15.125:0/2327149899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a415cc80 msgr2=0x7f31a406de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.753+0000 7f31aaa6c700 1 --2- 172.21.15.125:0/2327149899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a415cc80 0x7f31a406de60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31900098f0 tx=0x7f3190009c00 comp rx=0 tx=0).stop 2023-11-28T11:08:41.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.753+0000 7f31aaa6c700 1 -- 172.21.15.125:0/2327149899 shutdown_connections 2023-11-28T11:08:41.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.753+0000 7f31aaa6c700 1 --2- 172.21.15.125:0/2327149899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31a406a270 0x7f31a406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.753+0000 7f31aaa6c700 1 --2- 172.21.15.125:0/2327149899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a415cc80 0x7f31a406de60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.753+0000 7f31aaa6c700 1 -- 172.21.15.125:0/2327149899 >> 172.21.15.125:0/2327149899 conn(0x7f31a406c010 msgr2=0x7f31a40cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:41.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.753+0000 7f31aaa6c700 1 -- 172.21.15.125:0/2327149899 shutdown_connections 2023-11-28T11:08:41.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.753+0000 7f31aaa6c700 1 -- 172.21.15.125:0/2327149899 wait complete. 2023-11-28T11:08:41.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.754+0000 7f31aaa6c700 1 Processor -- start 2023-11-28T11:08:41.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.754+0000 7f31aaa6c700 1 -- start start 2023-11-28T11:08:41.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31aaa6c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31a406a270 0x7f31a40b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:41.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31aaa6c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31a406e3a0 0x7f31a41e7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:41.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31aaa6c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a415cc80 0x7f31a40cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:41.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31aaa6c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a40b3d60 con 0x7f31a415cc80 2023-11-28T11:08:41.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31aaa6c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a40b3f70 con 0x7f31a406e3a0 2023-11-28T11:08:41.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31aaa6c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a40b4250 con 0x7f31a406a270 2023-11-28T11:08:41.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31a9009700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a415cc80 0x7f31a40cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:41.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31a9009700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a415cc80 0x7f31a40cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56846/0 (socket says 172.21.15.125:56846) 2023-11-28T11:08:41.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31a9009700 1 -- 172.21.15.125:0/4215978701 learned_addr learned my addr 172.21.15.125:0/4215978701 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:41.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31a3fff700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31a406e3a0 0x7f31a41e7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:41.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31a8808700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31a406a270 0x7f31a40b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:41.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.755+0000 7f31a9009700 1 -- 172.21.15.125:0/4215978701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31a406a270 msgr2=0x7f31a40b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.756+0000 7f31a9009700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31a406a270 0x7f31a40b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.756+0000 7f31a9009700 1 -- 172.21.15.125:0/4215978701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31a406e3a0 msgr2=0x7f31a41e7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.756+0000 7f31a9009700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31a406e3a0 0x7f31a41e7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.756+0000 7f31a9009700 1 -- 172.21.15.125:0/4215978701 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190009550 con 0x7f31a415cc80 2023-11-28T11:08:41.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.756+0000 7f31a9009700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a415cc80 0x7f31a40cb710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f319c00cb50 tx=0x7f319c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:41.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.756+0000 7f31a17fa700 1 -- 172.21.15.125:0/4215978701 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c003c00 con 0x7f31a415cc80 2023-11-28T11:08:41.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.756+0000 7f31a17fa700 1 -- 172.21.15.125:0/4215978701 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c003d60 con 0x7f31a415cc80 2023-11-28T11:08:41.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.756+0000 7f31a17fa700 1 -- 172.21.15.125:0/4215978701 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c00ab70 con 0x7f31a415cc80 2023-11-28T11:08:41.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.756+0000 7f31aaa6c700 1 -- 172.21.15.125:0/4215978701 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a40b20b0 con 0x7f31a415cc80 2023-11-28T11:08:41.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.756+0000 7f31aaa6c700 1 -- 172.21.15.125:0/4215978701 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a40b1dd0 con 0x7f31a415cc80 2023-11-28T11:08:41.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.757+0000 7f31aaa6c700 1 -- 172.21.15.125:0/4215978701 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a406e7e0 con 0x7f31a415cc80 2023-11-28T11:08:41.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.757+0000 7f31a17fa700 1 -- 172.21.15.125:0/4215978701 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f319c010050 con 0x7f31a415cc80 2023-11-28T11:08:41.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.758+0000 7f31a17fa700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f31880682f0 0x7f318806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:41.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.758+0000 7f31a17fa700 1 -- 172.21.15.125:0/4215978701 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f319c085c60 con 0x7f31a415cc80 2023-11-28T11:08:41.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.758+0000 7f31a8808700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f31880682f0 0x7f318806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:41.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.758+0000 7f31a8808700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f31880682f0 0x7f318806a7a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3198009770 tx=0x7f3198008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:41.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.763+0000 7f31a17fa700 1 -- 172.21.15.125:0/4215978701 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f319c0523d0 con 0x7f31a415cc80 2023-11-28T11:08:41.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.941+0000 7f31aaa6c700 1 -- 172.21.15.125:0/4215978701 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31a40b4410 con 0x7f31880682f0 2023-11-28T11:08:41.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.949+0000 7f31a17fa700 1 -- 172.21.15.125:0/4215978701 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286677 (secure 0 0 0) 0x7f31980094e0 con 0x7f31880682f0 2023-11-28T11:08:41.954 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:41.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 -- 172.21.15.125:0/4215978701 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f31880682f0 msgr2=0x7f318806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f31880682f0 0x7f318806a7a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3198009770 tx=0x7f3198008040 comp rx=0 tx=0).stop 2023-11-28T11:08:41.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 -- 172.21.15.125:0/4215978701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a415cc80 msgr2=0x7f31a40cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:41.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a415cc80 0x7f31a40cb710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f319c00cb50 tx=0x7f319c00cf10 comp rx=0 tx=0).stop 2023-11-28T11:08:41.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 -- 172.21.15.125:0/4215978701 shutdown_connections 2023-11-28T11:08:41.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a415cc80 0x7f31a40cb710 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f31880682f0 0x7f318806a7a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31a406a270 0x7f31a40b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 --2- 172.21.15.125:0/4215978701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31a406e3a0 0x7f31a41e7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:41.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 -- 172.21.15.125:0/4215978701 >> 172.21.15.125:0/4215978701 conn(0x7f31a406c010 msgr2=0x7f31a40ad900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:41.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 -- 172.21.15.125:0/4215978701 shutdown_connections 2023-11-28T11:08:41.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:41.953+0000 7f31aaa6c700 1 -- 172.21.15.125:0/4215978701 wait complete. 2023-11-28T11:08:41.957 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:08:41.966 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-28T11:08:41.622808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66440,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":63168,"kb_avail":754908280,"statfs":{"total":773094113280,"available":773026078720,"internally_reserved":0,"allocated":3284992,"data_stored":1939556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64684032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001243"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527689+0000","last_change":"2023-11-28T11:08:36.416297+0000","last_active":"2023-11-28T11:08:37.527689+0000","last_peered":"2023-11-28T11:08:37.527689+0000","last_clean":"2023-11-28T11:08:37.527689+0000","last_became_active":"2023-11-28T11:08:36.415977+0000","last_became_peered":"2023-11-28T11:08:36.415977+0000","last_unstale":"2023-11-28T11:08:37.527689+0000","last_undegraded":"2023-11-28T11:08:37.527689+0000","last_fullsized":"2023-11-28T11:08:37.527689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:48.481042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029908+0000","last_change":"2023-11-28T11:08:36.400367+0000","last_active":"2023-11-28T11:08:38.029908+0000","last_peered":"2023-11-28T11:08:38.029908+0000","last_clean":"2023-11-28T11:08:38.029908+0000","last_became_active":"2023-11-28T11:08:36.400076+0000","last_became_peered":"2023-11-28T11:08:36.400076+0000","last_unstale":"2023-11-28T11:08:38.029908+0000","last_undegraded":"2023-11-28T11:08:38.029908+0000","last_fullsized":"2023-11-28T11:08:38.029908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029428+0000","last_change":"2023-11-28T11:08:36.406078+0000","last_active":"2023-11-28T11:08:38.029428+0000","last_peered":"2023-11-28T11:08:38.029428+0000","last_clean":"2023-11-28T11:08:38.029428+0000","last_became_active":"2023-11-28T11:08:36.405448+0000","last_became_peered":"2023-11-28T11:08:36.405448+0000","last_unstale":"2023-11-28T11:08:38.029428+0000","last_undegraded":"2023-11-28T11:08:38.029428+0000","last_fullsized":"2023-11-28T11:08:38.029428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:34:58.025630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389721+0000","last_change":"2023-11-28T11:08:36.411547+0000","last_active":"2023-11-28T11:08:37.389721+0000","last_peered":"2023-11-28T11:08:37.389721+0000","last_clean":"2023-11-28T11:08:37.389721+0000","last_became_active":"2023-11-28T11:08:36.411251+0000","last_became_peered":"2023-11-28T11:08:36.411251+0000","last_unstale":"2023-11-28T11:08:37.389721+0000","last_undegraded":"2023-11-28T11:08:37.389721+0000","last_fullsized":"2023-11-28T11:08:37.389721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:30.748107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388308+0000","last_change":"2023-11-28T11:08:36.408744+0000","last_active":"2023-11-28T11:08:37.388308+0000","last_peered":"2023-11-28T11:08:37.388308+0000","last_clean":"2023-11-28T11:08:37.388308+0000","last_became_active":"2023-11-28T11:08:36.408499+0000","last_became_peered":"2023-11-28T11:08:36.408499+0000","last_unstale":"2023-11-28T11:08:37.388308+0000","last_undegraded":"2023-11-28T11:08:37.388308+0000","last_fullsized":"2023-11-28T11:08:37.388308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029988+0000","last_change":"2023-11-28T11:08:36.404949+0000","last_active":"2023-11-28T11:08:38.029988+0000","last_peered":"2023-11-28T11:08:38.029988+0000","last_clean":"2023-11-28T11:08:38.029988+0000","last_became_active":"2023-11-28T11:08:36.404662+0000","last_became_peered":"2023-11-28T11:08:36.404662+0000","last_unstale":"2023-11-28T11:08:38.029988+0000","last_undegraded":"2023-11-28T11:08:38.029988+0000","last_fullsized":"2023-11-28T11:08:38.029988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:50.488364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389610+0000","last_change":"2023-11-28T11:08:36.407228+0000","last_active":"2023-11-28T11:08:37.389610+0000","last_peered":"2023-11-28T11:08:37.389610+0000","last_clean":"2023-11-28T11:08:37.389610+0000","last_became_active":"2023-11-28T11:08:36.406568+0000","last_became_peered":"2023-11-28T11:08:36.406568+0000","last_unstale":"2023-11-28T11:08:37.389610+0000","last_undegraded":"2023-11-28T11:08:37.389610+0000","last_fullsized":"2023-11-28T11:08:37.389610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029317+0000","last_change":"2023-11-28T11:08:36.404585+0000","last_active":"2023-11-28T11:08:38.029317+0000","last_peered":"2023-11-28T11:08:38.029317+0000","last_clean":"2023-11-28T11:08:38.029317+0000","last_became_active":"2023-11-28T11:08:36.404273+0000","last_became_peered":"2023-11-28T11:08:36.404273+0000","last_unstale":"2023-11-28T11:08:38.029317+0000","last_undegraded":"2023-11-28T11:08:38.029317+0000","last_fullsized":"2023-11-28T11:08:38.029317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388542+0000","last_change":"2023-11-28T11:08:36.416209+0000","last_active":"2023-11-28T11:08:37.388542+0000","last_peered":"2023-11-28T11:08:37.388542+0000","last_clean":"2023-11-28T11:08:37.388542+0000","last_became_active":"2023-11-28T11:08:36.415945+0000","last_became_peered":"2023-11-28T11:08:36.415945+0000","last_unstale":"2023-11-28T11:08:37.388542+0000","last_undegraded":"2023-11-28T11:08:37.388542+0000","last_fullsized":"2023-11-28T11:08:37.388542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029484+0000","last_change":"2023-11-28T11:08:36.393913+0000","last_active":"2023-11-28T11:08:38.029484+0000","last_peered":"2023-11-28T11:08:38.029484+0000","last_clean":"2023-11-28T11:08:38.029484+0000","last_became_active":"2023-11-28T11:08:36.393400+0000","last_became_peered":"2023-11-28T11:08:36.393400+0000","last_unstale":"2023-11-28T11:08:38.029484+0000","last_undegraded":"2023-11-28T11:08:38.029484+0000","last_fullsized":"2023-11-28T11:08:38.029484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029534+0000","last_change":"2023-11-28T11:08:36.405268+0000","last_active":"2023-11-28T11:08:38.029534+0000","last_peered":"2023-11-28T11:08:38.029534+0000","last_clean":"2023-11-28T11:08:38.029534+0000","last_became_active":"2023-11-28T11:08:36.404990+0000","last_became_peered":"2023-11-28T11:08:36.404990+0000","last_unstale":"2023-11-28T11:08:38.029534+0000","last_undegraded":"2023-11-28T11:08:38.029534+0000","last_fullsized":"2023-11-28T11:08:38.029534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:45:33.470588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527660+0000","last_change":"2023-11-28T11:08:36.405351+0000","last_active":"2023-11-28T11:08:37.527660+0000","last_peered":"2023-11-28T11:08:37.527660+0000","last_clean":"2023-11-28T11:08:37.527660+0000","last_became_active":"2023-11-28T11:08:36.405078+0000","last_became_peered":"2023-11-28T11:08:36.405078+0000","last_unstale":"2023-11-28T11:08:37.527660+0000","last_undegraded":"2023-11-28T11:08:37.527660+0000","last_fullsized":"2023-11-28T11:08:37.527660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:30.748107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527570+0000","last_change":"2023-11-28T11:08:36.408661+0000","last_active":"2023-11-28T11:08:37.527570+0000","last_peered":"2023-11-28T11:08:37.527570+0000","last_clean":"2023-11-28T11:08:37.527570+0000","last_became_active":"2023-11-28T11:08:36.408387+0000","last_became_peered":"2023-11-28T11:08:36.408387+0000","last_unstale":"2023-11-28T11:08:37.527570+0000","last_undegraded":"2023-11-28T11:08:37.527570+0000","last_fullsized":"2023-11-28T11:08:37.527570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:13.215556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029184+0000","last_change":"2023-11-28T11:08:36.401781+0000","last_active":"2023-11-28T11:08:38.029184+0000","last_peered":"2023-11-28T11:08:38.029184+0000","last_clean":"2023-11-28T11:08:38.029184+0000","last_became_active":"2023-11-28T11:08:36.401490+0000","last_became_peered":"2023-11-28T11:08:36.401490+0000","last_unstale":"2023-11-28T11:08:38.029184+0000","last_undegraded":"2023-11-28T11:08:38.029184+0000","last_fullsized":"2023-11-28T11:08:38.029184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390010+0000","last_change":"2023-11-28T11:08:36.407391+0000","last_active":"2023-11-28T11:08:37.390010+0000","last_peered":"2023-11-28T11:08:37.390010+0000","last_clean":"2023-11-28T11:08:37.390010+0000","last_became_active":"2023-11-28T11:08:36.406934+0000","last_became_peered":"2023-11-28T11:08:36.406934+0000","last_unstale":"2023-11-28T11:08:37.390010+0000","last_undegraded":"2023-11-28T11:08:37.390010+0000","last_fullsized":"2023-11-28T11:08:37.390010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029297+0000","last_change":"2023-11-28T11:08:36.405277+0000","last_active":"2023-11-28T11:08:38.029297+0000","last_peered":"2023-11-28T11:08:38.029297+0000","last_clean":"2023-11-28T11:08:38.029297+0000","last_became_active":"2023-11-28T11:08:36.405034+0000","last_became_peered":"2023-11-28T11:08:36.405034+0000","last_unstale":"2023-11-28T11:08:38.029297+0000","last_undegraded":"2023-11-28T11:08:38.029297+0000","last_fullsized":"2023-11-28T11:08:38.029297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:51.071881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388626+0000","last_change":"2023-11-28T11:08:36.416839+0000","last_active":"2023-11-28T11:08:37.388626+0000","last_peered":"2023-11-28T11:08:37.388626+0000","last_clean":"2023-11-28T11:08:37.388626+0000","last_became_active":"2023-11-28T11:08:36.416606+0000","last_became_peered":"2023-11-28T11:08:36.416606+0000","last_unstale":"2023-11-28T11:08:37.388626+0000","last_undegraded":"2023-11-28T11:08:37.388626+0000","last_fullsized":"2023-11-28T11:08:37.388626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029699+0000","last_change":"2023-11-28T11:08:36.403858+0000","last_active":"2023-11-28T11:08:38.029699+0000","last_peered":"2023-11-28T11:08:38.029699+0000","last_clean":"2023-11-28T11:08:38.029699+0000","last_became_active":"2023-11-28T11:08:36.403584+0000","last_became_peered":"2023-11-28T11:08:36.403584+0000","last_unstale":"2023-11-28T11:08:38.029699+0000","last_undegraded":"2023-11-28T11:08:38.029699+0000","last_fullsized":"2023-11-28T11:08:38.029699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527667+0000","last_change":"2023-11-28T11:08:36.413070+0000","last_active":"2023-11-28T11:08:37.527667+0000","last_peered":"2023-11-28T11:08:37.527667+0000","last_clean":"2023-11-28T11:08:37.527667+0000","last_became_active":"2023-11-28T11:08:36.412782+0000","last_became_peered":"2023-11-28T11:08:36.412782+0000","last_unstale":"2023-11-28T11:08:37.527667+0000","last_undegraded":"2023-11-28T11:08:37.527667+0000","last_fullsized":"2023-11-28T11:08:37.527667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:09.866075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029903+0000","last_change":"2023-11-28T11:08:36.412148+0000","last_active":"2023-11-28T11:08:38.029903+0000","last_peered":"2023-11-28T11:08:38.029903+0000","last_clean":"2023-11-28T11:08:38.029903+0000","last_became_active":"2023-11-28T11:08:36.411873+0000","last_became_peered":"2023-11-28T11:08:36.411873+0000","last_unstale":"2023-11-28T11:08:38.029903+0000","last_undegraded":"2023-11-28T11:08:38.029903+0000","last_fullsized":"2023-11-28T11:08:38.029903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:34:13.560527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390150+0000","last_change":"2023-11-28T11:08:36.416108+0000","last_active":"2023-11-28T11:08:37.390150+0000","last_peered":"2023-11-28T11:08:37.390150+0000","last_clean":"2023-11-28T11:08:37.390150+0000","last_became_active":"2023-11-28T11:08:36.415831+0000","last_became_peered":"2023-11-28T11:08:36.415831+0000","last_unstale":"2023-11-28T11:08:37.390150+0000","last_undegraded":"2023-11-28T11:08:37.390150+0000","last_fullsized":"2023-11-28T11:08:37.390150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388133+0000","last_change":"2023-11-28T11:08:36.404227+0000","last_active":"2023-11-28T11:08:37.388133+0000","last_peered":"2023-11-28T11:08:37.388133+0000","last_clean":"2023-11-28T11:08:37.388133+0000","last_became_active":"2023-11-28T11:08:36.403978+0000","last_became_peered":"2023-11-28T11:08:36.403978+0000","last_unstale":"2023-11-28T11:08:37.388133+0000","last_undegraded":"2023-11-28T11:08:37.388133+0000","last_fullsized":"2023-11-28T11:08:37.388133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028811+0000","last_change":"2023-11-28T11:08:36.405775+0000","last_active":"2023-11-28T11:08:38.028811+0000","last_peered":"2023-11-28T11:08:38.028811+0000","last_clean":"2023-11-28T11:08:38.028811+0000","last_became_active":"2023-11-28T11:08:36.405525+0000","last_became_peered":"2023-11-28T11:08:36.405525+0000","last_unstale":"2023-11-28T11:08:38.028811+0000","last_undegraded":"2023-11-28T11:08:38.028811+0000","last_fullsized":"2023-11-28T11:08:38.028811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390248+0000","last_change":"2023-11-28T11:08:36.416121+0000","last_active":"2023-11-28T11:08:37.390248+0000","last_peered":"2023-11-28T11:08:37.390248+0000","last_clean":"2023-11-28T11:08:37.390248+0000","last_became_active":"2023-11-28T11:08:36.415874+0000","last_became_peered":"2023-11-28T11:08:36.415874+0000","last_unstale":"2023-11-28T11:08:37.390248+0000","last_undegraded":"2023-11-28T11:08:37.390248+0000","last_fullsized":"2023-11-28T11:08:37.390248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029011+0000","last_change":"2023-11-28T11:08:36.409665+0000","last_active":"2023-11-28T11:08:38.029011+0000","last_peered":"2023-11-28T11:08:38.029011+0000","last_clean":"2023-11-28T11:08:38.029011+0000","last_became_active":"2023-11-28T11:08:36.409096+0000","last_became_peered":"2023-11-28T11:08:36.409096+0000","last_unstale":"2023-11-28T11:08:38.029011+0000","last_undegraded":"2023-11-28T11:08:38.029011+0000","last_fullsized":"2023-11-28T11:08:38.029011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028947+0000","last_change":"2023-11-28T11:08:36.401914+0000","last_active":"2023-11-28T11:08:38.028947+0000","last_peered":"2023-11-28T11:08:38.028947+0000","last_clean":"2023-11-28T11:08:38.028947+0000","last_became_active":"2023-11-28T11:08:36.401600+0000","last_became_peered":"2023-11-28T11:08:36.401600+0000","last_unstale":"2023-11-28T11:08:38.028947+0000","last_undegraded":"2023-11-28T11:08:38.028947+0000","last_fullsized":"2023-11-28T11:08:38.028947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029901+0000","last_change":"2023-11-28T11:08:36.409423+0000","last_active":"2023-11-28T11:08:38.029901+0000","last_peered":"2023-11-28T11:08:38.029901+0000","last_clean":"2023-11-28T11:08:38.029901+0000","last_became_active":"2023-11-28T11:08:36.409119+0000","last_became_peered":"2023-11-28T11:08:36.409119+0000","last_unstale":"2023-11-28T11:08:38.029901+0000","last_undegraded":"2023-11-28T11:08:38.029901+0000","last_fullsized":"2023-11-28T11:08:38.029901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030088+0000","last_change":"2023-11-28T11:08:36.008194+0000","last_active":"2023-11-28T11:08:38.030088+0000","last_peered":"2023-11-28T11:08:38.030088+0000","last_clean":"2023-11-28T11:08:38.030088+0000","last_became_active":"2023-11-28T11:08:36.007906+0000","last_became_peered":"2023-11-28T11:08:36.007906+0000","last_unstale":"2023-11-28T11:08:38.030088+0000","last_undegraded":"2023-11-28T11:08:38.030088+0000","last_fullsized":"2023-11-28T11:08:38.030088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:55:11.905711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029123+0000","last_change":"2023-11-28T11:08:36.408516+0000","last_active":"2023-11-28T11:08:38.029123+0000","last_peered":"2023-11-28T11:08:38.029123+0000","last_clean":"2023-11-28T11:08:38.029123+0000","last_became_active":"2023-11-28T11:08:36.408251+0000","last_became_peered":"2023-11-28T11:08:36.408251+0000","last_unstale":"2023-11-28T11:08:38.029123+0000","last_undegraded":"2023-11-28T11:08:38.029123+0000","last_fullsized":"2023-11-28T11:08:38.029123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028954+0000","last_change":"2023-11-28T11:08:36.011280+0000","last_active":"2023-11-28T11:08:38.028954+0000","last_peered":"2023-11-28T11:08:38.028954+0000","last_clean":"2023-11-28T11:08:38.028954+0000","last_became_active":"2023-11-28T11:08:36.011033+0000","last_became_peered":"2023-11-28T11:08:36.011033+0000","last_unstale":"2023-11-28T11:08:38.028954+0000","last_undegraded":"2023-11-28T11:08:38.028954+0000","last_fullsized":"2023-11-28T11:08:38.028954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388540+0000","last_change":"2023-11-28T11:08:36.407287+0000","last_active":"2023-11-28T11:08:37.388540+0000","last_peered":"2023-11-28T11:08:37.388540+0000","last_clean":"2023-11-28T11:08:37.388540+0000","last_became_active":"2023-11-28T11:08:36.407061+0000","last_became_peered":"2023-11-28T11:08:36.407061+0000","last_unstale":"2023-11-28T11:08:37.388540+0000","last_undegraded":"2023-11-28T11:08:37.388540+0000","last_fullsized":"2023-11-28T11:08:37.388540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028703+0000","last_change":"2023-11-28T11:08:36.001278+0000","last_active":"2023-11-28T11:08:38.028703+0000","last_peered":"2023-11-28T11:08:38.028703+0000","last_clean":"2023-11-28T11:08:38.028703+0000","last_became_active":"2023-11-28T11:08:36.000628+0000","last_became_peered":"2023-11-28T11:08:36.000628+0000","last_unstale":"2023-11-28T11:08:38.028703+0000","last_undegraded":"2023-11-28T11:08:38.028703+0000","last_fullsized":"2023-11-28T11:08:38.028703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390139+0000","last_change":"2023-11-28T11:08:36.408310+0000","last_active":"2023-11-28T11:08:37.390139+0000","last_peered":"2023-11-28T11:08:37.390139+0000","last_clean":"2023-11-28T11:08:37.390139+0000","last_became_active":"2023-11-28T11:08:36.407978+0000","last_became_peered":"2023-11-28T11:08:36.407978+0000","last_unstale":"2023-11-28T11:08:37.390139+0000","last_undegraded":"2023-11-28T11:08:37.390139+0000","last_fullsized":"2023-11-28T11:08:37.390139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:39.663018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388676+0000","last_change":"2023-11-28T11:08:36.002015+0000","last_active":"2023-11-28T11:08:37.388676+0000","last_peered":"2023-11-28T11:08:37.388676+0000","last_clean":"2023-11-28T11:08:37.388676+0000","last_became_active":"2023-11-28T11:08:36.001559+0000","last_became_peered":"2023-11-28T11:08:36.001559+0000","last_unstale":"2023-11-28T11:08:37.388676+0000","last_undegraded":"2023-11-28T11:08:37.388676+0000","last_fullsized":"2023-11-28T11:08:37.388676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:55:11.905711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028605+0000","last_change":"2023-11-28T11:08:36.408653+0000","last_active":"2023-11-28T11:08:38.028605+0000","last_peered":"2023-11-28T11:08:38.028605+0000","last_clean":"2023-11-28T11:08:38.028605+0000","last_became_active":"2023-11-28T11:08:36.408400+0000","last_became_peered":"2023-11-28T11:08:36.408400+0000","last_unstale":"2023-11-28T11:08:38.028605+0000","last_undegraded":"2023-11-28T11:08:38.028605+0000","last_fullsized":"2023-11-28T11:08:38.028605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029355+0000","last_change":"2023-11-28T11:08:36.005909+0000","last_active":"2023-11-28T11:08:38.029355+0000","last_peered":"2023-11-28T11:08:38.029355+0000","last_clean":"2023-11-28T11:08:38.029355+0000","last_became_active":"2023-11-28T11:08:36.005626+0000","last_became_peered":"2023-11-28T11:08:36.005626+0000","last_unstale":"2023-11-28T11:08:38.029355+0000","last_undegraded":"2023-11-28T11:08:38.029355+0000","last_fullsized":"2023-11-28T11:08:38.029355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028717+0000","last_change":"2023-11-28T11:08:36.410036+0000","last_active":"2023-11-28T11:08:38.028717+0000","last_peered":"2023-11-28T11:08:38.028717+0000","last_clean":"2023-11-28T11:08:38.028717+0000","last_became_active":"2023-11-28T11:08:36.409785+0000","last_became_peered":"2023-11-28T11:08:36.409785+0000","last_unstale":"2023-11-28T11:08:38.028717+0000","last_undegraded":"2023-11-28T11:08:38.028717+0000","last_fullsized":"2023-11-28T11:08:38.028717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:38:35.406909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390346+0000","last_change":"2023-11-28T11:08:36.008706+0000","last_active":"2023-11-28T11:08:37.390346+0000","last_peered":"2023-11-28T11:08:37.390346+0000","last_clean":"2023-11-28T11:08:37.390346+0000","last_became_active":"2023-11-28T11:08:36.008279+0000","last_became_peered":"2023-11-28T11:08:36.008279+0000","last_unstale":"2023-11-28T11:08:37.390346+0000","last_undegraded":"2023-11-28T11:08:37.390346+0000","last_fullsized":"2023-11-28T11:08:37.390346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028730+0000","last_change":"2023-11-28T11:08:36.413891+0000","last_active":"2023-11-28T11:08:38.028730+0000","last_peered":"2023-11-28T11:08:38.028730+0000","last_clean":"2023-11-28T11:08:38.028730+0000","last_became_active":"2023-11-28T11:08:36.413613+0000","last_became_peered":"2023-11-28T11:08:36.413613+0000","last_unstale":"2023-11-28T11:08:38.028730+0000","last_undegraded":"2023-11-28T11:08:38.028730+0000","last_fullsized":"2023-11-28T11:08:38.028730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030012+0000","last_change":"2023-11-28T11:08:36.009147+0000","last_active":"2023-11-28T11:08:38.030012+0000","last_peered":"2023-11-28T11:08:38.030012+0000","last_clean":"2023-11-28T11:08:38.030012+0000","last_became_active":"2023-11-28T11:08:36.008847+0000","last_became_peered":"2023-11-28T11:08:36.008847+0000","last_unstale":"2023-11-28T11:08:38.030012+0000","last_undegraded":"2023-11-28T11:08:38.030012+0000","last_fullsized":"2023-11-28T11:08:38.030012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029178+0000","last_change":"2023-11-28T11:08:36.410776+0000","last_active":"2023-11-28T11:08:38.029178+0000","last_peered":"2023-11-28T11:08:38.029178+0000","last_clean":"2023-11-28T11:08:38.029178+0000","last_became_active":"2023-11-28T11:08:36.410335+0000","last_became_peered":"2023-11-28T11:08:36.410335+0000","last_unstale":"2023-11-28T11:08:38.029178+0000","last_undegraded":"2023-11-28T11:08:38.029178+0000","last_fullsized":"2023-11-28T11:08:38.029178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:38:35.406909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390017+0000","last_change":"2023-11-28T11:08:36.011427+0000","last_active":"2023-11-28T11:08:37.390017+0000","last_peered":"2023-11-28T11:08:37.390017+0000","last_clean":"2023-11-28T11:08:37.390017+0000","last_became_active":"2023-11-28T11:08:36.011137+0000","last_became_peered":"2023-11-28T11:08:36.011137+0000","last_unstale":"2023-11-28T11:08:37.390017+0000","last_undegraded":"2023-11-28T11:08:37.390017+0000","last_fullsized":"2023-11-28T11:08:37.390017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:32:07.107062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029099+0000","last_change":"2023-11-28T11:08:36.408216+0000","last_active":"2023-11-28T11:08:38.029099+0000","last_peered":"2023-11-28T11:08:38.029099+0000","last_clean":"2023-11-28T11:08:38.029099+0000","last_became_active":"2023-11-28T11:08:36.407897+0000","last_became_peered":"2023-11-28T11:08:36.407897+0000","last_unstale":"2023-11-28T11:08:38.029099+0000","last_undegraded":"2023-11-28T11:08:38.029099+0000","last_fullsized":"2023-11-28T11:08:38.029099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:15.750770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388082+0000","last_change":"2023-11-28T11:08:35.994749+0000","last_active":"2023-11-28T11:08:37.388082+0000","last_peered":"2023-11-28T11:08:37.388082+0000","last_clean":"2023-11-28T11:08:37.388082+0000","last_became_active":"2023-11-28T11:08:35.994475+0000","last_became_peered":"2023-11-28T11:08:35.994475+0000","last_unstale":"2023-11-28T11:08:37.388082+0000","last_undegraded":"2023-11-28T11:08:37.388082+0000","last_fullsized":"2023-11-28T11:08:37.388082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:27.258902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029441+0000","last_change":"2023-11-28T11:08:36.409070+0000","last_active":"2023-11-28T11:08:38.029441+0000","last_peered":"2023-11-28T11:08:38.029441+0000","last_clean":"2023-11-28T11:08:38.029441+0000","last_became_active":"2023-11-28T11:08:36.408778+0000","last_became_peered":"2023-11-28T11:08:36.408778+0000","last_unstale":"2023-11-28T11:08:38.029441+0000","last_undegraded":"2023-11-28T11:08:38.029441+0000","last_fullsized":"2023-11-28T11:08:38.029441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390361+0000","last_change":"2023-11-28T11:08:36.010605+0000","last_active":"2023-11-28T11:08:37.390361+0000","last_peered":"2023-11-28T11:08:37.390361+0000","last_clean":"2023-11-28T11:08:37.390361+0000","last_became_active":"2023-11-28T11:08:36.010210+0000","last_became_peered":"2023-11-28T11:08:36.010210+0000","last_unstale":"2023-11-28T11:08:37.390361+0000","last_undegraded":"2023-11-28T11:08:37.390361+0000","last_fullsized":"2023-11-28T11:08:37.390361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:22:26.583310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388452+0000","last_change":"2023-11-28T11:08:36.413052+0000","last_active":"2023-11-28T11:08:37.388452+0000","last_peered":"2023-11-28T11:08:37.388452+0000","last_clean":"2023-11-28T11:08:37.388452+0000","last_became_active":"2023-11-28T11:08:36.412807+0000","last_became_peered":"2023-11-28T11:08:36.412807+0000","last_unstale":"2023-11-28T11:08:37.388452+0000","last_undegraded":"2023-11-28T11:08:37.388452+0000","last_fullsized":"2023-11-28T11:08:37.388452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389225+0000","last_change":"2023-11-28T11:08:36.004568+0000","last_active":"2023-11-28T11:08:37.389225+0000","last_peered":"2023-11-28T11:08:37.389225+0000","last_clean":"2023-11-28T11:08:37.389225+0000","last_became_active":"2023-11-28T11:08:36.004282+0000","last_became_peered":"2023-11-28T11:08:36.004282+0000","last_unstale":"2023-11-28T11:08:37.389225+0000","last_undegraded":"2023-11-28T11:08:37.389225+0000","last_fullsized":"2023-11-28T11:08:37.389225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:27:44.586581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029444+0000","last_change":"2023-11-28T11:08:36.410178+0000","last_active":"2023-11-28T11:08:38.029444+0000","last_peered":"2023-11-28T11:08:38.029444+0000","last_clean":"2023-11-28T11:08:38.029444+0000","last_became_active":"2023-11-28T11:08:36.409914+0000","last_became_peered":"2023-11-28T11:08:36.409914+0000","last_unstale":"2023-11-28T11:08:38.029444+0000","last_undegraded":"2023-11-28T11:08:38.029444+0000","last_fullsized":"2023-11-28T11:08:38.029444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390215+0000","last_change":"2023-11-28T11:08:36.006868+0000","last_active":"2023-11-28T11:08:37.390215+0000","last_peered":"2023-11-28T11:08:37.390215+0000","last_clean":"2023-11-28T11:08:37.390215+0000","last_became_active":"2023-11-28T11:08:36.006544+0000","last_became_peered":"2023-11-28T11:08:36.006544+0000","last_unstale":"2023-11-28T11:08:37.390215+0000","last_undegraded":"2023-11-28T11:08:37.390215+0000","last_fullsized":"2023-11-28T11:08:37.390215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:38.660821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029014+0000","last_change":"2023-11-28T11:08:36.409753+0000","last_active":"2023-11-28T11:08:38.029014+0000","last_peered":"2023-11-28T11:08:38.029014+0000","last_clean":"2023-11-28T11:08:38.029014+0000","last_became_active":"2023-11-28T11:08:36.409427+0000","last_became_peered":"2023-11-28T11:08:36.409427+0000","last_unstale":"2023-11-28T11:08:38.029014+0000","last_undegraded":"2023-11-28T11:08:38.029014+0000","last_fullsized":"2023-11-28T11:08:38.029014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390044+0000","last_change":"2023-11-28T11:08:36.006987+0000","last_active":"2023-11-28T11:08:37.390044+0000","last_peered":"2023-11-28T11:08:37.390044+0000","last_clean":"2023-11-28T11:08:37.390044+0000","last_became_active":"2023-11-28T11:08:36.006697+0000","last_became_peered":"2023-11-28T11:08:36.006697+0000","last_unstale":"2023-11-28T11:08:37.390044+0000","last_undegraded":"2023-11-28T11:08:37.390044+0000","last_fullsized":"2023-11-28T11:08:37.390044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:50.422704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029242+0000","last_change":"2023-11-28T11:08:36.404777+0000","last_active":"2023-11-28T11:08:38.029242+0000","last_peered":"2023-11-28T11:08:38.029242+0000","last_clean":"2023-11-28T11:08:38.029242+0000","last_became_active":"2023-11-28T11:08:36.404490+0000","last_became_peered":"2023-11-28T11:08:36.404490+0000","last_unstale":"2023-11-28T11:08:38.029242+0000","last_undegraded":"2023-11-28T11:08:38.029242+0000","last_fullsized":"2023-11-28T11:08:38.029242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:04:03.572831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390457+0000","last_change":"2023-11-28T11:08:36.005444+0000","last_active":"2023-11-28T11:08:37.390457+0000","last_peered":"2023-11-28T11:08:37.390457+0000","last_clean":"2023-11-28T11:08:37.390457+0000","last_became_active":"2023-11-28T11:08:36.005138+0000","last_became_peered":"2023-11-28T11:08:36.005138+0000","last_unstale":"2023-11-28T11:08:37.390457+0000","last_undegraded":"2023-11-28T11:08:37.390457+0000","last_fullsized":"2023-11-28T11:08:37.390457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:59:24.537181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389803+0000","last_change":"2023-11-28T11:08:36.411990+0000","last_active":"2023-11-28T11:08:37.389803+0000","last_peered":"2023-11-28T11:08:37.389803+0000","last_clean":"2023-11-28T11:08:37.389803+0000","last_became_active":"2023-11-28T11:08:36.411669+0000","last_became_peered":"2023-11-28T11:08:36.411669+0000","last_unstale":"2023-11-28T11:08:37.389803+0000","last_undegraded":"2023-11-28T11:08:37.389803+0000","last_fullsized":"2023-11-28T11:08:37.389803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:03.044603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029851+0000","last_change":"2023-11-28T11:08:36.011735+0000","last_active":"2023-11-28T11:08:38.029851+0000","last_peered":"2023-11-28T11:08:38.029851+0000","last_clean":"2023-11-28T11:08:38.029851+0000","last_became_active":"2023-11-28T11:08:36.011491+0000","last_became_peered":"2023-11-28T11:08:36.011491+0000","last_unstale":"2023-11-28T11:08:38.029851+0000","last_undegraded":"2023-11-28T11:08:38.029851+0000","last_fullsized":"2023-11-28T11:08:38.029851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388243+0000","last_change":"2023-11-28T11:08:36.400761+0000","last_active":"2023-11-28T11:08:37.388243+0000","last_peered":"2023-11-28T11:08:37.388243+0000","last_clean":"2023-11-28T11:08:37.388243+0000","last_became_active":"2023-11-28T11:08:36.400410+0000","last_became_peered":"2023-11-28T11:08:36.400410+0000","last_unstale":"2023-11-28T11:08:37.388243+0000","last_undegraded":"2023-11-28T11:08:37.388243+0000","last_fullsized":"2023-11-28T11:08:37.388243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:15.750770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029008+0000","last_change":"2023-11-28T11:08:36.008241+0000","last_active":"2023-11-28T11:08:38.029008+0000","last_peered":"2023-11-28T11:08:38.029008+0000","last_clean":"2023-11-28T11:08:38.029008+0000","last_became_active":"2023-11-28T11:08:36.007905+0000","last_became_peered":"2023-11-28T11:08:36.007905+0000","last_unstale":"2023-11-28T11:08:38.029008+0000","last_undegraded":"2023-11-28T11:08:38.029008+0000","last_fullsized":"2023-11-28T11:08:38.029008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029892+0000","last_change":"2023-11-28T11:08:36.414154+0000","last_active":"2023-11-28T11:08:38.029892+0000","last_peered":"2023-11-28T11:08:38.029892+0000","last_clean":"2023-11-28T11:08:38.029892+0000","last_became_active":"2023-11-28T11:08:36.413893+0000","last_became_peered":"2023-11-28T11:08:36.413893+0000","last_unstale":"2023-11-28T11:08:38.029892+0000","last_undegraded":"2023-11-28T11:08:38.029892+0000","last_fullsized":"2023-11-28T11:08:38.029892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389697+0000","last_change":"2023-11-28T11:08:36.010954+0000","last_active":"2023-11-28T11:08:37.389697+0000","last_peered":"2023-11-28T11:08:37.389697+0000","last_clean":"2023-11-28T11:08:37.389697+0000","last_became_active":"2023-11-28T11:08:36.010641+0000","last_became_peered":"2023-11-28T11:08:36.010641+0000","last_unstale":"2023-11-28T11:08:37.389697+0000","last_undegraded":"2023-11-28T11:08:37.389697+0000","last_fullsized":"2023-11-28T11:08:37.389697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:25:48.509520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029750+0000","last_change":"2023-11-28T11:08:36.403947+0000","last_active":"2023-11-28T11:08:38.029750+0000","last_peered":"2023-11-28T11:08:38.029750+0000","last_clean":"2023-11-28T11:08:38.029750+0000","last_became_active":"2023-11-28T11:08:36.403015+0000","last_became_peered":"2023-11-28T11:08:36.403015+0000","last_unstale":"2023-11-28T11:08:38.029750+0000","last_undegraded":"2023-11-28T11:08:38.029750+0000","last_fullsized":"2023-11-28T11:08:38.029750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:56.135916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029783+0000","last_change":"2023-11-28T11:08:36.008497+0000","last_active":"2023-11-28T11:08:38.029783+0000","last_peered":"2023-11-28T11:08:38.029783+0000","last_clean":"2023-11-28T11:08:38.029783+0000","last_became_active":"2023-11-28T11:08:36.008076+0000","last_became_peered":"2023-11-28T11:08:36.008076+0000","last_unstale":"2023-11-28T11:08:38.029783+0000","last_undegraded":"2023-11-28T11:08:38.029783+0000","last_fullsized":"2023-11-28T11:08:38.029783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029879+0000","last_change":"2023-11-28T11:08:36.408545+0000","last_active":"2023-11-28T11:08:38.029879+0000","last_peered":"2023-11-28T11:08:38.029879+0000","last_clean":"2023-11-28T11:08:38.029879+0000","last_became_active":"2023-11-28T11:08:36.408324+0000","last_became_peered":"2023-11-28T11:08:36.408324+0000","last_unstale":"2023-11-28T11:08:38.029879+0000","last_undegraded":"2023-11-28T11:08:38.029879+0000","last_fullsized":"2023-11-28T11:08:38.029879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029222+0000","last_change":"2023-11-28T11:08:36.008197+0000","last_active":"2023-11-28T11:08:38.029222+0000","last_peered":"2023-11-28T11:08:38.029222+0000","last_clean":"2023-11-28T11:08:38.029222+0000","last_became_active":"2023-11-28T11:08:36.007930+0000","last_became_peered":"2023-11-28T11:08:36.007930+0000","last_unstale":"2023-11-28T11:08:38.029222+0000","last_undegraded":"2023-11-28T11:08:38.029222+0000","last_fullsized":"2023-11-28T11:08:38.029222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029235+0000","last_change":"2023-11-28T11:08:36.414124+0000","last_active":"2023-11-28T11:08:38.029235+0000","last_peered":"2023-11-28T11:08:38.029235+0000","last_clean":"2023-11-28T11:08:38.029235+0000","last_became_active":"2023-11-28T11:08:36.413627+0000","last_became_peered":"2023-11-28T11:08:36.413627+0000","last_unstale":"2023-11-28T11:08:38.029235+0000","last_undegraded":"2023-11-28T11:08:38.029235+0000","last_fullsized":"2023-11-28T11:08:38.029235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.395305+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:08:36.395305+0000","last_peered":"2023-11-28T11:08:36.395305+0000","last_clean":"2023-11-28T11:08:36.395305+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:08:36.395305+0000","last_undegraded":"2023-11-28T11:08:36.395305+0000","last_fullsized":"2023-11-28T11:08:36.395305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029614+0000","last_change":"2023-11-28T11:08:36.012422+0000","last_active":"2023-11-28T11:08:38.029614+0000","last_peered":"2023-11-28T11:08:38.029614+0000","last_clean":"2023-11-28T11:08:38.029614+0000","last_became_active":"2023-11-28T11:08:36.012145+0000","last_became_peered":"2023-11-28T11:08:36.012145+0000","last_unstale":"2023-11-28T11:08:38.029614+0000","last_undegraded":"2023-11-28T11:08:38.029614+0000","last_fullsized":"2023-11-28T11:08:38.029614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029445+0000","last_change":"2023-11-28T11:08:36.404785+0000","last_active":"2023-11-28T11:08:38.029445+0000","last_peered":"2023-11-28T11:08:38.029445+0000","last_clean":"2023-11-28T11:08:38.029445+0000","last_became_active":"2023-11-28T11:08:36.404512+0000","last_became_peered":"2023-11-28T11:08:36.404512+0000","last_unstale":"2023-11-28T11:08:38.029445+0000","last_undegraded":"2023-11-28T11:08:38.029445+0000","last_fullsized":"2023-11-28T11:08:38.029445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.390894+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:08:36.390894+0000","last_peered":"2023-11-28T11:08:36.390894+0000","last_clean":"2023-11-28T11:08:36.390894+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:08:36.390894+0000","last_undegraded":"2023-11-28T11:08:36.390894+0000","last_fullsized":"2023-11-28T11:08:36.390894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029511+0000","last_change":"2023-11-28T11:08:36.011603+0000","last_active":"2023-11-28T11:08:38.029511+0000","last_peered":"2023-11-28T11:08:38.029511+0000","last_clean":"2023-11-28T11:08:38.029511+0000","last_became_active":"2023-11-28T11:08:36.011343+0000","last_became_peered":"2023-11-28T11:08:36.011343+0000","last_unstale":"2023-11-28T11:08:38.029511+0000","last_undegraded":"2023-11-28T11:08:38.029511+0000","last_fullsized":"2023-11-28T11:08:38.029511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:27.258902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029473+0000","last_change":"2023-11-28T11:08:36.398461+0000","last_active":"2023-11-28T11:08:38.029473+0000","last_peered":"2023-11-28T11:08:38.029473+0000","last_clean":"2023-11-28T11:08:38.029473+0000","last_became_active":"2023-11-28T11:08:36.398208+0000","last_became_peered":"2023-11-28T11:08:36.398208+0000","last_unstale":"2023-11-28T11:08:38.029473+0000","last_undegraded":"2023-11-28T11:08:38.029473+0000","last_fullsized":"2023-11-28T11:08:38.029473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.394283+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:08:36.394283+0000","last_peered":"2023-11-28T11:08:36.394283+0000","last_clean":"2023-11-28T11:08:36.394283+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:08:36.394283+0000","last_undegraded":"2023-11-28T11:08:36.394283+0000","last_fullsized":"2023-11-28T11:08:36.394283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028711+0000","last_change":"2023-11-28T11:08:36.003399+0000","last_active":"2023-11-28T11:08:38.028711+0000","last_peered":"2023-11-28T11:08:38.028711+0000","last_clean":"2023-11-28T11:08:38.028711+0000","last_became_active":"2023-11-28T11:08:36.003098+0000","last_became_peered":"2023-11-28T11:08:36.003098+0000","last_unstale":"2023-11-28T11:08:38.028711+0000","last_undegraded":"2023-11-28T11:08:38.028711+0000","last_fullsized":"2023-11-28T11:08:38.028711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029328+0000","last_change":"2023-11-28T11:08:36.402922+0000","last_active":"2023-11-28T11:08:38.029328+0000","last_peered":"2023-11-28T11:08:38.029328+0000","last_clean":"2023-11-28T11:08:38.029328+0000","last_became_active":"2023-11-28T11:08:36.402567+0000","last_became_peered":"2023-11-28T11:08:36.402567+0000","last_unstale":"2023-11-28T11:08:38.029328+0000","last_undegraded":"2023-11-28T11:08:38.029328+0000","last_fullsized":"2023-11-28T11:08:38.029328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.390396+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:08:36.390396+0000","last_peered":"2023-11-28T11:08:36.390396+0000","last_clean":"2023-11-28T11:08:36.390396+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:08:36.390396+0000","last_undegraded":"2023-11-28T11:08:36.390396+0000","last_fullsized":"2023-11-28T11:08:36.390396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.397551+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:08:36.397551+0000","last_peered":"2023-11-28T11:08:36.397551+0000","last_clean":"2023-11-28T11:08:36.397551+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:08:36.397551+0000","last_undegraded":"2023-11-28T11:08:36.397551+0000","last_fullsized":"2023-11-28T11:08:36.397551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029536+0000","last_change":"2023-11-28T11:08:36.005814+0000","last_active":"2023-11-28T11:08:38.029536+0000","last_peered":"2023-11-28T11:08:38.029536+0000","last_clean":"2023-11-28T11:08:38.029536+0000","last_became_active":"2023-11-28T11:08:36.005597+0000","last_became_peered":"2023-11-28T11:08:36.005597+0000","last_unstale":"2023-11-28T11:08:38.029536+0000","last_undegraded":"2023-11-28T11:08:38.029536+0000","last_fullsized":"2023-11-28T11:08:38.029536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389609+0000","last_change":"2023-11-28T11:08:36.412276+0000","last_active":"2023-11-28T11:08:37.389609+0000","last_peered":"2023-11-28T11:08:37.389609+0000","last_clean":"2023-11-28T11:08:37.389609+0000","last_became_active":"2023-11-28T11:08:36.411972+0000","last_became_peered":"2023-11-28T11:08:36.411972+0000","last_unstale":"2023-11-28T11:08:37.389609+0000","last_undegraded":"2023-11-28T11:08:37.389609+0000","last_fullsized":"2023-11-28T11:08:37.389609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:51.424901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.397737+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:08:36.397737+0000","last_peered":"2023-11-28T11:08:36.397737+0000","last_clean":"2023-11-28T11:08:36.397737+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:08:36.397737+0000","last_undegraded":"2023-11-28T11:08:36.397737+0000","last_fullsized":"2023-11-28T11:08:36.397737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388014+0000","last_change":"2023-11-28T11:08:36.007167+0000","last_active":"2023-11-28T11:08:37.388014+0000","last_peered":"2023-11-28T11:08:37.388014+0000","last_clean":"2023-11-28T11:08:37.388014+0000","last_became_active":"2023-11-28T11:08:36.006824+0000","last_became_peered":"2023-11-28T11:08:36.006824+0000","last_unstale":"2023-11-28T11:08:37.388014+0000","last_undegraded":"2023-11-28T11:08:37.388014+0000","last_fullsized":"2023-11-28T11:08:37.388014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388714+0000","last_change":"2023-11-28T11:08:36.400076+0000","last_active":"2023-11-28T11:08:37.388714+0000","last_peered":"2023-11-28T11:08:37.388714+0000","last_clean":"2023-11-28T11:08:37.388714+0000","last_became_active":"2023-11-28T11:08:36.399490+0000","last_became_peered":"2023-11-28T11:08:36.399490+0000","last_unstale":"2023-11-28T11:08:37.388714+0000","last_undegraded":"2023-11-28T11:08:37.388714+0000","last_fullsized":"2023-11-28T11:08:37.388714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.399615+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:08:36.399615+0000","last_peered":"2023-11-28T11:08:36.399615+0000","last_clean":"2023-11-28T11:08:36.399615+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:08:36.399615+0000","last_undegraded":"2023-11-28T11:08:36.399615+0000","last_fullsized":"2023-11-28T11:08:36.399615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029477+0000","last_change":"2023-11-28T11:08:36.001037+0000","last_active":"2023-11-28T11:08:38.029477+0000","last_peered":"2023-11-28T11:08:38.029477+0000","last_clean":"2023-11-28T11:08:38.029477+0000","last_became_active":"2023-11-28T11:08:36.000535+0000","last_became_peered":"2023-11-28T11:08:36.000535+0000","last_unstale":"2023-11-28T11:08:38.029477+0000","last_undegraded":"2023-11-28T11:08:38.029477+0000","last_fullsized":"2023-11-28T11:08:38.029477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388339+0000","last_change":"2023-11-28T11:08:36.395350+0000","last_active":"2023-11-28T11:08:37.388339+0000","last_peered":"2023-11-28T11:08:37.388339+0000","last_clean":"2023-11-28T11:08:37.388339+0000","last_became_active":"2023-11-28T11:08:36.394962+0000","last_became_peered":"2023-11-28T11:08:36.394962+0000","last_unstale":"2023-11-28T11:08:37.388339+0000","last_undegraded":"2023-11-28T11:08:37.388339+0000","last_fullsized":"2023-11-28T11:08:37.388339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029389+0000","last_change":"2023-11-28T11:08:36.008154+0000","last_active":"2023-11-28T11:08:38.029389+0000","last_peered":"2023-11-28T11:08:38.029389+0000","last_clean":"2023-11-28T11:08:38.029389+0000","last_became_active":"2023-11-28T11:08:36.007856+0000","last_became_peered":"2023-11-28T11:08:36.007856+0000","last_unstale":"2023-11-28T11:08:38.029389+0000","last_undegraded":"2023-11-28T11:08:38.029389+0000","last_fullsized":"2023-11-28T11:08:38.029389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.395415+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:08:36.395415+0000","last_peered":"2023-11-28T11:08:36.395415+0000","last_clean":"2023-11-28T11:08:36.395415+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:08:36.395415+0000","last_undegraded":"2023-11-28T11:08:36.395415+0000","last_fullsized":"2023-11-28T11:08:36.395415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028493+0000","last_change":"2023-11-28T11:08:36.409355+0000","last_active":"2023-11-28T11:08:38.028493+0000","last_peered":"2023-11-28T11:08:38.028493+0000","last_clean":"2023-11-28T11:08:38.028493+0000","last_became_active":"2023-11-28T11:08:36.409102+0000","last_became_peered":"2023-11-28T11:08:36.409102+0000","last_unstale":"2023-11-28T11:08:38.028493+0000","last_undegraded":"2023-11-28T11:08:38.028493+0000","last_fullsized":"2023-11-28T11:08:38.028493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:17:00.028902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.398519+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:08:36.398519+0000","last_peered":"2023-11-28T11:08:36.398519+0000","last_clean":"2023-11-28T11:08:36.398519+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:08:36.398519+0000","last_undegraded":"2023-11-28T11:08:36.398519+0000","last_fullsized":"2023-11-28T11:08:36.398519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388624+0000","last_change":"2023-11-28T11:08:36.003130+0000","last_active":"2023-11-28T11:08:37.388624+0000","last_peered":"2023-11-28T11:08:37.388624+0000","last_clean":"2023-11-28T11:08:37.388624+0000","last_became_active":"2023-11-28T11:08:36.002603+0000","last_became_peered":"2023-11-28T11:08:36.002603+0000","last_unstale":"2023-11-28T11:08:37.388624+0000","last_undegraded":"2023-11-28T11:08:37.388624+0000","last_fullsized":"2023-11-28T11:08:37.388624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:37:12.961779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029185+0000","last_change":"2023-11-28T11:08:36.404217+0000","last_active":"2023-11-28T11:08:38.029185+0000","last_peered":"2023-11-28T11:08:38.029185+0000","last_clean":"2023-11-28T11:08:38.029185+0000","last_became_active":"2023-11-28T11:08:36.403929+0000","last_became_peered":"2023-11-28T11:08:36.403929+0000","last_unstale":"2023-11-28T11:08:38.029185+0000","last_undegraded":"2023-11-28T11:08:38.029185+0000","last_fullsized":"2023-11-28T11:08:38.029185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:13.390834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388389+0000","last_change":"2023-11-28T11:08:36.010521+0000","last_active":"2023-11-28T11:08:37.388389+0000","last_peered":"2023-11-28T11:08:37.388389+0000","last_clean":"2023-11-28T11:08:37.388389+0000","last_became_active":"2023-11-28T11:08:36.010235+0000","last_became_peered":"2023-11-28T11:08:36.010235+0000","last_unstale":"2023-11-28T11:08:37.388389+0000","last_undegraded":"2023-11-28T11:08:37.388389+0000","last_fullsized":"2023-11-28T11:08:37.388389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527702+0000","last_change":"2023-11-28T11:08:36.399755+0000","last_active":"2023-11-28T11:08:37.527702+0000","last_peered":"2023-11-28T11:08:37.527702+0000","last_clean":"2023-11-28T11:08:37.527702+0000","last_became_active":"2023-11-28T11:08:36.399504+0000","last_became_peered":"2023-11-28T11:08:36.399504+0000","last_unstale":"2023-11-28T11:08:37.527702+0000","last_undegraded":"2023-11-28T11:08:37.527702+0000","last_fullsized":"2023-11-28T11:08:37.527702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:13.661118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029388+0000","last_change":"2023-11-28T11:08:36.010768+0000","last_active":"2023-11-28T11:08:38.029388+0000","last_peered":"2023-11-28T11:08:38.029388+0000","last_clean":"2023-11-28T11:08:38.029388+0000","last_became_active":"2023-11-28T11:08:36.010442+0000","last_became_peered":"2023-11-28T11:08:36.010442+0000","last_unstale":"2023-11-28T11:08:38.029388+0000","last_undegraded":"2023-11-28T11:08:38.029388+0000","last_fullsized":"2023-11-28T11:08:38.029388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029576+0000","last_change":"2023-11-28T11:08:36.410581+0000","last_active":"2023-11-28T11:08:38.029576+0000","last_peered":"2023-11-28T11:08:38.029576+0000","last_clean":"2023-11-28T11:08:38.029576+0000","last_became_active":"2023-11-28T11:08:36.410010+0000","last_became_peered":"2023-11-28T11:08:36.410010+0000","last_unstale":"2023-11-28T11:08:38.029576+0000","last_undegraded":"2023-11-28T11:08:38.029576+0000","last_fullsized":"2023-11-28T11:08:38.029576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:31.911633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029714+0000","last_change":"2023-11-28T11:08:36.010817+0000","last_active":"2023-11-28T11:08:38.029714+0000","last_peered":"2023-11-28T11:08:38.029714+0000","last_clean":"2023-11-28T11:08:38.029714+0000","last_became_active":"2023-11-28T11:08:36.010516+0000","last_became_peered":"2023-11-28T11:08:36.010516+0000","last_unstale":"2023-11-28T11:08:38.029714+0000","last_undegraded":"2023-11-28T11:08:38.029714+0000","last_fullsized":"2023-11-28T11:08:38.029714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030156+0000","last_change":"2023-11-28T11:08:36.414691+0000","last_active":"2023-11-28T11:08:38.030156+0000","last_peered":"2023-11-28T11:08:38.030156+0000","last_clean":"2023-11-28T11:08:38.030156+0000","last_became_active":"2023-11-28T11:08:36.412582+0000","last_became_peered":"2023-11-28T11:08:36.412582+0000","last_unstale":"2023-11-28T11:08:38.030156+0000","last_undegraded":"2023-11-28T11:08:38.030156+0000","last_fullsized":"2023-11-28T11:08:38.030156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:27.723848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028818+0000","last_change":"2023-11-28T11:08:36.004724+0000","last_active":"2023-11-28T11:08:38.028818+0000","last_peered":"2023-11-28T11:08:38.028818+0000","last_clean":"2023-11-28T11:08:38.028818+0000","last_became_active":"2023-11-28T11:08:36.004413+0000","last_became_peered":"2023-11-28T11:08:36.004413+0000","last_unstale":"2023-11-28T11:08:38.028818+0000","last_undegraded":"2023-11-28T11:08:38.028818+0000","last_fullsized":"2023-11-28T11:08:38.028818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028617+0000","last_change":"2023-11-28T11:08:36.405263+0000","last_active":"2023-11-28T11:08:38.028617+0000","last_peered":"2023-11-28T11:08:38.028617+0000","last_clean":"2023-11-28T11:08:38.028617+0000","last_became_active":"2023-11-28T11:08:36.405009+0000","last_became_peered":"2023-11-28T11:08:36.405009+0000","last_unstale":"2023-11-28T11:08:38.028617+0000","last_undegraded":"2023-11-28T11:08:38.028617+0000","last_fullsized":"2023-11-28T11:08:38.028617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:56.135916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388734+0000","last_change":"2023-11-28T11:08:36.004954+0000","last_active":"2023-11-28T11:08:37.388734+0000","last_peered":"2023-11-28T11:08:37.388734+0000","last_clean":"2023-11-28T11:08:37.388734+0000","last_became_active":"2023-11-28T11:08:36.004689+0000","last_became_peered":"2023-11-28T11:08:36.004689+0000","last_unstale":"2023-11-28T11:08:37.388734+0000","last_undegraded":"2023-11-28T11:08:37.388734+0000","last_fullsized":"2023-11-28T11:08:37.388734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029176+0000","last_change":"2023-11-28T11:08:36.409550+0000","last_active":"2023-11-28T11:08:38.029176+0000","last_peered":"2023-11-28T11:08:38.029176+0000","last_clean":"2023-11-28T11:08:38.029176+0000","last_became_active":"2023-11-28T11:08:36.409256+0000","last_became_peered":"2023-11-28T11:08:36.409256+0000","last_unstale":"2023-11-28T11:08:38.029176+0000","last_undegraded":"2023-11-28T11:08:38.029176+0000","last_fullsized":"2023-11-28T11:08:38.029176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389289+0000","last_change":"2023-11-28T11:08:36.408453+0000","last_active":"2023-11-28T11:08:37.389289+0000","last_peered":"2023-11-28T11:08:37.389289+0000","last_clean":"2023-11-28T11:08:37.389289+0000","last_became_active":"2023-11-28T11:08:36.408159+0000","last_became_peered":"2023-11-28T11:08:36.408159+0000","last_unstale":"2023-11-28T11:08:37.389289+0000","last_undegraded":"2023-11-28T11:08:37.389289+0000","last_fullsized":"2023-11-28T11:08:37.389289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:59:25.539378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029482+0000","last_change":"2023-11-28T11:08:36.408287+0000","last_active":"2023-11-28T11:08:38.029482+0000","last_peered":"2023-11-28T11:08:38.029482+0000","last_clean":"2023-11-28T11:08:38.029482+0000","last_became_active":"2023-11-28T11:08:36.408035+0000","last_became_peered":"2023-11-28T11:08:36.408035+0000","last_unstale":"2023-11-28T11:08:38.029482+0000","last_undegraded":"2023-11-28T11:08:38.029482+0000","last_fullsized":"2023-11-28T11:08:38.029482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:45:33.470588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030002+0000","last_change":"2023-11-28T11:08:36.414705+0000","last_active":"2023-11-28T11:08:38.030002+0000","last_peered":"2023-11-28T11:08:38.030002+0000","last_clean":"2023-11-28T11:08:38.030002+0000","last_became_active":"2023-11-28T11:08:36.414428+0000","last_became_peered":"2023-11-28T11:08:36.414428+0000","last_unstale":"2023-11-28T11:08:38.030002+0000","last_undegraded":"2023-11-28T11:08:38.030002+0000","last_fullsized":"2023-11-28T11:08:38.030002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:05.744622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029115+0000","last_change":"2023-11-28T11:08:36.409051+0000","last_active":"2023-11-28T11:08:38.029115+0000","last_peered":"2023-11-28T11:08:38.029115+0000","last_clean":"2023-11-28T11:08:38.029115+0000","last_became_active":"2023-11-28T11:08:36.408827+0000","last_became_peered":"2023-11-28T11:08:36.408827+0000","last_unstale":"2023-11-28T11:08:38.029115+0000","last_undegraded":"2023-11-28T11:08:38.029115+0000","last_fullsized":"2023-11-28T11:08:38.029115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:05.744622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029371+0000","last_change":"2023-11-28T11:08:36.410425+0000","last_active":"2023-11-28T11:08:38.029371+0000","last_peered":"2023-11-28T11:08:38.029371+0000","last_clean":"2023-11-28T11:08:38.029371+0000","last_became_active":"2023-11-28T11:08:36.409787+0000","last_became_peered":"2023-11-28T11:08:36.409787+0000","last_unstale":"2023-11-28T11:08:38.029371+0000","last_undegraded":"2023-11-28T11:08:38.029371+0000","last_fullsized":"2023-11-28T11:08:38.029371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:37:56.065831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":685204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2330000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0179999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.444}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:08:44.972 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:08:45.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.110+0000 7fc68fa6d700 1 Processor -- start 2023-11-28T11:08:45.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.110+0000 7fc68fa6d700 1 -- start start 2023-11-28T11:08:45.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.111+0000 7fc68fa6d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc68806a270 0x7fc68806a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.111+0000 7fc68fa6d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc688070d90 0x7fc6880711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.111+0000 7fc68fa6d700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc688151a50 con 0x7fc68806da40 2023-11-28T11:08:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.111+0000 7fc68fa6d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68815f0c0 con 0x7fc688070d90 2023-11-28T11:08:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.111+0000 7fc68fa6d700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68815b440 con 0x7fc68806a270 2023-11-28T11:08:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.111+0000 7fc68d008700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc688070d90 0x7fc6880711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.111+0000 7fc68d008700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc688070d90 0x7fc6880711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56852/0 (socket says 172.21.15.125:56852) 2023-11-28T11:08:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.111+0000 7fc68d008700 1 -- 172.21.15.125:0/2250835103 learned_addr learned my addr 172.21.15.125:0/2250835103 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.112+0000 7fc68d809700 1 --2- 172.21.15.125:0/2250835103 >> v2:172.21.15.167:3300/0 conn(0x7fc68806a270 0x7fc68806a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.112+0000 7fc68d008700 1 -- 172.21.15.125:0/2250835103 >> v2:172.21.15.167:3300/0 conn(0x7fc68806a270 msgr2=0x7fc68806a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:45.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.112+0000 7fc68d008700 1 --2- 172.21.15.125:0/2250835103 >> v2:172.21.15.167:3300/0 conn(0x7fc68806a270 0x7fc68806a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.112+0000 7fc68d008700 1 -- 172.21.15.125:0/2250835103 >> v1:172.21.15.167:6789/0 conn(0x7fc68806da40 legacy=0x7fc68806de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.112+0000 7fc68d008700 1 -- 172.21.15.125:0/2250835103 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68806ab80 con 0x7fc688070d90 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.112+0000 7fc68d809700 1 --2- 172.21.15.125:0/2250835103 >> v2:172.21.15.167:3300/0 conn(0x7fc68806a270 0x7fc68806a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.112+0000 7fc68d008700 1 --2- 172.21.15.125:0/2250835103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc688070d90 0x7fc6880711e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6880cd250 tx=0x7fc684009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f277b6935c6e4d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.112+0000 7fc68c807700 1 -- 172.21.15.125:0/2250835103 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684004230 con 0x7fc688070d90 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.112+0000 7fc68c807700 1 -- 172.21.15.125:0/2250835103 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc684004390 con 0x7fc688070d90 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.112+0000 7fc68c807700 1 -- 172.21.15.125:0/2250835103 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6840036a0 con 0x7fc688070d90 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.113+0000 7fc68fa6d700 1 -- 172.21.15.125:0/2250835103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc688070d90 msgr2=0x7fc6880711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.113+0000 7fc68fa6d700 1 --2- 172.21.15.125:0/2250835103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc688070d90 0x7fc6880711e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6880cd250 tx=0x7fc684009bd0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.113+0000 7fc68fa6d700 1 -- 172.21.15.125:0/2250835103 shutdown_connections 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.113+0000 7fc68fa6d700 1 --2- 172.21.15.125:0/2250835103 >> v2:172.21.15.167:3300/0 conn(0x7fc68806a270 0x7fc68806a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.113+0000 7fc68fa6d700 1 --2- 172.21.15.125:0/2250835103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc688070d90 0x7fc6880711e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.113+0000 7fc68fa6d700 1 -- 172.21.15.125:0/2250835103 >> 172.21.15.125:0/2250835103 conn(0x7fc68806c010 msgr2=0x7fc6880cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:45.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.113+0000 7fc68fa6d700 1 -- 172.21.15.125:0/2250835103 shutdown_connections 2023-11-28T11:08:45.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.113+0000 7fc68fa6d700 1 -- 172.21.15.125:0/2250835103 wait complete. 2023-11-28T11:08:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.114+0000 7fc68fa6d700 1 Processor -- start 2023-11-28T11:08:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.114+0000 7fc68fa6d700 1 -- start start 2023-11-28T11:08:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.115+0000 7fc68fa6d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc68806a270 0x7fc688153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.115+0000 7fc68fa6d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68806da40 0x7fc688151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.115+0000 7fc68fa6d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc688070d90 0x7fc688151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.115+0000 7fc68fa6d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc688152f40 con 0x7fc68806da40 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.115+0000 7fc68fa6d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc688154950 con 0x7fc68806a270 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.115+0000 7fc68fa6d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6881522c0 con 0x7fc688070d90 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.115+0000 7fc68d008700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68806da40 0x7fc688151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.115+0000 7fc68d008700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68806da40 0x7fc688151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56858/0 (socket says 172.21.15.125:56858) 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.115+0000 7fc68d008700 1 -- 172.21.15.125:0/3504116275 learned_addr learned my addr 172.21.15.125:0/3504116275 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc68d809700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc68806a270 0x7fc688153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc68e00a700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc688070d90 0x7fc688151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc68d008700 1 -- 172.21.15.125:0/3504116275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc688070d90 msgr2=0x7fc688151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc68d008700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc688070d90 0x7fc688151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc68d008700 1 -- 172.21.15.125:0/3504116275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc68806a270 msgr2=0x7fc688153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc68d008700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc68806a270 0x7fc688153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc68d008700 1 -- 172.21.15.125:0/3504116275 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc684009550 con 0x7fc68806da40 2023-11-28T11:08:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc68d809700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc68806a270 0x7fc688153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc68d008700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68806da40 0x7fc688151110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc688067450 tx=0x7fc684004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc67e7fc700 1 -- 172.21.15.125:0/3504116275 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684011630 con 0x7fc68806da40 2023-11-28T11:08:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc67e7fc700 1 -- 172.21.15.125:0/3504116275 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc684011790 con 0x7fc68806da40 2023-11-28T11:08:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc68fa6d700 1 -- 172.21.15.125:0/3504116275 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68815adf0 con 0x7fc68806da40 2023-11-28T11:08:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc67e7fc700 1 -- 172.21.15.125:0/3504116275 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684011b40 con 0x7fc68806da40 2023-11-28T11:08:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.116+0000 7fc68fa6d700 1 -- 172.21.15.125:0/3504116275 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc688071ac0 con 0x7fc68806da40 2023-11-28T11:08:45.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.117+0000 7fc68fa6d700 1 -- 172.21.15.125:0/3504116275 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68815b0d0 con 0x7fc68806da40 2023-11-28T11:08:45.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.118+0000 7fc67e7fc700 1 -- 172.21.15.125:0/3504116275 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc684017020 con 0x7fc68806da40 2023-11-28T11:08:45.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.119+0000 7fc67e7fc700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc66c0682f0 0x7fc66c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.119+0000 7fc67e7fc700 1 -- 172.21.15.125:0/3504116275 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6840877c0 con 0x7fc68806da40 2023-11-28T11:08:45.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.119+0000 7fc68d809700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc66c0682f0 0x7fc66c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.119+0000 7fc68d809700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc66c0682f0 0x7fc66c06a7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc678006fd0 tx=0x7fc678008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:45.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.122+0000 7fc67e7fc700 1 -- 172.21.15.125:0/3504116275 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc6840540c0 con 0x7fc68806da40 2023-11-28T11:08:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.303+0000 7fc68fa6d700 1 -- 172.21.15.125:0/3504116275 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6880743f0 con 0x7fc66c0682f0 2023-11-28T11:08:45.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.311+0000 7fc67e7fc700 1 -- 172.21.15.125:0/3504116275 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286677 (secure 0 0 0) 0x7fc6880743f0 con 0x7fc66c0682f0 2023-11-28T11:08:45.315 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 -- 172.21.15.125:0/3504116275 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc66c0682f0 msgr2=0x7fc66c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc66c0682f0 0x7fc66c06a7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc678006fd0 tx=0x7fc678008040 comp rx=0 tx=0).stop 2023-11-28T11:08:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 -- 172.21.15.125:0/3504116275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68806da40 msgr2=0x7fc688151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68806da40 0x7fc688151110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc688067450 tx=0x7fc684004750 comp rx=0 tx=0).stop 2023-11-28T11:08:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 -- 172.21.15.125:0/3504116275 shutdown_connections 2023-11-28T11:08:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc66c0682f0 0x7fc66c06a7a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc688070d90 0x7fc688151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc68806a270 0x7fc688153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 --2- 172.21.15.125:0/3504116275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc68806da40 0x7fc688151110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 -- 172.21.15.125:0/3504116275 >> 172.21.15.125:0/3504116275 conn(0x7fc68806c010 msgr2=0x7fc6880b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 -- 172.21.15.125:0/3504116275 shutdown_connections 2023-11-28T11:08:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.314+0000 7fc68fa6d700 1 -- 172.21.15.125:0/3504116275 wait complete. 2023-11-28T11:08:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:08:45.327 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-28T11:08:43.623332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66440,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":63168,"kb_avail":754908280,"statfs":{"total":773094113280,"available":773026078720,"internally_reserved":0,"allocated":3284992,"data_stored":1939556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64684032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.635705"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527689+0000","last_change":"2023-11-28T11:08:36.416297+0000","last_active":"2023-11-28T11:08:37.527689+0000","last_peered":"2023-11-28T11:08:37.527689+0000","last_clean":"2023-11-28T11:08:37.527689+0000","last_became_active":"2023-11-28T11:08:36.415977+0000","last_became_peered":"2023-11-28T11:08:36.415977+0000","last_unstale":"2023-11-28T11:08:37.527689+0000","last_undegraded":"2023-11-28T11:08:37.527689+0000","last_fullsized":"2023-11-28T11:08:37.527689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:48.481042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029908+0000","last_change":"2023-11-28T11:08:36.400367+0000","last_active":"2023-11-28T11:08:38.029908+0000","last_peered":"2023-11-28T11:08:38.029908+0000","last_clean":"2023-11-28T11:08:38.029908+0000","last_became_active":"2023-11-28T11:08:36.400076+0000","last_became_peered":"2023-11-28T11:08:36.400076+0000","last_unstale":"2023-11-28T11:08:38.029908+0000","last_undegraded":"2023-11-28T11:08:38.029908+0000","last_fullsized":"2023-11-28T11:08:38.029908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029428+0000","last_change":"2023-11-28T11:08:36.406078+0000","last_active":"2023-11-28T11:08:38.029428+0000","last_peered":"2023-11-28T11:08:38.029428+0000","last_clean":"2023-11-28T11:08:38.029428+0000","last_became_active":"2023-11-28T11:08:36.405448+0000","last_became_peered":"2023-11-28T11:08:36.405448+0000","last_unstale":"2023-11-28T11:08:38.029428+0000","last_undegraded":"2023-11-28T11:08:38.029428+0000","last_fullsized":"2023-11-28T11:08:38.029428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:34:58.025630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389721+0000","last_change":"2023-11-28T11:08:36.411547+0000","last_active":"2023-11-28T11:08:37.389721+0000","last_peered":"2023-11-28T11:08:37.389721+0000","last_clean":"2023-11-28T11:08:37.389721+0000","last_became_active":"2023-11-28T11:08:36.411251+0000","last_became_peered":"2023-11-28T11:08:36.411251+0000","last_unstale":"2023-11-28T11:08:37.389721+0000","last_undegraded":"2023-11-28T11:08:37.389721+0000","last_fullsized":"2023-11-28T11:08:37.389721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:30.748107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388308+0000","last_change":"2023-11-28T11:08:36.408744+0000","last_active":"2023-11-28T11:08:37.388308+0000","last_peered":"2023-11-28T11:08:37.388308+0000","last_clean":"2023-11-28T11:08:37.388308+0000","last_became_active":"2023-11-28T11:08:36.408499+0000","last_became_peered":"2023-11-28T11:08:36.408499+0000","last_unstale":"2023-11-28T11:08:37.388308+0000","last_undegraded":"2023-11-28T11:08:37.388308+0000","last_fullsized":"2023-11-28T11:08:37.388308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029988+0000","last_change":"2023-11-28T11:08:36.404949+0000","last_active":"2023-11-28T11:08:38.029988+0000","last_peered":"2023-11-28T11:08:38.029988+0000","last_clean":"2023-11-28T11:08:38.029988+0000","last_became_active":"2023-11-28T11:08:36.404662+0000","last_became_peered":"2023-11-28T11:08:36.404662+0000","last_unstale":"2023-11-28T11:08:38.029988+0000","last_undegraded":"2023-11-28T11:08:38.029988+0000","last_fullsized":"2023-11-28T11:08:38.029988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:50.488364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389610+0000","last_change":"2023-11-28T11:08:36.407228+0000","last_active":"2023-11-28T11:08:37.389610+0000","last_peered":"2023-11-28T11:08:37.389610+0000","last_clean":"2023-11-28T11:08:37.389610+0000","last_became_active":"2023-11-28T11:08:36.406568+0000","last_became_peered":"2023-11-28T11:08:36.406568+0000","last_unstale":"2023-11-28T11:08:37.389610+0000","last_undegraded":"2023-11-28T11:08:37.389610+0000","last_fullsized":"2023-11-28T11:08:37.389610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029317+0000","last_change":"2023-11-28T11:08:36.404585+0000","last_active":"2023-11-28T11:08:38.029317+0000","last_peered":"2023-11-28T11:08:38.029317+0000","last_clean":"2023-11-28T11:08:38.029317+0000","last_became_active":"2023-11-28T11:08:36.404273+0000","last_became_peered":"2023-11-28T11:08:36.404273+0000","last_unstale":"2023-11-28T11:08:38.029317+0000","last_undegraded":"2023-11-28T11:08:38.029317+0000","last_fullsized":"2023-11-28T11:08:38.029317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388542+0000","last_change":"2023-11-28T11:08:36.416209+0000","last_active":"2023-11-28T11:08:37.388542+0000","last_peered":"2023-11-28T11:08:37.388542+0000","last_clean":"2023-11-28T11:08:37.388542+0000","last_became_active":"2023-11-28T11:08:36.415945+0000","last_became_peered":"2023-11-28T11:08:36.415945+0000","last_unstale":"2023-11-28T11:08:37.388542+0000","last_undegraded":"2023-11-28T11:08:37.388542+0000","last_fullsized":"2023-11-28T11:08:37.388542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029484+0000","last_change":"2023-11-28T11:08:36.393913+0000","last_active":"2023-11-28T11:08:38.029484+0000","last_peered":"2023-11-28T11:08:38.029484+0000","last_clean":"2023-11-28T11:08:38.029484+0000","last_became_active":"2023-11-28T11:08:36.393400+0000","last_became_peered":"2023-11-28T11:08:36.393400+0000","last_unstale":"2023-11-28T11:08:38.029484+0000","last_undegraded":"2023-11-28T11:08:38.029484+0000","last_fullsized":"2023-11-28T11:08:38.029484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029534+0000","last_change":"2023-11-28T11:08:36.405268+0000","last_active":"2023-11-28T11:08:38.029534+0000","last_peered":"2023-11-28T11:08:38.029534+0000","last_clean":"2023-11-28T11:08:38.029534+0000","last_became_active":"2023-11-28T11:08:36.404990+0000","last_became_peered":"2023-11-28T11:08:36.404990+0000","last_unstale":"2023-11-28T11:08:38.029534+0000","last_undegraded":"2023-11-28T11:08:38.029534+0000","last_fullsized":"2023-11-28T11:08:38.029534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:45:33.470588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527660+0000","last_change":"2023-11-28T11:08:36.405351+0000","last_active":"2023-11-28T11:08:37.527660+0000","last_peered":"2023-11-28T11:08:37.527660+0000","last_clean":"2023-11-28T11:08:37.527660+0000","last_became_active":"2023-11-28T11:08:36.405078+0000","last_became_peered":"2023-11-28T11:08:36.405078+0000","last_unstale":"2023-11-28T11:08:37.527660+0000","last_undegraded":"2023-11-28T11:08:37.527660+0000","last_fullsized":"2023-11-28T11:08:37.527660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:30.748107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527570+0000","last_change":"2023-11-28T11:08:36.408661+0000","last_active":"2023-11-28T11:08:37.527570+0000","last_peered":"2023-11-28T11:08:37.527570+0000","last_clean":"2023-11-28T11:08:37.527570+0000","last_became_active":"2023-11-28T11:08:36.408387+0000","last_became_peered":"2023-11-28T11:08:36.408387+0000","last_unstale":"2023-11-28T11:08:37.527570+0000","last_undegraded":"2023-11-28T11:08:37.527570+0000","last_fullsized":"2023-11-28T11:08:37.527570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:13.215556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029184+0000","last_change":"2023-11-28T11:08:36.401781+0000","last_active":"2023-11-28T11:08:38.029184+0000","last_peered":"2023-11-28T11:08:38.029184+0000","last_clean":"2023-11-28T11:08:38.029184+0000","last_became_active":"2023-11-28T11:08:36.401490+0000","last_became_peered":"2023-11-28T11:08:36.401490+0000","last_unstale":"2023-11-28T11:08:38.029184+0000","last_undegraded":"2023-11-28T11:08:38.029184+0000","last_fullsized":"2023-11-28T11:08:38.029184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390010+0000","last_change":"2023-11-28T11:08:36.407391+0000","last_active":"2023-11-28T11:08:37.390010+0000","last_peered":"2023-11-28T11:08:37.390010+0000","last_clean":"2023-11-28T11:08:37.390010+0000","last_became_active":"2023-11-28T11:08:36.406934+0000","last_became_peered":"2023-11-28T11:08:36.406934+0000","last_unstale":"2023-11-28T11:08:37.390010+0000","last_undegraded":"2023-11-28T11:08:37.390010+0000","last_fullsized":"2023-11-28T11:08:37.390010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029297+0000","last_change":"2023-11-28T11:08:36.405277+0000","last_active":"2023-11-28T11:08:38.029297+0000","last_peered":"2023-11-28T11:08:38.029297+0000","last_clean":"2023-11-28T11:08:38.029297+0000","last_became_active":"2023-11-28T11:08:36.405034+0000","last_became_peered":"2023-11-28T11:08:36.405034+0000","last_unstale":"2023-11-28T11:08:38.029297+0000","last_undegraded":"2023-11-28T11:08:38.029297+0000","last_fullsized":"2023-11-28T11:08:38.029297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:51.071881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388626+0000","last_change":"2023-11-28T11:08:36.416839+0000","last_active":"2023-11-28T11:08:37.388626+0000","last_peered":"2023-11-28T11:08:37.388626+0000","last_clean":"2023-11-28T11:08:37.388626+0000","last_became_active":"2023-11-28T11:08:36.416606+0000","last_became_peered":"2023-11-28T11:08:36.416606+0000","last_unstale":"2023-11-28T11:08:37.388626+0000","last_undegraded":"2023-11-28T11:08:37.388626+0000","last_fullsized":"2023-11-28T11:08:37.388626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029699+0000","last_change":"2023-11-28T11:08:36.403858+0000","last_active":"2023-11-28T11:08:38.029699+0000","last_peered":"2023-11-28T11:08:38.029699+0000","last_clean":"2023-11-28T11:08:38.029699+0000","last_became_active":"2023-11-28T11:08:36.403584+0000","last_became_peered":"2023-11-28T11:08:36.403584+0000","last_unstale":"2023-11-28T11:08:38.029699+0000","last_undegraded":"2023-11-28T11:08:38.029699+0000","last_fullsized":"2023-11-28T11:08:38.029699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527667+0000","last_change":"2023-11-28T11:08:36.413070+0000","last_active":"2023-11-28T11:08:37.527667+0000","last_peered":"2023-11-28T11:08:37.527667+0000","last_clean":"2023-11-28T11:08:37.527667+0000","last_became_active":"2023-11-28T11:08:36.412782+0000","last_became_peered":"2023-11-28T11:08:36.412782+0000","last_unstale":"2023-11-28T11:08:37.527667+0000","last_undegraded":"2023-11-28T11:08:37.527667+0000","last_fullsized":"2023-11-28T11:08:37.527667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:09.866075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029903+0000","last_change":"2023-11-28T11:08:36.412148+0000","last_active":"2023-11-28T11:08:38.029903+0000","last_peered":"2023-11-28T11:08:38.029903+0000","last_clean":"2023-11-28T11:08:38.029903+0000","last_became_active":"2023-11-28T11:08:36.411873+0000","last_became_peered":"2023-11-28T11:08:36.411873+0000","last_unstale":"2023-11-28T11:08:38.029903+0000","last_undegraded":"2023-11-28T11:08:38.029903+0000","last_fullsized":"2023-11-28T11:08:38.029903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:34:13.560527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390150+0000","last_change":"2023-11-28T11:08:36.416108+0000","last_active":"2023-11-28T11:08:37.390150+0000","last_peered":"2023-11-28T11:08:37.390150+0000","last_clean":"2023-11-28T11:08:37.390150+0000","last_became_active":"2023-11-28T11:08:36.415831+0000","last_became_peered":"2023-11-28T11:08:36.415831+0000","last_unstale":"2023-11-28T11:08:37.390150+0000","last_undegraded":"2023-11-28T11:08:37.390150+0000","last_fullsized":"2023-11-28T11:08:37.390150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388133+0000","last_change":"2023-11-28T11:08:36.404227+0000","last_active":"2023-11-28T11:08:37.388133+0000","last_peered":"2023-11-28T11:08:37.388133+0000","last_clean":"2023-11-28T11:08:37.388133+0000","last_became_active":"2023-11-28T11:08:36.403978+0000","last_became_peered":"2023-11-28T11:08:36.403978+0000","last_unstale":"2023-11-28T11:08:37.388133+0000","last_undegraded":"2023-11-28T11:08:37.388133+0000","last_fullsized":"2023-11-28T11:08:37.388133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028811+0000","last_change":"2023-11-28T11:08:36.405775+0000","last_active":"2023-11-28T11:08:38.028811+0000","last_peered":"2023-11-28T11:08:38.028811+0000","last_clean":"2023-11-28T11:08:38.028811+0000","last_became_active":"2023-11-28T11:08:36.405525+0000","last_became_peered":"2023-11-28T11:08:36.405525+0000","last_unstale":"2023-11-28T11:08:38.028811+0000","last_undegraded":"2023-11-28T11:08:38.028811+0000","last_fullsized":"2023-11-28T11:08:38.028811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390248+0000","last_change":"2023-11-28T11:08:36.416121+0000","last_active":"2023-11-28T11:08:37.390248+0000","last_peered":"2023-11-28T11:08:37.390248+0000","last_clean":"2023-11-28T11:08:37.390248+0000","last_became_active":"2023-11-28T11:08:36.415874+0000","last_became_peered":"2023-11-28T11:08:36.415874+0000","last_unstale":"2023-11-28T11:08:37.390248+0000","last_undegraded":"2023-11-28T11:08:37.390248+0000","last_fullsized":"2023-11-28T11:08:37.390248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029011+0000","last_change":"2023-11-28T11:08:36.409665+0000","last_active":"2023-11-28T11:08:38.029011+0000","last_peered":"2023-11-28T11:08:38.029011+0000","last_clean":"2023-11-28T11:08:38.029011+0000","last_became_active":"2023-11-28T11:08:36.409096+0000","last_became_peered":"2023-11-28T11:08:36.409096+0000","last_unstale":"2023-11-28T11:08:38.029011+0000","last_undegraded":"2023-11-28T11:08:38.029011+0000","last_fullsized":"2023-11-28T11:08:38.029011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028947+0000","last_change":"2023-11-28T11:08:36.401914+0000","last_active":"2023-11-28T11:08:38.028947+0000","last_peered":"2023-11-28T11:08:38.028947+0000","last_clean":"2023-11-28T11:08:38.028947+0000","last_became_active":"2023-11-28T11:08:36.401600+0000","last_became_peered":"2023-11-28T11:08:36.401600+0000","last_unstale":"2023-11-28T11:08:38.028947+0000","last_undegraded":"2023-11-28T11:08:38.028947+0000","last_fullsized":"2023-11-28T11:08:38.028947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029901+0000","last_change":"2023-11-28T11:08:36.409423+0000","last_active":"2023-11-28T11:08:38.029901+0000","last_peered":"2023-11-28T11:08:38.029901+0000","last_clean":"2023-11-28T11:08:38.029901+0000","last_became_active":"2023-11-28T11:08:36.409119+0000","last_became_peered":"2023-11-28T11:08:36.409119+0000","last_unstale":"2023-11-28T11:08:38.029901+0000","last_undegraded":"2023-11-28T11:08:38.029901+0000","last_fullsized":"2023-11-28T11:08:38.029901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030088+0000","last_change":"2023-11-28T11:08:36.008194+0000","last_active":"2023-11-28T11:08:38.030088+0000","last_peered":"2023-11-28T11:08:38.030088+0000","last_clean":"2023-11-28T11:08:38.030088+0000","last_became_active":"2023-11-28T11:08:36.007906+0000","last_became_peered":"2023-11-28T11:08:36.007906+0000","last_unstale":"2023-11-28T11:08:38.030088+0000","last_undegraded":"2023-11-28T11:08:38.030088+0000","last_fullsized":"2023-11-28T11:08:38.030088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:55:11.905711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029123+0000","last_change":"2023-11-28T11:08:36.408516+0000","last_active":"2023-11-28T11:08:38.029123+0000","last_peered":"2023-11-28T11:08:38.029123+0000","last_clean":"2023-11-28T11:08:38.029123+0000","last_became_active":"2023-11-28T11:08:36.408251+0000","last_became_peered":"2023-11-28T11:08:36.408251+0000","last_unstale":"2023-11-28T11:08:38.029123+0000","last_undegraded":"2023-11-28T11:08:38.029123+0000","last_fullsized":"2023-11-28T11:08:38.029123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028954+0000","last_change":"2023-11-28T11:08:36.011280+0000","last_active":"2023-11-28T11:08:38.028954+0000","last_peered":"2023-11-28T11:08:38.028954+0000","last_clean":"2023-11-28T11:08:38.028954+0000","last_became_active":"2023-11-28T11:08:36.011033+0000","last_became_peered":"2023-11-28T11:08:36.011033+0000","last_unstale":"2023-11-28T11:08:38.028954+0000","last_undegraded":"2023-11-28T11:08:38.028954+0000","last_fullsized":"2023-11-28T11:08:38.028954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388540+0000","last_change":"2023-11-28T11:08:36.407287+0000","last_active":"2023-11-28T11:08:37.388540+0000","last_peered":"2023-11-28T11:08:37.388540+0000","last_clean":"2023-11-28T11:08:37.388540+0000","last_became_active":"2023-11-28T11:08:36.407061+0000","last_became_peered":"2023-11-28T11:08:36.407061+0000","last_unstale":"2023-11-28T11:08:37.388540+0000","last_undegraded":"2023-11-28T11:08:37.388540+0000","last_fullsized":"2023-11-28T11:08:37.388540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028703+0000","last_change":"2023-11-28T11:08:36.001278+0000","last_active":"2023-11-28T11:08:38.028703+0000","last_peered":"2023-11-28T11:08:38.028703+0000","last_clean":"2023-11-28T11:08:38.028703+0000","last_became_active":"2023-11-28T11:08:36.000628+0000","last_became_peered":"2023-11-28T11:08:36.000628+0000","last_unstale":"2023-11-28T11:08:38.028703+0000","last_undegraded":"2023-11-28T11:08:38.028703+0000","last_fullsized":"2023-11-28T11:08:38.028703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390139+0000","last_change":"2023-11-28T11:08:36.408310+0000","last_active":"2023-11-28T11:08:37.390139+0000","last_peered":"2023-11-28T11:08:37.390139+0000","last_clean":"2023-11-28T11:08:37.390139+0000","last_became_active":"2023-11-28T11:08:36.407978+0000","last_became_peered":"2023-11-28T11:08:36.407978+0000","last_unstale":"2023-11-28T11:08:37.390139+0000","last_undegraded":"2023-11-28T11:08:37.390139+0000","last_fullsized":"2023-11-28T11:08:37.390139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:39.663018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388676+0000","last_change":"2023-11-28T11:08:36.002015+0000","last_active":"2023-11-28T11:08:37.388676+0000","last_peered":"2023-11-28T11:08:37.388676+0000","last_clean":"2023-11-28T11:08:37.388676+0000","last_became_active":"2023-11-28T11:08:36.001559+0000","last_became_peered":"2023-11-28T11:08:36.001559+0000","last_unstale":"2023-11-28T11:08:37.388676+0000","last_undegraded":"2023-11-28T11:08:37.388676+0000","last_fullsized":"2023-11-28T11:08:37.388676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:55:11.905711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028605+0000","last_change":"2023-11-28T11:08:36.408653+0000","last_active":"2023-11-28T11:08:38.028605+0000","last_peered":"2023-11-28T11:08:38.028605+0000","last_clean":"2023-11-28T11:08:38.028605+0000","last_became_active":"2023-11-28T11:08:36.408400+0000","last_became_peered":"2023-11-28T11:08:36.408400+0000","last_unstale":"2023-11-28T11:08:38.028605+0000","last_undegraded":"2023-11-28T11:08:38.028605+0000","last_fullsized":"2023-11-28T11:08:38.028605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029355+0000","last_change":"2023-11-28T11:08:36.005909+0000","last_active":"2023-11-28T11:08:38.029355+0000","last_peered":"2023-11-28T11:08:38.029355+0000","last_clean":"2023-11-28T11:08:38.029355+0000","last_became_active":"2023-11-28T11:08:36.005626+0000","last_became_peered":"2023-11-28T11:08:36.005626+0000","last_unstale":"2023-11-28T11:08:38.029355+0000","last_undegraded":"2023-11-28T11:08:38.029355+0000","last_fullsized":"2023-11-28T11:08:38.029355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028717+0000","last_change":"2023-11-28T11:08:36.410036+0000","last_active":"2023-11-28T11:08:38.028717+0000","last_peered":"2023-11-28T11:08:38.028717+0000","last_clean":"2023-11-28T11:08:38.028717+0000","last_became_active":"2023-11-28T11:08:36.409785+0000","last_became_peered":"2023-11-28T11:08:36.409785+0000","last_unstale":"2023-11-28T11:08:38.028717+0000","last_undegraded":"2023-11-28T11:08:38.028717+0000","last_fullsized":"2023-11-28T11:08:38.028717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:38:35.406909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390346+0000","last_change":"2023-11-28T11:08:36.008706+0000","last_active":"2023-11-28T11:08:37.390346+0000","last_peered":"2023-11-28T11:08:37.390346+0000","last_clean":"2023-11-28T11:08:37.390346+0000","last_became_active":"2023-11-28T11:08:36.008279+0000","last_became_peered":"2023-11-28T11:08:36.008279+0000","last_unstale":"2023-11-28T11:08:37.390346+0000","last_undegraded":"2023-11-28T11:08:37.390346+0000","last_fullsized":"2023-11-28T11:08:37.390346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028730+0000","last_change":"2023-11-28T11:08:36.413891+0000","last_active":"2023-11-28T11:08:38.028730+0000","last_peered":"2023-11-28T11:08:38.028730+0000","last_clean":"2023-11-28T11:08:38.028730+0000","last_became_active":"2023-11-28T11:08:36.413613+0000","last_became_peered":"2023-11-28T11:08:36.413613+0000","last_unstale":"2023-11-28T11:08:38.028730+0000","last_undegraded":"2023-11-28T11:08:38.028730+0000","last_fullsized":"2023-11-28T11:08:38.028730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030012+0000","last_change":"2023-11-28T11:08:36.009147+0000","last_active":"2023-11-28T11:08:38.030012+0000","last_peered":"2023-11-28T11:08:38.030012+0000","last_clean":"2023-11-28T11:08:38.030012+0000","last_became_active":"2023-11-28T11:08:36.008847+0000","last_became_peered":"2023-11-28T11:08:36.008847+0000","last_unstale":"2023-11-28T11:08:38.030012+0000","last_undegraded":"2023-11-28T11:08:38.030012+0000","last_fullsized":"2023-11-28T11:08:38.030012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029178+0000","last_change":"2023-11-28T11:08:36.410776+0000","last_active":"2023-11-28T11:08:38.029178+0000","last_peered":"2023-11-28T11:08:38.029178+0000","last_clean":"2023-11-28T11:08:38.029178+0000","last_became_active":"2023-11-28T11:08:36.410335+0000","last_became_peered":"2023-11-28T11:08:36.410335+0000","last_unstale":"2023-11-28T11:08:38.029178+0000","last_undegraded":"2023-11-28T11:08:38.029178+0000","last_fullsized":"2023-11-28T11:08:38.029178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:38:35.406909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390017+0000","last_change":"2023-11-28T11:08:36.011427+0000","last_active":"2023-11-28T11:08:37.390017+0000","last_peered":"2023-11-28T11:08:37.390017+0000","last_clean":"2023-11-28T11:08:37.390017+0000","last_became_active":"2023-11-28T11:08:36.011137+0000","last_became_peered":"2023-11-28T11:08:36.011137+0000","last_unstale":"2023-11-28T11:08:37.390017+0000","last_undegraded":"2023-11-28T11:08:37.390017+0000","last_fullsized":"2023-11-28T11:08:37.390017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:32:07.107062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029099+0000","last_change":"2023-11-28T11:08:36.408216+0000","last_active":"2023-11-28T11:08:38.029099+0000","last_peered":"2023-11-28T11:08:38.029099+0000","last_clean":"2023-11-28T11:08:38.029099+0000","last_became_active":"2023-11-28T11:08:36.407897+0000","last_became_peered":"2023-11-28T11:08:36.407897+0000","last_unstale":"2023-11-28T11:08:38.029099+0000","last_undegraded":"2023-11-28T11:08:38.029099+0000","last_fullsized":"2023-11-28T11:08:38.029099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:15.750770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388082+0000","last_change":"2023-11-28T11:08:35.994749+0000","last_active":"2023-11-28T11:08:37.388082+0000","last_peered":"2023-11-28T11:08:37.388082+0000","last_clean":"2023-11-28T11:08:37.388082+0000","last_became_active":"2023-11-28T11:08:35.994475+0000","last_became_peered":"2023-11-28T11:08:35.994475+0000","last_unstale":"2023-11-28T11:08:37.388082+0000","last_undegraded":"2023-11-28T11:08:37.388082+0000","last_fullsized":"2023-11-28T11:08:37.388082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:27.258902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029441+0000","last_change":"2023-11-28T11:08:36.409070+0000","last_active":"2023-11-28T11:08:38.029441+0000","last_peered":"2023-11-28T11:08:38.029441+0000","last_clean":"2023-11-28T11:08:38.029441+0000","last_became_active":"2023-11-28T11:08:36.408778+0000","last_became_peered":"2023-11-28T11:08:36.408778+0000","last_unstale":"2023-11-28T11:08:38.029441+0000","last_undegraded":"2023-11-28T11:08:38.029441+0000","last_fullsized":"2023-11-28T11:08:38.029441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390361+0000","last_change":"2023-11-28T11:08:36.010605+0000","last_active":"2023-11-28T11:08:37.390361+0000","last_peered":"2023-11-28T11:08:37.390361+0000","last_clean":"2023-11-28T11:08:37.390361+0000","last_became_active":"2023-11-28T11:08:36.010210+0000","last_became_peered":"2023-11-28T11:08:36.010210+0000","last_unstale":"2023-11-28T11:08:37.390361+0000","last_undegraded":"2023-11-28T11:08:37.390361+0000","last_fullsized":"2023-11-28T11:08:37.390361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:22:26.583310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388452+0000","last_change":"2023-11-28T11:08:36.413052+0000","last_active":"2023-11-28T11:08:37.388452+0000","last_peered":"2023-11-28T11:08:37.388452+0000","last_clean":"2023-11-28T11:08:37.388452+0000","last_became_active":"2023-11-28T11:08:36.412807+0000","last_became_peered":"2023-11-28T11:08:36.412807+0000","last_unstale":"2023-11-28T11:08:37.388452+0000","last_undegraded":"2023-11-28T11:08:37.388452+0000","last_fullsized":"2023-11-28T11:08:37.388452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389225+0000","last_change":"2023-11-28T11:08:36.004568+0000","last_active":"2023-11-28T11:08:37.389225+0000","last_peered":"2023-11-28T11:08:37.389225+0000","last_clean":"2023-11-28T11:08:37.389225+0000","last_became_active":"2023-11-28T11:08:36.004282+0000","last_became_peered":"2023-11-28T11:08:36.004282+0000","last_unstale":"2023-11-28T11:08:37.389225+0000","last_undegraded":"2023-11-28T11:08:37.389225+0000","last_fullsized":"2023-11-28T11:08:37.389225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:27:44.586581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029444+0000","last_change":"2023-11-28T11:08:36.410178+0000","last_active":"2023-11-28T11:08:38.029444+0000","last_peered":"2023-11-28T11:08:38.029444+0000","last_clean":"2023-11-28T11:08:38.029444+0000","last_became_active":"2023-11-28T11:08:36.409914+0000","last_became_peered":"2023-11-28T11:08:36.409914+0000","last_unstale":"2023-11-28T11:08:38.029444+0000","last_undegraded":"2023-11-28T11:08:38.029444+0000","last_fullsized":"2023-11-28T11:08:38.029444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390215+0000","last_change":"2023-11-28T11:08:36.006868+0000","last_active":"2023-11-28T11:08:37.390215+0000","last_peered":"2023-11-28T11:08:37.390215+0000","last_clean":"2023-11-28T11:08:37.390215+0000","last_became_active":"2023-11-28T11:08:36.006544+0000","last_became_peered":"2023-11-28T11:08:36.006544+0000","last_unstale":"2023-11-28T11:08:37.390215+0000","last_undegraded":"2023-11-28T11:08:37.390215+0000","last_fullsized":"2023-11-28T11:08:37.390215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:38.660821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029014+0000","last_change":"2023-11-28T11:08:36.409753+0000","last_active":"2023-11-28T11:08:38.029014+0000","last_peered":"2023-11-28T11:08:38.029014+0000","last_clean":"2023-11-28T11:08:38.029014+0000","last_became_active":"2023-11-28T11:08:36.409427+0000","last_became_peered":"2023-11-28T11:08:36.409427+0000","last_unstale":"2023-11-28T11:08:38.029014+0000","last_undegraded":"2023-11-28T11:08:38.029014+0000","last_fullsized":"2023-11-28T11:08:38.029014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390044+0000","last_change":"2023-11-28T11:08:36.006987+0000","last_active":"2023-11-28T11:08:37.390044+0000","last_peered":"2023-11-28T11:08:37.390044+0000","last_clean":"2023-11-28T11:08:37.390044+0000","last_became_active":"2023-11-28T11:08:36.006697+0000","last_became_peered":"2023-11-28T11:08:36.006697+0000","last_unstale":"2023-11-28T11:08:37.390044+0000","last_undegraded":"2023-11-28T11:08:37.390044+0000","last_fullsized":"2023-11-28T11:08:37.390044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:50.422704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029242+0000","last_change":"2023-11-28T11:08:36.404777+0000","last_active":"2023-11-28T11:08:38.029242+0000","last_peered":"2023-11-28T11:08:38.029242+0000","last_clean":"2023-11-28T11:08:38.029242+0000","last_became_active":"2023-11-28T11:08:36.404490+0000","last_became_peered":"2023-11-28T11:08:36.404490+0000","last_unstale":"2023-11-28T11:08:38.029242+0000","last_undegraded":"2023-11-28T11:08:38.029242+0000","last_fullsized":"2023-11-28T11:08:38.029242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:04:03.572831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390457+0000","last_change":"2023-11-28T11:08:36.005444+0000","last_active":"2023-11-28T11:08:37.390457+0000","last_peered":"2023-11-28T11:08:37.390457+0000","last_clean":"2023-11-28T11:08:37.390457+0000","last_became_active":"2023-11-28T11:08:36.005138+0000","last_became_peered":"2023-11-28T11:08:36.005138+0000","last_unstale":"2023-11-28T11:08:37.390457+0000","last_undegraded":"2023-11-28T11:08:37.390457+0000","last_fullsized":"2023-11-28T11:08:37.390457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:59:24.537181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389803+0000","last_change":"2023-11-28T11:08:36.411990+0000","last_active":"2023-11-28T11:08:37.389803+0000","last_peered":"2023-11-28T11:08:37.389803+0000","last_clean":"2023-11-28T11:08:37.389803+0000","last_became_active":"2023-11-28T11:08:36.411669+0000","last_became_peered":"2023-11-28T11:08:36.411669+0000","last_unstale":"2023-11-28T11:08:37.389803+0000","last_undegraded":"2023-11-28T11:08:37.389803+0000","last_fullsized":"2023-11-28T11:08:37.389803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:03.044603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029851+0000","last_change":"2023-11-28T11:08:36.011735+0000","last_active":"2023-11-28T11:08:38.029851+0000","last_peered":"2023-11-28T11:08:38.029851+0000","last_clean":"2023-11-28T11:08:38.029851+0000","last_became_active":"2023-11-28T11:08:36.011491+0000","last_became_peered":"2023-11-28T11:08:36.011491+0000","last_unstale":"2023-11-28T11:08:38.029851+0000","last_undegraded":"2023-11-28T11:08:38.029851+0000","last_fullsized":"2023-11-28T11:08:38.029851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388243+0000","last_change":"2023-11-28T11:08:36.400761+0000","last_active":"2023-11-28T11:08:37.388243+0000","last_peered":"2023-11-28T11:08:37.388243+0000","last_clean":"2023-11-28T11:08:37.388243+0000","last_became_active":"2023-11-28T11:08:36.400410+0000","last_became_peered":"2023-11-28T11:08:36.400410+0000","last_unstale":"2023-11-28T11:08:37.388243+0000","last_undegraded":"2023-11-28T11:08:37.388243+0000","last_fullsized":"2023-11-28T11:08:37.388243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:15.750770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029008+0000","last_change":"2023-11-28T11:08:36.008241+0000","last_active":"2023-11-28T11:08:38.029008+0000","last_peered":"2023-11-28T11:08:38.029008+0000","last_clean":"2023-11-28T11:08:38.029008+0000","last_became_active":"2023-11-28T11:08:36.007905+0000","last_became_peered":"2023-11-28T11:08:36.007905+0000","last_unstale":"2023-11-28T11:08:38.029008+0000","last_undegraded":"2023-11-28T11:08:38.029008+0000","last_fullsized":"2023-11-28T11:08:38.029008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029892+0000","last_change":"2023-11-28T11:08:36.414154+0000","last_active":"2023-11-28T11:08:38.029892+0000","last_peered":"2023-11-28T11:08:38.029892+0000","last_clean":"2023-11-28T11:08:38.029892+0000","last_became_active":"2023-11-28T11:08:36.413893+0000","last_became_peered":"2023-11-28T11:08:36.413893+0000","last_unstale":"2023-11-28T11:08:38.029892+0000","last_undegraded":"2023-11-28T11:08:38.029892+0000","last_fullsized":"2023-11-28T11:08:38.029892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389697+0000","last_change":"2023-11-28T11:08:36.010954+0000","last_active":"2023-11-28T11:08:37.389697+0000","last_peered":"2023-11-28T11:08:37.389697+0000","last_clean":"2023-11-28T11:08:37.389697+0000","last_became_active":"2023-11-28T11:08:36.010641+0000","last_became_peered":"2023-11-28T11:08:36.010641+0000","last_unstale":"2023-11-28T11:08:37.389697+0000","last_undegraded":"2023-11-28T11:08:37.389697+0000","last_fullsized":"2023-11-28T11:08:37.389697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:25:48.509520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029750+0000","last_change":"2023-11-28T11:08:36.403947+0000","last_active":"2023-11-28T11:08:38.029750+0000","last_peered":"2023-11-28T11:08:38.029750+0000","last_clean":"2023-11-28T11:08:38.029750+0000","last_became_active":"2023-11-28T11:08:36.403015+0000","last_became_peered":"2023-11-28T11:08:36.403015+0000","last_unstale":"2023-11-28T11:08:38.029750+0000","last_undegraded":"2023-11-28T11:08:38.029750+0000","last_fullsized":"2023-11-28T11:08:38.029750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:56.135916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029783+0000","last_change":"2023-11-28T11:08:36.008497+0000","last_active":"2023-11-28T11:08:38.029783+0000","last_peered":"2023-11-28T11:08:38.029783+0000","last_clean":"2023-11-28T11:08:38.029783+0000","last_became_active":"2023-11-28T11:08:36.008076+0000","last_became_peered":"2023-11-28T11:08:36.008076+0000","last_unstale":"2023-11-28T11:08:38.029783+0000","last_undegraded":"2023-11-28T11:08:38.029783+0000","last_fullsized":"2023-11-28T11:08:38.029783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029879+0000","last_change":"2023-11-28T11:08:36.408545+0000","last_active":"2023-11-28T11:08:38.029879+0000","last_peered":"2023-11-28T11:08:38.029879+0000","last_clean":"2023-11-28T11:08:38.029879+0000","last_became_active":"2023-11-28T11:08:36.408324+0000","last_became_peered":"2023-11-28T11:08:36.408324+0000","last_unstale":"2023-11-28T11:08:38.029879+0000","last_undegraded":"2023-11-28T11:08:38.029879+0000","last_fullsized":"2023-11-28T11:08:38.029879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029222+0000","last_change":"2023-11-28T11:08:36.008197+0000","last_active":"2023-11-28T11:08:38.029222+0000","last_peered":"2023-11-28T11:08:38.029222+0000","last_clean":"2023-11-28T11:08:38.029222+0000","last_became_active":"2023-11-28T11:08:36.007930+0000","last_became_peered":"2023-11-28T11:08:36.007930+0000","last_unstale":"2023-11-28T11:08:38.029222+0000","last_undegraded":"2023-11-28T11:08:38.029222+0000","last_fullsized":"2023-11-28T11:08:38.029222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029235+0000","last_change":"2023-11-28T11:08:36.414124+0000","last_active":"2023-11-28T11:08:38.029235+0000","last_peered":"2023-11-28T11:08:38.029235+0000","last_clean":"2023-11-28T11:08:38.029235+0000","last_became_active":"2023-11-28T11:08:36.413627+0000","last_became_peered":"2023-11-28T11:08:36.413627+0000","last_unstale":"2023-11-28T11:08:38.029235+0000","last_undegraded":"2023-11-28T11:08:38.029235+0000","last_fullsized":"2023-11-28T11:08:38.029235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.395305+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:08:36.395305+0000","last_peered":"2023-11-28T11:08:36.395305+0000","last_clean":"2023-11-28T11:08:36.395305+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:08:36.395305+0000","last_undegraded":"2023-11-28T11:08:36.395305+0000","last_fullsized":"2023-11-28T11:08:36.395305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029614+0000","last_change":"2023-11-28T11:08:36.012422+0000","last_active":"2023-11-28T11:08:38.029614+0000","last_peered":"2023-11-28T11:08:38.029614+0000","last_clean":"2023-11-28T11:08:38.029614+0000","last_became_active":"2023-11-28T11:08:36.012145+0000","last_became_peered":"2023-11-28T11:08:36.012145+0000","last_unstale":"2023-11-28T11:08:38.029614+0000","last_undegraded":"2023-11-28T11:08:38.029614+0000","last_fullsized":"2023-11-28T11:08:38.029614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029445+0000","last_change":"2023-11-28T11:08:36.404785+0000","last_active":"2023-11-28T11:08:38.029445+0000","last_peered":"2023-11-28T11:08:38.029445+0000","last_clean":"2023-11-28T11:08:38.029445+0000","last_became_active":"2023-11-28T11:08:36.404512+0000","last_became_peered":"2023-11-28T11:08:36.404512+0000","last_unstale":"2023-11-28T11:08:38.029445+0000","last_undegraded":"2023-11-28T11:08:38.029445+0000","last_fullsized":"2023-11-28T11:08:38.029445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.390894+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:08:36.390894+0000","last_peered":"2023-11-28T11:08:36.390894+0000","last_clean":"2023-11-28T11:08:36.390894+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:08:36.390894+0000","last_undegraded":"2023-11-28T11:08:36.390894+0000","last_fullsized":"2023-11-28T11:08:36.390894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029511+0000","last_change":"2023-11-28T11:08:36.011603+0000","last_active":"2023-11-28T11:08:38.029511+0000","last_peered":"2023-11-28T11:08:38.029511+0000","last_clean":"2023-11-28T11:08:38.029511+0000","last_became_active":"2023-11-28T11:08:36.011343+0000","last_became_peered":"2023-11-28T11:08:36.011343+0000","last_unstale":"2023-11-28T11:08:38.029511+0000","last_undegraded":"2023-11-28T11:08:38.029511+0000","last_fullsized":"2023-11-28T11:08:38.029511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:27.258902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029473+0000","last_change":"2023-11-28T11:08:36.398461+0000","last_active":"2023-11-28T11:08:38.029473+0000","last_peered":"2023-11-28T11:08:38.029473+0000","last_clean":"2023-11-28T11:08:38.029473+0000","last_became_active":"2023-11-28T11:08:36.398208+0000","last_became_peered":"2023-11-28T11:08:36.398208+0000","last_unstale":"2023-11-28T11:08:38.029473+0000","last_undegraded":"2023-11-28T11:08:38.029473+0000","last_fullsized":"2023-11-28T11:08:38.029473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.394283+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:08:36.394283+0000","last_peered":"2023-11-28T11:08:36.394283+0000","last_clean":"2023-11-28T11:08:36.394283+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:08:36.394283+0000","last_undegraded":"2023-11-28T11:08:36.394283+0000","last_fullsized":"2023-11-28T11:08:36.394283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028711+0000","last_change":"2023-11-28T11:08:36.003399+0000","last_active":"2023-11-28T11:08:38.028711+0000","last_peered":"2023-11-28T11:08:38.028711+0000","last_clean":"2023-11-28T11:08:38.028711+0000","last_became_active":"2023-11-28T11:08:36.003098+0000","last_became_peered":"2023-11-28T11:08:36.003098+0000","last_unstale":"2023-11-28T11:08:38.028711+0000","last_undegraded":"2023-11-28T11:08:38.028711+0000","last_fullsized":"2023-11-28T11:08:38.028711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029328+0000","last_change":"2023-11-28T11:08:36.402922+0000","last_active":"2023-11-28T11:08:38.029328+0000","last_peered":"2023-11-28T11:08:38.029328+0000","last_clean":"2023-11-28T11:08:38.029328+0000","last_became_active":"2023-11-28T11:08:36.402567+0000","last_became_peered":"2023-11-28T11:08:36.402567+0000","last_unstale":"2023-11-28T11:08:38.029328+0000","last_undegraded":"2023-11-28T11:08:38.029328+0000","last_fullsized":"2023-11-28T11:08:38.029328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.390396+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:08:36.390396+0000","last_peered":"2023-11-28T11:08:36.390396+0000","last_clean":"2023-11-28T11:08:36.390396+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:08:36.390396+0000","last_undegraded":"2023-11-28T11:08:36.390396+0000","last_fullsized":"2023-11-28T11:08:36.390396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.397551+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:08:36.397551+0000","last_peered":"2023-11-28T11:08:36.397551+0000","last_clean":"2023-11-28T11:08:36.397551+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:08:36.397551+0000","last_undegraded":"2023-11-28T11:08:36.397551+0000","last_fullsized":"2023-11-28T11:08:36.397551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029536+0000","last_change":"2023-11-28T11:08:36.005814+0000","last_active":"2023-11-28T11:08:38.029536+0000","last_peered":"2023-11-28T11:08:38.029536+0000","last_clean":"2023-11-28T11:08:38.029536+0000","last_became_active":"2023-11-28T11:08:36.005597+0000","last_became_peered":"2023-11-28T11:08:36.005597+0000","last_unstale":"2023-11-28T11:08:38.029536+0000","last_undegraded":"2023-11-28T11:08:38.029536+0000","last_fullsized":"2023-11-28T11:08:38.029536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389609+0000","last_change":"2023-11-28T11:08:36.412276+0000","last_active":"2023-11-28T11:08:37.389609+0000","last_peered":"2023-11-28T11:08:37.389609+0000","last_clean":"2023-11-28T11:08:37.389609+0000","last_became_active":"2023-11-28T11:08:36.411972+0000","last_became_peered":"2023-11-28T11:08:36.411972+0000","last_unstale":"2023-11-28T11:08:37.389609+0000","last_undegraded":"2023-11-28T11:08:37.389609+0000","last_fullsized":"2023-11-28T11:08:37.389609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:51.424901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.397737+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:08:36.397737+0000","last_peered":"2023-11-28T11:08:36.397737+0000","last_clean":"2023-11-28T11:08:36.397737+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:08:36.397737+0000","last_undegraded":"2023-11-28T11:08:36.397737+0000","last_fullsized":"2023-11-28T11:08:36.397737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388014+0000","last_change":"2023-11-28T11:08:36.007167+0000","last_active":"2023-11-28T11:08:37.388014+0000","last_peered":"2023-11-28T11:08:37.388014+0000","last_clean":"2023-11-28T11:08:37.388014+0000","last_became_active":"2023-11-28T11:08:36.006824+0000","last_became_peered":"2023-11-28T11:08:36.006824+0000","last_unstale":"2023-11-28T11:08:37.388014+0000","last_undegraded":"2023-11-28T11:08:37.388014+0000","last_fullsized":"2023-11-28T11:08:37.388014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388714+0000","last_change":"2023-11-28T11:08:36.400076+0000","last_active":"2023-11-28T11:08:37.388714+0000","last_peered":"2023-11-28T11:08:37.388714+0000","last_clean":"2023-11-28T11:08:37.388714+0000","last_became_active":"2023-11-28T11:08:36.399490+0000","last_became_peered":"2023-11-28T11:08:36.399490+0000","last_unstale":"2023-11-28T11:08:37.388714+0000","last_undegraded":"2023-11-28T11:08:37.388714+0000","last_fullsized":"2023-11-28T11:08:37.388714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.399615+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:08:36.399615+0000","last_peered":"2023-11-28T11:08:36.399615+0000","last_clean":"2023-11-28T11:08:36.399615+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:08:36.399615+0000","last_undegraded":"2023-11-28T11:08:36.399615+0000","last_fullsized":"2023-11-28T11:08:36.399615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029477+0000","last_change":"2023-11-28T11:08:36.001037+0000","last_active":"2023-11-28T11:08:38.029477+0000","last_peered":"2023-11-28T11:08:38.029477+0000","last_clean":"2023-11-28T11:08:38.029477+0000","last_became_active":"2023-11-28T11:08:36.000535+0000","last_became_peered":"2023-11-28T11:08:36.000535+0000","last_unstale":"2023-11-28T11:08:38.029477+0000","last_undegraded":"2023-11-28T11:08:38.029477+0000","last_fullsized":"2023-11-28T11:08:38.029477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388339+0000","last_change":"2023-11-28T11:08:36.395350+0000","last_active":"2023-11-28T11:08:37.388339+0000","last_peered":"2023-11-28T11:08:37.388339+0000","last_clean":"2023-11-28T11:08:37.388339+0000","last_became_active":"2023-11-28T11:08:36.394962+0000","last_became_peered":"2023-11-28T11:08:36.394962+0000","last_unstale":"2023-11-28T11:08:37.388339+0000","last_undegraded":"2023-11-28T11:08:37.388339+0000","last_fullsized":"2023-11-28T11:08:37.388339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029389+0000","last_change":"2023-11-28T11:08:36.008154+0000","last_active":"2023-11-28T11:08:38.029389+0000","last_peered":"2023-11-28T11:08:38.029389+0000","last_clean":"2023-11-28T11:08:38.029389+0000","last_became_active":"2023-11-28T11:08:36.007856+0000","last_became_peered":"2023-11-28T11:08:36.007856+0000","last_unstale":"2023-11-28T11:08:38.029389+0000","last_undegraded":"2023-11-28T11:08:38.029389+0000","last_fullsized":"2023-11-28T11:08:38.029389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.395415+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:08:36.395415+0000","last_peered":"2023-11-28T11:08:36.395415+0000","last_clean":"2023-11-28T11:08:36.395415+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:08:36.395415+0000","last_undegraded":"2023-11-28T11:08:36.395415+0000","last_fullsized":"2023-11-28T11:08:36.395415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028493+0000","last_change":"2023-11-28T11:08:36.409355+0000","last_active":"2023-11-28T11:08:38.028493+0000","last_peered":"2023-11-28T11:08:38.028493+0000","last_clean":"2023-11-28T11:08:38.028493+0000","last_became_active":"2023-11-28T11:08:36.409102+0000","last_became_peered":"2023-11-28T11:08:36.409102+0000","last_unstale":"2023-11-28T11:08:38.028493+0000","last_undegraded":"2023-11-28T11:08:38.028493+0000","last_fullsized":"2023-11-28T11:08:38.028493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:17:00.028902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.398519+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:08:36.398519+0000","last_peered":"2023-11-28T11:08:36.398519+0000","last_clean":"2023-11-28T11:08:36.398519+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:08:36.398519+0000","last_undegraded":"2023-11-28T11:08:36.398519+0000","last_fullsized":"2023-11-28T11:08:36.398519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388624+0000","last_change":"2023-11-28T11:08:36.003130+0000","last_active":"2023-11-28T11:08:37.388624+0000","last_peered":"2023-11-28T11:08:37.388624+0000","last_clean":"2023-11-28T11:08:37.388624+0000","last_became_active":"2023-11-28T11:08:36.002603+0000","last_became_peered":"2023-11-28T11:08:36.002603+0000","last_unstale":"2023-11-28T11:08:37.388624+0000","last_undegraded":"2023-11-28T11:08:37.388624+0000","last_fullsized":"2023-11-28T11:08:37.388624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:37:12.961779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029185+0000","last_change":"2023-11-28T11:08:36.404217+0000","last_active":"2023-11-28T11:08:38.029185+0000","last_peered":"2023-11-28T11:08:38.029185+0000","last_clean":"2023-11-28T11:08:38.029185+0000","last_became_active":"2023-11-28T11:08:36.403929+0000","last_became_peered":"2023-11-28T11:08:36.403929+0000","last_unstale":"2023-11-28T11:08:38.029185+0000","last_undegraded":"2023-11-28T11:08:38.029185+0000","last_fullsized":"2023-11-28T11:08:38.029185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:13.390834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388389+0000","last_change":"2023-11-28T11:08:36.010521+0000","last_active":"2023-11-28T11:08:37.388389+0000","last_peered":"2023-11-28T11:08:37.388389+0000","last_clean":"2023-11-28T11:08:37.388389+0000","last_became_active":"2023-11-28T11:08:36.010235+0000","last_became_peered":"2023-11-28T11:08:36.010235+0000","last_unstale":"2023-11-28T11:08:37.388389+0000","last_undegraded":"2023-11-28T11:08:37.388389+0000","last_fullsized":"2023-11-28T11:08:37.388389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527702+0000","last_change":"2023-11-28T11:08:36.399755+0000","last_active":"2023-11-28T11:08:37.527702+0000","last_peered":"2023-11-28T11:08:37.527702+0000","last_clean":"2023-11-28T11:08:37.527702+0000","last_became_active":"2023-11-28T11:08:36.399504+0000","last_became_peered":"2023-11-28T11:08:36.399504+0000","last_unstale":"2023-11-28T11:08:37.527702+0000","last_undegraded":"2023-11-28T11:08:37.527702+0000","last_fullsized":"2023-11-28T11:08:37.527702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:13.661118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029388+0000","last_change":"2023-11-28T11:08:36.010768+0000","last_active":"2023-11-28T11:08:38.029388+0000","last_peered":"2023-11-28T11:08:38.029388+0000","last_clean":"2023-11-28T11:08:38.029388+0000","last_became_active":"2023-11-28T11:08:36.010442+0000","last_became_peered":"2023-11-28T11:08:36.010442+0000","last_unstale":"2023-11-28T11:08:38.029388+0000","last_undegraded":"2023-11-28T11:08:38.029388+0000","last_fullsized":"2023-11-28T11:08:38.029388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029576+0000","last_change":"2023-11-28T11:08:36.410581+0000","last_active":"2023-11-28T11:08:38.029576+0000","last_peered":"2023-11-28T11:08:38.029576+0000","last_clean":"2023-11-28T11:08:38.029576+0000","last_became_active":"2023-11-28T11:08:36.410010+0000","last_became_peered":"2023-11-28T11:08:36.410010+0000","last_unstale":"2023-11-28T11:08:38.029576+0000","last_undegraded":"2023-11-28T11:08:38.029576+0000","last_fullsized":"2023-11-28T11:08:38.029576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:31.911633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029714+0000","last_change":"2023-11-28T11:08:36.010817+0000","last_active":"2023-11-28T11:08:38.029714+0000","last_peered":"2023-11-28T11:08:38.029714+0000","last_clean":"2023-11-28T11:08:38.029714+0000","last_became_active":"2023-11-28T11:08:36.010516+0000","last_became_peered":"2023-11-28T11:08:36.010516+0000","last_unstale":"2023-11-28T11:08:38.029714+0000","last_undegraded":"2023-11-28T11:08:38.029714+0000","last_fullsized":"2023-11-28T11:08:38.029714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030156+0000","last_change":"2023-11-28T11:08:36.414691+0000","last_active":"2023-11-28T11:08:38.030156+0000","last_peered":"2023-11-28T11:08:38.030156+0000","last_clean":"2023-11-28T11:08:38.030156+0000","last_became_active":"2023-11-28T11:08:36.412582+0000","last_became_peered":"2023-11-28T11:08:36.412582+0000","last_unstale":"2023-11-28T11:08:38.030156+0000","last_undegraded":"2023-11-28T11:08:38.030156+0000","last_fullsized":"2023-11-28T11:08:38.030156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:27.723848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028818+0000","last_change":"2023-11-28T11:08:36.004724+0000","last_active":"2023-11-28T11:08:38.028818+0000","last_peered":"2023-11-28T11:08:38.028818+0000","last_clean":"2023-11-28T11:08:38.028818+0000","last_became_active":"2023-11-28T11:08:36.004413+0000","last_became_peered":"2023-11-28T11:08:36.004413+0000","last_unstale":"2023-11-28T11:08:38.028818+0000","last_undegraded":"2023-11-28T11:08:38.028818+0000","last_fullsized":"2023-11-28T11:08:38.028818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028617+0000","last_change":"2023-11-28T11:08:36.405263+0000","last_active":"2023-11-28T11:08:38.028617+0000","last_peered":"2023-11-28T11:08:38.028617+0000","last_clean":"2023-11-28T11:08:38.028617+0000","last_became_active":"2023-11-28T11:08:36.405009+0000","last_became_peered":"2023-11-28T11:08:36.405009+0000","last_unstale":"2023-11-28T11:08:38.028617+0000","last_undegraded":"2023-11-28T11:08:38.028617+0000","last_fullsized":"2023-11-28T11:08:38.028617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:56.135916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388734+0000","last_change":"2023-11-28T11:08:36.004954+0000","last_active":"2023-11-28T11:08:37.388734+0000","last_peered":"2023-11-28T11:08:37.388734+0000","last_clean":"2023-11-28T11:08:37.388734+0000","last_became_active":"2023-11-28T11:08:36.004689+0000","last_became_peered":"2023-11-28T11:08:36.004689+0000","last_unstale":"2023-11-28T11:08:37.388734+0000","last_undegraded":"2023-11-28T11:08:37.388734+0000","last_fullsized":"2023-11-28T11:08:37.388734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029176+0000","last_change":"2023-11-28T11:08:36.409550+0000","last_active":"2023-11-28T11:08:38.029176+0000","last_peered":"2023-11-28T11:08:38.029176+0000","last_clean":"2023-11-28T11:08:38.029176+0000","last_became_active":"2023-11-28T11:08:36.409256+0000","last_became_peered":"2023-11-28T11:08:36.409256+0000","last_unstale":"2023-11-28T11:08:38.029176+0000","last_undegraded":"2023-11-28T11:08:38.029176+0000","last_fullsized":"2023-11-28T11:08:38.029176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389289+0000","last_change":"2023-11-28T11:08:36.408453+0000","last_active":"2023-11-28T11:08:37.389289+0000","last_peered":"2023-11-28T11:08:37.389289+0000","last_clean":"2023-11-28T11:08:37.389289+0000","last_became_active":"2023-11-28T11:08:36.408159+0000","last_became_peered":"2023-11-28T11:08:36.408159+0000","last_unstale":"2023-11-28T11:08:37.389289+0000","last_undegraded":"2023-11-28T11:08:37.389289+0000","last_fullsized":"2023-11-28T11:08:37.389289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:59:25.539378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029482+0000","last_change":"2023-11-28T11:08:36.408287+0000","last_active":"2023-11-28T11:08:38.029482+0000","last_peered":"2023-11-28T11:08:38.029482+0000","last_clean":"2023-11-28T11:08:38.029482+0000","last_became_active":"2023-11-28T11:08:36.408035+0000","last_became_peered":"2023-11-28T11:08:36.408035+0000","last_unstale":"2023-11-28T11:08:38.029482+0000","last_undegraded":"2023-11-28T11:08:38.029482+0000","last_fullsized":"2023-11-28T11:08:38.029482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:45:33.470588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030002+0000","last_change":"2023-11-28T11:08:36.414705+0000","last_active":"2023-11-28T11:08:38.030002+0000","last_peered":"2023-11-28T11:08:38.030002+0000","last_clean":"2023-11-28T11:08:38.030002+0000","last_became_active":"2023-11-28T11:08:36.414428+0000","last_became_peered":"2023-11-28T11:08:36.414428+0000","last_unstale":"2023-11-28T11:08:38.030002+0000","last_undegraded":"2023-11-28T11:08:38.030002+0000","last_fullsized":"2023-11-28T11:08:38.030002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:05.744622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029115+0000","last_change":"2023-11-28T11:08:36.409051+0000","last_active":"2023-11-28T11:08:38.029115+0000","last_peered":"2023-11-28T11:08:38.029115+0000","last_clean":"2023-11-28T11:08:38.029115+0000","last_became_active":"2023-11-28T11:08:36.408827+0000","last_became_peered":"2023-11-28T11:08:36.408827+0000","last_unstale":"2023-11-28T11:08:38.029115+0000","last_undegraded":"2023-11-28T11:08:38.029115+0000","last_fullsized":"2023-11-28T11:08:38.029115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:05.744622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029371+0000","last_change":"2023-11-28T11:08:36.410425+0000","last_active":"2023-11-28T11:08:38.029371+0000","last_peered":"2023-11-28T11:08:38.029371+0000","last_clean":"2023-11-28T11:08:38.029371+0000","last_became_active":"2023-11-28T11:08:36.409787+0000","last_became_peered":"2023-11-28T11:08:36.409787+0000","last_unstale":"2023-11-28T11:08:38.029371+0000","last_undegraded":"2023-11-28T11:08:38.029371+0000","last_fullsized":"2023-11-28T11:08:38.029371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:37:56.065831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":685204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2330000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0179999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.444}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:08:45.332 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:08:45.333 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T11:08:45.333 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T11:08:45.333 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T11:08:45.334 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T11:08:45.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.486+0000 7f3e31fcd700 1 Processor -- start 2023-11-28T11:08:45.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.487+0000 7f3e31fcd700 1 -- start start 2023-11-28T11:08:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.487+0000 7f3e31fcd700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3e2c06e400 0x7f3e2c06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.487+0000 7f3e31fcd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e2c15e010 0x7f3e2c0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.487+0000 7f3e31fcd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c15af30 con 0x7f3e2c0d15f0 2023-11-28T11:08:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.487+0000 7f3e31fcd700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2c15a9d0 con 0x7f3e2c06e400 2023-11-28T11:08:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.487+0000 7f3e31fcd700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c1584e0 con 0x7f3e2c15e010 2023-11-28T11:08:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.487+0000 7f3e2affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3e2c0d15f0 0x7f3e2c15b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40990/0 (socket says 172.21.15.125:40990) 2023-11-28T11:08:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2affd700 1 -- 172.21.15.125:0/2481093312 learned_addr learned my addr 172.21.15.125:0/2481093312 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2b7fe700 1 --2- 172.21.15.125:0/2481093312 >> v2:172.21.15.167:3300/0 conn(0x7f3e2c06e400 0x7f3e2c06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2bfff700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e2c15e010 0x7f3e2c0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519464968 0 0) 0x7f3e2c15af30 con 0x7f3e2c0d15f0 2023-11-28T11:08:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e180035b0 con 0x7f3e2c0d15f0 2023-11-28T11:08:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3145959166 0 0) 0x7f3e180035b0 con 0x7f3e2c0d15f0 2023-11-28T11:08:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e2c15e010 msgr2=0x7f3e2c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e2c15e010 0x7f3e2c0ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 >> v2:172.21.15.167:3300/0 conn(0x7f3e2c06e400 msgr2=0x7f3e2c06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 --2- 172.21.15.125:0/2481093312 >> v2:172.21.15.167:3300/0 conn(0x7f3e2c06e400 0x7f3e2c06e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c15ef40 con 0x7f3e2c0d15f0 2023-11-28T11:08:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f3e1c001670 con 0x7f3e2c0d15f0 2023-11-28T11:08:45.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 >> v1:172.21.15.125:6789/0 conn(0x7f3e2c0d15f0 legacy=0x7f3e2c15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e18003a00 0x7f3e18003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e180043e0 0x7f3e180048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e18004f20 0x7f3e1800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c1584e0 con 0x7f3e18004f20 2023-11-28T11:08:45.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1800bf50 con 0x7f3e180043e0 2023-11-28T11:08:45.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1800c090 con 0x7f3e18003a00 2023-11-28T11:08:45.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2b7fe700 1 --2- 172.21.15.125:0/2481093312 >> v2:172.21.15.167:3300/0 conn(0x7f3e2c06e400 0x7f3e2c06e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:45.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2bfff700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e2c15e010 0x7f3e2c0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:45.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2bfff700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e18004f20 0x7f3e1800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2affd700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e180043e0 0x7f3e180048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.488+0000 7f3e2b7fe700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e18003a00 0x7f3e18003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e2bfff700 1 -- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e18003a00 msgr2=0x7f3e18003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:45.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e2bfff700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e18003a00 0x7f3e18003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e2bfff700 1 -- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e180043e0 msgr2=0x7f3e180048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:45.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e2bfff700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e180043e0 0x7f3e180048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e2bfff700 1 -- 172.21.15.125:0/2481093312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180035b0 con 0x7f3e18004f20 2023-11-28T11:08:45.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e2b7fe700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e18003a00 0x7f3e18003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:45.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e2bfff700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e18004f20 0x7f3e1800ba10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c15e3e0 tx=0x7f3e18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32d881197cd0e8a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:45.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24003c20 con 0x7f3e18004f20 2023-11-28T11:08:45.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2400f040 con 0x7f3e18004f20 2023-11-28T11:08:45.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e2a7fc700 1 -- 172.21.15.125:0/2481093312 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2400ea60 con 0x7f3e18004f20 2023-11-28T11:08:45.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e31fcd700 1 -- 172.21.15.125:0/2481093312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e18004f20 msgr2=0x7f3e1800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e31fcd700 1 --2- 172.21.15.125:0/2481093312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e18004f20 0x7f3e1800ba10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c15e3e0 tx=0x7f3e18005880 comp rx=0 tx=0).stop 2023-11-28T11:08:45.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e2bfff700 1 -- 172.21.15.125:0/2481093312 reap_dead start 2023-11-28T11:08:45.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e31fcd700 1 -- 172.21.15.125:0/2481093312 shutdown_connections 2023-11-28T11:08:45.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e31fcd700 1 -- 172.21.15.125:0/2481093312 >> 172.21.15.125:0/2481093312 conn(0x7f3e2c06a270 msgr2=0x7f3e2c06a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:45.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e31fcd700 1 -- 172.21.15.125:0/2481093312 shutdown_connections 2023-11-28T11:08:45.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.489+0000 7f3e31fcd700 1 -- 172.21.15.125:0/2481093312 wait complete. 2023-11-28T11:08:45.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.491+0000 7f3e31fcd700 1 Processor -- start 2023-11-28T11:08:45.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.491+0000 7f3e31fcd700 1 -- start start 2023-11-28T11:08:45.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.491+0000 7f3e31fcd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e18004f20 0x7f3e2c14bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e31fcd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e2c15d4c0 0x7f3e2c15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e31fcd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e2c15d930 0x7f3e2c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e31fcd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c15c420 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e31fcd700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c15c700 con 0x7f3e18004f20 2023-11-28T11:08:45.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e31fcd700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c15c9e0 con 0x7f3e2c15d930 2023-11-28T11:08:45.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e2c15d4c0 0x7f3e2c15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e2c15d4c0 0x7f3e2c15b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56876/0 (socket says 172.21.15.125:56876) 2023-11-28T11:08:45.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2affd700 1 -- 172.21.15.125:0/258696292 learned_addr learned my addr 172.21.15.125:0/258696292 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:45.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2b7fe700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e18004f20 0x7f3e2c14bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2bfff700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e2c15d930 0x7f3e2c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2affd700 1 -- 172.21.15.125:0/258696292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e2c15d930 msgr2=0x7f3e2c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2affd700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e2c15d930 0x7f3e2c0b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2affd700 1 -- 172.21.15.125:0/258696292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e18004f20 msgr2=0x7f3e2c14bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2affd700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e18004f20 0x7f3e2c14bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2affd700 1 -- 172.21.15.125:0/258696292 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c15e980 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2b7fe700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e18004f20 0x7f3e2c14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:45.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e2affd700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e2c15d4c0 0x7f3e2c15b9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c007340 tx=0x7f3e1c007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:45.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e23fff700 1 -- 172.21.15.125:0/258696292 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00f6c0 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e23fff700 1 -- 172.21.15.125:0/258696292 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c00f840 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e31fcd700 1 -- 172.21.15.125:0/258696292 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c06ed10 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e23fff700 1 -- 172.21.15.125:0/258696292 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00fbf0 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.492+0000 7f3e31fcd700 1 -- 172.21.15.125:0/258696292 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c15ec60 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.493+0000 7f3e31fcd700 1 -- 172.21.15.125:0/258696292 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c0743f0 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.494+0000 7f3e23fff700 1 -- 172.21.15.125:0/258696292 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3e1c00fd50 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.494+0000 7f3e23fff700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3e0c0682f0 0x7f3e0c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.494+0000 7f3e23fff700 1 -- 172.21.15.125:0/258696292 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e1c085e70 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.494+0000 7f3e2b7fe700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3e0c0682f0 0x7f3e0c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.494+0000 7f3e2b7fe700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3e0c0682f0 0x7f3e0c06a7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3e14004660 tx=0x7f3e14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:45.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.498+0000 7f3e23fff700 1 -- 172.21.15.125:0/258696292 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3e1c0526d0 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.735+0000 7f3e31fcd700 1 -- 172.21.15.125:0/258696292 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3e2c06dcd0 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.738+0000 7f3e23fff700 1 -- 172.21.15.125:0/258696292 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+166384 (secure 0 0 0) 0x7f3e1c055cf0 con 0x7f3e2c15d4c0 2023-11-28T11:08:45.741 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:45.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.740+0000 7f3e31fcd700 1 -- 172.21.15.125:0/258696292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3e0c0682f0 msgr2=0x7f3e0c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.740+0000 7f3e31fcd700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3e0c0682f0 0x7f3e0c06a7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3e14004660 tx=0x7f3e14008040 comp rx=0 tx=0).stop 2023-11-28T11:08:45.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.740+0000 7f3e31fcd700 1 -- 172.21.15.125:0/258696292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e2c15d4c0 msgr2=0x7f3e2c15b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.740+0000 7f3e31fcd700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e2c15d4c0 0x7f3e2c15b9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c007340 tx=0x7f3e1c007650 comp rx=0 tx=0).stop 2023-11-28T11:08:45.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.741+0000 7f3e31fcd700 1 -- 172.21.15.125:0/258696292 shutdown_connections 2023-11-28T11:08:45.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.741+0000 7f3e31fcd700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3e0c0682f0 0x7f3e0c06a7a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.741+0000 7f3e31fcd700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e2c15d930 0x7f3e2c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.741+0000 7f3e31fcd700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e18004f20 0x7f3e2c14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.741+0000 7f3e31fcd700 1 --2- 172.21.15.125:0/258696292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e2c15d4c0 0x7f3e2c15b9c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.741+0000 7f3e31fcd700 1 -- 172.21.15.125:0/258696292 >> 172.21.15.125:0/258696292 conn(0x7f3e2c06a270 msgr2=0x7f3e2c152b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:45.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.741+0000 7f3e31fcd700 1 -- 172.21.15.125:0/258696292 shutdown_connections 2023-11-28T11:08:45.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.741+0000 7f3e31fcd700 1 -- 172.21.15.125:0/258696292 wait complete. 2023-11-28T11:08:45.753 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":103314},{"type":"v1","addr":"172.21.15.125:6833","nonce":103314}]},"active_addr":"172.21.15.125:6833/103314","active_change":"2023-11-28T11:08:17.612274+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":4182481650}]},{"addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":926285490}]},{"addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":754726801}]},{"addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":4060518668}]}]} 2023-11-28T11:08:45.756 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T11:08:45.756 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T11:08:45.757 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.875+0000 7f971f782700 1 Processor -- start 2023-11-28T11:08:45.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.876+0000 7f971f782700 1 -- start start 2023-11-28T11:08:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.876+0000 7f971f782700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97180ce040 0x7f971815d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.876+0000 7f971f782700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9718142db0 0x7f971813ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.876+0000 7f971f782700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971813fc90 con 0x7f97180b1770 2023-11-28T11:08:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.876+0000 7f971f782700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971813f6d0 con 0x7f9718142db0 2023-11-28T11:08:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.876+0000 7f971f782700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971813f9b0 con 0x7f97180ce040 2023-11-28T11:08:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f971dd1f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f97180b1770 0x7f971813cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41008/0 (socket says 172.21.15.125:41008) 2023-11-28T11:08:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f971dd1f700 1 -- 172.21.15.125:0/357447439 learned_addr learned my addr 172.21.15.125:0/357447439 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:45.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f971cd1d700 1 --2- 172.21.15.125:0/357447439 >> v2:172.21.15.167:3300/0 conn(0x7f9718142db0 0x7f971813ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f971d51e700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97180ce040 0x7f971815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757108666 0 0) 0x7f971813fc90 con 0x7f97180b1770 2023-11-28T11:08:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97040035b0 con 0x7f97180b1770 2023-11-28T11:08:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4212919680 0 0) 0x7f97040035b0 con 0x7f97180b1770 2023-11-28T11:08:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97180ce040 msgr2=0x7f971815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97180ce040 0x7f971815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 >> v2:172.21.15.167:3300/0 conn(0x7f9718142db0 msgr2=0x7f971813ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 --2- 172.21.15.125:0/357447439 >> v2:172.21.15.167:3300/0 conn(0x7f9718142db0 0x7f971813ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971815d100 con 0x7f97180b1770 2023-11-28T11:08:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f97100019f0 con 0x7f97180b1770 2023-11-28T11:08:45.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 >> v1:172.21.15.125:6789/0 conn(0x7f97180b1770 legacy=0x7f971813cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97180ce040 0x7f9704003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9704003f80 0x7f9704004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9704004d90 0x7f9704005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971813f6d0 con 0x7f9704004d90 2023-11-28T11:08:45.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971813f9b0 con 0x7f9704003f80 2023-11-28T11:08:45.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970400ba10 con 0x7f97180ce040 2023-11-28T11:08:45.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f971dd1f700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9704004d90 0x7f9704005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f971cd1d700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9704003f80 0x7f9704004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.877+0000 7f971d51e700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97180ce040 0x7f9704003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971dd1f700 1 -- 172.21.15.125:0/357447439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97180ce040 msgr2=0x7f9704003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:45.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971dd1f700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97180ce040 0x7f9704003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971dd1f700 1 -- 172.21.15.125:0/357447439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9704003f80 msgr2=0x7f9704004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971dd1f700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9704003f80 0x7f9704004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971dd1f700 1 -- 172.21.15.125:0/357447439 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97040035b0 con 0x7f9704004d90 2023-11-28T11:08:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971dd1f700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9704004d90 0x7f9704005200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f971000a8d0 tx=0x7f9704005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3c93221cd051dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971000a340 con 0x7f9704004d90 2023-11-28T11:08:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9710012600 con 0x7f9704004d90 2023-11-28T11:08:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f970ffff700 1 -- 172.21.15.125:0/357447439 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97100129b0 con 0x7f9704004d90 2023-11-28T11:08:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971f782700 1 -- 172.21.15.125:0/357447439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9704004d90 msgr2=0x7f9704005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971f782700 1 --2- 172.21.15.125:0/357447439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9704004d90 0x7f9704005200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f971000a8d0 tx=0x7f9704005880 comp rx=0 tx=0).stop 2023-11-28T11:08:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971dd1f700 1 -- 172.21.15.125:0/357447439 reap_dead start 2023-11-28T11:08:45.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971f782700 1 -- 172.21.15.125:0/357447439 shutdown_connections 2023-11-28T11:08:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971f782700 1 -- 172.21.15.125:0/357447439 >> 172.21.15.125:0/357447439 conn(0x7f971806c010 msgr2=0x7f97180cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971f782700 1 -- 172.21.15.125:0/357447439 shutdown_connections 2023-11-28T11:08:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.878+0000 7f971f782700 1 -- 172.21.15.125:0/357447439 wait complete. 2023-11-28T11:08:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.880+0000 7f971f782700 1 Processor -- start 2023-11-28T11:08:45.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.880+0000 7f971f782700 1 -- start start 2023-11-28T11:08:45.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.880+0000 7f971f782700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9704004d90 0x7f9718166fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.880+0000 7f971f782700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97180b5230 0x7f97181f9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.880+0000 7f971f782700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97181fa420 0x7f9718142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.880+0000 7f971f782700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97180b3480 con 0x7f97181fa420 2023-11-28T11:08:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.880+0000 7f971f782700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97181fa8c0 con 0x7f97180b5230 2023-11-28T11:08:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.880+0000 7f971f782700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97180b3cb0 con 0x7f9704004d90 2023-11-28T11:08:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.880+0000 7f971dd1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97181fa420 0x7f9718142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.880+0000 7f971dd1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97181fa420 0x7f9718142050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56898/0 (socket says 172.21.15.125:56898) 2023-11-28T11:08:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.880+0000 7f971dd1f700 1 -- 172.21.15.125:0/3725690811 learned_addr learned my addr 172.21.15.125:0/3725690811 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f971cd1d700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97180b5230 0x7f97181f9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f971d51e700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9704004d90 0x7f9718166fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f971dd1f700 1 -- 172.21.15.125:0/3725690811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9704004d90 msgr2=0x7f9718166fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f971dd1f700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9704004d90 0x7f9718166fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f971dd1f700 1 -- 172.21.15.125:0/3725690811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97180b5230 msgr2=0x7f97181f9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:45.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f971dd1f700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97180b5230 0x7f97181f9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:45.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f971dd1f700 1 -- 172.21.15.125:0/3725690811 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97180ce410 con 0x7f97181fa420 2023-11-28T11:08:45.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f971cd1d700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97180b5230 0x7f97181f9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:45.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f971dd1f700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97181fa420 0x7f9718142050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9710015040 tx=0x7f9710001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:45.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f970dffb700 1 -- 172.21.15.125:0/3725690811 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971000a340 con 0x7f97181fa420 2023-11-28T11:08:45.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f970dffb700 1 -- 172.21.15.125:0/3725690811 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97100019c0 con 0x7f97181fa420 2023-11-28T11:08:45.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f971f782700 1 -- 172.21.15.125:0/3725690811 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971815d3e0 con 0x7f97181fa420 2023-11-28T11:08:45.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f970dffb700 1 -- 172.21.15.125:0/3725690811 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971001e640 con 0x7f97181fa420 2023-11-28T11:08:45.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.881+0000 7f971f782700 1 -- 172.21.15.125:0/3725690811 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97180ce5a0 con 0x7f97181fa420 2023-11-28T11:08:45.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.882+0000 7f971f782700 1 -- 172.21.15.125:0/3725690811 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97180b58a0 con 0x7f97181fa420 2023-11-28T11:08:45.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.883+0000 7f970dffb700 1 -- 172.21.15.125:0/3725690811 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9710010070 con 0x7f97181fa420 2023-11-28T11:08:45.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.883+0000 7f970dffb700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f96fc0682f0 0x7f96fc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:45.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.883+0000 7f970dffb700 1 -- 172.21.15.125:0/3725690811 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9710087870 con 0x7f97181fa420 2023-11-28T11:08:45.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.883+0000 7f971d51e700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f96fc0682f0 0x7f96fc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:45.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.884+0000 7f971d51e700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f96fc0682f0 0x7f96fc06a7a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9714009ba0 tx=0x7f9714008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:45.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:45.887+0000 7f970dffb700 1 -- 172.21.15.125:0/3725690811 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f97100540d0 con 0x7f97181fa420 2023-11-28T11:08:46.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.070+0000 7f971f782700 1 -- 172.21.15.125:0/3725690811 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97180743f0 con 0x7f97181fa420 2023-11-28T11:08:46.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.071+0000 7f970dffb700 1 -- 172.21.15.125:0/3725690811 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f9710017020 con 0x7f97181fa420 2023-11-28T11:08:46.072 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:46.072 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:46.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 -- 172.21.15.125:0/3725690811 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f96fc0682f0 msgr2=0x7f96fc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f96fc0682f0 0x7f96fc06a7a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9714009ba0 tx=0x7f9714008040 comp rx=0 tx=0).stop 2023-11-28T11:08:46.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 -- 172.21.15.125:0/3725690811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97181fa420 msgr2=0x7f9718142050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97181fa420 0x7f9718142050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9710015040 tx=0x7f9710001360 comp rx=0 tx=0).stop 2023-11-28T11:08:46.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 -- 172.21.15.125:0/3725690811 shutdown_connections 2023-11-28T11:08:46.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97181fa420 0x7f9718142050 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f96fc0682f0 0x7f96fc06a7a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9704004d90 0x7f9718166fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 --2- 172.21.15.125:0/3725690811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97180b5230 0x7f97181f9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 -- 172.21.15.125:0/3725690811 >> 172.21.15.125:0/3725690811 conn(0x7f971806c010 msgr2=0x7f97180ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 -- 172.21.15.125:0/3725690811 shutdown_connections 2023-11-28T11:08:46.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.073+0000 7f971f782700 1 -- 172.21.15.125:0/3725690811 wait complete. 2023-11-28T11:08:46.086 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T11:08:46.086 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:46.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.206+0000 7f6f0152d700 1 Processor -- start 2023-11-28T11:08:46.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.206+0000 7f6f0152d700 1 -- start start 2023-11-28T11:08:46.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6f0152d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6efc0b4660 0x7f6efc071f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6f0152d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6efc0b4a30 0x7f6efc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6f0152d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6efc0cfb00 con 0x7f6efc0cff90 2023-11-28T11:08:46.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6f0152d700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6efc15aa20 con 0x7f6efc0b4660 2023-11-28T11:08:46.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6f0152d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc0cf4d0 con 0x7f6efc0b4a30 2023-11-28T11:08:46.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6efa7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6efc0cff90 0x7f6efc06b590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41026/0 (socket says 172.21.15.125:41026) 2023-11-28T11:08:46.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6efa7fc700 1 -- 172.21.15.125:0/3625254244 learned_addr learned my addr 172.21.15.125:0/3625254244 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:46.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6efaffd700 1 --2- 172.21.15.125:0/3625254244 >> v2:172.21.15.167:3300/0 conn(0x7f6efc0b4660 0x7f6efc071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6efb7fe700 1 --2- 172.21.15.125:0/3625254244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6efc0b4a30 0x7f6efc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6ef9ffb700 1 -- 172.21.15.125:0/3625254244 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088560238 0 0) 0x7f6efc0cfb00 con 0x7f6efc0cff90 2023-11-28T11:08:46.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6ef9ffb700 1 -- 172.21.15.125:0/3625254244 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee40035b0 con 0x7f6efc0cff90 2023-11-28T11:08:46.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6efaffd700 1 -- 172.21.15.125:0/3625254244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6efc0b4a30 msgr2=0x7f6efc0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:46.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6efaffd700 1 --2- 172.21.15.125:0/3625254244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6efc0b4a30 0x7f6efc0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6efaffd700 1 -- 172.21.15.125:0/3625254244 >> v1:172.21.15.125:6789/0 conn(0x7f6efc0cff90 legacy=0x7f6efc06b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6ef9ffb700 1 -- 172.21.15.125:0/3625254244 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1857318004 0 0) 0x7f6ee40035b0 con 0x7f6efc0cff90 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.207+0000 7f6efaffd700 1 -- 172.21.15.125:0/3625254244 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc072550 con 0x7f6efc0b4660 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6efaffd700 1 --2- 172.21.15.125:0/3625254244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6efc0b4660 0x7f6efc071f70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009840 tx=0x7f6ef0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a910a95a657cfe45 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6ef9ffb700 1 -- 172.21.15.125:0/3625254244 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec001670 con 0x7f6efc0b4660 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6ef9ffb700 1 -- 172.21.15.125:0/3625254244 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef0004030 con 0x7f6efc0b4660 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6ef9ffb700 1 -- 172.21.15.125:0/3625254244 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef00043a0 con 0x7f6efc0b4660 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6f0152d700 1 -- 172.21.15.125:0/3625254244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6efc0b4660 msgr2=0x7f6efc071f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6f0152d700 1 --2- 172.21.15.125:0/3625254244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6efc0b4660 0x7f6efc071f70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009840 tx=0x7f6ef0009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6f0152d700 1 -- 172.21.15.125:0/3625254244 shutdown_connections 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6f0152d700 1 --2- 172.21.15.125:0/3625254244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6efc0b4a30 0x7f6efc0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6f0152d700 1 --2- 172.21.15.125:0/3625254244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6efc0b4660 0x7f6efc071f70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6f0152d700 1 -- 172.21.15.125:0/3625254244 >> 172.21.15.125:0/3625254244 conn(0x7f6efc0b2fc0 msgr2=0x7f6efc071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6f0152d700 1 -- 172.21.15.125:0/3625254244 shutdown_connections 2023-11-28T11:08:46.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.208+0000 7f6f0152d700 1 -- 172.21.15.125:0/3625254244 wait complete. 2023-11-28T11:08:46.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.210+0000 7f6f0152d700 1 Processor -- start 2023-11-28T11:08:46.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.210+0000 7f6f0152d700 1 -- start start 2023-11-28T11:08:46.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.210+0000 7f6f0152d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6efc0b4660 0x7f6efc1f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.210+0000 7f6f0152d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6efc0b4a30 0x7f6efc0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.210+0000 7f6f0152d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6efc0cff90 0x7f6efc15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.210+0000 7f6f0152d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc0c8750 con 0x7f6efc0cff90 2023-11-28T11:08:46.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.210+0000 7f6f0152d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc0c66c0 con 0x7f6efc0b4660 2023-11-28T11:08:46.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.210+0000 7f6f0152d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc0c69a0 con 0x7f6efc0b4a30 2023-11-28T11:08:46.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.210+0000 7f6efb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6efc0cff90 0x7f6efc15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.210+0000 7f6efb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6efc0cff90 0x7f6efc15e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56910/0 (socket says 172.21.15.125:56910) 2023-11-28T11:08:46.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6efb7fe700 1 -- 172.21.15.125:0/1165868164 learned_addr learned my addr 172.21.15.125:0/1165868164 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6efa7fc700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6efc0b4a30 0x7f6efc0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6efaffd700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6efc0b4660 0x7f6efc1f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6efb7fe700 1 -- 172.21.15.125:0/1165868164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6efc0b4a30 msgr2=0x7f6efc0c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6efb7fe700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6efc0b4a30 0x7f6efc0c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6efb7fe700 1 -- 172.21.15.125:0/1165868164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6efc0b4660 msgr2=0x7f6efc1f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6efb7fe700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6efc0b4660 0x7f6efc1f4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6efb7fe700 1 -- 172.21.15.125:0/1165868164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef00094a0 con 0x7f6efc0cff90 2023-11-28T11:08:46.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6efaffd700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6efc0b4660 0x7f6efc1f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:46.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6efb7fe700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6efc0cff90 0x7f6efc15e0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400efc0 tx=0x7f6ef400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6ee37fe700 1 -- 172.21.15.125:0/1165868164 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4009ea0 con 0x7f6efc0cff90 2023-11-28T11:08:46.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6ee37fe700 1 -- 172.21.15.125:0/1165868164 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef400f040 con 0x7f6efc0cff90 2023-11-28T11:08:46.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6f0152d700 1 -- 172.21.15.125:0/1165868164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6efc15f170 con 0x7f6efc0cff90 2023-11-28T11:08:46.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6ee37fe700 1 -- 172.21.15.125:0/1165868164 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4014480 con 0x7f6efc0cff90 2023-11-28T11:08:46.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.211+0000 7f6f0152d700 1 -- 172.21.15.125:0/1165868164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6efc0cf790 con 0x7f6efc0cff90 2023-11-28T11:08:46.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.212+0000 7f6f0152d700 1 -- 172.21.15.125:0/1165868164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6efc15f300 con 0x7f6efc0cff90 2023-11-28T11:08:46.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.213+0000 7f6ee37fe700 1 -- 172.21.15.125:0/1165868164 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6ef40145e0 con 0x7f6efc0cff90 2023-11-28T11:08:46.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.213+0000 7f6ee37fe700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ee80682f0 0x7f6ee806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.213+0000 7f6ee37fe700 1 -- 172.21.15.125:0/1165868164 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ef4086660 con 0x7f6efc0cff90 2023-11-28T11:08:46.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.213+0000 7f6efaffd700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ee80682f0 0x7f6ee806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.213+0000 7f6efaffd700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ee80682f0 0x7f6ee806a7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0000c00 tx=0x7f6ef0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.217+0000 7f6ee37fe700 1 -- 172.21.15.125:0/1165868164 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6ef4052ec0 con 0x7f6efc0cff90 2023-11-28T11:08:46.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.401+0000 7f6f0152d700 1 -- 172.21.15.125:0/1165868164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6efc0743f0 con 0x7f6efc0cff90 2023-11-28T11:08:46.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.402+0000 7f6ee37fe700 1 -- 172.21.15.125:0/1165868164 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f6ef40564e0 con 0x7f6efc0cff90 2023-11-28T11:08:46.403 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:46.403 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 -- 172.21.15.125:0/1165868164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ee80682f0 msgr2=0x7f6ee806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ee80682f0 0x7f6ee806a7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0000c00 tx=0x7f6ef0008030 comp rx=0 tx=0).stop 2023-11-28T11:08:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 -- 172.21.15.125:0/1165868164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6efc0cff90 msgr2=0x7f6efc15e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6efc0cff90 0x7f6efc15e0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400efc0 tx=0x7f6ef400c3a0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 -- 172.21.15.125:0/1165868164 shutdown_connections 2023-11-28T11:08:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6efc0cff90 0x7f6efc15e0f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6efc0b4660 0x7f6efc1f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ee80682f0 0x7f6ee806a7a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 --2- 172.21.15.125:0/1165868164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6efc0b4a30 0x7f6efc0c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 -- 172.21.15.125:0/1165868164 >> 172.21.15.125:0/1165868164 conn(0x7f6efc0b2fc0 msgr2=0x7f6efc06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 -- 172.21.15.125:0/1165868164 shutdown_connections 2023-11-28T11:08:46.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.404+0000 7f6f0152d700 1 -- 172.21.15.125:0/1165868164 wait complete. 2023-11-28T11:08:46.417 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T11:08:46.418 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T11:08:46.418 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T11:08:46.419 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T11:08:46.419 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T11:08:46.419 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T11:08:46.420 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T11:08:46.420 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T11:08:46.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.627+0000 7f60c6fec700 1 Processor -- start 2023-11-28T11:08:46.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.627+0000 7f60c6fec700 1 -- start start 2023-11-28T11:08:46.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.627+0000 7f52d13c4700 1 Processor -- start 2023-11-28T11:08:46.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.627+0000 7f52d13c4700 1 -- start start 2023-11-28T11:08:46.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52d13c4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52cc1609c0 0x7f52cc0ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.628+0000 7f60c6fec700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60c0160c30 0x7f60c00ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.628+0000 7f60c6fec700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60c00adda0 0x7f60c00b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.628+0000 7f60c6fec700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c00c2460 con 0x7f60c00b0d20 2023-11-28T11:08:46.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.628+0000 7f60c6fec700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c00ae210 con 0x7f60c0160c30 2023-11-28T11:08:46.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.628+0000 7f60c6fec700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0161000 con 0x7f60c00adda0 2023-11-28T11:08:46.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f60c4d88700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60c0160c30 0x7f60c00ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f60c4d88700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60c0160c30 0x7f60c00ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:53644/0 (socket says 172.21.15.125:53644) 2023-11-28T11:08:46.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f60c4d88700 1 -- 172.21.15.125:0/2544456355 learned_addr learned my addr 172.21.15.125:0/2544456355 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52d13c4700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52cc0b0c50 0x7f52cc06bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52d13c4700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc0cc690 con 0x7f52cc06cdd0 2023-11-28T11:08:46.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52d13c4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc0cc8c0 con 0x7f52cc1609c0 2023-11-28T11:08:46.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52caffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52cc1609c0 0x7f52cc0ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52caffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52cc1609c0 0x7f52cc0ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56918/0 (socket says 172.21.15.125:56918) 2023-11-28T11:08:46.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52caffd700 1 -- 172.21.15.125:0/1378798689 learned_addr learned my addr 172.21.15.125:0/1378798689 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52d13c4700 1 -- 172.21.15.125:0/1378798689 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc0caa30 con 0x7f52cc0b0c50 2023-11-28T11:08:46.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52caffd700 1 -- 172.21.15.125:0/1378798689 >> v2:172.21.15.167:3300/0 conn(0x7f52cc0b0c50 msgr2=0x7f52cc06bd30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:08:46.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52caffd700 1 --2- 172.21.15.125:0/1378798689 >> v2:172.21.15.167:3300/0 conn(0x7f52cc0b0c50 0x7f52cc06bd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52caffd700 1 -- 172.21.15.125:0/1378798689 >> v1:172.21.15.167:6789/0 conn(0x7f52cc06cdd0 legacy=0x7f52cc0b0540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:08:46.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52caffd700 1 -- 172.21.15.125:0/1378798689 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc0cad10 con 0x7f52cc1609c0 2023-11-28T11:08:46.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515916754 0 0) 0x7f60c00c2460 con 0x7f60c00b0d20 2023-11-28T11:08:46.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a80035b0 con 0x7f60c00b0d20 2023-11-28T11:08:46.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f52caffd700 1 --2- 172.21.15.125:0/1378798689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52cc1609c0 0x7f52cc0ca150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0cc620 tx=0x7f52bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a5758b0cfcd248 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.629+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3473618291 0 0) 0x7f60a80035b0 con 0x7f60c00b0d20 2023-11-28T11:08:46.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60c00adda0 msgr2=0x7f60c00b07e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:08:46.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 --2- 172.21.15.125:0/2544456355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60c00adda0 0x7f60c00b07e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 >> v2:172.21.15.167:3300/0 conn(0x7f60c0160c30 msgr2=0x7f60c00ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:46.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 --2- 172.21.15.125:0/2544456355 >> v2:172.21.15.167:3300/0 conn(0x7f60c0160c30 0x7f60c00ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c006b770 con 0x7f60c00b0d20 2023-11-28T11:08:46.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f60b80019f0 con 0x7f60c00b0d20 2023-11-28T11:08:46.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 >> v1:172.21.15.167:6789/0 conn(0x7f60c00b0d20 legacy=0x7f60c00cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 --2- 172.21.15.125:0/2544456355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60a8003a00 0x7f60a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 --2- 172.21.15.125:0/2544456355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a8004850 0x7f60a8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 --2- 172.21.15.125:0/2544456355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a8005200 0x7f60a800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c00ae210 con 0x7f60a8003a00 2023-11-28T11:08:46.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0161000 con 0x7f60a8005200 2023-11-28T11:08:46.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a800c0b0 con 0x7f60a8004850 2023-11-28T11:08:46.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60c4d88700 1 --2- 172.21.15.125:0/2544456355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60a8003a00 0x7f60a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60c5589700 1 --2- 172.21.15.125:0/2544456355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a8005200 0x7f60a800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7ff1d2612700 1 Processor -- start 2023-11-28T11:08:46.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f52c9ffb700 1 -- 172.21.15.125:0/1378798689 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc004230 con 0x7f52cc1609c0 2023-11-28T11:08:46.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f52c9ffb700 1 -- 172.21.15.125:0/1378798689 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc004390 con 0x7f52cc1609c0 2023-11-28T11:08:46.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f52c9ffb700 1 -- 172.21.15.125:0/1378798689 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0036a0 con 0x7f52cc1609c0 2023-11-28T11:08:46.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7fab37f98700 1 Processor -- start 2023-11-28T11:08:46.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7ff1d2612700 1 -- start start 2023-11-28T11:08:46.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7fab37f98700 1 -- start start 2023-11-28T11:08:46.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60c4d88700 1 -- 172.21.15.125:0/2544456355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a8004850 msgr2=0x7f60a8004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:08:46.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60c4d88700 1 --2- 172.21.15.125:0/2544456355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a8004850 0x7f60a8004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60c4d88700 1 -- 172.21.15.125:0/2544456355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a8005200 msgr2=0x7f60a800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:46.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60c4d88700 1 --2- 172.21.15.125:0/2544456355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a8005200 0x7f60a800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.630+0000 7f60c4d88700 1 -- 172.21.15.125:0/2544456355 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c006b770 con 0x7f60a8003a00 2023-11-28T11:08:46.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.631+0000 7f60c4d88700 1 --2- 172.21.15.125:0/2544456355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60a8003a00 0x7f60a8003e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009930 tx=0x7f60a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c874950719f90721 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.631+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4004230 con 0x7f60a8003a00 2023-11-28T11:08:46.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.631+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b4004390 con 0x7f60a8003a00 2023-11-28T11:08:46.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.631+0000 7f60bf7fe700 1 -- 172.21.15.125:0/2544456355 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b40036a0 con 0x7f60a8003a00 2023-11-28T11:08:46.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.631+0000 7fab37f98700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fab300b0540 0x7fab3006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab37f98700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab300cc690 0x7fab300b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab37f98700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab300b0e50 con 0x7fab300ac8f0 2023-11-28T11:08:46.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab37f98700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3006d740 con 0x7fab300b0540 2023-11-28T11:08:46.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab37f98700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab300ce3d0 con 0x7fab300cc690 2023-11-28T11:08:46.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.631+0000 7ff1d2612700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff1cc0cc690 0x7ff1cc0b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.631+0000 7ff1d2612700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1cc0b0a80 0x7ff1cc0c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7ff1d2612700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0cc4a0 con 0x7ff1cc15c680 2023-11-28T11:08:46.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7ff1d2612700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b0f00 con 0x7ff1cc0cc690 2023-11-28T11:08:46.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7ff1d2612700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0ccb00 con 0x7ff1cc0b0a80 2023-11-28T11:08:46.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab35d34700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fab300b0540 0x7fab3006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7f52d13c4700 1 -- 172.21.15.125:0/1378798689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52cc1609c0 msgr2=0x7f52cc0ca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7f52d13c4700 1 --2- 172.21.15.125:0/1378798689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52cc1609c0 0x7f52cc0ca150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0cc620 tx=0x7f52bc009bd0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab35d34700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fab300b0540 0x7fab3006c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56932/0 (socket says 172.21.15.125:56932) 2023-11-28T11:08:46.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab35d34700 1 -- 172.21.15.125:0/2669299362 learned_addr learned my addr 172.21.15.125:0/2669299362 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7f9e49814700 1 Processor -- start 2023-11-28T11:08:46.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7f60c6fec700 1 -- 172.21.15.125:0/2544456355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60a8003a00 msgr2=0x7f60a8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7f60c6fec700 1 --2- 172.21.15.125:0/2544456355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60a8003a00 0x7f60a8003e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009930 tx=0x7f60a8005880 comp rx=0 tx=0).stop 2023-11-28T11:08:46.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7f60c5589700 1 -- 172.21.15.125:0/2544456355 reap_dead start 2023-11-28T11:08:46.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab35d34700 1 -- 172.21.15.125:0/2669299362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab300cc690 msgr2=0x7fab300b0910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:08:46.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab35d34700 1 --2- 172.21.15.125:0/2669299362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab300cc690 0x7fab300b0910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab35d34700 1 -- 172.21.15.125:0/2669299362 >> v1:172.21.15.125:6789/0 conn(0x7fab300ac8f0 legacy=0x7fab300acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab35d34700 1 -- 172.21.15.125:0/2669299362 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab300ce6b0 con 0x7fab300b0540 2023-11-28T11:08:46.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7ff1cbfff700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff1cc15c680 0x7ff1cc0ada30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:43854/0 (socket says 172.21.15.125:43854) 2023-11-28T11:08:46.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7ff1cbfff700 1 -- 172.21.15.125:0/1591096167 learned_addr learned my addr 172.21.15.125:0/1591096167 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:46.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7ff1cb7fe700 1 --2- 172.21.15.125:0/1591096167 >> v2:172.21.15.125:3300/0 conn(0x7ff1cc0cc690 0x7ff1cc0b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7f60c6fec700 1 -- 172.21.15.125:0/2544456355 shutdown_connections 2023-11-28T11:08:46.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7f60c6fec700 1 -- 172.21.15.125:0/2544456355 >> 172.21.15.125:0/2544456355 conn(0x7f60c00cb540 msgr2=0x7f60c00cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7f9e49814700 1 -- start start 2023-11-28T11:08:46.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.632+0000 7fab35d34700 1 --2- 172.21.15.125:0/2669299362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab300b0540 0x7fab3006c540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0098f0 tx=0x7fab2c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a1b1776c8f80e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7ff1cb7fe700 1 -- 172.21.15.125:0/1591096167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1cc0b0a80 msgr2=0x7ff1cc0c9110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:08:46.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7ff1cb7fe700 1 --2- 172.21.15.125:0/1591096167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1cc0b0a80 0x7ff1cc0c9110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7ff1cb7fe700 1 -- 172.21.15.125:0/1591096167 >> v1:172.21.15.167:6789/0 conn(0x7ff1cc15c680 legacy=0x7ff1cc0ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:46.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7ff1cb7fe700 1 -- 172.21.15.125:0/1591096167 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0ac990 con 0x7ff1cc0cc690 2023-11-28T11:08:46.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7ff1cb7fe700 1 --2- 172.21.15.125:0/1591096167 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1cc0cc690 0x7ff1cc0b0540 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009840 tx=0x7ff1c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330f92353a525ba4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7f52d13c4700 1 -- 172.21.15.125:0/1378798689 shutdown_connections 2023-11-28T11:08:46.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7f52d13c4700 1 --2- 172.21.15.125:0/1378798689 >> v2:172.21.15.167:3300/0 conn(0x7f52cc0b0c50 0x7f52cc06bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7f52d13c4700 1 --2- 172.21.15.125:0/1378798689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52cc1609c0 0x7f52cc0ca150 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7f52d13c4700 1 -- 172.21.15.125:0/1378798689 >> 172.21.15.125:0/1378798689 conn(0x7f52cc06aed0 msgr2=0x7f52cc0cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7fab34d32700 1 -- 172.21.15.125:0/2669299362 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c00b8a0 con 0x7fab300b0540 2023-11-28T11:08:46.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7f52d13c4700 1 -- 172.21.15.125:0/1378798689 shutdown_connections 2023-11-28T11:08:46.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7fab34d32700 1 -- 172.21.15.125:0/2669299362 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c00ba00 con 0x7fab300b0540 2023-11-28T11:08:46.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7fab34d32700 1 -- 172.21.15.125:0/2669299362 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c00bd90 con 0x7fab300b0540 2023-11-28T11:08:46.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7f52d13c4700 1 -- 172.21.15.125:0/1378798689 wait complete. 2023-11-28T11:08:46.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.634+0000 7fab37f98700 1 -- 172.21.15.125:0/2669299362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab300b0540 msgr2=0x7fab3006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.634+0000 7fab37f98700 1 --2- 172.21.15.125:0/2669299362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab300b0540 0x7fab3006c540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0098f0 tx=0x7fab2c009c00 comp rx=0 tx=0).stop 2023-11-28T11:08:46.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.634+0000 7ff1caffd700 1 -- 172.21.15.125:0/1591096167 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0004230 con 0x7ff1cc0cc690 2023-11-28T11:08:46.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.634+0000 7ff1caffd700 1 -- 172.21.15.125:0/1591096167 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0004390 con 0x7ff1cc0cc690 2023-11-28T11:08:46.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.634+0000 7ff1caffd700 1 -- 172.21.15.125:0/1591096167 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00036a0 con 0x7ff1cc0cc690 2023-11-28T11:08:46.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.634+0000 7ff1d2612700 1 -- 172.21.15.125:0/1591096167 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1cc0cc690 msgr2=0x7ff1cc0b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7ff1d2612700 1 --2- 172.21.15.125:0/1591096167 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1cc0cc690 0x7ff1cc0b0540 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009840 tx=0x7ff1c0009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:46.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7ff1d2612700 1 -- 172.21.15.125:0/1591096167 shutdown_connections 2023-11-28T11:08:46.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7ff1d2612700 1 --2- 172.21.15.125:0/1591096167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1cc0b0a80 0x7ff1cc0c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7ff1d2612700 1 --2- 172.21.15.125:0/1591096167 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1cc0cc690 0x7ff1cc0b0540 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009840 tx=0x7ff1c0009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:46.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7ff1d2612700 1 -- 172.21.15.125:0/1591096167 >> 172.21.15.125:0/1591096167 conn(0x7ff1cc0cb540 msgr2=0x7ff1cc0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f60c6fec700 1 -- 172.21.15.125:0/2544456355 shutdown_connections 2023-11-28T11:08:46.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f52d13c4700 1 Processor -- start 2023-11-28T11:08:46.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7f9e49814700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e440b0540 0x7f9e440b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7f9e49814700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9e440c9e40 0x7f9e440709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7f9e49814700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4415a8c0 con 0x7f9e4415ebb0 2023-11-28T11:08:46.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7f9e49814700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e440caad0 con 0x7f9e440c9e40 2023-11-28T11:08:46.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7ff1d2612700 1 -- 172.21.15.125:0/1591096167 shutdown_connections 2023-11-28T11:08:46.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.633+0000 7f9e49814700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440c9110 con 0x7f9e440b0540 2023-11-28T11:08:46.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.634+0000 7f9e427fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9e4415ebb0 0x7f9e440ca3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41064/0 (socket says 172.21.15.125:41064) 2023-11-28T11:08:46.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.634+0000 7f9e427fc700 1 -- 172.21.15.125:0/842857094 learned_addr learned my addr 172.21.15.125:0/842857094 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:46.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986979752 0 0) 0x7f9e3c001490 con 0x7f9e4415ebb0 2023-11-28T11:08:46.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e42ffd700 1 --2- 172.21.15.125:0/842857094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e440b0540 0x7f9e440b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e2c0035b0 con 0x7f9e4415ebb0 2023-11-28T11:08:46.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e437fe700 1 --2- 172.21.15.125:0/842857094 >> v2:172.21.15.167:3300/0 conn(0x7f9e440c9e40 0x7f9e440709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 570317502 0 0) 0x7f9e2c0035b0 con 0x7f9e4415ebb0 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e440b0540 msgr2=0x7f9e440b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 --2- 172.21.15.125:0/842857094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e440b0540 0x7f9e440b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 >> v2:172.21.15.167:3300/0 conn(0x7f9e440c9e40 msgr2=0x7f9e440709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 --2- 172.21.15.125:0/842857094 >> v2:172.21.15.167:3300/0 conn(0x7f9e440c9e40 0x7f9e440709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440b0e50 con 0x7f9e4415ebb0 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f9e3c001b80 con 0x7f9e4415ebb0 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 >> v1:172.21.15.125:6789/0 conn(0x7f9e4415ebb0 legacy=0x7f9e440ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 --2- 172.21.15.125:0/842857094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e2c003a00 0x7f9e2c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 --2- 172.21.15.125:0/842857094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c004430 0x7f9e2c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 --2- 172.21.15.125:0/842857094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0050b0 0x7f9e2c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440caad0 con 0x7f9e2c003a00 2023-11-28T11:08:46.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440c9110 con 0x7f9e2c004430 2023-11-28T11:08:46.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c02e010 con 0x7f9e2c0050b0 2023-11-28T11:08:46.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f9e437fe700 1 --2- 172.21.15.125:0/842857094 >> v2:172.21.15.167:3300/0 conn(0x7f9e440c9e40 0x7f9e440709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:46.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f52d13c4700 1 -- start start 2023-11-28T11:08:46.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.636+0000 7f52d13c4700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52cc06cdd0 0x7f52cc1eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.636+0000 7f52d13c4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52cc0b0c50 0x7f52cc0c2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.636+0000 7f52d13c4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52cc1609c0 0x7f52cc0c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.636+0000 7f52d13c4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0b21d0 con 0x7f52cc0b0c50 2023-11-28T11:08:46.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.636+0000 7f52d13c4700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0c7720 con 0x7f52cc06cdd0 2023-11-28T11:08:46.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.636+0000 7f52d13c4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0c3120 con 0x7f52cc1609c0 2023-11-28T11:08:46.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.636+0000 7f52caffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52cc06cdd0 0x7f52cc1eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.636+0000 7f52caffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52cc06cdd0 0x7f52cc1eda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:53680/0 (socket says 172.21.15.125:53680) 2023-11-28T11:08:46.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.636+0000 7f52caffd700 1 -- 172.21.15.125:0/2812891299 learned_addr learned my addr 172.21.15.125:0/2812891299 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f52caffd700 1 -- 172.21.15.125:0/2812891299 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52cc1609c0 msgr2=0x7f52cc0c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f52caffd700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52cc1609c0 0x7f52cc0c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f52caffd700 1 -- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52cc0b0c50 msgr2=0x7f52cc0c2540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:08:46.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f52caffd700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52cc0b0c50 0x7f52cc0c2540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f52caffd700 1 -- 172.21.15.125:0/2812891299 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009550 con 0x7f52cc06cdd0 2023-11-28T11:08:46.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f52caffd700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52cc06cdd0 0x7f52cc1eda20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52cc067450 tx=0x7f52bc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f52b37fe700 1 -- 172.21.15.125:0/2812891299 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc011630 con 0x7f52cc06cdd0 2023-11-28T11:08:46.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7f60c6fec700 1 -- 172.21.15.125:0/2544456355 wait complete. 2023-11-28T11:08:46.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f52d13c4700 1 -- 172.21.15.125:0/2812891299 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc0cb2d0 con 0x7f52cc06cdd0 2023-11-28T11:08:46.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f60c6fec700 1 Processor -- start 2023-11-28T11:08:46.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.635+0000 7ff1d2612700 1 -- 172.21.15.125:0/1591096167 wait complete. 2023-11-28T11:08:46.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7ff1d2612700 1 Processor -- start 2023-11-28T11:08:46.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7ff1d2612700 1 -- start start 2023-11-28T11:08:46.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f52d13c4700 1 -- 172.21.15.125:0/2812891299 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc0caff0 con 0x7f52cc06cdd0 2023-11-28T11:08:46.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f52b37fe700 1 -- 172.21.15.125:0/2812891299 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc011790 con 0x7f52cc06cdd0 2023-11-28T11:08:46.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f52b37fe700 1 -- 172.21.15.125:0/2812891299 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc011b20 con 0x7f52cc06cdd0 2023-11-28T11:08:46.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f9e427fc700 1 --2- 172.21.15.125:0/842857094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c004430 0x7f9e2c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.637+0000 7f9e42ffd700 1 --2- 172.21.15.125:0/842857094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e2c003a00 0x7f9e2c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7f9e427fc700 1 -- 172.21.15.125:0/842857094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0050b0 msgr2=0x7f9e2c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7f9e427fc700 1 --2- 172.21.15.125:0/842857094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0050b0 0x7f9e2c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7f9e427fc700 1 -- 172.21.15.125:0/842857094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e2c003a00 msgr2=0x7f9e2c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7f9e427fc700 1 --2- 172.21.15.125:0/842857094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e2c003a00 0x7f9e2c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7f9e427fc700 1 -- 172.21.15.125:0/842857094 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c0035b0 con 0x7f9e2c004430 2023-11-28T11:08:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7f9e427fc700 1 --2- 172.21.15.125:0/842857094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c004430 0x7f9e2c0048f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00a830 tx=0x7f9e2c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21f8dd8c2b50de9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c012600 con 0x7f9e2c004430 2023-11-28T11:08:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c012780 con 0x7f9e2c004430 2023-11-28T11:08:46.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7f9e41ffb700 1 -- 172.21.15.125:0/842857094 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c012b30 con 0x7f9e2c004430 2023-11-28T11:08:46.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7f52d13c4700 1 -- 172.21.15.125:0/2812891299 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52ac000fc0 con 0x7f52cc06cdd0 2023-11-28T11:08:46.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7ff1d2612700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1cc0b0a80 0x7ff1cc0c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7ff1d2612700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1cc15c680 0x7ff1cc15ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7ff1d2612700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1cc0c45b0 0x7ff1cc15cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7ff1d2612700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0c3be0 con 0x7ff1cc15c680 2023-11-28T11:08:46.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7ff1d2612700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0c2fd0 con 0x7ff1cc0c45b0 2023-11-28T11:08:46.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.638+0000 7ff1d2612700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0c32b0 con 0x7ff1cc0b0a80 2023-11-28T11:08:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1cb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1cc15c680 0x7ff1cc15ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1cbfff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1cc0b0a80 0x7ff1cc0c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1cb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1cc15c680 0x7ff1cc15ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56958/0 (socket says 172.21.15.125:56958) 2023-11-28T11:08:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1d0baf700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1cc0c45b0 0x7ff1cc15cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1cb7fe700 1 -- 172.21.15.125:0/1235313271 learned_addr learned my addr 172.21.15.125:0/1235313271 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1cb7fe700 1 -- 172.21.15.125:0/1235313271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1cc0b0a80 msgr2=0x7ff1cc0c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1cb7fe700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1cc0b0a80 0x7ff1cc0c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1cb7fe700 1 -- 172.21.15.125:0/1235313271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1cc0c45b0 msgr2=0x7ff1cc15cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1cb7fe700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1cc0c45b0 0x7ff1cc15cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1cb7fe700 1 -- 172.21.15.125:0/1235313271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00094a0 con 0x7ff1cc15c680 2023-11-28T11:08:46.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1cb7fe700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1cc15c680 0x7ff1cc15ca50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00090b0 tx=0x7ff1c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1c8ff9700 1 -- 172.21.15.125:0/1235313271 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0003e60 con 0x7ff1cc15c680 2023-11-28T11:08:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1c8ff9700 1 -- 172.21.15.125:0/1235313271 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c001e070 con 0x7ff1cc15c680 2023-11-28T11:08:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1d2612700 1 -- 172.21.15.125:0/1235313271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc0acf50 con 0x7ff1cc15c680 2023-11-28T11:08:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1c8ff9700 1 -- 172.21.15.125:0/1235313271 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0011850 con 0x7ff1cc15c680 2023-11-28T11:08:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7ff1d2612700 1 -- 172.21.15.125:0/1235313271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc0acc70 con 0x7ff1cc15c680 2023-11-28T11:08:46.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7f52b37fe700 1 -- 172.21.15.125:0/2812891299 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f52bc017020 con 0x7f52cc06cdd0 2023-11-28T11:08:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7f9e49814700 1 -- 172.21.15.125:0/842857094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c004430 msgr2=0x7f9e2c0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.639+0000 7f9e49814700 1 --2- 172.21.15.125:0/842857094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c004430 0x7f9e2c0048f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00a830 tx=0x7f9e2c005880 comp rx=0 tx=0).stop 2023-11-28T11:08:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7fab37f98700 1 -- 172.21.15.125:0/2669299362 shutdown_connections 2023-11-28T11:08:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7fab37f98700 1 --2- 172.21.15.125:0/2669299362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab300b0540 0x7fab3006c540 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7fab37f98700 1 --2- 172.21.15.125:0/2669299362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab300cc690 0x7fab300b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7fab37f98700 1 -- 172.21.15.125:0/2669299362 >> 172.21.15.125:0/2669299362 conn(0x7fab3006aed0 msgr2=0x7fab300cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7f9e437fe700 1 -- 172.21.15.125:0/842857094 reap_dead start 2023-11-28T11:08:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7f9e49814700 1 -- 172.21.15.125:0/842857094 shutdown_connections 2023-11-28T11:08:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7f9e49814700 1 -- 172.21.15.125:0/842857094 >> 172.21.15.125:0/842857094 conn(0x7f9e4406aed0 msgr2=0x7f9e440cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7f60c6fec700 1 -- start start 2023-11-28T11:08:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c6fec700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a8003a00 0x7f60c00b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c6fec700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60c015bad0 0x7f60c01eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c6fec700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c015c000 0x7f60c0163340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c6fec700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0162f40 con 0x7f60c015bad0 2023-11-28T11:08:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c6fec700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0162bf0 con 0x7f60c015c000 2023-11-28T11:08:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c6fec700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c00ccdd0 con 0x7f60a8003a00 2023-11-28T11:08:46.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7f52b37fe700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52b80682f0 0x7f52b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7f52b37fe700 1 -- 172.21.15.125:0/2812891299 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52bc0870d0 con 0x7f52cc06cdd0 2023-11-28T11:08:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7f52ca7fc700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52b80682f0 0x7f52b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7f52b37fe700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x7f52b8070b20 0x7f52b8072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7f52b37fe700 1 -- 172.21.15.125:0/2812891299 --> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52b80735e0 con 0x7f52b8070b20 2023-11-28T11:08:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7f52b37fe700 1 -- 172.21.15.125:0/2812891299 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52bc087410 con 0x7f52cc06cdd0 2023-11-28T11:08:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.640+0000 7f52cb7fe700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x7f52b8070b20 0x7f52b8072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f52ca7fc700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52b80682f0 0x7f52b806a7a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f52c0006fd0 tx=0x7f52c0006ba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f52cb7fe700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x7f52b8070b20 0x7f52b8072f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c5589700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c015c000 0x7f60c0163340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c5589700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c015c000 0x7f60c0163340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:53700/0 (socket says 172.21.15.125:53700) 2023-11-28T11:08:46.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c5589700 1 -- 172.21.15.125:0/2952621711 learned_addr learned my addr 172.21.15.125:0/2952621711 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c5589700 1 -- 172.21.15.125:0/2952621711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a8003a00 msgr2=0x7f60c00b18f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T11:08:46.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c5589700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a8003a00 0x7f60c00b18f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c5589700 1 -- 172.21.15.125:0/2952621711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60c015bad0 msgr2=0x7f60c01eaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60bffff700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60c015bad0 0x7f60c01eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.641+0000 7f60c5589700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60c015bad0 0x7f60c01eaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7f60c5589700 1 -- 172.21.15.125:0/2952621711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0164a90 con 0x7f60c015c000 2023-11-28T11:08:46.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7f60bffff700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60c015bad0 0x7f60c01eaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:46.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7f52b37fe700 1 -- 172.21.15.125:0/2812891299 <== osd.1 v2:172.21.15.125:6824/103588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f52b80735e0 con 0x7f52b8070b20 2023-11-28T11:08:46.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7f60c5589700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c015c000 0x7f60c0163340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f60c006f6a0 tx=0x7f60b8005980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7f9e49814700 1 -- 172.21.15.125:0/842857094 shutdown_connections 2023-11-28T11:08:46.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7f9e49814700 1 -- 172.21.15.125:0/842857094 wait complete. 2023-11-28T11:08:46.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7ff1d2612700 1 -- 172.21.15.125:0/1235313271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1cc0c3420 con 0x7ff1cc15c680 2023-11-28T11:08:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7f60bd7fa700 1 -- 172.21.15.125:0/2952621711 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b800aca0 con 0x7f60c015c000 2023-11-28T11:08:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7f60bd7fa700 1 -- 172.21.15.125:0/2952621711 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b800ae20 con 0x7f60c015c000 2023-11-28T11:08:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7f60bd7fa700 1 -- 172.21.15.125:0/2952621711 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8013630 con 0x7f60c015c000 2023-11-28T11:08:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7f60c6fec700 1 -- 172.21.15.125:0/2952621711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c01647b0 con 0x7f60c015c000 2023-11-28T11:08:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7f60c6fec700 1 -- 172.21.15.125:0/2952621711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c0164d70 con 0x7f60c015c000 2023-11-28T11:08:46.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.642+0000 7ff1c8ff9700 1 -- 172.21.15.125:0/1235313271 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff1c0017020 con 0x7ff1cc15c680 2023-11-28T11:08:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.643+0000 7ff1c8ff9700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff1b80682f0 0x7ff1b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.643+0000 7ff1c8ff9700 1 -- 172.21.15.125:0/1235313271 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1c0086da0 con 0x7ff1cc15c680 2023-11-28T11:08:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.643+0000 7ff1c8ff9700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] conn(0x7ff1b8070aa0 0x7ff1b8072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.643+0000 7ff1c8ff9700 1 -- 172.21.15.125:0/1235313271 --> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1b8073560 con 0x7ff1b8070aa0 2023-11-28T11:08:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.643+0000 7fab37f98700 1 -- 172.21.15.125:0/2669299362 shutdown_connections 2023-11-28T11:08:46.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.643+0000 7fab37f98700 1 -- 172.21.15.125:0/2669299362 wait complete. 2023-11-28T11:08:46.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.643+0000 7f60c6fec700 1 -- 172.21.15.125:0/2952621711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60c00743f0 con 0x7f60c015c000 2023-11-28T11:08:46.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.644+0000 7f60bd7fa700 1 -- 172.21.15.125:0/2952621711 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f60b8013790 con 0x7f60c015c000 2023-11-28T11:08:46.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.644+0000 7fab37f98700 1 Processor -- start 2023-11-28T11:08:46.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.644+0000 7fab37f98700 1 -- start start 2023-11-28T11:08:46.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.644+0000 7f9e49814700 1 Processor -- start 2023-11-28T11:08:46.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.644+0000 7f9e49814700 1 -- start start 2023-11-28T11:08:46.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f52a1b94700 1 Processor -- start 2023-11-28T11:08:46.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f60bd7fa700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f60ac0682f0 0x7f60ac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f60bd7fa700 1 -- 172.21.15.125:0/2952621711 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60b8086470 con 0x7f60c015c000 2023-11-28T11:08:46.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f60c4d88700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f60ac0682f0 0x7f60ac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f60bd7fa700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] conn(0x7f60ac070b20 0x7f60ac072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f60bd7fa700 1 -- 172.21.15.125:0/2952621711 --> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60ac0735e0 con 0x7f60ac070b20 2023-11-28T11:08:46.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f60bd7fa700 1 -- 172.21.15.125:0/2952621711 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60b8088b40 con 0x7f60c015c000 2023-11-28T11:08:46.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f60bffff700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] conn(0x7f60ac070b20 0x7f60ac072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab37f98700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab300ac8f0 0x7fab300abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab37f98700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab300b0540 0x7fab300b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab37f98700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab300cc690 0x7fab300b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab37f98700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab301e7e20 con 0x7fab300cc690 2023-11-28T11:08:46.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab37f98700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab301e72a0 con 0x7fab300ac8f0 2023-11-28T11:08:46.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab37f98700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab301e7580 con 0x7fab300b0540 2023-11-28T11:08:46.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f60bffff700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] conn(0x7f60ac070b20 0x7f60ac072f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab35533700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab300b0540 0x7fab300b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab35533700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab300b0540 0x7fab300b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:51994/0 (socket says 172.21.15.125:51994) 2023-11-28T11:08:46.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab35533700 1 -- 172.21.15.125:0/4038411991 learned_addr learned my addr 172.21.15.125:0/4038411991 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab35d34700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab300ac8f0 0x7fab300abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7ff1cbfff700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff1b80682f0 0x7ff1b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab35533700 1 -- 172.21.15.125:0/4038411991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab300ac8f0 msgr2=0x7fab300abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab35533700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab300ac8f0 0x7fab300abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab35533700 1 -- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab300cc690 msgr2=0x7fab300b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab35533700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab300cc690 0x7fab300b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7fab35533700 1 -- 172.21.15.125:0/4038411991 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c009550 con 0x7fab300b0540 2023-11-28T11:08:46.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7fab35533700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab300b0540 0x7fab300b4170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fab2000b4a0 tx=0x7fab2000b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7fab267fc700 1 -- 172.21.15.125:0/4038411991 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20011830 con 0x7fab300b0540 2023-11-28T11:08:46.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7fab37f98700 1 -- 172.21.15.125:0/4038411991 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab300ad460 con 0x7fab300b0540 2023-11-28T11:08:46.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7fab37f98700 1 -- 172.21.15.125:0/4038411991 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab300ccb00 con 0x7fab300b0540 2023-11-28T11:08:46.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f9e49814700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e440c1a10 0x7f9e44146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f9e49814700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e440c1de0 0x7f9e440b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f9e49814700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e440b3100 0x7f9e44148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f9e49814700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440b1e30 con 0x7f9e440b3100 2023-11-28T11:08:46.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f9e49814700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440b2c70 con 0x7f9e440c1a10 2023-11-28T11:08:46.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f9e49814700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440c2250 con 0x7f9e440c1de0 2023-11-28T11:08:46.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f9e42ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e440c1a10 0x7f9e44146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f9e42ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e440c1a10 0x7f9e44146bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:53712/0 (socket says 172.21.15.125:53712) 2023-11-28T11:08:46.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f9e437fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e440b3100 0x7f9e44148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f9e42ffd700 1 -- 172.21.15.125:0/1165240684 learned_addr learned my addr 172.21.15.125:0/1165240684 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f9e427fc700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e440c1de0 0x7f9e440b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f9e42ffd700 1 -- 172.21.15.125:0/1165240684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e440c1de0 msgr2=0x7f9e440b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f9e42ffd700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e440c1de0 0x7f9e440b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f9e42ffd700 1 -- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e440b3100 msgr2=0x7f9e44148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f9e42ffd700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e440b3100 0x7f9e44148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f9e42ffd700 1 -- 172.21.15.125:0/1165240684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440c9360 con 0x7f9e440c1a10 2023-11-28T11:08:46.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f9e427fc700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e440c1de0 0x7f9e440b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:46.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f9e42ffd700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e440c1a10 0x7f9e44146bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9e38010630 tx=0x7f9e38010940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7f9e2bfff700 1 -- 172.21.15.125:0/1165240684 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e38004020 con 0x7f9e440c1a10 2023-11-28T11:08:46.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.645+0000 7f52a1b94700 1 -- start start 2023-11-28T11:08:46.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7ff1cbfff700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff1b80682f0 0x7ff1b806a7a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009340 tx=0x7ff1bc0092d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7f9e49814700 1 -- 172.21.15.125:0/1165240684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e440cacf0 con 0x7f9e440c1a10 2023-11-28T11:08:46.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7f9e2bfff700 1 -- 172.21.15.125:0/1165240684 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e38004180 con 0x7f9e440c1a10 2023-11-28T11:08:46.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7f9e2bfff700 1 -- 172.21.15.125:0/1165240684 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e38004570 con 0x7f9e440c1a10 2023-11-28T11:08:46.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7f9e49814700 1 -- 172.21.15.125:0/1165240684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e440c9640 con 0x7f9e440c1a10 2023-11-28T11:08:46.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7f60c4d88700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f60ac0682f0 0x7f60ac06a7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009930 tx=0x7f60b400b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7fab37f98700 1 -- 172.21.15.125:0/4038411991 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab300743f0 con 0x7fab300b0540 2023-11-28T11:08:46.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f9e49814700 1 -- 172.21.15.125:0/1165240684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e24000fc0 con 0x7f9e440c1a10 2023-11-28T11:08:46.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.646+0000 7f52a1b94700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f529c160a50 0x7f529c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.647+0000 7f52a1b94700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529c160e20 0x7f529c0cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f52a1b94700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f529c0ae660 0x7f529c06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f52a1b94700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c0ce740 con 0x7f529c160a50 2023-11-28T11:08:46.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f52a1b94700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c071870 con 0x7f529c0ae660 2023-11-28T11:08:46.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f52a1b94700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0af450 con 0x7f529c160e20 2023-11-28T11:08:46.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f5292ffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529c160e20 0x7f529c0cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f5292ffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529c160e20 0x7f529c0cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:52000/0 (socket says 172.21.15.125:52000) 2023-11-28T11:08:46.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f5292ffd700 1 -- 172.21.15.125:0/2293562856 learned_addr learned my addr 172.21.15.125:0/2293562856 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f60bd7fa700 1 -- 172.21.15.125:0/2952621711 <== osd.4 v2:172.21.15.167:6800/103804 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f60ac0735e0 con 0x7f60ac070b20 2023-11-28T11:08:46.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f529b7fe700 1 --2- 172.21.15.125:0/2293562856 >> v2:172.21.15.125:3300/0 conn(0x7f529c160a50 0x7f529c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f529b7fe700 1 -- 172.21.15.125:0/2293562856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529c160e20 msgr2=0x7f529c0cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:46.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f529b7fe700 1 --2- 172.21.15.125:0/2293562856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529c160e20 0x7f529c0cf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f529b7fe700 1 -- 172.21.15.125:0/2293562856 >> v2:172.21.15.167:3300/0 conn(0x7f529c0ae660 msgr2=0x7f529c06c880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:08:46.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f529b7fe700 1 --2- 172.21.15.125:0/2293562856 >> v2:172.21.15.167:3300/0 conn(0x7f529c0ae660 0x7f529c06c880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f529b7fe700 1 -- 172.21.15.125:0/2293562856 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c0712b0 con 0x7f529c160a50 2023-11-28T11:08:46.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7f529b7fe700 1 --2- 172.21.15.125:0/2293562856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529c160a50 0x7f529c070bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f529c0cd710 tx=0x7f528c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7972042d731a4278 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7f529affd700 1 -- 172.21.15.125:0/2293562856 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c00e070 con 0x7f529c160a50 2023-11-28T11:08:46.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7f529affd700 1 -- 172.21.15.125:0/2293562856 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c00bbd0 con 0x7f529c160a50 2023-11-28T11:08:46.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7f529affd700 1 -- 172.21.15.125:0/2293562856 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c012430 con 0x7f529c160a50 2023-11-28T11:08:46.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7f9e2bfff700 1 -- 172.21.15.125:0/1165240684 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9e38012040 con 0x7f9e440c1a10 2023-11-28T11:08:46.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7f52a1b94700 1 -- 172.21.15.125:0/2293562856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529c160a50 msgr2=0x7f529c070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7f52a1b94700 1 --2- 172.21.15.125:0/2293562856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529c160a50 0x7f529c070bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f529c0cd710 tx=0x7f528c00b330 comp rx=0 tx=0).stop 2023-11-28T11:08:46.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f52a1b94700 1 -- 172.21.15.125:0/2293562856 shutdown_connections 2023-11-28T11:08:46.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f52a1b94700 1 --2- 172.21.15.125:0/2293562856 >> v2:172.21.15.167:3300/0 conn(0x7f529c0ae660 0x7f529c06c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f52a1b94700 1 --2- 172.21.15.125:0/2293562856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529c160a50 0x7f529c070bf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f52a1b94700 1 --2- 172.21.15.125:0/2293562856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529c160e20 0x7f529c0cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f52a1b94700 1 -- 172.21.15.125:0/2293562856 >> 172.21.15.125:0/2293562856 conn(0x7f529c06c010 msgr2=0x7f529c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f9e2bfff700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9e300682f0 0x7f9e3006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f9e2bfff700 1 -- 172.21.15.125:0/1165240684 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e38086510 con 0x7f9e440c1a10 2023-11-28T11:08:46.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f9e427fc700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9e300682f0 0x7f9e3006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7fab267fc700 1 -- 172.21.15.125:0/4038411991 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab200119b0 con 0x7fab300b0540 2023-11-28T11:08:46.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7fab267fc700 1 -- 172.21.15.125:0/4038411991 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20011d60 con 0x7fab300b0540 2023-11-28T11:08:46.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f9e2bfff700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] conn(0x7f9e30070ba0 0x7f9e30072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f9e2bfff700 1 -- 172.21.15.125:0/1165240684 --> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e30073660 con 0x7f9e30070ba0 2023-11-28T11:08:46.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f9e2bfff700 1 -- 172.21.15.125:0/1165240684 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e380868c0 con 0x7f9e440c1a10 2023-11-28T11:08:46.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f9e437fe700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] conn(0x7f9e30070ba0 0x7f9e30072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7f9e427fc700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9e300682f0 0x7f9e3006a7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c000f80 tx=0x7f9e3c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.651+0000 7ff1d0baf700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] conn(0x7ff1b8070aa0 0x7ff1b8072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.651+0000 7f9e437fe700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] conn(0x7f9e30070ba0 0x7f9e30072fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.651+0000 7fb36d6ca700 1 Processor -- start 2023-11-28T11:08:46.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.651+0000 7fb36d6ca700 1 -- start start 2023-11-28T11:08:46.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.651+0000 7ff1c8ff9700 1 -- 172.21.15.125:0/1235313271 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1c0053600 con 0x7ff1cc15c680 2023-11-28T11:08:46.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.651+0000 7ff1d0baf700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] conn(0x7ff1b8070aa0 0x7ff1b8072eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7f9e2bfff700 1 -- 172.21.15.125:0/1165240684 <== osd.3 v2:172.21.15.125:6800/103585 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9e30073660 con 0x7f9e30070ba0 2023-11-28T11:08:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7fac59d82700 1 Processor -- start 2023-11-28T11:08:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.648+0000 7fac59d82700 1 -- start start 2023-11-28T11:08:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7fac59d82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac540ae020 0x7fac5406c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7fac59d82700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5408ac20 0x7fac540cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7fac59d82700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac540cb160 con 0x7fac5406c930 2023-11-28T11:08:46.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7fac59d82700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5406b910 con 0x7fac540ae020 2023-11-28T11:08:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7fac59d82700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5406bbf0 con 0x7fac5408ac20 2023-11-28T11:08:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7fac537fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac540ae020 0x7fac5406c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7fac537fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac540ae020 0x7fac5406c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:56998/0 (socket says 172.21.15.125:56998) 2023-11-28T11:08:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.649+0000 7fac537fe700 1 -- 172.21.15.125:0/643823904 learned_addr learned my addr 172.21.15.125:0/643823904 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.650+0000 7fac527fc700 1 -- 172.21.15.125:0/643823904 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813152616 0 0) 0x7fac540cb160 con 0x7fac5406c930 2023-11-28T11:08:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fac527fc700 1 -- 172.21.15.125:0/643823904 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac3c0035b0 con 0x7fac5406c930 2023-11-28T11:08:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7f52a1b94700 1 -- 172.21.15.125:0/2293562856 shutdown_connections 2023-11-28T11:08:46.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7f52a1b94700 1 -- 172.21.15.125:0/2293562856 wait complete. 2023-11-28T11:08:46.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fac537fe700 1 -- 172.21.15.125:0/643823904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5408ac20 msgr2=0x7fac540cc690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:08:46.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fac537fe700 1 --2- 172.21.15.125:0/643823904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5408ac20 0x7fac540cc690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fac537fe700 1 -- 172.21.15.125:0/643823904 >> v1:172.21.15.167:6789/0 conn(0x7fac5406c930 legacy=0x7fac540b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fac537fe700 1 -- 172.21.15.125:0/643823904 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5406bed0 con 0x7fac540ae020 2023-11-28T11:08:46.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fab267fc700 1 -- 172.21.15.125:0/4038411991 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fab20021070 con 0x7fab300b0540 2023-11-28T11:08:46.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fab267fc700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fab140682f0 0x7fab1406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fab267fc700 1 -- 172.21.15.125:0/4038411991 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab200861c0 con 0x7fab300b0540 2023-11-28T11:08:46.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fab267fc700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] conn(0x7fab14070ba0 0x7fab14072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fab267fc700 1 -- 172.21.15.125:0/4038411991 --> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab14073660 con 0x7fab14070ba0 2023-11-28T11:08:46.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fab267fc700 1 -- 172.21.15.125:0/4038411991 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab20086570 con 0x7fab300b0540 2023-11-28T11:08:46.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.653+0000 7fab36535700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] conn(0x7fab14070ba0 0x7fab14072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fac537fe700 1 --2- 172.21.15.125:0/643823904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac540ae020 0x7fac5406c3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac440078e0 tx=0x7fac44007bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ee8c776ad7d13e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fb36d6ca700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb3680b0540 0x7fb3680b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fb36d6ca700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb36815ebb0 0x7fb3680ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fb36d6ca700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36815a8c0 con 0x7fb3680c9e40 2023-11-28T11:08:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fb36d6ca700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3680c9110 con 0x7fb3680b0540 2023-11-28T11:08:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fb36d6ca700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3680ce6a0 con 0x7fb36815ebb0 2023-11-28T11:08:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fb3677fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb3680c9e40 0x7fb36806b770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41136/0 (socket says 172.21.15.125:41136) 2023-11-28T11:08:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7fb3677fe700 1 -- 172.21.15.125:0/1095241468 learned_addr learned my addr 172.21.15.125:0/1095241468 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.653+0000 7fb366ffd700 1 --2- 172.21.15.125:0/1095241468 >> v2:172.21.15.125:3300/0 conn(0x7fb3680b0540 0x7fb3680b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.653+0000 7fab35d34700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fab140682f0 0x7fab1406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.654+0000 7fab36535700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] conn(0x7fab14070ba0 0x7fab14072fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.654+0000 7fab35d34700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fab140682f0 0x7fab1406a7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab2c000c00 tx=0x7fab2c01d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.653+0000 7fb366ffd700 1 -- 172.21.15.125:0/1095241468 >> v2:172.21.15.167:3300/0 conn(0x7fb36815ebb0 msgr2=0x7fb3680ca3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:08:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.653+0000 7fb366ffd700 1 --2- 172.21.15.125:0/1095241468 >> v2:172.21.15.167:3300/0 conn(0x7fb36815ebb0 0x7fb3680ca3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.653+0000 7fb366ffd700 1 -- 172.21.15.125:0/1095241468 >> v1:172.21.15.125:6789/0 conn(0x7fb3680c9e40 legacy=0x7fb36806b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.653+0000 7fb366ffd700 1 -- 172.21.15.125:0/1095241468 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680b0e50 con 0x7fb3680b0540 2023-11-28T11:08:46.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.653+0000 7fb366ffd700 1 --2- 172.21.15.125:0/1095241468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3680b0540 0x7fb3680b0910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb36806d0e0 tx=0x7fb358009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6715160a16612edf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.654+0000 7f52a1b94700 1 Processor -- start 2023-11-28T11:08:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.653+0000 7fac527fc700 1 -- 172.21.15.125:0/643823904 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44004230 con 0x7fac540ae020 2023-11-28T11:08:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.653+0000 7fac527fc700 1 -- 172.21.15.125:0/643823904 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac44004390 con 0x7fac540ae020 2023-11-28T11:08:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.653+0000 7fac527fc700 1 -- 172.21.15.125:0/643823904 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4400a5c0 con 0x7fac540ae020 2023-11-28T11:08:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.654+0000 7fac59d82700 1 -- 172.21.15.125:0/643823904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac540ae020 msgr2=0x7fac5406c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.654+0000 7fac59d82700 1 --2- 172.21.15.125:0/643823904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac540ae020 0x7fac5406c3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac440078e0 tx=0x7fac44007bf0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.654+0000 7f52a1b94700 1 -- start start 2023-11-28T11:08:46.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7fab267fc700 1 -- 172.21.15.125:0/4038411991 <== osd.2 v2:172.21.15.125:6808/103587 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fab14073660 con 0x7fab14070ba0 2023-11-28T11:08:46.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7fac59d82700 1 -- 172.21.15.125:0/643823904 shutdown_connections 2023-11-28T11:08:46.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7fac59d82700 1 --2- 172.21.15.125:0/643823904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac540ae020 0x7fac5406c3f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7fac59d82700 1 --2- 172.21.15.125:0/643823904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5408ac20 0x7fac540cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7fac59d82700 1 -- 172.21.15.125:0/643823904 >> 172.21.15.125:0/643823904 conn(0x7fac5406aed0 msgr2=0x7fac540cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7f52a1b94700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f529c0ae660 0x7f529c1f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7f52a1b94700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529c160a50 0x7f529c0b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7f52a1b94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529c1ece20 0x7f529c0b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7f52a1b94700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0b0c30 con 0x7f529c1ece20 2023-11-28T11:08:46.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7f52a1b94700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0b3580 con 0x7f529c0ae660 2023-11-28T11:08:46.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7f52a1b94700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0b0e80 con 0x7f529c160a50 2023-11-28T11:08:46.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7fac59d82700 1 -- 172.21.15.125:0/643823904 shutdown_connections 2023-11-28T11:08:46.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7f529bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529c1ece20 0x7f529c0b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7f529bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529c1ece20 0x7f529c0b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57022/0 (socket says 172.21.15.125:57022) 2023-11-28T11:08:46.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7f529bfff700 1 -- 172.21.15.125:0/3779612691 learned_addr learned my addr 172.21.15.125:0/3779612691 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.656+0000 7f529bfff700 1 -- 172.21.15.125:0/3779612691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529c160a50 msgr2=0x7f529c0b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.656+0000 7f529bfff700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529c160a50 0x7f529c0b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.656+0000 7f529bfff700 1 -- 172.21.15.125:0/3779612691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f529c0ae660 msgr2=0x7f529c1f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.656+0000 7f529bfff700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f529c0ae660 0x7f529c1f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.656+0000 7f529bfff700 1 -- 172.21.15.125:0/3779612691 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c009a70 con 0x7f529c1ece20 2023-11-28T11:08:46.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.656+0000 7f529bfff700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529c1ece20 0x7f529c0b2c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f529400b4a0 tx=0x7f529400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.652+0000 7ff1c8ff9700 1 -- 172.21.15.125:0/1235313271 <== osd.0 v2:172.21.15.125:6816/103586 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff1b8073560 con 0x7ff1b8070aa0 2023-11-28T11:08:46.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.655+0000 7fac59d82700 1 -- 172.21.15.125:0/643823904 wait complete. 2023-11-28T11:08:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.657+0000 7fac59d82700 1 Processor -- start 2023-11-28T11:08:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.657+0000 7fac59d82700 1 -- start start 2023-11-28T11:08:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac59d82700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5406c930 0x7fac5408a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac59d82700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac540ae020 0x7fac5416b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac59d82700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac54087a40 0x7fac5416beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac59d82700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac540c2820 con 0x7fac54087a40 2023-11-28T11:08:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac59d82700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac541657d0 con 0x7fac540ae020 2023-11-28T11:08:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac59d82700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac54168b90 con 0x7fac5406c930 2023-11-28T11:08:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac53fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac54087a40 0x7fac5416beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac53fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac54087a40 0x7fac5416beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57024/0 (socket says 172.21.15.125:57024) 2023-11-28T11:08:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac53fff700 1 -- 172.21.15.125:0/1948999259 learned_addr learned my addr 172.21.15.125:0/1948999259 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fb365ffb700 1 -- 172.21.15.125:0/1095241468 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358004230 con 0x7fb3680b0540 2023-11-28T11:08:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fb365ffb700 1 -- 172.21.15.125:0/1095241468 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358004390 con 0x7fb3680b0540 2023-11-28T11:08:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fb365ffb700 1 -- 172.21.15.125:0/1095241468 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580036a0 con 0x7fb3680b0540 2023-11-28T11:08:46.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac53fff700 1 -- 172.21.15.125:0/1948999259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5406c930 msgr2=0x7fac5408a3b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:08:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac53fff700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5406c930 0x7fac5408a3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac53fff700 1 -- 172.21.15.125:0/1948999259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac540ae020 msgr2=0x7fac5416b970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:08:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac53fff700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac540ae020 0x7fac5416b970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.658+0000 7fac53fff700 1 -- 172.21.15.125:0/1948999259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440075c0 con 0x7fac54087a40 2023-11-28T11:08:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.659+0000 7fb36d6ca700 1 -- 172.21.15.125:0/1095241468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3680b0540 msgr2=0x7fb3680b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.659+0000 7fb36d6ca700 1 --2- 172.21.15.125:0/1095241468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3680b0540 0x7fb3680b0910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb36806d0e0 tx=0x7fb358009b20 comp rx=0 tx=0).stop 2023-11-28T11:08:46.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.659+0000 7fac53fff700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac54087a40 0x7fac5416beb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c840 tx=0x7fac4c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.659+0000 7fb36d6ca700 1 -- 172.21.15.125:0/1095241468 shutdown_connections 2023-11-28T11:08:46.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.659+0000 7fb36d6ca700 1 --2- 172.21.15.125:0/1095241468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3680b0540 0x7fb3680b0910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.659+0000 7fb36d6ca700 1 --2- 172.21.15.125:0/1095241468 >> v2:172.21.15.167:3300/0 conn(0x7fb36815ebb0 0x7fb3680ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.659+0000 7fb36d6ca700 1 -- 172.21.15.125:0/1095241468 >> 172.21.15.125:0/1095241468 conn(0x7fb36806aed0 msgr2=0x7fb3680cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.659+0000 7fb36d6ca700 1 -- 172.21.15.125:0/1095241468 shutdown_connections 2023-11-28T11:08:46.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.659+0000 7fb36d6ca700 1 -- 172.21.15.125:0/1095241468 wait complete. 2023-11-28T11:08:46.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.661+0000 7fb36d6ca700 1 Processor -- start 2023-11-28T11:08:46.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.661+0000 7fb36d6ca700 1 -- start start 2023-11-28T11:08:46.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.662+0000 7fb36d6ca700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3680b0540 0x7fb3680b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.662+0000 7fb36d6ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3680c9e40 0x7fb36814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.662+0000 7fb36d6ca700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb36815ebb0 0x7fb3680b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.662+0000 7fb36d6ca700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680b3430 con 0x7fb3680c9e40 2023-11-28T11:08:46.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.662+0000 7fb36d6ca700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680b3710 con 0x7fb36815ebb0 2023-11-28T11:08:46.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.662+0000 7fb36d6ca700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680b39f0 con 0x7fb3680b0540 2023-11-28T11:08:46.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.663+0000 7fb3667fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3680c9e40 0x7fb36814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.663+0000 7fb3667fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3680c9e40 0x7fb36814ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57030/0 (socket says 172.21.15.125:57030) 2023-11-28T11:08:46.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.663+0000 7fb3667fc700 1 -- 172.21.15.125:0/3861799517 learned_addr learned my addr 172.21.15.125:0/3861799517 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:46.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.663+0000 7fb3677fe700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb36815ebb0 0x7fb3680b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.663+0000 7fb366ffd700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3680b0540 0x7fb3680b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.663+0000 7fb3677fe700 1 -- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3680b0540 msgr2=0x7fb3680b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.663+0000 7fb3677fe700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3680b0540 0x7fb3680b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.663+0000 7fb3677fe700 1 -- 172.21.15.125:0/3861799517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3680c9e40 msgr2=0x7fb36814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.663+0000 7fb3677fe700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3680c9e40 0x7fb36814ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.663+0000 7fb3677fe700 1 -- 172.21.15.125:0/3861799517 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3580094a0 con 0x7fb36815ebb0 2023-11-28T11:08:46.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.663+0000 7fb3677fe700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb36815ebb0 0x7fb3680b2a50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb360001ff0 tx=0x7fb36000a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.664+0000 7fac3bfff700 1 -- 172.21.15.125:0/1948999259 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c003e30 con 0x7fac54087a40 2023-11-28T11:08:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.664+0000 7fac59d82700 1 -- 172.21.15.125:0/1948999259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac540b0de0 con 0x7fac54087a40 2023-11-28T11:08:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.664+0000 7fac59d82700 1 -- 172.21.15.125:0/1948999259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac540b0c50 con 0x7fac54087a40 2023-11-28T11:08:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.664+0000 7fac3bfff700 1 -- 172.21.15.125:0/1948999259 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c005070 con 0x7fac54087a40 2023-11-28T11:08:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.664+0000 7fac3bfff700 1 -- 172.21.15.125:0/1948999259 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c005400 con 0x7fac54087a40 2023-11-28T11:08:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.668+0000 7fac3bfff700 1 -- 172.21.15.125:0/1948999259 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fac4c010070 con 0x7fac54087a40 2023-11-28T11:08:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.668+0000 7fac3bfff700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac400682f0 0x7fac4006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.668+0000 7fac3bfff700 1 -- 172.21.15.125:0/1948999259 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac4c0859b0 con 0x7fac54087a40 2023-11-28T11:08:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.664+0000 7f5298ff9700 1 -- 172.21.15.125:0/3779612691 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294011830 con 0x7f529c1ece20 2023-11-28T11:08:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.664+0000 7f5298ff9700 1 -- 172.21.15.125:0/3779612691 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294011990 con 0x7f529c1ece20 2023-11-28T11:08:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.664+0000 7f5298ff9700 1 -- 172.21.15.125:0/3779612691 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294011d40 con 0x7f529c1ece20 2023-11-28T11:08:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.664+0000 7f52a1b94700 1 -- 172.21.15.125:0/3779612691 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c0ce970 con 0x7f529c1ece20 2023-11-28T11:08:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.664+0000 7f52a1b94700 1 -- 172.21.15.125:0/3779612691 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c071590 con 0x7f529c1ece20 2023-11-28T11:08:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.668+0000 7f5298ff9700 1 -- 172.21.15.125:0/3779612691 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5294021070 con 0x7f529c1ece20 2023-11-28T11:08:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.668+0000 7f5298ff9700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f527c0682f0 0x7f527c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.668+0000 7f5298ff9700 1 -- 172.21.15.125:0/3779612691 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5294085ba0 con 0x7f529c1ece20 2023-11-28T11:08:46.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.669+0000 7f52a1b94700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x7f529c0b1370 0x7f529c0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.669+0000 7f52a1b94700 1 -- 172.21.15.125:0/3779612691 --> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f529c0743f0 con 0x7f529c0b1370 2023-11-28T11:08:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.669+0000 7fac59d82700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x7fac340015e0 0x7fac34003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.669+0000 7fac59d82700 1 -- 172.21.15.125:0/1948999259 --> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac34006bc0 con 0x7fac340015e0 2023-11-28T11:08:46.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.669+0000 7f5292ffd700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x7f529c0b1370 0x7f529c0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.669+0000 7fac52ffd700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x7fac340015e0 0x7fac34003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.670+0000 7fac537fe700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac400682f0 0x7fac4006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.670+0000 7fac52ffd700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x7fac340015e0 0x7fac34003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.670+0000 7f5292ffd700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x7f529c0b1370 0x7f529c0c4e60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.670+0000 7fb34f7fe700 1 -- 172.21.15.125:0/3861799517 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36000acd0 con 0x7fb36815ebb0 2023-11-28T11:08:46.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.670+0000 7fb34f7fe700 1 -- 172.21.15.125:0/3861799517 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36000ae30 con 0x7fb36815ebb0 2023-11-28T11:08:46.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.670+0000 7fb36d6ca700 1 -- 172.21.15.125:0/3861799517 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3680c9360 con 0x7fb36815ebb0 2023-11-28T11:08:46.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.670+0000 7fb36d6ca700 1 -- 172.21.15.125:0/3861799517 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3680cacf0 con 0x7fb36815ebb0 2023-11-28T11:08:46.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.670+0000 7fb34f7fe700 1 -- 172.21.15.125:0/3861799517 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360007310 con 0x7fb36815ebb0 2023-11-28T11:08:46.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.670+0000 7fac537fe700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac400682f0 0x7fac4006a7a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fac540cd540 tx=0x7fac44012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.671+0000 7f5298ff9700 1 -- 172.21.15.125:0/3779612691 <== osd.7 v2:172.21.15.167:6824/103835 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f529c0743f0 con 0x7f529c0b1370 2023-11-28T11:08:46.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.671+0000 7fac3bfff700 1 -- 172.21.15.125:0/1948999259 <== osd.5 v2:172.21.15.167:6816/103820 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fac34006bc0 con 0x7fac340015e0 2023-11-28T11:08:46.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.673+0000 7f529b7fe700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f527c0682f0 0x7f527c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.674+0000 7f529b7fe700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f527c0682f0 0x7f527c06a7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f528c000f80 tx=0x7f528c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.672+0000 7f52d13c4700 1 -- 172.21.15.125:0/2812891299 --> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f52ac002d40 con 0x7f52b8070b20 2023-11-28T11:08:46.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.673+0000 7f52b37fe700 1 -- 172.21.15.125:0/2812891299 <== osd.1 v2:172.21.15.125:6824/103588 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f52ac002d40 con 0x7f52b8070b20 2023-11-28T11:08:46.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.676+0000 7f60c6fec700 1 -- 172.21.15.125:0/2952621711 --> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f60c00b4a40 con 0x7f60ac070b20 2023-11-28T11:08:46.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.676+0000 7ff1d2612700 1 -- 172.21.15.125:0/1235313271 --> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff1cc0ad230 con 0x7ff1b8070aa0 2023-11-28T11:08:46.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.673+0000 7fb34f7fe700 1 -- 172.21.15.125:0/3861799517 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb36001a030 con 0x7fb36815ebb0 2023-11-28T11:08:46.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.673+0000 7fb34f7fe700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb3540683c0 0x7fb35406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.673+0000 7fb366ffd700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb3540683c0 0x7fb35406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.673+0000 7fb34f7fe700 1 -- 172.21.15.125:0/3861799517 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb360085a30 con 0x7fb36815ebb0 2023-11-28T11:08:46.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.674+0000 7fb366ffd700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb3540683c0 0x7fb35406a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb36806d0e0 tx=0x7fb358008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.675+0000 7fb36d6ca700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x7fb3680b2f90 0x7fb3680709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.675+0000 7fb36d6ca700 1 -- 172.21.15.125:0/3861799517 --> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb36815a8c0 con 0x7fb3680b2f90 2023-11-28T11:08:46.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.676+0000 7fb3667fc700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x7fb3680b2f90 0x7fb3680709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.676+0000 7fb3667fc700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x7fb3680b2f90 0x7fb3680709b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f60bd7fa700 1 -- 172.21.15.125:0/2952621711 <== osd.4 v2:172.21.15.167:6800/103804 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f60c00b4a40 con 0x7f60ac070b20 2023-11-28T11:08:46.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f52d13c4700 1 -- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x7f52b8070b20 msgr2=0x7f52b8072f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f52d13c4700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x7f52b8070b20 0x7f52b8072f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f52d13c4700 1 -- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52b80682f0 msgr2=0x7f52b806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f52d13c4700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52b80682f0 0x7f52b806a7a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f52c0006fd0 tx=0x7f52c0006ba0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f52d13c4700 1 -- 172.21.15.125:0/2812891299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52cc06cdd0 msgr2=0x7f52cc1eda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f52d13c4700 1 --2- 172.21.15.125:0/2812891299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52cc06cdd0 0x7f52cc1eda20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52cc067450 tx=0x7f52bc004750 comp rx=0 tx=0).stop 2023-11-28T11:08:46.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f52cb7fe700 1 -- 172.21.15.125:0/2812891299 reap_dead start 2023-11-28T11:08:46.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f60c6fec700 1 -- 172.21.15.125:0/2952621711 >> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] conn(0x7f60ac070b20 msgr2=0x7f60ac072f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f60c6fec700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] conn(0x7f60ac070b20 0x7f60ac072f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7ff1c8ff9700 1 -- 172.21.15.125:0/1235313271 <== osd.0 v2:172.21.15.125:6816/103586 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff1cc0ad230 con 0x7ff1b8070aa0 2023-11-28T11:08:46.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f60c6fec700 1 -- 172.21.15.125:0/2952621711 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f60ac0682f0 msgr2=0x7f60ac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f60c6fec700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f60ac0682f0 0x7f60ac06a7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009930 tx=0x7f60b400b000 comp rx=0 tx=0).stop 2023-11-28T11:08:46.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f60c6fec700 1 -- 172.21.15.125:0/2952621711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c015c000 msgr2=0x7f60c0163340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7f60c6fec700 1 --2- 172.21.15.125:0/2952621711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60c015c000 0x7f60c0163340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f60c006f6a0 tx=0x7f60b8005980 comp rx=0 tx=0).stop 2023-11-28T11:08:46.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.677+0000 7fb34f7fe700 1 -- 172.21.15.125:0/3861799517 <== osd.6 v2:172.21.15.167:6808/103805 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb36815a8c0 con 0x7fb3680b2f90 2023-11-28T11:08:46.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.678+0000 7ff1d2612700 1 -- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] conn(0x7ff1b8070aa0 msgr2=0x7ff1b8072eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.678+0000 7ff1d2612700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] conn(0x7ff1b8070aa0 0x7ff1b8072eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.678+0000 7ff1d2612700 1 -- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff1b80682f0 msgr2=0x7ff1b806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.678+0000 7ff1d2612700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff1b80682f0 0x7ff1b806a7a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009340 tx=0x7ff1bc0092d0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.678+0000 7ff1d2612700 1 -- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1cc15c680 msgr2=0x7ff1cc15ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.678+0000 7ff1d2612700 1 --2- 172.21.15.125:0/1235313271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1cc15c680 0x7ff1cc15ca50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00090b0 tx=0x7ff1c0004750 comp rx=0 tx=0).stop 2023-11-28T11:08:46.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.678+0000 7ff1d0baf700 1 -- 172.21.15.125:0/1235313271 reap_dead start 2023-11-28T11:08:46.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.678+0000 7ff1d2612700 1 -- 172.21.15.125:0/1235313271 shutdown_connections 2023-11-28T11:08:46.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.678+0000 7ff1d2612700 1 -- 172.21.15.125:0/1235313271 >> 172.21.15.125:0/1235313271 conn(0x7ff1cc0cb540 msgr2=0x7ff1cc06b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.678+0000 7ff1d2612700 1 -- 172.21.15.125:0/1235313271 shutdown_connections 2023-11-28T11:08:46.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.678+0000 7ff1d2612700 1 -- 172.21.15.125:0/1235313271 wait complete. 2023-11-28T11:08:46.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.680+0000 7f52d13c4700 1 -- 172.21.15.125:0/2812891299 shutdown_connections 2023-11-28T11:08:46.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.680+0000 7f52d13c4700 1 -- 172.21.15.125:0/2812891299 >> 172.21.15.125:0/2812891299 conn(0x7f52cc06aed0 msgr2=0x7f52cc0ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.680+0000 7f52d13c4700 1 -- 172.21.15.125:0/2812891299 shutdown_connections 2023-11-28T11:08:46.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.680+0000 7f52d13c4700 1 -- 172.21.15.125:0/2812891299 wait complete. 2023-11-28T11:08:46.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.680+0000 7f60c5589700 1 -- 172.21.15.125:0/2952621711 reap_dead start 2023-11-28T11:08:46.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.686+0000 7f60c6fec700 1 -- 172.21.15.125:0/2952621711 shutdown_connections 2023-11-28T11:08:46.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.686+0000 7f60c6fec700 1 -- 172.21.15.125:0/2952621711 >> 172.21.15.125:0/2952621711 conn(0x7f60c00cb540 msgr2=0x7f60c00713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.686+0000 7f9e49814700 1 -- 172.21.15.125:0/1165240684 --> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e24002d40 con 0x7f9e30070ba0 2023-11-28T11:08:46.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.687+0000 7f9e2bfff700 1 -- 172.21.15.125:0/1165240684 <== osd.3 v2:172.21.15.125:6800/103585 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e24002d40 con 0x7f9e30070ba0 2023-11-28T11:08:46.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.688+0000 7f9e49814700 1 -- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] conn(0x7f9e30070ba0 msgr2=0x7f9e30072fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.688+0000 7f9e49814700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] conn(0x7f9e30070ba0 0x7f9e30072fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.688+0000 7f9e49814700 1 -- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9e300682f0 msgr2=0x7f9e3006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.688+0000 7f9e49814700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9e300682f0 0x7f9e3006a7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c000f80 tx=0x7f9e3c009030 comp rx=0 tx=0).stop 2023-11-28T11:08:46.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.688+0000 7f9e49814700 1 -- 172.21.15.125:0/1165240684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e440c1a10 msgr2=0x7f9e44146bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.688+0000 7f9e49814700 1 --2- 172.21.15.125:0/1165240684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e440c1a10 0x7f9e44146bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9e38010630 tx=0x7f9e38010940 comp rx=0 tx=0).stop 2023-11-28T11:08:46.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.688+0000 7f9e437fe700 1 -- 172.21.15.125:0/1165240684 reap_dead start 2023-11-28T11:08:46.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.688+0000 7f9e49814700 1 -- 172.21.15.125:0/1165240684 shutdown_connections 2023-11-28T11:08:46.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.688+0000 7f9e49814700 1 -- 172.21.15.125:0/1165240684 >> 172.21.15.125:0/1165240684 conn(0x7f9e4406aed0 msgr2=0x7f9e440af240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.689+0000 7fab37f98700 1 -- 172.21.15.125:0/4038411991 --> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab301e76c0 con 0x7fab14070ba0 2023-11-28T11:08:46.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.689+0000 7fab267fc700 1 -- 172.21.15.125:0/4038411991 <== osd.2 v2:172.21.15.125:6808/103587 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fab301e76c0 con 0x7fab14070ba0 2023-11-28T11:08:46.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.690+0000 7fab37f98700 1 -- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] conn(0x7fab14070ba0 msgr2=0x7fab14072fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.690+0000 7fab37f98700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] conn(0x7fab14070ba0 0x7fab14072fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.691+0000 7fab37f98700 1 -- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fab140682f0 msgr2=0x7fab1406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.691+0000 7fab37f98700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fab140682f0 0x7fab1406a7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab2c000c00 tx=0x7fab2c01d040 comp rx=0 tx=0).stop 2023-11-28T11:08:46.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.691+0000 7fab37f98700 1 -- 172.21.15.125:0/4038411991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab300b0540 msgr2=0x7fab300b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.691+0000 7fab37f98700 1 --2- 172.21.15.125:0/4038411991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab300b0540 0x7fab300b4170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fab2000b4a0 tx=0x7fab2000b7b0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.691+0000 7fab36535700 1 -- 172.21.15.125:0/4038411991 reap_dead start 2023-11-28T11:08:46.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.691+0000 7fab37f98700 1 -- 172.21.15.125:0/4038411991 shutdown_connections 2023-11-28T11:08:46.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.691+0000 7fab37f98700 1 -- 172.21.15.125:0/4038411991 >> 172.21.15.125:0/4038411991 conn(0x7fab3006aed0 msgr2=0x7fab300ae420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.731 INFO:teuthology.orchestra.run.smithi125.stdout:55834574857 2023-11-28T11:08:46.732 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T11:08:46.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.693+0000 7f60c6fec700 1 -- 172.21.15.125:0/2952621711 shutdown_connections 2023-11-28T11:08:46.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.693+0000 7fab37f98700 1 -- 172.21.15.125:0/4038411991 shutdown_connections 2023-11-28T11:08:46.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.693+0000 7f60c6fec700 1 -- 172.21.15.125:0/2952621711 wait complete. 2023-11-28T11:08:46.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.695+0000 7fab37f98700 1 -- 172.21.15.125:0/4038411991 wait complete. 2023-11-28T11:08:46.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.697+0000 7f52a1b94700 1 -- 172.21.15.125:0/3779612691 --> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f529c073a60 con 0x7f529c0b1370 2023-11-28T11:08:46.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.698+0000 7f5298ff9700 1 -- 172.21.15.125:0/3779612691 <== osd.7 v2:172.21.15.167:6824/103835 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f529c073a60 con 0x7f529c0b1370 2023-11-28T11:08:46.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.698+0000 7f52a1b94700 1 -- 172.21.15.125:0/3779612691 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x7f529c0b1370 msgr2=0x7f529c0c4e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.698+0000 7f52a1b94700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x7f529c0b1370 0x7f529c0c4e60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.698+0000 7f52a1b94700 1 -- 172.21.15.125:0/3779612691 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f527c0682f0 msgr2=0x7f527c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.698+0000 7f52a1b94700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f527c0682f0 0x7f527c06a7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f528c000f80 tx=0x7f528c010000 comp rx=0 tx=0).stop 2023-11-28T11:08:46.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.698+0000 7f52a1b94700 1 -- 172.21.15.125:0/3779612691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529c1ece20 msgr2=0x7f529c0b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.698+0000 7f52a1b94700 1 --2- 172.21.15.125:0/3779612691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f529c1ece20 0x7f529c0b2c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f529400b4a0 tx=0x7f529400b860 comp rx=0 tx=0).stop 2023-11-28T11:08:46.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.698+0000 7f529bfff700 1 -- 172.21.15.125:0/3779612691 reap_dead start 2023-11-28T11:08:46.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.699+0000 7f52a1b94700 1 -- 172.21.15.125:0/3779612691 shutdown_connections 2023-11-28T11:08:46.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.699+0000 7f52a1b94700 1 -- 172.21.15.125:0/3779612691 >> 172.21.15.125:0/3779612691 conn(0x7f529c06c010 msgr2=0x7f529c162650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.699+0000 7f52a1b94700 1 -- 172.21.15.125:0/3779612691 shutdown_connections 2023-11-28T11:08:46.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.699+0000 7f52a1b94700 1 -- 172.21.15.125:0/3779612691 wait complete. 2023-11-28T11:08:46.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.699+0000 7f9e49814700 1 -- 172.21.15.125:0/1165240684 shutdown_connections 2023-11-28T11:08:46.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.701+0000 7f9e49814700 1 -- 172.21.15.125:0/1165240684 wait complete. 2023-11-28T11:08:46.737 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-11-28T11:08:46.737 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T11:08:46.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.703+0000 7fac59d82700 1 -- 172.21.15.125:0/1948999259 --> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fac34005ca0 con 0x7fac340015e0 2023-11-28T11:08:46.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.704+0000 7fac3bfff700 1 -- 172.21.15.125:0/1948999259 <== osd.5 v2:172.21.15.167:6816/103820 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fac34005ca0 con 0x7fac340015e0 2023-11-28T11:08:46.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.705+0000 7fac59d82700 1 -- 172.21.15.125:0/1948999259 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x7fac340015e0 msgr2=0x7fac34003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.705+0000 7fac59d82700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x7fac340015e0 0x7fac34003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.705+0000 7fac59d82700 1 -- 172.21.15.125:0/1948999259 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac400682f0 msgr2=0x7fac4006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.705+0000 7fac59d82700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac400682f0 0x7fac4006a7a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fac540cd540 tx=0x7fac44012000 comp rx=0 tx=0).stop 2023-11-28T11:08:46.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.705+0000 7fac59d82700 1 -- 172.21.15.125:0/1948999259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac54087a40 msgr2=0x7fac5416beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.705+0000 7fac59d82700 1 --2- 172.21.15.125:0/1948999259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac54087a40 0x7fac5416beb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c840 tx=0x7fac4c00cc00 comp rx=0 tx=0).stop 2023-11-28T11:08:46.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.705+0000 7fac53fff700 1 -- 172.21.15.125:0/1948999259 reap_dead start 2023-11-28T11:08:46.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.708+0000 7fac59d82700 1 -- 172.21.15.125:0/1948999259 shutdown_connections 2023-11-28T11:08:46.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.708+0000 7fac59d82700 1 -- 172.21.15.125:0/1948999259 >> 172.21.15.125:0/1948999259 conn(0x7fac5406aed0 msgr2=0x7fac540b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.707+0000 7fb36d6ca700 1 -- 172.21.15.125:0/3861799517 --> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb3680743f0 con 0x7fb3680b2f90 2023-11-28T11:08:46.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.708+0000 7fac59d82700 1 -- 172.21.15.125:0/1948999259 shutdown_connections 2023-11-28T11:08:46.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.708+0000 7fac59d82700 1 -- 172.21.15.125:0/1948999259 wait complete. 2023-11-28T11:08:46.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.708+0000 7fb34f7fe700 1 -- 172.21.15.125:0/3861799517 <== osd.6 v2:172.21.15.167:6808/103805 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb3680743f0 con 0x7fb3680b2f90 2023-11-28T11:08:46.741 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-11-28T11:08:46.741 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T11:08:46.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.714+0000 7fb36d6ca700 1 -- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x7fb3680b2f90 msgr2=0x7fb3680709b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.714+0000 7fb36d6ca700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x7fb3680b2f90 0x7fb3680709b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.714+0000 7fb36d6ca700 1 -- 172.21.15.125:0/3861799517 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb3540683c0 msgr2=0x7fb35406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.714+0000 7fb36d6ca700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb3540683c0 0x7fb35406a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb36806d0e0 tx=0x7fb358008030 comp rx=0 tx=0).stop 2023-11-28T11:08:46.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.714+0000 7fb36d6ca700 1 -- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb36815ebb0 msgr2=0x7fb3680b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.714+0000 7fb36d6ca700 1 --2- 172.21.15.125:0/3861799517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb36815ebb0 0x7fb3680b2a50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb360001ff0 tx=0x7fb36000a340 comp rx=0 tx=0).stop 2023-11-28T11:08:46.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.714+0000 7fb3677fe700 1 -- 172.21.15.125:0/3861799517 reap_dead start 2023-11-28T11:08:46.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.715+0000 7fb36d6ca700 1 -- 172.21.15.125:0/3861799517 shutdown_connections 2023-11-28T11:08:46.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.715+0000 7fb36d6ca700 1 -- 172.21.15.125:0/3861799517 >> 172.21.15.125:0/3861799517 conn(0x7fb36806aed0 msgr2=0x7fb3680cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.715+0000 7fb36d6ca700 1 -- 172.21.15.125:0/3861799517 shutdown_connections 2023-11-28T11:08:46.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.715+0000 7fb36d6ca700 1 -- 172.21.15.125:0/3861799517 wait complete. 2023-11-28T11:08:46.744 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-11-28T11:08:46.744 INFO:teuthology.orchestra.run.smithi125.stdout:55834574858 2023-11-28T11:08:46.745 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T11:08:46.745 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T11:08:46.746 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-11-28T11:08:46.746 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T11:08:46.747 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-11-28T11:08:46.747 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T11:08:46.748 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-11-28T11:08:46.749 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T11:08:46.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.980+0000 7f0efbf9d700 1 Processor -- start 2023-11-28T11:08:46.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.980+0000 7f0efbf9d700 1 -- start start 2023-11-28T11:08:46.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.981+0000 7f0efbf9d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0ef406d230 0x7f0ef40adf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.981+0000 7f0efbf9d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef406d6c0 con 0x7f0ef4158980 2023-11-28T11:08:46.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.981+0000 7f0efbf9d700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef40ca7f0 con 0x7f0ef40b0c50 2023-11-28T11:08:46.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.981+0000 7f0efbf9d700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef406c700 con 0x7f0ef406d230 2023-11-28T11:08:46.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.982+0000 7f0ef9d39700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0ef4158980 0x7f0ef40b0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41178/0 (socket says 172.21.15.125:41178) 2023-11-28T11:08:46.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.982+0000 7f0ef9d39700 1 -- 172.21.15.125:0/1658116222 learned_addr learned my addr 172.21.15.125:0/1658116222 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:46.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.979+0000 7f5898784700 1 Processor -- start 2023-11-28T11:08:46.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.980+0000 7f5898784700 1 -- start start 2023-11-28T11:08:46.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.981+0000 7f5898784700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5890065ef0 0x7f589006c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.981+0000 7f5898784700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890066360 0x7f589006c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.981+0000 7f5898784700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58900cac90 con 0x7f58900cef30 2023-11-28T11:08:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.981+0000 7f5898784700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589006b0d0 con 0x7f5890065ef0 2023-11-28T11:08:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.981+0000 7f5898784700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58900c2ac0 con 0x7f5890066360 2023-11-28T11:08:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.981+0000 7f5896520700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f58900cef30 0x7f5890164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:43970/0 (socket says 172.21.15.125:43970) 2023-11-28T11:08:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.981+0000 7f5896520700 1 -- 172.21.15.125:0/2005241574 learned_addr learned my addr 172.21.15.125:0/2005241574 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.983+0000 7f5896d21700 1 --2- 172.21.15.125:0/2005241574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890066360 0x7f589006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.983+0000 7f5896d21700 1 -- 172.21.15.125:0/2005241574 >> v2:172.21.15.167:3300/0 conn(0x7f5890065ef0 msgr2=0x7f589006c440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:08:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.983+0000 7f5896d21700 1 --2- 172.21.15.125:0/2005241574 >> v2:172.21.15.167:3300/0 conn(0x7f5890065ef0 0x7f589006c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.983+0000 7f5896d21700 1 -- 172.21.15.125:0/2005241574 >> v1:172.21.15.167:6789/0 conn(0x7f58900cef30 legacy=0x7f5890164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.983+0000 7f5896d21700 1 -- 172.21.15.125:0/2005241574 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589006a270 con 0x7f5890066360 2023-11-28T11:08:46.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.983+0000 7f5896d21700 1 --2- 172.21.15.125:0/2005241574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890066360 0x7f589006c980 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5888009d90 tx=0x7f588800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0179a665ad784e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.983+0000 7faf0d29e700 1 Processor -- start 2023-11-28T11:08:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.983+0000 7faf0d29e700 1 -- start start 2023-11-28T11:08:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.984+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382141981 0 0) 0x7f0ef406d6c0 con 0x7f0ef4158980 2023-11-28T11:08:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.984+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee00035b0 con 0x7f0ef4158980 2023-11-28T11:08:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.984+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231807992 0 0) 0x7f0ef40ca7f0 con 0x7f0ef40b0c50 2023-11-28T11:08:46.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.984+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ef406d6c0 con 0x7f0ef40b0c50 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.984+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1072807796 0 0) 0x7f0ee00035b0 con 0x7f0ef4158980 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.984+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 >> v2:172.21.15.167:3300/0 conn(0x7f0ef406d230 msgr2=0x7f0ef40adf60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.984+0000 7f0ef8d37700 1 --2- 172.21.15.125:0/1658116222 >> v2:172.21.15.167:3300/0 conn(0x7f0ef406d230 0x7f0ef40adf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.984+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 >> v1:172.21.15.167:6789/0 conn(0x7f0ef40b0c50 legacy=0x7f0ef40cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.984+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef40caad0 con 0x7f0ef4158980 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.984+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f0ee40015f0 con 0x7f0ef4158980 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.984+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 >> v1:172.21.15.125:6789/0 conn(0x7f0ef4158980 legacy=0x7f0ef40b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0ef8d37700 1 --2- 172.21.15.125:0/1658116222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee0003b90 0x7f0ee0003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0ef8d37700 1 --2- 172.21.15.125:0/1658116222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee0004850 0x7f0ee0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0ef8d37700 1 --2- 172.21.15.125:0/1658116222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee0005320 0x7f0ee00059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef406c700 con 0x7f0ee0003b90 2023-11-28T11:08:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00061d0 con 0x7f0ee0004850 2023-11-28T11:08:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0006390 con 0x7f0ee0005320 2023-11-28T11:08:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0efa53a700 1 --2- 172.21.15.125:0/1658116222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee0005320 0x7f0ee00059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf0d29e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf0815a590 0x7faf0806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf0d29e700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faf0806cb50 0x7faf0806a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf0d29e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf080cd480 con 0x7faf080b50d0 2023-11-28T11:08:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf0d29e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf080cd760 con 0x7faf0815a590 2023-11-28T11:08:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf0d29e700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf080cda40 con 0x7faf0806cb50 2023-11-28T11:08:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf067fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7faf080b50d0 0x7faf0806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41188/0 (socket says 172.21.15.125:41188) 2023-11-28T11:08:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf067fc700 1 -- 172.21.15.125:0/1096134536 learned_addr learned my addr 172.21.15.125:0/1096134536 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf077fe700 1 --2- 172.21.15.125:0/1096134536 >> v2:172.21.15.167:3300/0 conn(0x7faf0806cb50 0x7faf0806a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf06ffd700 1 --2- 172.21.15.125:0/1096134536 >> v2:172.21.15.125:3300/0 conn(0x7faf0815a590 0x7faf0806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf077fe700 1 -- 172.21.15.125:0/1096134536 >> v2:172.21.15.125:3300/0 conn(0x7faf0815a590 msgr2=0x7faf0806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf077fe700 1 --2- 172.21.15.125:0/1096134536 >> v2:172.21.15.125:3300/0 conn(0x7faf0815a590 0x7faf0806b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7faf077fe700 1 -- 172.21.15.125:0/1096134536 >> v1:172.21.15.125:6789/0 conn(0x7faf080b50d0 legacy=0x7faf0806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7faf077fe700 1 -- 172.21.15.125:0/1096134536 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf080cdd20 con 0x7faf0806cb50 2023-11-28T11:08:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0efa53a700 1 -- 172.21.15.125:0/1658116222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee0004850 msgr2=0x7f0ee0004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:08:46.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0efa53a700 1 --2- 172.21.15.125:0/1658116222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee0004850 0x7f0ee0004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0efa53a700 1 -- 172.21.15.125:0/1658116222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee0003b90 msgr2=0x7f0ee0003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:46.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0efa53a700 1 --2- 172.21.15.125:0/1658116222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee0003b90 0x7f0ee0003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7faf077fe700 1 --2- 172.21.15.125:0/1096134536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf0806cb50 0x7faf0806a350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faf08070170 tx=0x7faf0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8821ed08361bf37e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0efa53a700 1 -- 172.21.15.125:0/1658116222 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00035b0 con 0x7f0ee0005320 2023-11-28T11:08:46.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.985+0000 7f0efa53a700 1 -- 172.21.15.125:0/1658116222 reap_dead start 2023-11-28T11:08:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7f0efa53a700 1 --2- 172.21.15.125:0/1658116222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee0005320 0x7f0ee00059e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00019e0 tx=0x7f0ee0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=497946894c27d090 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7faf05ffb700 1 -- 172.21.15.125:0/1096134536 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000e070 con 0x7faf0806cb50 2023-11-28T11:08:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7faf05ffb700 1 -- 172.21.15.125:0/1096134536 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0000bb20 con 0x7faf0806cb50 2023-11-28T11:08:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7faf05ffb700 1 -- 172.21.15.125:0/1096134536 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00012430 con 0x7faf0806cb50 2023-11-28T11:08:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7faf0d29e700 1 -- 172.21.15.125:0/1096134536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf0806cb50 msgr2=0x7faf0806a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7faf0d29e700 1 --2- 172.21.15.125:0/1096134536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf0806cb50 0x7faf0806a350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faf08070170 tx=0x7faf0000b330 comp rx=0 tx=0).stop 2023-11-28T11:08:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0001480 con 0x7f0ee0005320 2023-11-28T11:08:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef00052d0 con 0x7f0ee0005320 2023-11-28T11:08:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7f0ef8d37700 1 -- 172.21.15.125:0/1658116222 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0003680 con 0x7f0ee0005320 2023-11-28T11:08:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7f0efbf9d700 1 -- 172.21.15.125:0/1658116222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee0005320 msgr2=0x7f0ee00059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7f0efbf9d700 1 --2- 172.21.15.125:0/1658116222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee0005320 0x7f0ee00059e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00019e0 tx=0x7f0ee0005880 comp rx=0 tx=0).stop 2023-11-28T11:08:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7f0efbf9d700 1 -- 172.21.15.125:0/1658116222 shutdown_connections 2023-11-28T11:08:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7f0efbf9d700 1 --2- 172.21.15.125:0/1658116222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee0005320 0x7f0ee00059e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7f0efbf9d700 1 -- 172.21.15.125:0/1658116222 >> 172.21.15.125:0/1658116222 conn(0x7f0ef406aed0 msgr2=0x7f0ef40cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7faf0d29e700 1 -- 172.21.15.125:0/1096134536 shutdown_connections 2023-11-28T11:08:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7faf0d29e700 1 --2- 172.21.15.125:0/1096134536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf0806cb50 0x7faf0806a350 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7faf0d29e700 1 --2- 172.21.15.125:0/1096134536 >> v2:172.21.15.125:3300/0 conn(0x7faf0815a590 0x7faf0806b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7faf0d29e700 1 -- 172.21.15.125:0/1096134536 >> 172.21.15.125:0/1096134536 conn(0x7faf080cf400 msgr2=0x7faf080cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7f589551e700 1 -- 172.21.15.125:0/2005241574 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800e070 con 0x7f5890066360 2023-11-28T11:08:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7f589551e700 1 -- 172.21.15.125:0/2005241574 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588800bbd0 con 0x7f5890066360 2023-11-28T11:08:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.986+0000 7f589551e700 1 -- 172.21.15.125:0/2005241574 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888012430 con 0x7f5890066360 2023-11-28T11:08:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7f5898784700 1 -- 172.21.15.125:0/2005241574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890066360 msgr2=0x7f589006c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7f5898784700 1 --2- 172.21.15.125:0/2005241574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890066360 0x7f589006c980 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5888009d90 tx=0x7f588800b330 comp rx=0 tx=0).stop 2023-11-28T11:08:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7f5898784700 1 -- 172.21.15.125:0/2005241574 shutdown_connections 2023-11-28T11:08:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7f5898784700 1 --2- 172.21.15.125:0/2005241574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890066360 0x7f589006c980 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.987+0000 7f5898784700 1 --2- 172.21.15.125:0/2005241574 >> v2:172.21.15.167:3300/0 conn(0x7f5890065ef0 0x7f589006c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.988+0000 7f5898784700 1 -- 172.21.15.125:0/2005241574 >> 172.21.15.125:0/2005241574 conn(0x7f58900cf400 msgr2=0x7f58900cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.988+0000 7f5898784700 1 -- 172.21.15.125:0/2005241574 shutdown_connections 2023-11-28T11:08:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.988+0000 7f5898784700 1 -- 172.21.15.125:0/2005241574 wait complete. 2023-11-28T11:08:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.988+0000 7faf0d29e700 1 -- 172.21.15.125:0/1096134536 shutdown_connections 2023-11-28T11:08:46.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.988+0000 7f0efbf9d700 1 -- 172.21.15.125:0/1658116222 shutdown_connections 2023-11-28T11:08:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.988+0000 7faf0d29e700 1 -- 172.21.15.125:0/1096134536 wait complete. 2023-11-28T11:08:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.989+0000 7f5898784700 1 Processor -- start 2023-11-28T11:08:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.990+0000 7f5898784700 1 -- start start 2023-11-28T11:08:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.988+0000 7f0efbf9d700 1 -- 172.21.15.125:0/1658116222 wait complete. 2023-11-28T11:08:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.990+0000 7f0efbf9d700 1 Processor -- start 2023-11-28T11:08:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.990+0000 7faf0d29e700 1 Processor -- start 2023-11-28T11:08:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.990+0000 7f0efbf9d700 1 -- start start 2023-11-28T11:08:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.990+0000 7f0efbf9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee0005320 0x7f0ef40cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.990+0000 7f0efbf9d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ef40c4fc0 0x7f0ef41f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.990+0000 7f0efbf9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ef40b3c80 0x7f0ef40cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.990+0000 7f0efbf9d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40c4390 con 0x7f0ee0005320 2023-11-28T11:08:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0efbf9d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40c5430 con 0x7f0ef40b3c80 2023-11-28T11:08:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0efbf9d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef41f62a0 con 0x7f0ef40c4fc0 2023-11-28T11:08:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5898784700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890065ef0 0x7f5890154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5898784700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5890066360 0x7f5890154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5898784700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58900cef30 0x7f589015d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5898784700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58900c4400 con 0x7f5890066360 2023-11-28T11:08:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5898784700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58901627b0 con 0x7f58900cef30 2023-11-28T11:08:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5898784700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5890161f10 con 0x7f5890065ef0 2023-11-28T11:08:47.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0ef9d39700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee0005320 0x7f0ef40cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0ef9d39700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee0005320 0x7f0ef40cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57070/0 (socket says 172.21.15.125:57070) 2023-11-28T11:08:47.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0ef9d39700 1 -- 172.21.15.125:0/4246152848 learned_addr learned my addr 172.21.15.125:0/4246152848 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:47.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0efa53a700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ef40b3c80 0x7f0ef40cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0ef9538700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ef40c4fc0 0x7f0ef41f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5896d21700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58900cef30 0x7f589015d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5896520700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890065ef0 0x7f5890154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5896520700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890065ef0 0x7f5890154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:52080/0 (socket says 172.21.15.125:52080) 2023-11-28T11:08:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5896d21700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58900cef30 0x7f589015d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:53804/0 (socket says 172.21.15.125:53804) 2023-11-28T11:08:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5896520700 1 -- 172.21.15.125:0/2769152301 learned_addr learned my addr 172.21.15.125:0/2769152301 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f5895d1f700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5890066360 0x7f5890154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0efa53a700 1 -- 172.21.15.125:0/4246152848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ef40c4fc0 msgr2=0x7f0ef41f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0efa53a700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ef40c4fc0 0x7f0ef41f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0efa53a700 1 -- 172.21.15.125:0/4246152848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee0005320 msgr2=0x7f0ef40cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0efa53a700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee0005320 0x7f0ef40cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.991+0000 7f0efa53a700 1 -- 172.21.15.125:0/4246152848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef40cb090 con 0x7f0ef40b3c80 2023-11-28T11:08:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7f0ef9538700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ef40c4fc0 0x7f0ef41f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7f0efa53a700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ef40b3c80 0x7f0ef40cd830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ef406f590 tx=0x7f0ef00012b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7f0eea7fc700 1 -- 172.21.15.125:0/4246152848 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0001420 con 0x7f0ef40b3c80 2023-11-28T11:08:47.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7f0eea7fc700 1 -- 172.21.15.125:0/4246152848 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef0018070 con 0x7f0ef40b3c80 2023-11-28T11:08:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7f0eea7fc700 1 -- 172.21.15.125:0/4246152848 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0003e00 con 0x7f0ef40b3c80 2023-11-28T11:08:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7f5895d1f700 1 -- 172.21.15.125:0/2769152301 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890065ef0 msgr2=0x7f5890154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7f5895d1f700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890065ef0 0x7f5890154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7f5895d1f700 1 -- 172.21.15.125:0/2769152301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58900cef30 msgr2=0x7f589015d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7f5895d1f700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58900cef30 0x7f589015d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7f5895d1f700 1 -- 172.21.15.125:0/2769152301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5888009a70 con 0x7f5890066360 2023-11-28T11:08:47.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7f5895d1f700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5890066360 0x7f5890154540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f588c006fd0 tx=0x7f588c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.992+0000 7faf0d29e700 1 -- start start 2023-11-28T11:08:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf0d29e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf0806cb50 0x7faf0816a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf0d29e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf080b50d0 0x7faf0815c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf0d29e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf0815a590 0x7faf080c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf0d29e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0815dcf0 con 0x7faf0815a590 2023-11-28T11:08:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf0d29e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0815d170 con 0x7faf080b50d0 2023-11-28T11:08:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf0d29e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0815d450 con 0x7faf0806cb50 2023-11-28T11:08:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf06ffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf0806cb50 0x7faf0816a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf06ffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf0806cb50 0x7faf0816a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:52086/0 (socket says 172.21.15.125:52086) 2023-11-28T11:08:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf06ffd700 1 -- 172.21.15.125:0/3575364298 learned_addr learned my addr 172.21.15.125:0/3575364298 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:47.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf077fe700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf0815a590 0x7faf080c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf067fc700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf080b50d0 0x7faf0815c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7f5886ffd700 1 -- 172.21.15.125:0/2769152301 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c011830 con 0x7f5890066360 2023-11-28T11:08:47.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7f0efbf9d700 1 -- 172.21.15.125:0/4246152848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef40cadb0 con 0x7f0ef40b3c80 2023-11-28T11:08:47.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7f0efbf9d700 1 -- 172.21.15.125:0/4246152848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef4158d50 con 0x7f0ef40b3c80 2023-11-28T11:08:47.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7f5886ffd700 1 -- 172.21.15.125:0/2769152301 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c011990 con 0x7f5890066360 2023-11-28T11:08:47.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7f5886ffd700 1 -- 172.21.15.125:0/2769152301 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c011d20 con 0x7f5890066360 2023-11-28T11:08:47.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7f5898784700 1 -- 172.21.15.125:0/2769152301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589006a830 con 0x7f5890066360 2023-11-28T11:08:47.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7f5898784700 1 -- 172.21.15.125:0/2769152301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589006a550 con 0x7f5890066360 2023-11-28T11:08:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf06ffd700 1 -- 172.21.15.125:0/3575364298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf080b50d0 msgr2=0x7faf0815c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf06ffd700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf080b50d0 0x7faf0815c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf06ffd700 1 -- 172.21.15.125:0/3575364298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf0815a590 msgr2=0x7faf080c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf06ffd700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf0815a590 0x7faf080c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf06ffd700 1 -- 172.21.15.125:0/3575364298 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf00009a70 con 0x7faf0806cb50 2023-11-28T11:08:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.993+0000 7faf06ffd700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf0806cb50 0x7faf0816a150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faef800e870 tx=0x7faef800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.994+0000 7faeef7fe700 1 -- 172.21.15.125:0/3575364298 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8009590 con 0x7faf0806cb50 2023-11-28T11:08:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.994+0000 7faf0d29e700 1 -- 172.21.15.125:0/3575364298 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0806baf0 con 0x7faf0806cb50 2023-11-28T11:08:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.994+0000 7faf0d29e700 1 -- 172.21.15.125:0/3575364298 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf080ce000 con 0x7faf0806cb50 2023-11-28T11:08:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.994+0000 7f315cc66700 1 Processor -- start 2023-11-28T11:08:47.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.994+0000 7f315cc66700 1 -- start start 2023-11-28T11:08:47.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.996+0000 7faf0d29e700 1 -- 172.21.15.125:0/3575364298 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef4005320 con 0x7faf0806cb50 2023-11-28T11:08:47.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.996+0000 7f5898784700 1 -- 172.21.15.125:0/2769152301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58780052f0 con 0x7f5890066360 2023-11-28T11:08:47.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.996+0000 7f5886ffd700 1 -- 172.21.15.125:0/2769152301 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f588c021070 con 0x7f5890066360 2023-11-28T11:08:47.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.996+0000 7f0efbf9d700 1 -- 172.21.15.125:0/4246152848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef40743f0 con 0x7f0ef40b3c80 2023-11-28T11:08:47.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.996+0000 7f5886ffd700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5874068340 0x7f587406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.996+0000 7f5886ffd700 1 -- 172.21.15.125:0/2769152301 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f588c0858d0 con 0x7f5890066360 2023-11-28T11:08:47.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.997+0000 7faeef7fe700 1 -- 172.21.15.125:0/3575364298 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8013680 con 0x7faf0806cb50 2023-11-28T11:08:47.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.997+0000 7faeef7fe700 1 -- 172.21.15.125:0/3575364298 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80139f0 con 0x7faf0806cb50 2023-11-28T11:08:47.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.996+0000 7f0eea7fc700 1 -- 172.21.15.125:0/4246152848 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0ef0010050 con 0x7f0ef40b3c80 2023-11-28T11:08:47.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.997+0000 7f831a15c700 1 Processor -- start 2023-11-28T11:08:47.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.997+0000 7f0eea7fc700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ed80682d0 0x7f0ed806a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.997+0000 7f0eea7fc700 1 -- 172.21.15.125:0/4246152848 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ef0085f60 con 0x7f0ef40b3c80 2023-11-28T11:08:47.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.997+0000 7f0ef9d39700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ed80682d0 0x7f0ed806a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f315cc66700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f315808a5d0 0x7f315806b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f315cc66700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31580cdac0 0x7f31580b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f315cc66700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31580cac00 con 0x7f31580cdf60 2023-11-28T11:08:47.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f315cc66700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580cc690 con 0x7f31580cdac0 2023-11-28T11:08:47.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f315cc66700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580ce410 con 0x7f315808a5d0 2023-11-28T11:08:47.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f315659c700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f315808a5d0 0x7f315806b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f0ef9d39700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ed80682d0 0x7f0ed806a780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4004ad0 tx=0x7f0ee4001930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f3156d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f31580cdf60 0x7f31580ccae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41214/0 (socket says 172.21.15.125:41214) 2023-11-28T11:08:47.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f3156d9d700 1 -- 172.21.15.125:0/3527528244 learned_addr learned my addr 172.21.15.125:0/3527528244 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:47.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.997+0000 7f831a15c700 1 -- start start 2023-11-28T11:08:47.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f831a15c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8314160c30 0x7f83140ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f831a15c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83140adda0 0x7f83140b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f831a15c700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83140c2460 con 0x7f83140b0d20 2023-11-28T11:08:47.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f831a15c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83140ae210 con 0x7f8314160c30 2023-11-28T11:08:47.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f831a15c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8314161000 con 0x7f83140adda0 2023-11-28T11:08:47.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f3155d9b700 1 --2- 172.21.15.125:0/3527528244 >> v2:172.21.15.125:3300/0 conn(0x7f31580cdac0 0x7f31580b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.998+0000 7f8312ffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83140adda0 0x7f83140b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f8312ffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83140adda0 0x7f83140b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:52102/0 (socket says 172.21.15.125:52102) 2023-11-28T11:08:47.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f8312ffd700 1 -- 172.21.15.125:0/3208669401 learned_addr learned my addr 172.21.15.125:0/3208669401 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:47.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f83137fe700 1 --2- 172.21.15.125:0/3208669401 >> v2:172.21.15.125:3300/0 conn(0x7f8314160c30 0x7f83140ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f3155d9b700 1 -- 172.21.15.125:0/3527528244 >> v2:172.21.15.167:3300/0 conn(0x7f315808a5d0 msgr2=0x7f315806b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:47.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f3155d9b700 1 --2- 172.21.15.125:0/3527528244 >> v2:172.21.15.167:3300/0 conn(0x7f315808a5d0 0x7f315806b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f3155d9b700 1 -- 172.21.15.125:0/3527528244 >> v1:172.21.15.125:6789/0 conn(0x7f31580cdf60 legacy=0x7f31580ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f3155d9b700 1 -- 172.21.15.125:0/3527528244 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31580caeb0 con 0x7f31580cdac0 2023-11-28T11:08:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7faeef7fe700 1 -- 172.21.15.125:0/3575364298 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7faef8019030 con 0x7faf0806cb50 2023-11-28T11:08:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f83137fe700 1 -- 172.21.15.125:0/3208669401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83140adda0 msgr2=0x7f83140b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f83137fe700 1 --2- 172.21.15.125:0/3208669401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83140adda0 0x7f83140b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f83137fe700 1 -- 172.21.15.125:0/3208669401 >> v1:172.21.15.167:6789/0 conn(0x7f83140b0d20 legacy=0x7f83140cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f83137fe700 1 -- 172.21.15.125:0/3208669401 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831406b770 con 0x7f8314160c30 2023-11-28T11:08:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f3155d9b700 1 --2- 172.21.15.125:0/3527528244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31580cdac0 0x7f31580b0540 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f315806b550 tx=0x7f3148009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c25f2556dfb21ec server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:46.999+0000 7f83137fe700 1 --2- 172.21.15.125:0/3208669401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8314160c30 0x7f83140ad860 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8304009840 tx=0x7f8304009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90da3580887698c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.000+0000 7faeef7fe700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faef0068410 0x7faef006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.000+0000 7faf067fc700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faef0068410 0x7faef006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.000+0000 7f5896520700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5874068340 0x7f587406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.000+0000 7faeef7fe700 1 -- 172.21.15.125:0/3575364298 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faef8086150 con 0x7faf0806cb50 2023-11-28T11:08:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.000+0000 7f8ffb878700 1 Processor -- start 2023-11-28T11:08:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.001+0000 7faf067fc700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faef0068410 0x7faef006a8c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf080cb6f0 tx=0x7faefc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.001+0000 7f8ffb878700 1 -- start start 2023-11-28T11:08:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.001+0000 7f5896520700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5874068340 0x7f587406a7f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5880004ed0 tx=0x7f5880001080 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.002+0000 7f8ffb878700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8ff4158980 0x7f8ff40ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.002+0000 7f8ffb878700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ff40ccda0 0x7f8ff406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.002+0000 7f8ffb878700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff40cdf00 con 0x7f8ff4158d50 2023-11-28T11:08:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.002+0000 7f8ffb878700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff406d170 con 0x7f8ff4158980 2023-11-28T11:08:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.002+0000 7f8ffb878700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff40ce8d0 con 0x7f8ff40ccda0 2023-11-28T11:08:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.002+0000 7f0eea7fc700 1 -- 172.21.15.125:0/4246152848 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0ef00526d0 con 0x7f0ef40b3c80 2023-11-28T11:08:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.002+0000 7f8ff9e15700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ff40ccda0 0x7f8ff406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.002+0000 7f8ff9e15700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ff40ccda0 0x7f8ff406b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:53834/0 (socket says 172.21.15.125:53834) 2023-11-28T11:08:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.002+0000 7f8ff9e15700 1 -- 172.21.15.125:0/183153237 learned_addr learned my addr 172.21.15.125:0/183153237 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.003+0000 7f8ff9e15700 1 -- 172.21.15.125:0/183153237 >> v2:172.21.15.125:3300/0 conn(0x7f8ff4158980 msgr2=0x7f8ff40ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.003+0000 7f8ff9e15700 1 --2- 172.21.15.125:0/183153237 >> v2:172.21.15.125:3300/0 conn(0x7f8ff4158980 0x7f8ff40ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.003+0000 7f8ff9e15700 1 -- 172.21.15.125:0/183153237 >> v1:172.21.15.167:6789/0 conn(0x7f8ff4158d50 legacy=0x7f8ff40cc690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:08:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.003+0000 7f8ff9e15700 1 -- 172.21.15.125:0/183153237 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff40c9110 con 0x7f8ff40ccda0 2023-11-28T11:08:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.003+0000 7f8ff9e15700 1 --2- 172.21.15.125:0/183153237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ff40ccda0 0x7f8ff406b770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00af60 tx=0x7f8fec00af90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a35dd4223caf6c97 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.003+0000 7faeef7fe700 1 -- 172.21.15.125:0/3575364298 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7faef8056480 con 0x7faf0806cb50 2023-11-28T11:08:47.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.003+0000 7f8febfff700 1 -- 172.21.15.125:0/183153237 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec00f070 con 0x7f8ff40ccda0 2023-11-28T11:08:47.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.003+0000 7f8febfff700 1 -- 172.21.15.125:0/183153237 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec00a2e0 con 0x7f8ff40ccda0 2023-11-28T11:08:47.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.003+0000 7f8febfff700 1 -- 172.21.15.125:0/183153237 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec003c60 con 0x7f8ff40ccda0 2023-11-28T11:08:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f8ffb878700 1 -- 172.21.15.125:0/183153237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ff40ccda0 msgr2=0x7f8ff406b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f8ffb878700 1 --2- 172.21.15.125:0/183153237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ff40ccda0 0x7f8ff406b770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00af60 tx=0x7f8fec00af90 comp rx=0 tx=0).stop 2023-11-28T11:08:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f8ffb878700 1 -- 172.21.15.125:0/183153237 shutdown_connections 2023-11-28T11:08:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f8ffb878700 1 --2- 172.21.15.125:0/183153237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ff40ccda0 0x7f8ff406b770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f8ffb878700 1 --2- 172.21.15.125:0/183153237 >> v2:172.21.15.125:3300/0 conn(0x7f8ff4158980 0x7f8ff40ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f8ffb878700 1 -- 172.21.15.125:0/183153237 >> 172.21.15.125:0/183153237 conn(0x7f8ff40cb540 msgr2=0x7f8ff40cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.005+0000 7f8ffb878700 1 -- 172.21.15.125:0/183153237 shutdown_connections 2023-11-28T11:08:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.005+0000 7f8ffb878700 1 -- 172.21.15.125:0/183153237 wait complete. 2023-11-28T11:08:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.006+0000 7f8ffb878700 1 Processor -- start 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.007+0000 7f8ffb878700 1 -- start start 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.007+0000 7f8ffb878700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ff40ccda0 0x7f8ff41f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.007+0000 7f8ffb878700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff4158980 0x7f8ff40acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.007+0000 7f8ffb878700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ff4154540 0x7f8ff41549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.007+0000 7f8ffb878700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff41f5f10 con 0x7f8ff4158980 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.007+0000 7f8ffb878700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff41f6490 con 0x7f8ff40ccda0 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.007+0000 7f8ffb878700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff41f6e60 con 0x7f8ff4154540 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8ff8e13700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff4158980 0x7f8ff40acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8ff8e13700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff4158980 0x7f8ff40acb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57110/0 (socket says 172.21.15.125:57110) 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8ff8e13700 1 -- 172.21.15.125:0/2358785430 learned_addr learned my addr 172.21.15.125:0/2358785430 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8ff9e15700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ff4154540 0x7f8ff41549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8ff8e13700 1 -- 172.21.15.125:0/2358785430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ff4154540 msgr2=0x7f8ff41549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8ff8e13700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ff4154540 0x7f8ff41549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8ff8e13700 1 -- 172.21.15.125:0/2358785430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ff40ccda0 msgr2=0x7f8ff41f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8ff8e13700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ff40ccda0 0x7f8ff41f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8ff8e13700 1 -- 172.21.15.125:0/2358785430 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec00ac40 con 0x7f8ff4158980 2023-11-28T11:08:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8ff8e13700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff4158980 0x7f8ff40acb60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000b4d0 tx=0x7f8ff000b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8fe9ffb700 1 -- 172.21.15.125:0/2358785430 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0011830 con 0x7f8ff4158980 2023-11-28T11:08:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8fe9ffb700 1 -- 172.21.15.125:0/2358785430 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff00119b0 con 0x7f8ff4158980 2023-11-28T11:08:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8ffb878700 1 -- 172.21.15.125:0/2358785430 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff40cd8b0 con 0x7f8ff4158980 2023-11-28T11:08:47.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.008+0000 7f8fe9ffb700 1 -- 172.21.15.125:0/2358785430 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0011d60 con 0x7f8ff4158980 2023-11-28T11:08:47.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.003+0000 7f5886ffd700 1 -- 172.21.15.125:0/2769152301 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f588c0521d0 con 0x7f5890066360 2023-11-28T11:08:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.009+0000 7f8ffb878700 1 -- 172.21.15.125:0/2358785430 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff40c93f0 con 0x7f8ff4158980 2023-11-28T11:08:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.011+0000 7f8fe9ffb700 1 -- 172.21.15.125:0/2358785430 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8ff000f050 con 0x7f8ff4158980 2023-11-28T11:08:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.011+0000 7f8fe9ffb700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8fd80682f0 0x7f8fd806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.011+0000 7f8fe9ffb700 1 -- 172.21.15.125:0/2358785430 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ff0089170 con 0x7f8ff4158980 2023-11-28T11:08:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f315559a700 1 -- 172.21.15.125:0/3527528244 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148011830 con 0x7f31580cdac0 2023-11-28T11:08:47.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f315559a700 1 -- 172.21.15.125:0/3527528244 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3148011990 con 0x7f31580cdac0 2023-11-28T11:08:47.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f315559a700 1 -- 172.21.15.125:0/3527528244 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148011d00 con 0x7f31580cdac0 2023-11-28T11:08:47.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.010+0000 7f315cc66700 1 -- 172.21.15.125:0/3527528244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31580cdac0 msgr2=0x7f31580b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.010+0000 7f315cc66700 1 --2- 172.21.15.125:0/3527528244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31580cdac0 0x7f31580b0540 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f315806b550 tx=0x7f3148009b20 comp rx=0 tx=0).stop 2023-11-28T11:08:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f83127fc700 1 -- 172.21.15.125:0/3208669401 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304011830 con 0x7f8314160c30 2023-11-28T11:08:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f83127fc700 1 -- 172.21.15.125:0/3208669401 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8304011990 con 0x7f8314160c30 2023-11-28T11:08:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f83127fc700 1 -- 172.21.15.125:0/3208669401 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304011d20 con 0x7f8314160c30 2023-11-28T11:08:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f831a15c700 1 -- 172.21.15.125:0/3208669401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8314160c30 msgr2=0x7f83140ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.004+0000 7f831a15c700 1 --2- 172.21.15.125:0/3208669401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8314160c30 0x7f83140ad860 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8304009840 tx=0x7f8304009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.012+0000 7f831a15c700 1 -- 172.21.15.125:0/3208669401 shutdown_connections 2023-11-28T11:08:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.012+0000 7f831a15c700 1 --2- 172.21.15.125:0/3208669401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8314160c30 0x7f83140ad860 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.012+0000 7f831a15c700 1 --2- 172.21.15.125:0/3208669401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83140adda0 0x7f83140b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.012+0000 7f831a15c700 1 -- 172.21.15.125:0/3208669401 >> 172.21.15.125:0/3208669401 conn(0x7f83140cb540 msgr2=0x7f83140cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.012+0000 7f8ff9614700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8fd80682f0 0x7f8fd806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.012+0000 7f8ff9614700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8fd80682f0 0x7f8fd806a7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8ff41f5e70 tx=0x7f8fe4006c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.015+0000 7f8ffb878700 1 -- 172.21.15.125:0/2358785430 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff40cdb70 con 0x7f8ff4158980 2023-11-28T11:08:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.012+0000 7f172ac48700 1 Processor -- start 2023-11-28T11:08:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.012+0000 7f172ac48700 1 -- start start 2023-11-28T11:08:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.013+0000 7f172ac48700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17241609c0 0x7f17240ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.013+0000 7f172ac48700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17240b0c50 0x7f172406bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.013+0000 7f172ac48700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17240cc690 con 0x7f172406cdd0 2023-11-28T11:08:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.013+0000 7f172ac48700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240cc8c0 con 0x7f17240b0c50 2023-11-28T11:08:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.013+0000 7f172ac48700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17240caa30 con 0x7f17241609c0 2023-11-28T11:08:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.013+0000 7f1723fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f172406cdd0 0x7f17240b0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41240/0 (socket says 172.21.15.125:41240) 2023-11-28T11:08:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.013+0000 7f1723fff700 1 -- 172.21.15.125:0/2353329601 learned_addr learned my addr 172.21.15.125:0/2353329601 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.013+0000 7f17291e5700 1 --2- 172.21.15.125:0/2353329601 >> v2:172.21.15.125:3300/0 conn(0x7f17240b0c50 0x7f172406bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.013+0000 7f17289e4700 1 --2- 172.21.15.125:0/2353329601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17241609c0 0x7f17240ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.013+0000 7f17291e5700 1 -- 172.21.15.125:0/2353329601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17241609c0 msgr2=0x7f17240ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.013+0000 7f17291e5700 1 --2- 172.21.15.125:0/2353329601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17241609c0 0x7f17240ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.014+0000 7f17291e5700 1 -- 172.21.15.125:0/2353329601 >> v1:172.21.15.125:6789/0 conn(0x7f172406cdd0 legacy=0x7f17240b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.014+0000 7f17237fe700 1 -- 172.21.15.125:0/2353329601 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370120329 0 0) 0x7f17240cc690 con 0x7f172406cdd0 2023-11-28T11:08:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.014+0000 7f17291e5700 1 -- 172.21.15.125:0/2353329601 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240cad10 con 0x7f17240b0c50 2023-11-28T11:08:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.014+0000 7f17291e5700 1 --2- 172.21.15.125:0/2353329601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17240b0c50 0x7f172406bd30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1714009840 tx=0x7f1714009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce8fa48136ee58c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.014+0000 7f17237fe700 1 -- 172.21.15.125:0/2353329601 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714011830 con 0x7f17240b0c50 2023-11-28T11:08:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.014+0000 7f17237fe700 1 -- 172.21.15.125:0/2353329601 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1714011990 con 0x7f17240b0c50 2023-11-28T11:08:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.014+0000 7f17237fe700 1 -- 172.21.15.125:0/2353329601 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714011d20 con 0x7f17240b0c50 2023-11-28T11:08:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.015+0000 7f172ac48700 1 -- 172.21.15.125:0/2353329601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17240b0c50 msgr2=0x7f172406bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.015+0000 7f172ac48700 1 --2- 172.21.15.125:0/2353329601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17240b0c50 0x7f172406bd30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1714009840 tx=0x7f1714009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.015+0000 7f172ac48700 1 -- 172.21.15.125:0/2353329601 shutdown_connections 2023-11-28T11:08:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.015+0000 7f172ac48700 1 --2- 172.21.15.125:0/2353329601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17240b0c50 0x7f172406bd30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.015+0000 7f172ac48700 1 --2- 172.21.15.125:0/2353329601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17241609c0 0x7f17240ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.015+0000 7f172ac48700 1 -- 172.21.15.125:0/2353329601 >> 172.21.15.125:0/2353329601 conn(0x7f172406aed0 msgr2=0x7f17240cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.015+0000 7f172ac48700 1 -- 172.21.15.125:0/2353329601 shutdown_connections 2023-11-28T11:08:47.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.015+0000 7f172ac48700 1 -- 172.21.15.125:0/2353329601 wait complete. 2023-11-28T11:08:47.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.016+0000 7f315cc66700 1 -- 172.21.15.125:0/3527528244 shutdown_connections 2023-11-28T11:08:47.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.016+0000 7f315cc66700 1 --2- 172.21.15.125:0/3527528244 >> v2:172.21.15.167:3300/0 conn(0x7f315808a5d0 0x7f315806b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.016+0000 7f315cc66700 1 --2- 172.21.15.125:0/3527528244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31580cdac0 0x7f31580b0540 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.016+0000 7f315cc66700 1 -- 172.21.15.125:0/3527528244 >> 172.21.15.125:0/3527528244 conn(0x7f315806aed0 msgr2=0x7f31580cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.016+0000 7f315cc66700 1 -- 172.21.15.125:0/3527528244 shutdown_connections 2023-11-28T11:08:47.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.016+0000 7f315cc66700 1 -- 172.21.15.125:0/3527528244 wait complete. 2023-11-28T11:08:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.016+0000 7f831a15c700 1 -- 172.21.15.125:0/3208669401 shutdown_connections 2023-11-28T11:08:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.016+0000 7f831a15c700 1 -- 172.21.15.125:0/3208669401 wait complete. 2023-11-28T11:08:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.018+0000 7f315cc66700 1 Processor -- start 2023-11-28T11:08:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.018+0000 7f315cc66700 1 -- start start 2023-11-28T11:08:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.017+0000 7f172ac48700 1 Processor -- start 2023-11-28T11:08:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.017+0000 7f172ac48700 1 -- start start 2023-11-28T11:08:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.018+0000 7f831a15c700 1 Processor -- start 2023-11-28T11:08:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.018+0000 7f172ac48700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f172406cdd0 0x7f17240c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.018+0000 7f172ac48700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17240b0c50 0x7f17240c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.018+0000 7f172ac48700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241609c0 0x7f172406fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.018+0000 7f172ac48700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1724071760 con 0x7f17241609c0 2023-11-28T11:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.018+0000 7f172ac48700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1724070b50 con 0x7f17240b0c50 2023-11-28T11:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.018+0000 7f172ac48700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1724070e30 con 0x7f172406cdd0 2023-11-28T11:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f17291e5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241609c0 0x7f172406fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f17291e5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241609c0 0x7f172406fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57120/0 (socket says 172.21.15.125:57120) 2023-11-28T11:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f17291e5700 1 -- 172.21.15.125:0/274658920 learned_addr learned my addr 172.21.15.125:0/274658920 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f17289e4700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f172406cdd0 0x7f17240c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f17291e5700 1 -- 172.21.15.125:0/274658920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f172406cdd0 msgr2=0x7f17240c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f17291e5700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f172406cdd0 0x7f17240c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f17291e5700 1 -- 172.21.15.125:0/274658920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17240b0c50 msgr2=0x7f17240c42a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:08:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f17291e5700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17240b0c50 0x7f17240c42a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f17291e5700 1 -- 172.21.15.125:0/274658920 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17140094a0 con 0x7f17241609c0 2023-11-28T11:08:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f17289e4700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f172406cdd0 0x7f17240c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:08:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f17291e5700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241609c0 0x7f172406fe30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17140090b0 tx=0x7f1714004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f315cc66700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f315808a5d0 0x7f31580894a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f315cc66700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31580cdac0 0x7f31580c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f315cc66700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31580cdf60 0x7f3158202b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f315cc66700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b4180 con 0x7f31580cdf60 2023-11-28T11:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f315cc66700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3158168a10 con 0x7f31580cdac0 2023-11-28T11:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f315cc66700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3158168730 con 0x7f315808a5d0 2023-11-28T11:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f3155d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31580cdac0 0x7f31580c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f3156d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31580cdf60 0x7f3158202b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f3155d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31580cdac0 0x7f31580c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:53858/0 (socket says 172.21.15.125:53858) 2023-11-28T11:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f3155d9b700 1 -- 172.21.15.125:0/3873301506 learned_addr learned my addr 172.21.15.125:0/3873301506 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f3156d9d700 1 -- 172.21.15.125:0/3873301506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f315808a5d0 msgr2=0x7f31580894a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T11:08:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f3156d9d700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f315808a5d0 0x7f31580894a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f3156d9d700 1 -- 172.21.15.125:0/3873301506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31580cdac0 msgr2=0x7f31580c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f3156d9d700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31580cdac0 0x7f31580c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f3156d9d700 1 -- 172.21.15.125:0/3873301506 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31480094a0 con 0x7f31580cdf60 2023-11-28T11:08:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.018+0000 7f831a15c700 1 -- start start 2023-11-28T11:08:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f831a15c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83140adda0 0x7f83140c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.019+0000 7f831a15c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83140b0d20 0x7f83140c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f831a15c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8314160c30 0x7f83140ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f831a15c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83140b38d0 con 0x7f8314160c30 2023-11-28T11:08:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f831a15c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83140c60d0 con 0x7f83140b0d20 2023-11-28T11:08:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f831a15c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83140b3250 con 0x7f83140adda0 2023-11-28T11:08:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f83137fe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83140adda0 0x7f83140c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f8312ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83140b0d20 0x7f83140c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f8312ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83140b0d20 0x7f83140c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:53862/0 (socket says 172.21.15.125:53862) 2023-11-28T11:08:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f8312ffd700 1 -- 172.21.15.125:0/2321405085 learned_addr learned my addr 172.21.15.125:0/2321405085 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f8313fff700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8314160c30 0x7f83140ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.020+0000 7f3156d9d700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31580cdf60 0x7f3158202b40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c3c0 tx=0x7f314c00c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.021+0000 7f8313fff700 1 -- 172.21.15.125:0/2321405085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83140adda0 msgr2=0x7f83140c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.021+0000 7f8313fff700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83140adda0 0x7f83140c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.021+0000 7f8313fff700 1 -- 172.21.15.125:0/2321405085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83140b0d20 msgr2=0x7f83140c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.021+0000 7f8313fff700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83140b0d20 0x7f83140c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.021+0000 7f8313fff700 1 -- 172.21.15.125:0/2321405085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83040094a0 con 0x7f8314160c30 2023-11-28T11:08:47.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.021+0000 7f8313fff700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8314160c30 0x7f83140ca660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f830c00cb90 tx=0x7f830c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.022+0000 7f3146ffd700 1 -- 172.21.15.125:0/3873301506 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c005d70 con 0x7f31580cdf60 2023-11-28T11:08:47.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.022+0000 7f315cc66700 1 -- 172.21.15.125:0/3873301506 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31580ae1d0 con 0x7f31580cdf60 2023-11-28T11:08:47.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.022+0000 7f315cc66700 1 -- 172.21.15.125:0/3873301506 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31580cb190 con 0x7f31580cdf60 2023-11-28T11:08:47.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.022+0000 7f8fe9ffb700 1 -- 172.21.15.125:0/2358785430 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8ff008a060 con 0x7f8ff4158980 2023-11-28T11:08:47.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.022+0000 7f3146ffd700 1 -- 172.21.15.125:0/3873301506 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c00ce90 con 0x7f31580cdf60 2023-11-28T11:08:47.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.022+0000 7f3146ffd700 1 -- 172.21.15.125:0/3873301506 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c0072d0 con 0x7f31580cdf60 2023-11-28T11:08:47.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.023+0000 7f315cc66700 1 -- 172.21.15.125:0/3873301506 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313c0052f0 con 0x7f31580cdf60 2023-11-28T11:08:47.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.024+0000 7f82fbfff700 1 -- 172.21.15.125:0/2321405085 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00ab10 con 0x7f8314160c30 2023-11-28T11:08:47.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.024+0000 7f82fbfff700 1 -- 172.21.15.125:0/2321405085 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c00ac70 con 0x7f8314160c30 2023-11-28T11:08:47.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.024+0000 7f82fbfff700 1 -- 172.21.15.125:0/2321405085 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c012420 con 0x7f8314160c30 2023-11-28T11:08:47.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.024+0000 7f831a15c700 1 -- 172.21.15.125:0/2321405085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8314164a90 con 0x7f8314160c30 2023-11-28T11:08:47.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.024+0000 7f831a15c700 1 -- 172.21.15.125:0/2321405085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83141647b0 con 0x7f8314160c30 2023-11-28T11:08:47.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.025+0000 7f3146ffd700 1 -- 172.21.15.125:0/3873301506 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f314c019030 con 0x7f31580cdf60 2023-11-28T11:08:47.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.025+0000 7f3146ffd700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3140068460 0x7f314006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.025+0000 7f3146ffd700 1 -- 172.21.15.125:0/3873301506 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f314c0854b0 con 0x7f31580cdf60 2023-11-28T11:08:47.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.026+0000 7f831a15c700 1 -- 172.21.15.125:0/2321405085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8300005320 con 0x7f8314160c30 2023-11-28T11:08:47.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.030+0000 7f3146ffd700 1 -- 172.21.15.125:0/3873301506 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f314c051e60 con 0x7f31580cdf60 2023-11-28T11:08:47.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.030+0000 7f17217fa700 1 -- 172.21.15.125:0/274658920 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140045f0 con 0x7f17241609c0 2023-11-28T11:08:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.030+0000 7f17217fa700 1 -- 172.21.15.125:0/274658920 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171401f070 con 0x7f17241609c0 2023-11-28T11:08:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.030+0000 7f17217fa700 1 -- 172.21.15.125:0/274658920 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714003b00 con 0x7f17241609c0 2023-11-28T11:08:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.031+0000 7f82fbfff700 1 -- 172.21.15.125:0/2321405085 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f830c010050 con 0x7f8314160c30 2023-11-28T11:08:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.031+0000 7f82fbfff700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f82fc068410 0x7f82fc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.031+0000 7f82fbfff700 1 -- 172.21.15.125:0/2321405085 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f830c0862e0 con 0x7f8314160c30 2023-11-28T11:08:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.033+0000 7f315659c700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3140068460 0x7f314006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.033+0000 7f172ac48700 1 -- 172.21.15.125:0/274658920 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17240cb2d0 con 0x7f17241609c0 2023-11-28T11:08:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.033+0000 7f172ac48700 1 -- 172.21.15.125:0/274658920 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17240caff0 con 0x7f17241609c0 2023-11-28T11:08:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.033+0000 7f83137fe700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f82fc068410 0x7f82fc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.034+0000 7f315659c700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3140068460 0x7f314006a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3150009fa0 tx=0x7f315000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.034+0000 7f83137fe700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f82fc068410 0x7f82fc06a8c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83040090b0 tx=0x7f8304008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.035+0000 7f172ac48700 1 -- 172.21.15.125:0/274658920 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172406b810 con 0x7f17241609c0 2023-11-28T11:08:47.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.035+0000 7f102febc700 1 Processor -- start 2023-11-28T11:08:47.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.035+0000 7f82fbfff700 1 -- 172.21.15.125:0/2321405085 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f830c056610 con 0x7f8314160c30 2023-11-28T11:08:47.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.043+0000 7f17217fa700 1 -- 172.21.15.125:0/274658920 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f171400f050 con 0x7f17241609c0 2023-11-28T11:08:47.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.043+0000 7f17217fa700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f17100683c0 0x7f171006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.043+0000 7f17217fa700 1 -- 172.21.15.125:0/274658920 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1714021070 con 0x7f17241609c0 2023-11-28T11:08:47.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.036+0000 7f102febc700 1 -- start start 2023-11-28T11:08:47.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.037+0000 7f102febc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f102815a5f0 0x7f10280d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.037+0000 7f102febc700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f10280cc200 0x7f10280b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.038+0000 7f102febc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10280b2d10 0x7f102815e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.038+0000 7f102febc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10280b3190 con 0x7f102815a5f0 2023-11-28T11:08:47.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.038+0000 7f102febc700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102815a9c0 con 0x7f10280cc200 2023-11-28T11:08:47.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.038+0000 7f102febc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10280c7b80 con 0x7f10280b2d10 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.038+0000 7f102e459700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10280b2d10 0x7f102815e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.041+0000 7f102dc58700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f102815a5f0 0x7f10280d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.041+0000 7f102dc58700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f102815a5f0 0x7f10280d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57140/0 (socket says 172.21.15.125:57140) 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.041+0000 7f102dc58700 1 -- 172.21.15.125:0/437787106 learned_addr learned my addr 172.21.15.125:0/437787106 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.046+0000 7f102dc58700 1 -- 172.21.15.125:0/437787106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10280b2d10 msgr2=0x7f102815e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.046+0000 7f102dc58700 1 --2- 172.21.15.125:0/437787106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10280b2d10 0x7f102815e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.046+0000 7f102dc58700 1 -- 172.21.15.125:0/437787106 >> v2:172.21.15.167:3300/0 conn(0x7f10280cc200 msgr2=0x7f10280b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.046+0000 7f102dc58700 1 --2- 172.21.15.125:0/437787106 >> v2:172.21.15.167:3300/0 conn(0x7f10280cc200 0x7f10280b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.046+0000 7f102dc58700 1 -- 172.21.15.125:0/437787106 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280cc990 con 0x7f102815a5f0 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.046+0000 7f102dc58700 1 --2- 172.21.15.125:0/437787106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f102815a5f0 0x7f10280d0ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f102806d8d0 tx=0x7f102000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fe987f8da5d77 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.048+0000 7f102cc56700 1 -- 172.21.15.125:0/437787106 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102000e070 con 0x7f102815a5f0 2023-11-28T11:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.048+0000 7f102cc56700 1 -- 172.21.15.125:0/437787106 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102000b910 con 0x7f102815a5f0 2023-11-28T11:08:47.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.048+0000 7f102cc56700 1 -- 172.21.15.125:0/437787106 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102000bcc0 con 0x7f102815a5f0 2023-11-28T11:08:47.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.049+0000 7f102febc700 1 -- 172.21.15.125:0/437787106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f102815a5f0 msgr2=0x7f10280d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.049+0000 7f102febc700 1 --2- 172.21.15.125:0/437787106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f102815a5f0 0x7f10280d0ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f102806d8d0 tx=0x7f102000b330 comp rx=0 tx=0).stop 2023-11-28T11:08:47.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.045+0000 7f17289e4700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f17100683c0 0x7f171006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.045+0000 7f17289e4700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f17100683c0 0x7f171006a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1718006fd0 tx=0x7f1718008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.054+0000 7f102febc700 1 -- 172.21.15.125:0/437787106 shutdown_connections 2023-11-28T11:08:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.054+0000 7f102febc700 1 --2- 172.21.15.125:0/437787106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10280b2d10 0x7f102815e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.054+0000 7f102febc700 1 --2- 172.21.15.125:0/437787106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f102815a5f0 0x7f10280d0ad0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.054+0000 7f102febc700 1 --2- 172.21.15.125:0/437787106 >> v2:172.21.15.167:3300/0 conn(0x7f10280cc200 0x7f10280b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.054+0000 7f102febc700 1 -- 172.21.15.125:0/437787106 >> 172.21.15.125:0/437787106 conn(0x7f102806ea80 msgr2=0x7f102806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.054+0000 7f102febc700 1 -- 172.21.15.125:0/437787106 shutdown_connections 2023-11-28T11:08:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.054+0000 7f102febc700 1 -- 172.21.15.125:0/437787106 wait complete. 2023-11-28T11:08:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.056+0000 7f102febc700 1 Processor -- start 2023-11-28T11:08:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.057+0000 7f102febc700 1 -- start start 2023-11-28T11:08:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.058+0000 7f102febc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10280b2d10 0x7f1028144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.058+0000 7f102febc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10280cc200 0x7f10280c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.058+0000 7f102febc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f102815a5f0 0x7f10280c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.058+0000 7f102febc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1028145460 con 0x7f10280cc200 2023-11-28T11:08:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.058+0000 7f102febc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280c8620 con 0x7f10280b2d10 2023-11-28T11:08:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.058+0000 7f102febc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102814f5b0 con 0x7f102815a5f0 2023-11-28T11:08:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.054+0000 7f17217fa700 1 -- 172.21.15.125:0/274658920 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1714053fb0 con 0x7f17241609c0 2023-11-28T11:08:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.060+0000 7f102dc58700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10280b2d10 0x7f1028144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.060+0000 7f102e459700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f102815a5f0 0x7f10280c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.060+0000 7f102d457700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10280cc200 0x7f10280c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.060+0000 7f102d457700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10280cc200 0x7f10280c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57150/0 (socket says 172.21.15.125:57150) 2023-11-28T11:08:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.060+0000 7f102d457700 1 -- 172.21.15.125:0/2180007719 learned_addr learned my addr 172.21.15.125:0/2180007719 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.061+0000 7f102d457700 1 -- 172.21.15.125:0/2180007719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f102815a5f0 msgr2=0x7f10280c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.061+0000 7f102d457700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f102815a5f0 0x7f10280c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.061+0000 7f102d457700 1 -- 172.21.15.125:0/2180007719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10280b2d10 msgr2=0x7f1028144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.061+0000 7f102d457700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10280b2d10 0x7f1028144f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.061+0000 7f102d457700 1 -- 172.21.15.125:0/2180007719 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1020009b30 con 0x7f10280cc200 2023-11-28T11:08:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.061+0000 7f102d457700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10280cc200 0x7f10280c80e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f102400b530 tx=0x7f102400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.061+0000 7f101e7fc700 1 -- 172.21.15.125:0/2180007719 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024011830 con 0x7f10280cc200 2023-11-28T11:08:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.061+0000 7f101e7fc700 1 -- 172.21.15.125:0/2180007719 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1024011990 con 0x7f10280cc200 2023-11-28T11:08:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.061+0000 7f101e7fc700 1 -- 172.21.15.125:0/2180007719 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024011d40 con 0x7f10280cc200 2023-11-28T11:08:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.061+0000 7f102febc700 1 -- 172.21.15.125:0/2180007719 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10280ccf50 con 0x7f10280cc200 2023-11-28T11:08:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.061+0000 7f102febc700 1 -- 172.21.15.125:0/2180007719 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10280ccc70 con 0x7f10280cc200 2023-11-28T11:08:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.065+0000 7f101e7fc700 1 -- 172.21.15.125:0/2180007719 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1024021070 con 0x7f10280cc200 2023-11-28T11:08:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.065+0000 7f101e7fc700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f100c068390 0x7f100c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.065+0000 7f101e7fc700 1 -- 172.21.15.125:0/2180007719 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1024085ca0 con 0x7f10280cc200 2023-11-28T11:08:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.066+0000 7f102febc700 1 -- 172.21.15.125:0/2180007719 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10100052f0 con 0x7f10280cc200 2023-11-28T11:08:47.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.076+0000 7f101e7fc700 1 -- 172.21.15.125:0/2180007719 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1024015080 con 0x7f10280cc200 2023-11-28T11:08:47.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.079+0000 7f102dc58700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f100c068390 0x7f100c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:47.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.079+0000 7f102dc58700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f100c068390 0x7f100c06a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f10280d1060 tx=0x7f1020009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:47.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.375+0000 7faf0d29e700 1 -- 172.21.15.125:0/3575364298 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7faef40058a0 con 0x7faf0806cb50 2023-11-28T11:08:47.380 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-11-28T11:08:47.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.376+0000 7faeef7fe700 1 -- 172.21.15.125:0/3575364298 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faef8056070 con 0x7faf0806cb50 2023-11-28T11:08:47.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.380+0000 7faf0d29e700 1 -- 172.21.15.125:0/3575364298 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faef0068410 msgr2=0x7faef006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.380+0000 7faf0d29e700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faef0068410 0x7faef006a8c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf080cb6f0 tx=0x7faefc009040 comp rx=0 tx=0).stop 2023-11-28T11:08:47.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.380+0000 7faf0d29e700 1 -- 172.21.15.125:0/3575364298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf0806cb50 msgr2=0x7faf0816a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.380+0000 7faf0d29e700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf0806cb50 0x7faf0816a150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faef800e870 tx=0x7faef800eb80 comp rx=0 tx=0).stop 2023-11-28T11:08:47.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.381+0000 7faf0d29e700 1 -- 172.21.15.125:0/3575364298 shutdown_connections 2023-11-28T11:08:47.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.381+0000 7faf0d29e700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf0815a590 0x7faf080c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.381+0000 7faf0d29e700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faef0068410 0x7faef006a8c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.381+0000 7faf0d29e700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf0806cb50 0x7faf0816a150 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.381+0000 7faf0d29e700 1 --2- 172.21.15.125:0/3575364298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf080b50d0 0x7faf0815c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.381+0000 7faf0d29e700 1 -- 172.21.15.125:0/3575364298 >> 172.21.15.125:0/3575364298 conn(0x7faf080cf400 msgr2=0x7faf0806ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.381+0000 7faf0d29e700 1 -- 172.21.15.125:0/3575364298 shutdown_connections 2023-11-28T11:08:47.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.381+0000 7faf0d29e700 1 -- 172.21.15.125:0/3575364298 wait complete. 2023-11-28T11:08:47.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.381+0000 7f0efbf9d700 1 -- 172.21.15.125:0/4246152848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ef40b4a40 con 0x7f0ef40b3c80 2023-11-28T11:08:47.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.382+0000 7f0eea7fc700 1 -- 172.21.15.125:0/4246152848 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ef0055cf0 con 0x7f0ef40b3c80 2023-11-28T11:08:47.383 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-11-28T11:08:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.386+0000 7f0efbf9d700 1 -- 172.21.15.125:0/4246152848 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ed80682d0 msgr2=0x7f0ed806a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.386+0000 7f0efbf9d700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ed80682d0 0x7f0ed806a780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4004ad0 tx=0x7f0ee4001930 comp rx=0 tx=0).stop 2023-11-28T11:08:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.386+0000 7f0efbf9d700 1 -- 172.21.15.125:0/4246152848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ef40b3c80 msgr2=0x7f0ef40cd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.386+0000 7f0efbf9d700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ef40b3c80 0x7f0ef40cd830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ef406f590 tx=0x7f0ef00012b0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.391+0000 7f5898784700 1 -- 172.21.15.125:0/2769152301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f58780055a0 con 0x7f5890066360 2023-11-28T11:08:47.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.395+0000 7f5886ffd700 1 -- 172.21.15.125:0/2769152301 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f588c015020 con 0x7f5890066360 2023-11-28T11:08:47.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.395+0000 7f0efbf9d700 1 -- 172.21.15.125:0/4246152848 shutdown_connections 2023-11-28T11:08:47.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.395+0000 7f0efbf9d700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ef40b3c80 0x7f0ef40cd830 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.395+0000 7f0efbf9d700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee0005320 0x7f0ef40cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.395+0000 7f0efbf9d700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ed80682d0 0x7f0ed806a780 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.395+0000 7f0efbf9d700 1 --2- 172.21.15.125:0/4246152848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ef40c4fc0 0x7f0ef41f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.395+0000 7f0efbf9d700 1 -- 172.21.15.125:0/4246152848 >> 172.21.15.125:0/4246152848 conn(0x7f0ef406aed0 msgr2=0x7f0ef4156210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.398 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-11-28T11:08:47.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.398+0000 7f0efbf9d700 1 -- 172.21.15.125:0/4246152848 shutdown_connections 2023-11-28T11:08:47.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.398+0000 7f0efbf9d700 1 -- 172.21.15.125:0/4246152848 wait complete. 2023-11-28T11:08:47.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.398+0000 7f5898784700 1 -- 172.21.15.125:0/2769152301 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5874068340 msgr2=0x7f587406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.398+0000 7f5898784700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5874068340 0x7f587406a7f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5880004ed0 tx=0x7f5880001080 comp rx=0 tx=0).stop 2023-11-28T11:08:47.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.398+0000 7f5898784700 1 -- 172.21.15.125:0/2769152301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5890066360 msgr2=0x7f5890154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.398+0000 7f5898784700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5890066360 0x7f5890154540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f588c006fd0 tx=0x7f588c00b730 comp rx=0 tx=0).stop 2023-11-28T11:08:47.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.399+0000 7f5898784700 1 -- 172.21.15.125:0/2769152301 shutdown_connections 2023-11-28T11:08:47.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.399+0000 7f5898784700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58900cef30 0x7f589015d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.399+0000 7f5898784700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5874068340 0x7f587406a7f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.399+0000 7f5898784700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5890065ef0 0x7f5890154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.399+0000 7f5898784700 1 --2- 172.21.15.125:0/2769152301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5890066360 0x7f5890154540 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.399+0000 7f5898784700 1 -- 172.21.15.125:0/2769152301 >> 172.21.15.125:0/2769152301 conn(0x7f58900cf400 msgr2=0x7f58900c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.401+0000 7f5898784700 1 -- 172.21.15.125:0/2769152301 shutdown_connections 2023-11-28T11:08:47.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.401+0000 7f5898784700 1 -- 172.21.15.125:0/2769152301 wait complete. 2023-11-28T11:08:47.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-11-28T11:08:47.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.415+0000 7f8ffb878700 1 -- 172.21.15.125:0/2358785430 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8ff40743f0 con 0x7f8ff4158980 2023-11-28T11:08:47.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.416+0000 7f831a15c700 1 -- 172.21.15.125:0/2321405085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f83000058a0 con 0x7f8314160c30 2023-11-28T11:08:47.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.416+0000 7f82fbfff700 1 -- 172.21.15.125:0/2321405085 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f830c056200 con 0x7f8314160c30 2023-11-28T11:08:47.417 INFO:teuthology.orchestra.run.smithi125.stdout:55834574857 2023-11-28T11:08:47.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.418+0000 7f831a15c700 1 -- 172.21.15.125:0/2321405085 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f82fc068410 msgr2=0x7f82fc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.418+0000 7f831a15c700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f82fc068410 0x7f82fc06a8c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83040090b0 tx=0x7f8304008030 comp rx=0 tx=0).stop 2023-11-28T11:08:47.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.419+0000 7f831a15c700 1 -- 172.21.15.125:0/2321405085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8314160c30 msgr2=0x7f83140ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.419+0000 7f831a15c700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8314160c30 0x7f83140ca660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f830c00cb90 tx=0x7f830c00cf50 comp rx=0 tx=0).stop 2023-11-28T11:08:47.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.419+0000 7f831a15c700 1 -- 172.21.15.125:0/2321405085 shutdown_connections 2023-11-28T11:08:47.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.419+0000 7f831a15c700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8314160c30 0x7f83140ca660 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.419+0000 7f831a15c700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f82fc068410 0x7f82fc06a8c0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83040090b0 tx=0x7f8304008030 comp rx=0 tx=0).stop 2023-11-28T11:08:47.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.419+0000 7f831a15c700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83140adda0 0x7f83140c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.419+0000 7f831a15c700 1 --2- 172.21.15.125:0/2321405085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83140b0d20 0x7f83140c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.419+0000 7f831a15c700 1 -- 172.21.15.125:0/2321405085 >> 172.21.15.125:0/2321405085 conn(0x7f83140cb540 msgr2=0x7f83140cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-11-28T11:08:47.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.419+0000 7f315cc66700 1 -- 172.21.15.125:0/3873301506 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f313c005870 con 0x7f31580cdf60 2023-11-28T11:08:47.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.419+0000 7f3146ffd700 1 -- 172.21.15.125:0/3873301506 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f314c055480 con 0x7f31580cdf60 2023-11-28T11:08:47.422 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-11-28T11:08:47.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-11-28T11:08:47.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.421+0000 7f8fe9ffb700 1 -- 172.21.15.125:0/2358785430 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ff0051590 con 0x7f8ff4158980 2023-11-28T11:08:47.423 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-11-28T11:08:47.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f831a15c700 1 -- 172.21.15.125:0/2321405085 shutdown_connections 2023-11-28T11:08:47.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f831a15c700 1 -- 172.21.15.125:0/2321405085 wait complete. 2023-11-28T11:08:47.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 -- 172.21.15.125:0/3873301506 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3140068460 msgr2=0x7f314006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3140068460 0x7f314006a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3150009fa0 tx=0x7f315000b040 comp rx=0 tx=0).stop 2023-11-28T11:08:47.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 -- 172.21.15.125:0/3873301506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31580cdf60 msgr2=0x7f3158202b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31580cdf60 0x7f3158202b40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c3c0 tx=0x7f314c00c780 comp rx=0 tx=0).stop 2023-11-28T11:08:47.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 -- 172.21.15.125:0/3873301506 shutdown_connections 2023-11-28T11:08:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31580cdf60 0x7f3158202b40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3140068460 0x7f314006a910 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f315808a5d0 0x7f31580894a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 --2- 172.21.15.125:0/3873301506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31580cdac0 0x7f31580c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 -- 172.21.15.125:0/3873301506 >> 172.21.15.125:0/3873301506 conn(0x7f315806aed0 msgr2=0x7f3158172df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 -- 172.21.15.125:0/3873301506 shutdown_connections 2023-11-28T11:08:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.422+0000 7f315cc66700 1 -- 172.21.15.125:0/3873301506 wait complete. 2023-11-28T11:08:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.424+0000 7f8ffb878700 1 -- 172.21.15.125:0/2358785430 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8fd80682f0 msgr2=0x7f8fd806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.424+0000 7f8ffb878700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8fd80682f0 0x7f8fd806a7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8ff41f5e70 tx=0x7f8fe4006c60 comp rx=0 tx=0).stop 2023-11-28T11:08:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.424+0000 7f8ffb878700 1 -- 172.21.15.125:0/2358785430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff4158980 msgr2=0x7f8ff40acb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.424+0000 7f8ffb878700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff4158980 0x7f8ff40acb60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000b4d0 tx=0x7f8ff000b7e0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.426+0000 7f172ac48700 1 -- 172.21.15.125:0/274658920 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f17240718a0 con 0x7f17241609c0 2023-11-28T11:08:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.427+0000 7f8ffb878700 1 -- 172.21.15.125:0/2358785430 shutdown_connections 2023-11-28T11:08:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.427+0000 7f8ffb878700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8fd80682f0 0x7f8fd806a7a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.427+0000 7f8ffb878700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ff4154540 0x7f8ff41549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.427+0000 7f8ffb878700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ff40ccda0 0x7f8ff41f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.427+0000 7f8ffb878700 1 --2- 172.21.15.125:0/2358785430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff4158980 0x7f8ff40acb60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.427+0000 7f8ffb878700 1 -- 172.21.15.125:0/2358785430 >> 172.21.15.125:0/2358785430 conn(0x7f8ff40cb540 msgr2=0x7f8ff406f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.427+0000 7f8ffb878700 1 -- 172.21.15.125:0/2358785430 shutdown_connections 2023-11-28T11:08:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.427+0000 7f8ffb878700 1 -- 172.21.15.125:0/2358785430 wait complete. 2023-11-28T11:08:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.427+0000 7f17217fa700 1 -- 172.21.15.125:0/274658920 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17240718a0 con 0x7f17241609c0 2023-11-28T11:08:47.430 INFO:teuthology.orchestra.run.smithi125.stdout:55834574854 2023-11-28T11:08:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.429+0000 7f172ac48700 1 -- 172.21.15.125:0/274658920 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f17100683c0 msgr2=0x7f171006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.429+0000 7f172ac48700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f17100683c0 0x7f171006a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1718006fd0 tx=0x7f1718008040 comp rx=0 tx=0).stop 2023-11-28T11:08:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.429+0000 7f172ac48700 1 -- 172.21.15.125:0/274658920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241609c0 msgr2=0x7f172406fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.429+0000 7f172ac48700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241609c0 0x7f172406fe30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17140090b0 tx=0x7f1714004750 comp rx=0 tx=0).stop 2023-11-28T11:08:47.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.431+0000 7f172ac48700 1 -- 172.21.15.125:0/274658920 shutdown_connections 2023-11-28T11:08:47.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.431+0000 7f172ac48700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241609c0 0x7f172406fe30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.431+0000 7f172ac48700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f17100683c0 0x7f171006a870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.431+0000 7f172ac48700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f172406cdd0 0x7f17240c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.431+0000 7f172ac48700 1 --2- 172.21.15.125:0/274658920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17240b0c50 0x7f17240c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.431+0000 7f172ac48700 1 -- 172.21.15.125:0/274658920 >> 172.21.15.125:0/274658920 conn(0x7f172406aed0 msgr2=0x7f17241574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.431+0000 7f172ac48700 1 -- 172.21.15.125:0/274658920 shutdown_connections 2023-11-28T11:08:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.431+0000 7f172ac48700 1 -- 172.21.15.125:0/274658920 wait complete. 2023-11-28T11:08:47.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-11-28T11:08:47.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-11-28T11:08:47.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.442+0000 7f102febc700 1 -- 172.21.15.125:0/2180007719 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f10100055a0 con 0x7f10280cc200 2023-11-28T11:08:47.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.442+0000 7f101e7fc700 1 -- 172.21.15.125:0/2180007719 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1024055ec0 con 0x7f10280cc200 2023-11-28T11:08:47.443 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-11-28T11:08:47.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 -- 172.21.15.125:0/2180007719 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f100c068390 msgr2=0x7f100c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f100c068390 0x7f100c06a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f10280d1060 tx=0x7f1020009000 comp rx=0 tx=0).stop 2023-11-28T11:08:47.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 -- 172.21.15.125:0/2180007719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10280cc200 msgr2=0x7f10280c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:47.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10280cc200 0x7f10280c80e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f102400b530 tx=0x7f102400b8f0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 -- 172.21.15.125:0/2180007719 shutdown_connections 2023-11-28T11:08:47.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f100c068390 0x7f100c06a840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f102815a5f0 0x7f10280c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10280b2d10 0x7f1028144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 --2- 172.21.15.125:0/2180007719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10280cc200 0x7f10280c80e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:47.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 -- 172.21.15.125:0/2180007719 >> 172.21.15.125:0/2180007719 conn(0x7f102806ea80 msgr2=0x7f102814c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:47.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 -- 172.21.15.125:0/2180007719 shutdown_connections 2023-11-28T11:08:47.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:47.444+0000 7f102febc700 1 -- 172.21.15.125:0/2180007719 wait complete. 2023-11-28T11:08:47.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-11-28T11:08:47.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-11-28T11:08:47.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-11-28T11:08:48.409 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T11:08:48.422 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T11:08:48.423 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T11:08:48.440 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T11:08:48.444 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T11:08:48.448 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T11:08:48.448 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T11:08:48.458 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T11:08:48.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.603+0000 7fc53a1ed700 1 Processor -- start 2023-11-28T11:08:48.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.603+0000 7fc53a1ed700 1 -- start start 2023-11-28T11:08:48.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.604+0000 7fc53a1ed700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc534158980 0x7fc5340adf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.604+0000 7fc53a1ed700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc53406d230 0x7fc53406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.604+0000 7fc53a1ed700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53406d6c0 con 0x7fc5340b0540 2023-11-28T11:08:48.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.604+0000 7fc53a1ed700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53406c700 con 0x7fc53406d230 2023-11-28T11:08:48.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.604+0000 7fc53a1ed700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340ca7f0 con 0x7fc534158980 2023-11-28T11:08:48.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.605+0000 7fc533fff700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc5340b0540 0x7fc5340cdc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:44082/0 (socket says 172.21.15.125:44082) 2023-11-28T11:08:48.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.605+0000 7fc533fff700 1 -- 172.21.15.125:0/2741874130 learned_addr learned my addr 172.21.15.125:0/2741874130 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:48.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.605+0000 7fc5337fe700 1 --2- 172.21.15.125:0/2741874130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc534158980 0x7fc5340adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.605+0000 7fc532ffd700 1 --2- 172.21.15.125:0/2741874130 >> v2:172.21.15.167:3300/0 conn(0x7fc53406d230 0x7fc53406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.606+0000 7fc5337fe700 1 -- 172.21.15.125:0/2741874130 >> v2:172.21.15.167:3300/0 conn(0x7fc53406d230 msgr2=0x7fc53406b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.606+0000 7fc5337fe700 1 --2- 172.21.15.125:0/2741874130 >> v2:172.21.15.167:3300/0 conn(0x7fc53406d230 0x7fc53406b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.606+0000 7fc5337fe700 1 -- 172.21.15.125:0/2741874130 >> v1:172.21.15.167:6789/0 conn(0x7fc5340b0540 legacy=0x7fc5340cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.606+0000 7fc5337fe700 1 -- 172.21.15.125:0/2741874130 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5340caad0 con 0x7fc534158980 2023-11-28T11:08:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.606+0000 7fc5337fe700 1 --2- 172.21.15.125:0/2741874130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc534158980 0x7fc5340adf60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc524009840 tx=0x7fc524009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9e469eb3e3d3e82 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.607+0000 7fc5327fc700 1 -- 172.21.15.125:0/2741874130 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52400f8a0 con 0x7fc534158980 2023-11-28T11:08:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.607+0000 7fc5327fc700 1 -- 172.21.15.125:0/2741874130 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52400fa00 con 0x7fc534158980 2023-11-28T11:08:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.607+0000 7fc5327fc700 1 -- 172.21.15.125:0/2741874130 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52400fd70 con 0x7fc534158980 2023-11-28T11:08:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.608+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2741874130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc534158980 msgr2=0x7fc5340adf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.608+0000 7fc53a1ed700 1 --2- 172.21.15.125:0/2741874130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc534158980 0x7fc5340adf60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc524009840 tx=0x7fc524009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.608+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2741874130 shutdown_connections 2023-11-28T11:08:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.608+0000 7fc53a1ed700 1 --2- 172.21.15.125:0/2741874130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc534158980 0x7fc5340adf60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.608+0000 7fc53a1ed700 1 --2- 172.21.15.125:0/2741874130 >> v2:172.21.15.167:3300/0 conn(0x7fc53406d230 0x7fc53406b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.608+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2741874130 >> 172.21.15.125:0/2741874130 conn(0x7fc53406aed0 msgr2=0x7fc5340cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.609+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2741874130 shutdown_connections 2023-11-28T11:08:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.609+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2741874130 wait complete. 2023-11-28T11:08:48.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.611+0000 7fc53a1ed700 1 Processor -- start 2023-11-28T11:08:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.611+0000 7fc53a1ed700 1 -- start start 2023-11-28T11:08:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.612+0000 7fc53a1ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53406d230 0x7fc5340c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.612+0000 7fc53a1ed700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5340b0540 0x7fc5340ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.612+0000 7fc53a1ed700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc534158980 0x7fc5340aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.612+0000 7fc53a1ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340c3140 con 0x7fc53406d230 2023-11-28T11:08:48.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.612+0000 7fc53a1ed700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5341f9a50 con 0x7fc534158980 2023-11-28T11:08:48.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.612+0000 7fc53a1ed700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5341f9d30 con 0x7fc5340b0540 2023-11-28T11:08:48.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.613+0000 7fc5337fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53406d230 0x7fc5340c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.613+0000 7fc5337fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53406d230 0x7fc5340c2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57162/0 (socket says 172.21.15.125:57162) 2023-11-28T11:08:48.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.613+0000 7fc5337fe700 1 -- 172.21.15.125:0/2390693932 learned_addr learned my addr 172.21.15.125:0/2390693932 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.613+0000 7fc5337fe700 1 -- 172.21.15.125:0/2390693932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5340b0540 msgr2=0x7fc5340ae500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:08:48.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.613+0000 7fc5337fe700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5340b0540 0x7fc5340ae500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.613+0000 7fc5337fe700 1 -- 172.21.15.125:0/2390693932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc534158980 msgr2=0x7fc5340aea40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T11:08:48.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.613+0000 7fc5337fe700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc534158980 0x7fc5340aea40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.614+0000 7fc5337fe700 1 -- 172.21.15.125:0/2390693932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240094a0 con 0x7fc53406d230 2023-11-28T11:08:48.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.614+0000 7fc5337fe700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53406d230 0x7fc5340c2c00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc524000c00 tx=0x7fc524004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.614+0000 7fc51bfff700 1 -- 172.21.15.125:0/2390693932 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524003ab0 con 0x7fc53406d230 2023-11-28T11:08:48.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.614+0000 7fc51bfff700 1 -- 172.21.15.125:0/2390693932 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524003c30 con 0x7fc53406d230 2023-11-28T11:08:48.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.614+0000 7fc51bfff700 1 -- 172.21.15.125:0/2390693932 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524010470 con 0x7fc53406d230 2023-11-28T11:08:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.614+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2390693932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5340cb090 con 0x7fc53406d230 2023-11-28T11:08:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.614+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2390693932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5340cadb0 con 0x7fc53406d230 2023-11-28T11:08:48.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.619+0000 7fc51bfff700 1 -- 172.21.15.125:0/2390693932 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc524019400 con 0x7fc53406d230 2023-11-28T11:08:48.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.619+0000 7fc51bfff700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc5200683c0 0x7fc52006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.619+0000 7fc51bfff700 1 -- 172.21.15.125:0/2390693932 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5240874d0 con 0x7fc53406d230 2023-11-28T11:08:48.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.620+0000 7fc532ffd700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc5200683c0 0x7fc52006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.621+0000 7fc532ffd700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc5200683c0 0x7fc52006a870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc5340ac8c0 tx=0x7fc528008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.622+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2390693932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5140052f0 con 0x7fc53406d230 2023-11-28T11:08:48.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.630+0000 7fc51bfff700 1 -- 172.21.15.125:0/2390693932 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc524053c60 con 0x7fc53406d230 2023-11-28T11:08:48.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.659+0000 7f24e8ea0700 1 Processor -- start 2023-11-28T11:08:48.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.659+0000 7f24e8ea0700 1 -- start start 2023-11-28T11:08:48.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.660+0000 7f24e8ea0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e41609c0 0x7f24e40ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.660+0000 7f24e8ea0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24e406cdd0 0x7f24e40b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.660+0000 7f24e8ea0700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e40cc690 con 0x7f24e40b0a80 2023-11-28T11:08:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.660+0000 7f24e8ea0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e40b0f00 con 0x7f24e406cdd0 2023-11-28T11:08:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.660+0000 7f24e8ea0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e40cc8c0 con 0x7f24e41609c0 2023-11-28T11:08:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.661+0000 7f24e1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24e406cdd0 0x7f24e40b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.661+0000 7f24e1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24e406cdd0 0x7f24e40b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57172/0 (socket says 172.21.15.125:57172) 2023-11-28T11:08:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.661+0000 7f24e1d9b700 1 -- 172.21.15.125:0/797978325 learned_addr learned my addr 172.21.15.125:0/797978325 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.661+0000 7f24e1d9b700 1 -- 172.21.15.125:0/797978325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e41609c0 msgr2=0x7f24e40ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.661+0000 7f24e259c700 1 --2- 172.21.15.125:0/797978325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e41609c0 0x7f24e40ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.661+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/797978325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e41609c0 0x7f24e40ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.661+0000 7f24e1d9b700 1 -- 172.21.15.125:0/797978325 >> v1:172.21.15.167:6789/0 conn(0x7f24e40b0a80 legacy=0x7f24e4164630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:48.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.661+0000 7f24e1d9b700 1 -- 172.21.15.125:0/797978325 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e40caa30 con 0x7f24e406cdd0 2023-11-28T11:08:48.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.661+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/797978325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e406cdd0 0x7f24e40b0540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f24d80098f0 tx=0x7f24d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d5a313c0383129 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.662+0000 7f24e159a700 1 -- 172.21.15.125:0/797978325 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8004230 con 0x7f24e406cdd0 2023-11-28T11:08:48.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.662+0000 7f24e159a700 1 -- 172.21.15.125:0/797978325 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d8004390 con 0x7f24e406cdd0 2023-11-28T11:08:48.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.662+0000 7f24e159a700 1 -- 172.21.15.125:0/797978325 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d80036a0 con 0x7f24e406cdd0 2023-11-28T11:08:48.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.662+0000 7f456cabc700 1 Processor -- start 2023-11-28T11:08:48.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.662+0000 7f456cabc700 1 -- start start 2023-11-28T11:08:48.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.663+0000 7f24e8ea0700 1 -- 172.21.15.125:0/797978325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e406cdd0 msgr2=0x7f24e40b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.663+0000 7f24e8ea0700 1 --2- 172.21.15.125:0/797978325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e406cdd0 0x7f24e40b0540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f24d80098f0 tx=0x7f24d8009c00 comp rx=0 tx=0).stop 2023-11-28T11:08:48.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.663+0000 7f24e8ea0700 1 -- 172.21.15.125:0/797978325 shutdown_connections 2023-11-28T11:08:48.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.663+0000 7f24e8ea0700 1 --2- 172.21.15.125:0/797978325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e41609c0 0x7f24e40ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.663+0000 7f24e8ea0700 1 --2- 172.21.15.125:0/797978325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e406cdd0 0x7f24e40b0540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.663+0000 7f24e8ea0700 1 -- 172.21.15.125:0/797978325 >> 172.21.15.125:0/797978325 conn(0x7f24e406aed0 msgr2=0x7f24e40cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:48.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.663+0000 7f24e8ea0700 1 -- 172.21.15.125:0/797978325 shutdown_connections 2023-11-28T11:08:48.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.663+0000 7f24e8ea0700 1 -- 172.21.15.125:0/797978325 wait complete. 2023-11-28T11:08:48.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.664+0000 7f456cabc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45681609c0 0x7f45680ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.664+0000 7f456cabc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f456806cdd0 0x7f45680b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.664+0000 7f456cabc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45680cc690 con 0x7f45680b0a80 2023-11-28T11:08:48.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.664+0000 7f456cabc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45680b0f00 con 0x7f456806cdd0 2023-11-28T11:08:48.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.664+0000 7f456cabc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45680cc8c0 con 0x7f45681609c0 2023-11-28T11:08:48.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.664+0000 7f456659c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45681609c0 0x7f45680ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.664+0000 7f4565d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f456806cdd0 0x7f45680b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.664+0000 7f4565d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f456806cdd0 0x7f45680b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57176/0 (socket says 172.21.15.125:57176) 2023-11-28T11:08:48.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.664+0000 7f4565d9b700 1 -- 172.21.15.125:0/143726614 learned_addr learned my addr 172.21.15.125:0/143726614 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.665+0000 7f4565d9b700 1 -- 172.21.15.125:0/143726614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45681609c0 msgr2=0x7f45680ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:48.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.665+0000 7f4565d9b700 1 --2- 172.21.15.125:0/143726614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45681609c0 0x7f45680ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.665+0000 7f24e8ea0700 1 Processor -- start 2023-11-28T11:08:48.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.665+0000 7f4565d9b700 1 -- 172.21.15.125:0/143726614 >> v1:172.21.15.125:6789/0 conn(0x7f45680b0a80 legacy=0x7f4568164630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.665+0000 7f4565d9b700 1 -- 172.21.15.125:0/143726614 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45680caa30 con 0x7f456806cdd0 2023-11-28T11:08:48.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.666+0000 7f4565d9b700 1 --2- 172.21.15.125:0/143726614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f456806cdd0 0x7f45680b0540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f455c0098f0 tx=0x7f455c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e00640f3f9148 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.666+0000 7f456559a700 1 -- 172.21.15.125:0/143726614 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c004230 con 0x7f456806cdd0 2023-11-28T11:08:48.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.666+0000 7f456559a700 1 -- 172.21.15.125:0/143726614 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c004390 con 0x7f456806cdd0 2023-11-28T11:08:48.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.666+0000 7f456559a700 1 -- 172.21.15.125:0/143726614 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c0036a0 con 0x7f456806cdd0 2023-11-28T11:08:48.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.665+0000 7f24e8ea0700 1 -- start start 2023-11-28T11:08:48.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.666+0000 7f24e8ea0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e406cdd0 0x7f24e4163880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.666+0000 7f24e8ea0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40b0a80 0x7f24e4162070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.666+0000 7f24e8ea0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e41609c0 0x7f24e40c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.666+0000 7f24e8ea0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41633f0 con 0x7f24e406cdd0 2023-11-28T11:08:48.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.666+0000 7f24e8ea0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e4162670 con 0x7f24e40b0a80 2023-11-28T11:08:48.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.666+0000 7f24e8ea0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e4162b00 con 0x7f24e41609c0 2023-11-28T11:08:48.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.667+0000 7f24e259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e406cdd0 0x7f24e4163880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.667+0000 7f24e259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e406cdd0 0x7f24e4163880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57180/0 (socket says 172.21.15.125:57180) 2023-11-28T11:08:48.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.667+0000 7f24e259c700 1 -- 172.21.15.125:0/3362594412 learned_addr learned my addr 172.21.15.125:0/3362594412 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.667+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e41609c0 0x7f24e40c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.667+0000 7f456cabc700 1 -- 172.21.15.125:0/143726614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f456806cdd0 msgr2=0x7f45680b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.667+0000 7f456cabc700 1 --2- 172.21.15.125:0/143726614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f456806cdd0 0x7f45680b0540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f455c0098f0 tx=0x7f455c009c00 comp rx=0 tx=0).stop 2023-11-28T11:08:48.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.667+0000 7f24e2d9d700 1 -- 172.21.15.125:0/3362594412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40b0a80 msgr2=0x7f24e4162070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:08:48.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.667+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40b0a80 0x7f24e4162070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.667+0000 7f24e2d9d700 1 -- 172.21.15.125:0/3362594412 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e406cdd0 msgr2=0x7f24e4163880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.667+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e406cdd0 0x7f24e4163880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.667+0000 7f24e2d9d700 1 -- 172.21.15.125:0/3362594412 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d8009550 con 0x7f24e41609c0 2023-11-28T11:08:48.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.668+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e41609c0 0x7f24e40c3860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00cb10 tx=0x7f24dc00ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.668+0000 7f456cabc700 1 -- 172.21.15.125:0/143726614 shutdown_connections 2023-11-28T11:08:48.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.668+0000 7f456cabc700 1 --2- 172.21.15.125:0/143726614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45681609c0 0x7f45680ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.668+0000 7f456cabc700 1 --2- 172.21.15.125:0/143726614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f456806cdd0 0x7f45680b0540 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.668+0000 7f456cabc700 1 -- 172.21.15.125:0/143726614 >> 172.21.15.125:0/143726614 conn(0x7f456806aed0 msgr2=0x7f45680cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:48.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.668+0000 7f456cabc700 1 -- 172.21.15.125:0/143726614 shutdown_connections 2023-11-28T11:08:48.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.668+0000 7f456cabc700 1 -- 172.21.15.125:0/143726614 wait complete. 2023-11-28T11:08:48.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.670+0000 7f456cabc700 1 Processor -- start 2023-11-28T11:08:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.671+0000 7f456cabc700 1 -- start start 2023-11-28T11:08:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456cabc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f456806cdd0 0x7f45681f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456cabc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45680b0a80 0x7f45681f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456cabc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45681609c0 0x7f45681f9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456cabc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456815ca00 con 0x7f456806cdd0 2023-11-28T11:08:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456cabc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456815d580 con 0x7f45681609c0 2023-11-28T11:08:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456cabc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456815cc50 con 0x7f45680b0a80 2023-11-28T11:08:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f456806cdd0 0x7f45681f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f456806cdd0 0x7f45681f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57184/0 (socket says 172.21.15.125:57184) 2023-11-28T11:08:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456659c700 1 -- 172.21.15.125:0/3605675030 learned_addr learned my addr 172.21.15.125:0/3605675030 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f4565d9b700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45680b0a80 0x7f45681f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f4566d9d700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45681609c0 0x7f45681f9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456659c700 1 -- 172.21.15.125:0/3605675030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45680b0a80 msgr2=0x7f45681f7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456659c700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45680b0a80 0x7f45681f7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f24d2ffd700 1 -- 172.21.15.125:0/3362594412 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc00aaa0 con 0x7f24e41609c0 2023-11-28T11:08:48.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456659c700 1 -- 172.21.15.125:0/3605675030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45681609c0 msgr2=0x7f45681f9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456659c700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45681609c0 0x7f45681f9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f456659c700 1 -- 172.21.15.125:0/3605675030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c009550 con 0x7f456806cdd0 2023-11-28T11:08:48.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f24d2ffd700 1 -- 172.21.15.125:0/3362594412 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24dc00ac00 con 0x7f24e41609c0 2023-11-28T11:08:48.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f24e8ea0700 1 -- 172.21.15.125:0/3362594412 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e40caff0 con 0x7f24e41609c0 2023-11-28T11:08:48.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f24d2ffd700 1 -- 172.21.15.125:0/3362594412 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc012420 con 0x7f24e41609c0 2023-11-28T11:08:48.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.673+0000 7f24e8ea0700 1 -- 172.21.15.125:0/3362594412 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e40cad10 con 0x7f24e41609c0 2023-11-28T11:08:48.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.674+0000 7f456659c700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f456806cdd0 0x7f45681f3ae0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f455800ea00 tx=0x7f455800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.674+0000 7fbd56242700 1 Processor -- start 2023-11-28T11:08:48.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.674+0000 7f4556ffd700 1 -- 172.21.15.125:0/3605675030 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558009730 con 0x7f456806cdd0 2023-11-28T11:08:48.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.674+0000 7fbd56242700 1 -- start start 2023-11-28T11:08:48.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.674+0000 7f4556ffd700 1 -- 172.21.15.125:0/3605675030 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455800eea0 con 0x7f456806cdd0 2023-11-28T11:08:48.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.674+0000 7f456cabc700 1 -- 172.21.15.125:0/3605675030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45680caff0 con 0x7f456806cdd0 2023-11-28T11:08:48.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.674+0000 7f456cabc700 1 -- 172.21.15.125:0/3605675030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45680cad10 con 0x7f456806cdd0 2023-11-28T11:08:48.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.674+0000 7f4556ffd700 1 -- 172.21.15.125:0/3605675030 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455800ca70 con 0x7f456806cdd0 2023-11-28T11:08:48.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.675+0000 7fbd56242700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbd500b0540 0x7fbd500c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.675+0000 7fbd56242700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd5015e910 0x7fbd50070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.675+0000 7fbd56242700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd500ca7b0 con 0x7fbd500ca310 2023-11-28T11:08:48.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.675+0000 7fbd56242700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5015a8c0 con 0x7fbd500b0540 2023-11-28T11:08:48.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.675+0000 7fbd56242700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd500caa10 con 0x7fbd5015e910 2023-11-28T11:08:48.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.675+0000 7fbd4f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbd500b0540 0x7fbd500c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.676+0000 7fbd4f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbd500b0540 0x7fbd500c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57190/0 (socket says 172.21.15.125:57190) 2023-11-28T11:08:48.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.676+0000 7fbd4f7fe700 1 -- 172.21.15.125:0/1260034486 learned_addr learned my addr 172.21.15.125:0/1260034486 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.676+0000 7fbd4f7fe700 1 -- 172.21.15.125:0/1260034486 >> v2:172.21.15.167:3300/0 conn(0x7fbd5015e910 msgr2=0x7fbd50070940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:08:48.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.676+0000 7fbd4f7fe700 1 --2- 172.21.15.125:0/1260034486 >> v2:172.21.15.167:3300/0 conn(0x7fbd5015e910 0x7fbd50070940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.676+0000 7fbd4f7fe700 1 -- 172.21.15.125:0/1260034486 >> v1:172.21.15.167:6789/0 conn(0x7fbd500ca310 legacy=0x7fbd500b0910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:08:48.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.676+0000 7fbd4f7fe700 1 -- 172.21.15.125:0/1260034486 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500cacf0 con 0x7fbd500b0540 2023-11-28T11:08:48.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.676+0000 7fbd4f7fe700 1 --2- 172.21.15.125:0/1260034486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd500b0540 0x7fbd500c9bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbd400098f0 tx=0x7fbd40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806d90ab30b5a1b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.676+0000 7f4556ffd700 1 -- 172.21.15.125:0/3605675030 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4558019030 con 0x7f456806cdd0 2023-11-28T11:08:48.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.675+0000 7f24e8ea0700 1 -- 172.21.15.125:0/3362594412 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e40cb2d0 con 0x7f24e41609c0 2023-11-28T11:08:48.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.676+0000 7f24d2ffd700 1 -- 172.21.15.125:0/3362594412 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f24dc022070 con 0x7f24e41609c0 2023-11-28T11:08:48.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7f4556ffd700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45480682c0 0x7f454806a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7f24d2ffd700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c4068340 0x7f24c406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7f24d2ffd700 1 -- 172.21.15.125:0/3362594412 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24dc086230 con 0x7f24e41609c0 2023-11-28T11:08:48.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7f4556ffd700 1 -- 172.21.15.125:0/3605675030 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4558085390 con 0x7f456806cdd0 2023-11-28T11:08:48.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7fbd4e7fc700 1 -- 172.21.15.125:0/1260034486 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40004230 con 0x7fbd500b0540 2023-11-28T11:08:48.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7fbd4e7fc700 1 -- 172.21.15.125:0/1260034486 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd40004390 con 0x7fbd500b0540 2023-11-28T11:08:48.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7fbd4e7fc700 1 -- 172.21.15.125:0/1260034486 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd400036a0 con 0x7fbd500b0540 2023-11-28T11:08:48.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7fbd56242700 1 -- 172.21.15.125:0/1260034486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd500b0540 msgr2=0x7fbd500c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7fbd56242700 1 --2- 172.21.15.125:0/1260034486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd500b0540 0x7fbd500c9bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbd400098f0 tx=0x7fbd40009c00 comp rx=0 tx=0).stop 2023-11-28T11:08:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7fbd56242700 1 -- 172.21.15.125:0/1260034486 shutdown_connections 2023-11-28T11:08:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7fbd56242700 1 --2- 172.21.15.125:0/1260034486 >> v2:172.21.15.167:3300/0 conn(0x7fbd5015e910 0x7fbd50070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7fbd56242700 1 --2- 172.21.15.125:0/1260034486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd500b0540 0x7fbd500c9bf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.677+0000 7fbd56242700 1 -- 172.21.15.125:0/1260034486 >> 172.21.15.125:0/1260034486 conn(0x7fbd500cb540 msgr2=0x7fbd500cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.678+0000 7fbd56242700 1 -- 172.21.15.125:0/1260034486 shutdown_connections 2023-11-28T11:08:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.678+0000 7fbd56242700 1 -- 172.21.15.125:0/1260034486 wait complete. 2023-11-28T11:08:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.679+0000 7fbd56242700 1 Processor -- start 2023-11-28T11:08:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.679+0000 7fbd56242700 1 -- start start 2023-11-28T11:08:48.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.680+0000 7ff1cd41d700 1 Processor -- start 2023-11-28T11:08:48.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.680+0000 7ff1cd41d700 1 -- start start 2023-11-28T11:08:48.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.680+0000 7f8f05b61700 1 Processor -- start 2023-11-28T11:08:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.680+0000 7fbd56242700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd500b0540 0x7fbd50150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.680+0000 7fbd56242700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5015e910 0x7fbd5015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd56242700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd500cdd30 0x7fbd500ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd56242700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd500ce710 con 0x7fbd5015e910 2023-11-28T11:08:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd56242700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5015c3f0 con 0x7fbd500cdd30 2023-11-28T11:08:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd56242700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5015c6d0 con 0x7fbd500b0540 2023-11-28T11:08:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd4effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5015e910 0x7fbd5015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd4effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5015e910 0x7fbd5015bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57198/0 (socket says 172.21.15.125:57198) 2023-11-28T11:08:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd4effd700 1 -- 172.21.15.125:0/2132143043 learned_addr learned my addr 172.21.15.125:0/2132143043 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7ff1cd41d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 0x7ff1c815d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7ff1cd41d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c815cf40 con 0x7ff1c80c9b00 2023-11-28T11:08:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7ff1cd41d700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c815a1c0 con 0x7ff1c80b0540 2023-11-28T11:08:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7ff1cd41d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8159fc0 con 0x7ff1c80adf30 2023-11-28T11:08:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7ff1c6ffd700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff1c80b0540 0x7ff1c80b0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:44130/0 (socket says 172.21.15.125:44130) 2023-11-28T11:08:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7ff1c6ffd700 1 -- 172.21.15.125:0/345939501 learned_addr learned my addr 172.21.15.125:0/345939501 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd4ffff700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd500cdd30 0x7fbd500ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7ff1c77fe700 1 --2- 172.21.15.125:0/345939501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 0x7ff1c815d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd4effd700 1 -- 172.21.15.125:0/2132143043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd500b0540 msgr2=0x7fbd50150900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T11:08:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd4effd700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd500b0540 0x7fbd50150900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd4effd700 1 -- 172.21.15.125:0/2132143043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd500cdd30 msgr2=0x7fbd500ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd4effd700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd500cdd30 0x7fbd500ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7fbd4effd700 1 -- 172.21.15.125:0/2132143043 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd40009550 con 0x7fbd5015e910 2023-11-28T11:08:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.680+0000 7f8f05b61700 1 -- start start 2023-11-28T11:08:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7fbd4effd700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5015e910 0x7fbd5015bb80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400b550 tx=0x7fbd4400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7f8f05b61700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8f000ae850 0x7f8f0006c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7f8f05b61700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f000cbcc0 con 0x7f8f00158e10 2023-11-28T11:08:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7f8f05b61700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0006cda0 con 0x7f8f0006c980 2023-11-28T11:08:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.681+0000 7f8f05b61700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0006ac30 con 0x7f8f000ae850 2023-11-28T11:08:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7f8efffff700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f8f0006c980 0x7f8f00070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:44136/0 (socket says 172.21.15.125:44136) 2023-11-28T11:08:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7f8efffff700 1 -- 172.21.15.125:0/2478521233 learned_addr learned my addr 172.21.15.125:0/2478521233 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7f8efeffd700 1 --2- 172.21.15.125:0/2478521233 >> v2:172.21.15.167:3300/0 conn(0x7f8f000ae850 0x7f8f0006c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7f24e259c700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c4068340 0x7f24c406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7fbd37fff700 1 -- 172.21.15.125:0/2132143043 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44011830 con 0x7fbd5015e910 2023-11-28T11:08:48.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7fbd37fff700 1 -- 172.21.15.125:0/2132143043 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd440119b0 con 0x7fbd5015e910 2023-11-28T11:08:48.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7fbd56242700 1 -- 172.21.15.125:0/2132143043 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd500c93f0 con 0x7fbd5015e910 2023-11-28T11:08:48.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7f4565d9b700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45480682c0 0x7f454806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7fbd37fff700 1 -- 172.21.15.125:0/2132143043 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44011d60 con 0x7fbd5015e910 2023-11-28T11:08:48.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7f24d2ffd700 1 -- 172.21.15.125:0/3362594412 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f24dc052be0 con 0x7f24e41609c0 2023-11-28T11:08:48.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7ff1c77fe700 1 -- 172.21.15.125:0/345939501 >> v1:172.21.15.167:6789/0 conn(0x7ff1c80b0540 legacy=0x7ff1c80b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7ff1c77fe700 1 -- 172.21.15.125:0/345939501 >> v1:172.21.15.125:6789/0 conn(0x7ff1c80c9b00 legacy=0x7ff1c81598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7ff1c77fe700 1 -- 172.21.15.125:0/345939501 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c815a4a0 con 0x7ff1c80adf30 2023-11-28T11:08:48.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7fbd56242700 1 -- 172.21.15.125:0/2132143043 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd500c9110 con 0x7fbd5015e910 2023-11-28T11:08:48.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7f24e259c700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c4068340 0x7f24c406a7f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24d400ac10 tx=0x7f24d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.683+0000 7f456cabc700 1 -- 172.21.15.125:0/3605675030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c0052f0 con 0x7f456806cdd0 2023-11-28T11:08:48.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.683+0000 7f4565d9b700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45480682c0 0x7f454806a770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f455c000c00 tx=0x7f455c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.684+0000 7f47187cb700 1 Processor -- start 2023-11-28T11:08:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7f8efeffd700 1 -- 172.21.15.125:0/2478521233 >> v1:172.21.15.167:6789/0 conn(0x7f8f0006c980 legacy=0x7f8f00070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7f8efeffd700 1 -- 172.21.15.125:0/2478521233 >> v1:172.21.15.125:6789/0 conn(0x7f8f00158e10 legacy=0x7f8f000cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.682+0000 7f8efeffd700 1 -- 172.21.15.125:0/2478521233 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f000ca140 con 0x7f8f000ae850 2023-11-28T11:08:48.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.683+0000 7f8efeffd700 1 --2- 172.21.15.125:0/2478521233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f000ae850 0x7f8f0006c440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009840 tx=0x7f8ef0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac38d9c95fe3ce98 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f8efe7fc700 1 -- 172.21.15.125:0/2478521233 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0013c90 con 0x7f8f000ae850 2023-11-28T11:08:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f8efe7fc700 1 -- 172.21.15.125:0/2478521233 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef0013df0 con 0x7f8f000ae850 2023-11-28T11:08:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f8efe7fc700 1 -- 172.21.15.125:0/2478521233 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0004250 con 0x7f8f000ae850 2023-11-28T11:08:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.684+0000 7fbd37fff700 1 -- 172.21.15.125:0/2132143043 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbd44021070 con 0x7fbd5015e910 2023-11-28T11:08:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.685+0000 7fbd56242700 1 -- 172.21.15.125:0/2132143043 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd500c96d0 con 0x7fbd5015e910 2023-11-28T11:08:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.685+0000 7fbd37fff700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd3c0682f0 0x7fbd3c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.685+0000 7fbd37fff700 1 -- 172.21.15.125:0/2132143043 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd44085bd0 con 0x7fbd5015e910 2023-11-28T11:08:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.685+0000 7fbd4f7fe700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd3c0682f0 0x7fbd3c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.685+0000 7fbd4f7fe700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd3c0682f0 0x7fbd3c06a7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009c40 tx=0x7fbd40008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.684+0000 7f47187cb700 1 -- start start 2023-11-28T11:08:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f47187cb700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4710158980 0x7f47100adf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f47187cb700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47100b0c50 0x7f471006b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f47187cb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471006d6c0 con 0x7f471006d230 2023-11-28T11:08:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f47187cb700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471006c700 con 0x7f4710158980 2023-11-28T11:08:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f47187cb700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47100ca7f0 con 0x7f47100b0c50 2023-11-28T11:08:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f4716567700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4710158980 0x7f47100adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f4716567700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4710158980 0x7f47100adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:53948/0 (socket says 172.21.15.125:53948) 2023-11-28T11:08:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f4716567700 1 -- 172.21.15.125:0/2539674954 learned_addr learned my addr 172.21.15.125:0/2539674954 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f4716d68700 1 --2- 172.21.15.125:0/2539674954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47100b0c50 0x7f471006b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7ff1c77fe700 1 --2- 172.21.15.125:0/345939501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 0x7ff1c815d6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009dc0 tx=0x7ff1c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c97380d85656af8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f4716567700 1 -- 172.21.15.125:0/2539674954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47100b0c50 msgr2=0x7f471006b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f4716567700 1 --2- 172.21.15.125:0/2539674954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47100b0c50 0x7f471006b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f4716567700 1 -- 172.21.15.125:0/2539674954 >> v1:172.21.15.125:6789/0 conn(0x7f471006d230 legacy=0x7f47100b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7f4716567700 1 -- 172.21.15.125:0/2539674954 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47100caad0 con 0x7f4710158980 2023-11-28T11:08:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.686+0000 7ff1c5ffb700 1 -- 172.21.15.125:0/345939501 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000e070 con 0x7ff1c80adf30 2023-11-28T11:08:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.687+0000 7ff1c5ffb700 1 -- 172.21.15.125:0/345939501 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000bad0 con 0x7ff1c80adf30 2023-11-28T11:08:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.687+0000 7ff1c5ffb700 1 -- 172.21.15.125:0/345939501 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000be60 con 0x7ff1c80adf30 2023-11-28T11:08:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.687+0000 7ff1cd41d700 1 -- 172.21.15.125:0/345939501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 msgr2=0x7ff1c815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.687+0000 7ff1cd41d700 1 --2- 172.21.15.125:0/345939501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 0x7ff1c815d6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009dc0 tx=0x7ff1c000b330 comp rx=0 tx=0).stop 2023-11-28T11:08:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.687+0000 7f8f05b61700 1 -- 172.21.15.125:0/2478521233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f000ae850 msgr2=0x7f8f0006c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.687+0000 7f8f05b61700 1 --2- 172.21.15.125:0/2478521233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f000ae850 0x7f8f0006c440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009840 tx=0x7f8ef0009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.687+0000 7ff1cd41d700 1 -- 172.21.15.125:0/345939501 shutdown_connections 2023-11-28T11:08:48.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.687+0000 7ff1cd41d700 1 --2- 172.21.15.125:0/345939501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 0x7ff1c815d6b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.687+0000 7ff1cd41d700 1 -- 172.21.15.125:0/345939501 >> 172.21.15.125:0/345939501 conn(0x7ff1c80cb540 msgr2=0x7ff1c80cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.688+0000 7ff1cd41d700 1 -- 172.21.15.125:0/345939501 shutdown_connections 2023-11-28T11:08:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.688+0000 7f4716567700 1 --2- 172.21.15.125:0/2539674954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4710158980 0x7f47100adf60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f47000092e0 tx=0x7f47000095f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=906a98904b1bd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.688+0000 7ff1cd41d700 1 -- 172.21.15.125:0/345939501 wait complete. 2023-11-28T11:08:48.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.688+0000 7f8f05b61700 1 -- 172.21.15.125:0/2478521233 shutdown_connections 2023-11-28T11:08:48.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.688+0000 7f8f05b61700 1 --2- 172.21.15.125:0/2478521233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f000ae850 0x7f8f0006c440 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.688+0000 7f8f05b61700 1 -- 172.21.15.125:0/2478521233 >> 172.21.15.125:0/2478521233 conn(0x7f8f000cf400 msgr2=0x7f8f000cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:48.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.688+0000 7f8f05b61700 1 -- 172.21.15.125:0/2478521233 shutdown_connections 2023-11-28T11:08:48.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.688+0000 7f8f05b61700 1 -- 172.21.15.125:0/2478521233 wait complete. 2023-11-28T11:08:48.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.689+0000 7ff1cd41d700 1 Processor -- start 2023-11-28T11:08:48.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.690+0000 7f8f05b61700 1 Processor -- start 2023-11-28T11:08:48.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.688+0000 7f4715565700 1 -- 172.21.15.125:0/2539674954 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700011830 con 0x7f4710158980 2023-11-28T11:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.688+0000 7f4715565700 1 -- 172.21.15.125:0/2539674954 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4700011990 con 0x7f4710158980 2023-11-28T11:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.688+0000 7f4715565700 1 -- 172.21.15.125:0/2539674954 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700011d20 con 0x7f4710158980 2023-11-28T11:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.689+0000 7f47187cb700 1 -- 172.21.15.125:0/2539674954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4710158980 msgr2=0x7f47100adf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.689+0000 7f47187cb700 1 --2- 172.21.15.125:0/2539674954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4710158980 0x7f47100adf60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f47000092e0 tx=0x7f47000095f0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.689+0000 7f47187cb700 1 -- 172.21.15.125:0/2539674954 shutdown_connections 2023-11-28T11:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.689+0000 7f47187cb700 1 --2- 172.21.15.125:0/2539674954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47100b0c50 0x7f471006b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.689+0000 7f47187cb700 1 --2- 172.21.15.125:0/2539674954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4710158980 0x7f47100adf60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.689+0000 7f47187cb700 1 -- 172.21.15.125:0/2539674954 >> 172.21.15.125:0/2539674954 conn(0x7f471006aed0 msgr2=0x7f47100cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.689+0000 7ff1cd41d700 1 -- start start 2023-11-28T11:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7ff1cd41d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 0x7ff1c80c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7ff1cd41d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c80b0540 0x7ff1c8150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7ff1cd41d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c80c9b00 0x7ff1c80b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7ff1cd41d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80c56d0 con 0x7ff1c80b0540 2023-11-28T11:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7ff1cd41d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80b4140 con 0x7ff1c80c9b00 2023-11-28T11:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7ff1cd41d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80b4420 con 0x7ff1c80adf30 2023-11-28T11:08:48.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7ff1c6ffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 0x7ff1c80c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7ff1c77fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c80c9b00 0x7ff1c80b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7ff1c6ffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 0x7ff1c80c5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:52234/0 (socket says 172.21.15.125:52234) 2023-11-28T11:08:48.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7ff1c6ffd700 1 -- 172.21.15.125:0/3426692767 learned_addr learned my addr 172.21.15.125:0/3426692767 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.690+0000 7f8f05b61700 1 -- start start 2023-11-28T11:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7f8f05b61700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f0006c980 0x7f8f0015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7f8f05b61700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f000ae850 0x7f8f0015aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7f8f05b61700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f00158e10 0x7f8f00159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7f8f05b61700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f00159990 con 0x7f8f0006c980 2023-11-28T11:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7f8f05b61700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f001f6d70 con 0x7f8f00158e10 2023-11-28T11:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7f8f05b61700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f00156fe0 con 0x7f8f000ae850 2023-11-28T11:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7f8efffff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f00158e10 0x7f8f00159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7f8efffff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f00158e10 0x7f8f00159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:53962/0 (socket says 172.21.15.125:53962) 2023-11-28T11:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7f8efffff700 1 -- 172.21.15.125:0/1109255794 learned_addr learned my addr 172.21.15.125:0/1109255794 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7f8efeffd700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f000ae850 0x7f8f0015aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7f8eff7fe700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f0006c980 0x7f8f0015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.691+0000 7ff1c6ffd700 1 -- 172.21.15.125:0/3426692767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c80c9b00 msgr2=0x7ff1c80b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7ff1c6ffd700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c80c9b00 0x7ff1c80b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7ff1c6ffd700 1 -- 172.21.15.125:0/3426692767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c80b0540 msgr2=0x7ff1c8150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7ff1c6ffd700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c80b0540 0x7ff1c8150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7ff1c6ffd700 1 -- 172.21.15.125:0/3426692767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c0009a70 con 0x7ff1c80adf30 2023-11-28T11:08:48.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7ff1c6ffd700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 0x7ff1c80c5190 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800c780 tx=0x7ff1b800cb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7f8efeffd700 1 -- 172.21.15.125:0/1109255794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f00158e10 msgr2=0x7f8f00159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7f8efeffd700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f00158e10 0x7f8f00159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7f8efeffd700 1 -- 172.21.15.125:0/1109255794 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f0006c980 msgr2=0x7f8f0015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7f8efeffd700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f0006c980 0x7f8f0015ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7f8efeffd700 1 -- 172.21.15.125:0/1109255794 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00094a0 con 0x7f8f000ae850 2023-11-28T11:08:48.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7ff1af7fe700 1 -- 172.21.15.125:0/3426692767 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8004c80 con 0x7ff1c80adf30 2023-11-28T11:08:48.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7ff1af7fe700 1 -- 172.21.15.125:0/3426692767 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b8004e00 con 0x7ff1c80adf30 2023-11-28T11:08:48.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7ff1cd41d700 1 -- 172.21.15.125:0/3426692767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c815d190 con 0x7ff1c80adf30 2023-11-28T11:08:48.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7ff1af7fe700 1 -- 172.21.15.125:0/3426692767 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8007310 con 0x7ff1c80adf30 2023-11-28T11:08:48.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7f8efeffd700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f000ae850 0x7f8f0015aaf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0019000 tx=0x7f8ef0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.693+0000 7f8ee7fff700 1 -- 172.21.15.125:0/1109255794 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0013610 con 0x7f8f000ae850 2023-11-28T11:08:48.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.692+0000 7ff1cd41d700 1 -- 172.21.15.125:0/3426692767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c815a780 con 0x7ff1c80adf30 2023-11-28T11:08:48.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.693+0000 7f8ee7fff700 1 -- 172.21.15.125:0/1109255794 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef00036a0 con 0x7f8f000ae850 2023-11-28T11:08:48.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.693+0000 7f8ee7fff700 1 -- 172.21.15.125:0/1109255794 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0003a30 con 0x7f8f000ae850 2023-11-28T11:08:48.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.693+0000 7ff1cd41d700 1 -- 172.21.15.125:0/3426692767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c815dbf0 con 0x7ff1c80adf30 2023-11-28T11:08:48.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.694+0000 7f8f05b61700 1 -- 172.21.15.125:0/1109255794 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f000c9e60 con 0x7f8f000ae850 2023-11-28T11:08:48.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.694+0000 7f8f05b61700 1 -- 172.21.15.125:0/1109255794 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f000c9b80 con 0x7f8f000ae850 2023-11-28T11:08:48.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.695+0000 7ff1af7fe700 1 -- 172.21.15.125:0/3426692767 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff1b801a030 con 0x7ff1c80adf30 2023-11-28T11:08:48.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.695+0000 7ff1af7fe700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff1b4068340 0x7ff1b406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.695+0000 7ff1af7fe700 1 -- 172.21.15.125:0/3426692767 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1b80851a0 con 0x7ff1c80adf30 2023-11-28T11:08:48.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.695+0000 7ff1c67fc700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff1b4068340 0x7ff1b406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.696+0000 7f8ee7fff700 1 -- 172.21.15.125:0/1109255794 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8ef000e070 con 0x7f8f000ae850 2023-11-28T11:08:48.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.696+0000 7f8f05b61700 1 -- 172.21.15.125:0/1109255794 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0006ae20 con 0x7f8f000ae850 2023-11-28T11:08:48.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.696+0000 7ff1c67fc700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff1b4068340 0x7ff1b406a7f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc000f60 tx=0x7ff1bc007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.696+0000 7fbd37fff700 1 -- 172.21.15.125:0/2132143043 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbd440523b0 con 0x7fbd5015e910 2023-11-28T11:08:48.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.696+0000 7f8ee7fff700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8ee8068450 0x7f8ee806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.696+0000 7f8ee7fff700 1 -- 172.21.15.125:0/1109255794 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ef0086a90 con 0x7f8f000ae850 2023-11-28T11:08:48.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.696+0000 7f8eff7fe700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8ee8068450 0x7f8ee806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.697+0000 7f8eff7fe700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8ee8068450 0x7f8ee806a900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009960 tx=0x7f8ef40090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.699+0000 7ff1af7fe700 1 -- 172.21.15.125:0/3426692767 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff1b8051990 con 0x7ff1c80adf30 2023-11-28T11:08:48.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.703+0000 7f4556ffd700 1 -- 172.21.15.125:0/3605675030 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f455804b5e0 con 0x7f456806cdd0 2023-11-28T11:08:48.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.704+0000 7f8ee7fff700 1 -- 172.21.15.125:0/1109255794 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8ef00532b0 con 0x7f8f000ae850 2023-11-28T11:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.710+0000 7f47187cb700 1 -- 172.21.15.125:0/2539674954 shutdown_connections 2023-11-28T11:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.710+0000 7f47187cb700 1 -- 172.21.15.125:0/2539674954 wait complete. 2023-11-28T11:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.712+0000 7f47187cb700 1 Processor -- start 2023-11-28T11:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.713+0000 7f47187cb700 1 -- start start 2023-11-28T11:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.714+0000 7f47187cb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f471006d230 0x7f471016b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.714+0000 7f47187cb700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47100b0c50 0x7f47101ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.714+0000 7f47187cb700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4710158980 0x7f471014aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.714+0000 7f47187cb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47100b2e20 con 0x7f471006d230 2023-11-28T11:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.714+0000 7f47187cb700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47100c5410 con 0x7f4710158980 2023-11-28T11:08:48.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.714+0000 7f47187cb700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47100c4e50 con 0x7f47100b0c50 2023-11-28T11:08:48.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.716+0000 7f4716567700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f471006d230 0x7f471016b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.716+0000 7f4716567700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f471006d230 0x7f471016b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57242/0 (socket says 172.21.15.125:57242) 2023-11-28T11:08:48.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.716+0000 7f4716567700 1 -- 172.21.15.125:0/3384794261 learned_addr learned my addr 172.21.15.125:0/3384794261 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.716+0000 7f4715d66700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47100b0c50 0x7f47101ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.716+0000 7f4716567700 1 -- 172.21.15.125:0/3384794261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47100b0c50 msgr2=0x7f47101ff0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.716+0000 7f4716567700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47100b0c50 0x7f47101ff0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.716+0000 7f4716567700 1 -- 172.21.15.125:0/3384794261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4710158980 msgr2=0x7f471014aff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T11:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.716+0000 7f4716567700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4710158980 0x7f471014aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.716+0000 7f4716567700 1 -- 172.21.15.125:0/3384794261 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4700009de0 con 0x7f471006d230 2023-11-28T11:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.717+0000 7f4716567700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f471006d230 0x7f471016b110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4700009630 tx=0x7f4700004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.717+0000 7f4706ffd700 1 -- 172.21.15.125:0/3384794261 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700004590 con 0x7f471006d230 2023-11-28T11:08:48.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.717+0000 7f4706ffd700 1 -- 172.21.15.125:0/3384794261 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470001f070 con 0x7f471006d230 2023-11-28T11:08:48.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.717+0000 7f4706ffd700 1 -- 172.21.15.125:0/3384794261 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47000038c0 con 0x7f471006d230 2023-11-28T11:08:48.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.717+0000 7f47187cb700 1 -- 172.21.15.125:0/3384794261 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47100cb090 con 0x7f471006d230 2023-11-28T11:08:48.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.718+0000 7f47187cb700 1 -- 172.21.15.125:0/3384794261 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47100cadb0 con 0x7f471006d230 2023-11-28T11:08:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.722+0000 7f4706ffd700 1 -- 172.21.15.125:0/3384794261 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f470000f050 con 0x7f471006d230 2023-11-28T11:08:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.723+0000 7f4706ffd700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f46f40683c0 0x7f46f406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.723+0000 7f4706ffd700 1 -- 172.21.15.125:0/3384794261 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4700021070 con 0x7f471006d230 2023-11-28T11:08:48.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.724+0000 7f47187cb700 1 -- 172.21.15.125:0/3384794261 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f80052f0 con 0x7f471006d230 2023-11-28T11:08:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.730+0000 7f4715d66700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f46f40683c0 0x7f46f406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.731+0000 7f4715d66700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f46f40683c0 0x7f46f406a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f47100ae130 tx=0x7f470c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.733+0000 7f4706ffd700 1 -- 172.21.15.125:0/3384794261 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f47000541a0 con 0x7f471006d230 2023-11-28T11:08:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.734+0000 7f08a96d1700 1 Processor -- start 2023-11-28T11:08:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.734+0000 7f08a96d1700 1 -- start start 2023-11-28T11:08:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.735+0000 7f08a96d1700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08a40ce1f0 0x7f08a40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.735+0000 7f08a96d1700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f08a40ae1c0 0x7f08a40b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.735+0000 7f08a96d1700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a4160f40 con 0x7f08a40ce5c0 2023-11-28T11:08:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.735+0000 7f08a96d1700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a40714b0 con 0x7f08a40ae1c0 2023-11-28T11:08:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.735+0000 7f08a96d1700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4071790 con 0x7f08a40ce1f0 2023-11-28T11:08:48.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.736+0000 7f08a27fc700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f08a40ce5c0 0x7f08a41616e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:44178/0 (socket says 172.21.15.125:44178) 2023-11-28T11:08:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.736+0000 7f08a27fc700 1 -- 172.21.15.125:0/2929546779 learned_addr learned my addr 172.21.15.125:0/2929546779 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.736+0000 7f08a2ffd700 1 --2- 172.21.15.125:0/2929546779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08a40ce1f0 0x7f08a40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.736+0000 7f08a37fe700 1 --2- 172.21.15.125:0/2929546779 >> v2:172.21.15.167:3300/0 conn(0x7f08a40ae1c0 0x7f08a40b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.737+0000 7f08a1ffb700 1 -- 172.21.15.125:0/2929546779 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039738359 0 0) 0x7f08a4160f40 con 0x7f08a40ce5c0 2023-11-28T11:08:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.737+0000 7f08a1ffb700 1 -- 172.21.15.125:0/2929546779 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f088c0035b0 con 0x7f08a40ce5c0 2023-11-28T11:08:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.745+0000 7f08a37fe700 1 -- 172.21.15.125:0/2929546779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08a40ce1f0 msgr2=0x7f08a40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.745+0000 7f08a37fe700 1 --2- 172.21.15.125:0/2929546779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08a40ce1f0 0x7f08a40adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.745+0000 7f08a37fe700 1 -- 172.21.15.125:0/2929546779 >> v1:172.21.15.167:6789/0 conn(0x7f08a40ce5c0 legacy=0x7f08a41616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.745+0000 7f08a37fe700 1 -- 172.21.15.125:0/2929546779 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a4071a70 con 0x7f08a40ae1c0 2023-11-28T11:08:48.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.748+0000 7f08a37fe700 1 --2- 172.21.15.125:0/2929546779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08a40ae1c0 0x7f08a40b05d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0894009840 tx=0x7f0894009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b11fae326955e18 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.748+0000 7f08a1ffb700 1 -- 172.21.15.125:0/2929546779 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894011830 con 0x7f08a40ae1c0 2023-11-28T11:08:48.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.748+0000 7f08a1ffb700 1 -- 172.21.15.125:0/2929546779 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0894011990 con 0x7f08a40ae1c0 2023-11-28T11:08:48.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.748+0000 7f08a1ffb700 1 -- 172.21.15.125:0/2929546779 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894011d20 con 0x7f08a40ae1c0 2023-11-28T11:08:48.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.749+0000 7f08a96d1700 1 -- 172.21.15.125:0/2929546779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08a40ae1c0 msgr2=0x7f08a40b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:48.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.749+0000 7f08a96d1700 1 --2- 172.21.15.125:0/2929546779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08a40ae1c0 0x7f08a40b05d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0894009840 tx=0x7f0894009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:48.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.749+0000 7f08a96d1700 1 -- 172.21.15.125:0/2929546779 shutdown_connections 2023-11-28T11:08:48.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.749+0000 7f08a96d1700 1 --2- 172.21.15.125:0/2929546779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08a40ae1c0 0x7f08a40b05d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.749+0000 7f08a96d1700 1 --2- 172.21.15.125:0/2929546779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08a40ce1f0 0x7f08a40adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.749+0000 7f08a96d1700 1 -- 172.21.15.125:0/2929546779 >> 172.21.15.125:0/2929546779 conn(0x7f08a40cb410 msgr2=0x7f08a40cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:48.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.750+0000 7f08a96d1700 1 -- 172.21.15.125:0/2929546779 shutdown_connections 2023-11-28T11:08:48.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.750+0000 7f08a96d1700 1 -- 172.21.15.125:0/2929546779 wait complete. 2023-11-28T11:08:48.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.752+0000 7f08a96d1700 1 Processor -- start 2023-11-28T11:08:48.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.752+0000 7f08a96d1700 1 -- start start 2023-11-28T11:08:48.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.753+0000 7f08a96d1700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08a40ae1c0 0x7f08a4140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.753+0000 7f08a96d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08a40ce1f0 0x7f08a4133de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.753+0000 7f08a96d1700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08a40ce5c0 0x7f08a4134320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.753+0000 7f08a96d1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4160c10 con 0x7f08a40ce1f0 2023-11-28T11:08:48.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.753+0000 7f08a96d1700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41602e0 con 0x7f08a40ae1c0 2023-11-28T11:08:48.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.753+0000 7f08a96d1700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41605c0 con 0x7f08a40ce5c0 2023-11-28T11:08:48.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.754+0000 7f08a27fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08a40ce1f0 0x7f08a4133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.754+0000 7f08a27fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08a40ce1f0 0x7f08a4133de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57256/0 (socket says 172.21.15.125:57256) 2023-11-28T11:08:48.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.754+0000 7f08a27fc700 1 -- 172.21.15.125:0/1703540455 learned_addr learned my addr 172.21.15.125:0/1703540455 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:48.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.755+0000 7f08a27fc700 1 -- 172.21.15.125:0/1703540455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08a40ce5c0 msgr2=0x7f08a4134320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T11:08:48.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.755+0000 7f08a27fc700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08a40ce5c0 0x7f08a4134320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.755+0000 7f08a27fc700 1 -- 172.21.15.125:0/1703540455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08a40ae1c0 msgr2=0x7f08a4140140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T11:08:48.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.755+0000 7f08a27fc700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08a40ae1c0 0x7f08a4140140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:48.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.755+0000 7f08a27fc700 1 -- 172.21.15.125:0/1703540455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940094a0 con 0x7f08a40ce1f0 2023-11-28T11:08:48.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.755+0000 7f08a27fc700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08a40ce1f0 0x7f08a4133de0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0898001eb0 tx=0x7f089800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.757+0000 7f088b7fe700 1 -- 172.21.15.125:0/1703540455 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0898005d70 con 0x7f08a40ce1f0 2023-11-28T11:08:48.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.757+0000 7f088b7fe700 1 -- 172.21.15.125:0/1703540455 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08980070d0 con 0x7f08a40ce1f0 2023-11-28T11:08:48.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.757+0000 7f088b7fe700 1 -- 172.21.15.125:0/1703540455 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0898007440 con 0x7f08a40ce1f0 2023-11-28T11:08:48.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.757+0000 7f08a96d1700 1 -- 172.21.15.125:0/1703540455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a4161df0 con 0x7f08a40ce1f0 2023-11-28T11:08:48.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.757+0000 7f08a96d1700 1 -- 172.21.15.125:0/1703540455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a41611c0 con 0x7f08a40ce1f0 2023-11-28T11:08:48.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.762+0000 7f088b7fe700 1 -- 172.21.15.125:0/1703540455 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0898019030 con 0x7f08a40ce1f0 2023-11-28T11:08:48.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.763+0000 7f088b7fe700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f08900683c0 0x7f089006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:48.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.763+0000 7f088b7fe700 1 -- 172.21.15.125:0/1703540455 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0898084ef0 con 0x7f08a40ce1f0 2023-11-28T11:08:48.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.763+0000 7f08a2ffd700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f08900683c0 0x7f089006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:48.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.764+0000 7f08a2ffd700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f08900683c0 0x7f089006a870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f089c00e190 tx=0x7f089c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:48.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.764+0000 7f08a96d1700 1 -- 172.21.15.125:0/1703540455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08840052f0 con 0x7f08a40ce1f0 2023-11-28T11:08:48.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:48.774+0000 7f088b7fe700 1 -- 172.21.15.125:0/1703540455 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f089804b5e0 con 0x7f08a40ce1f0 2023-11-28T11:08:49.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.004+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2390693932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc5140055a0 con 0x7fc53406d230 2023-11-28T11:08:49.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.006+0000 7fc51bfff700 1 -- 172.21.15.125:0/2390693932 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc524057280 con 0x7fc53406d230 2023-11-28T11:08:49.009 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-11-28T11:08:49.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.009+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2390693932 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc5200683c0 msgr2=0x7fc52006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.009+0000 7fc53a1ed700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc5200683c0 0x7fc52006a870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc5340ac8c0 tx=0x7fc528008040 comp rx=0 tx=0).stop 2023-11-28T11:08:49.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.009+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2390693932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53406d230 msgr2=0x7fc5340c2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.009+0000 7fc53a1ed700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53406d230 0x7fc5340c2c00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc524000c00 tx=0x7fc524004750 comp rx=0 tx=0).stop 2023-11-28T11:08:49.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.010+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2390693932 shutdown_connections 2023-11-28T11:08:49.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.010+0000 7fc53a1ed700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc534158980 0x7fc5340aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.010+0000 7fc53a1ed700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53406d230 0x7fc5340c2c00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.010+0000 7fc53a1ed700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc5200683c0 0x7fc52006a870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.010+0000 7fc53a1ed700 1 --2- 172.21.15.125:0/2390693932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5340b0540 0x7fc5340ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.010+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2390693932 >> 172.21.15.125:0/2390693932 conn(0x7fc53406aed0 msgr2=0x7fc5340cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.010+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2390693932 shutdown_connections 2023-11-28T11:08:49.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.010+0000 7fc53a1ed700 1 -- 172.21.15.125:0/2390693932 wait complete. 2023-11-28T11:08:49.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-11-28T11:08:49.029 DEBUG:teuthology.parallel:result is None 2023-11-28T11:08:49.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.057+0000 7f24e8ea0700 1 -- 172.21.15.125:0/3362594412 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f24e4163560 con 0x7f24e41609c0 2023-11-28T11:08:49.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.057+0000 7f24d2ffd700 1 -- 172.21.15.125:0/3362594412 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24dc056200 con 0x7f24e41609c0 2023-11-28T11:08:49.058 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-11-28T11:08:49.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.061+0000 7f24e8ea0700 1 -- 172.21.15.125:0/3362594412 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c4068340 msgr2=0x7f24c406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.061+0000 7f24e8ea0700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c4068340 0x7f24c406a7f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24d400ac10 tx=0x7f24d4008040 comp rx=0 tx=0).stop 2023-11-28T11:08:49.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.061+0000 7f24e8ea0700 1 -- 172.21.15.125:0/3362594412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e41609c0 msgr2=0x7f24e40c3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.061+0000 7f24e8ea0700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e41609c0 0x7f24e40c3860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00cb10 tx=0x7f24dc00ce20 comp rx=0 tx=0).stop 2023-11-28T11:08:49.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.061+0000 7f24e8ea0700 1 -- 172.21.15.125:0/3362594412 shutdown_connections 2023-11-28T11:08:49.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.061+0000 7f24e8ea0700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c4068340 0x7f24c406a7f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.061+0000 7f24e8ea0700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e41609c0 0x7f24e40c3860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.061+0000 7f24e8ea0700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e406cdd0 0x7f24e4163880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.061+0000 7f24e8ea0700 1 --2- 172.21.15.125:0/3362594412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40b0a80 0x7f24e4162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.061+0000 7f24e8ea0700 1 -- 172.21.15.125:0/3362594412 >> 172.21.15.125:0/3362594412 conn(0x7f24e406aed0 msgr2=0x7f24e415edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.062+0000 7f24e8ea0700 1 -- 172.21.15.125:0/3362594412 shutdown_connections 2023-11-28T11:08:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.062+0000 7f24e8ea0700 1 -- 172.21.15.125:0/3362594412 wait complete. 2023-11-28T11:08:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.063+0000 7f8f05b61700 1 -- 172.21.15.125:0/1109255794 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ee00051a0 con 0x7f8f000ae850 2023-11-28T11:08:49.064 INFO:teuthology.orchestra.run.smithi125.stdout:55834574857 2023-11-28T11:08:49.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.064+0000 7f8ee7fff700 1 -- 172.21.15.125:0/1109255794 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ef0028020 con 0x7f8f000ae850 2023-11-28T11:08:49.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.068+0000 7f8f05b61700 1 -- 172.21.15.125:0/1109255794 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8ee8068450 msgr2=0x7f8ee806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.068+0000 7f8f05b61700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8ee8068450 0x7f8ee806a900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009960 tx=0x7f8ef40090e0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.068+0000 7f8f05b61700 1 -- 172.21.15.125:0/1109255794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f000ae850 msgr2=0x7f8f0015aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.068+0000 7f8f05b61700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f000ae850 0x7f8f0015aaf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0019000 tx=0x7f8ef0004750 comp rx=0 tx=0).stop 2023-11-28T11:08:49.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.071+0000 7f8f05b61700 1 -- 172.21.15.125:0/1109255794 shutdown_connections 2023-11-28T11:08:49.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.071+0000 7f8f05b61700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f00158e10 0x7f8f00159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.071+0000 7f8f05b61700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f0006c980 0x7f8f0015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.071+0000 7f8f05b61700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8ee8068450 0x7f8ee806a900 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.071+0000 7f8f05b61700 1 --2- 172.21.15.125:0/1109255794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f000ae850 0x7f8f0015aaf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.071+0000 7f8f05b61700 1 -- 172.21.15.125:0/1109255794 >> 172.21.15.125:0/1109255794 conn(0x7f8f000cf400 msgr2=0x7f8f000730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.074+0000 7f8f05b61700 1 -- 172.21.15.125:0/1109255794 shutdown_connections 2023-11-28T11:08:49.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.074+0000 7f8f05b61700 1 -- 172.21.15.125:0/1109255794 wait complete. 2023-11-28T11:08:49.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.077+0000 7fbd56242700 1 -- 172.21.15.125:0/2132143043 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbd500743f0 con 0x7fbd5015e910 2023-11-28T11:08:49.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-11-28T11:08:49.079 DEBUG:teuthology.parallel:result is None 2023-11-28T11:08:49.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.079+0000 7fbd37fff700 1 -- 172.21.15.125:0/2132143043 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd440092d0 con 0x7fbd5015e910 2023-11-28T11:08:49.082 INFO:teuthology.orchestra.run.smithi125.stdout:55834574858 2023-11-28T11:08:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.082+0000 7fbd56242700 1 -- 172.21.15.125:0/2132143043 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd3c0682f0 msgr2=0x7fbd3c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.082+0000 7fbd56242700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd3c0682f0 0x7fbd3c06a7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009c40 tx=0x7fbd40008030 comp rx=0 tx=0).stop 2023-11-28T11:08:49.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.082+0000 7fbd56242700 1 -- 172.21.15.125:0/2132143043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5015e910 msgr2=0x7fbd5015bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.082+0000 7fbd56242700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5015e910 0x7fbd5015bb80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400b550 tx=0x7fbd4400b910 comp rx=0 tx=0).stop 2023-11-28T11:08:49.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.082+0000 7fbd56242700 1 -- 172.21.15.125:0/2132143043 shutdown_connections 2023-11-28T11:08:49.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.082+0000 7fbd56242700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd500cdd30 0x7fbd500ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.082+0000 7fbd56242700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd3c0682f0 0x7fbd3c06a7a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.082+0000 7fbd56242700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd500b0540 0x7fbd50150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.082+0000 7fbd56242700 1 --2- 172.21.15.125:0/2132143043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5015e910 0x7fbd5015bb80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.082+0000 7fbd56242700 1 -- 172.21.15.125:0/2132143043 >> 172.21.15.125:0/2132143043 conn(0x7fbd500cb540 msgr2=0x7fbd500cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.083+0000 7fbd56242700 1 -- 172.21.15.125:0/2132143043 shutdown_connections 2023-11-28T11:08:49.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.083+0000 7fbd56242700 1 -- 172.21.15.125:0/2132143043 wait complete. 2023-11-28T11:08:49.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.087+0000 7ff1cd41d700 1 -- 172.21.15.125:0/3426692767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff1c80743f0 con 0x7ff1c80adf30 2023-11-28T11:08:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.087+0000 7ff1af7fe700 1 -- 172.21.15.125:0/3426692767 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1b8018090 con 0x7ff1c80adf30 2023-11-28T11:08:49.089 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-11-28T11:08:49.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.089+0000 7f456cabc700 1 -- 172.21.15.125:0/3605675030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f454c0055a0 con 0x7f456806cdd0 2023-11-28T11:08:49.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.090+0000 7f4556ffd700 1 -- 172.21.15.125:0/3605675030 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4558017070 con 0x7f456806cdd0 2023-11-28T11:08:49.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.090+0000 7ff1cd41d700 1 -- 172.21.15.125:0/3426692767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff1b4068340 msgr2=0x7ff1b406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.090+0000 7ff1cd41d700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff1b4068340 0x7ff1b406a7f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc000f60 tx=0x7ff1bc007a40 comp rx=0 tx=0).stop 2023-11-28T11:08:49.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.090+0000 7ff1cd41d700 1 -- 172.21.15.125:0/3426692767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 msgr2=0x7ff1c80c5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.090+0000 7ff1cd41d700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 0x7ff1c80c5190 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800c780 tx=0x7ff1b800cb40 comp rx=0 tx=0).stop 2023-11-28T11:08:49.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.090+0000 7ff1cd41d700 1 -- 172.21.15.125:0/3426692767 shutdown_connections 2023-11-28T11:08:49.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.090+0000 7ff1cd41d700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c80c9b00 0x7ff1c80b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.090+0000 7ff1cd41d700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff1b4068340 0x7ff1b406a7f0 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc000f60 tx=0x7ff1bc007a40 comp rx=0 tx=0).stop 2023-11-28T11:08:49.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.090+0000 7ff1cd41d700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1c80adf30 0x7ff1c80c5190 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.090+0000 7ff1cd41d700 1 --2- 172.21.15.125:0/3426692767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c80b0540 0x7ff1c8150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.090+0000 7ff1cd41d700 1 -- 172.21.15.125:0/3426692767 >> 172.21.15.125:0/3426692767 conn(0x7ff1c80cb540 msgr2=0x7ff1c80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.091+0000 7ff1cd41d700 1 -- 172.21.15.125:0/3426692767 shutdown_connections 2023-11-28T11:08:49.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.091+0000 7ff1cd41d700 1 -- 172.21.15.125:0/3426692767 wait complete. 2023-11-28T11:08:49.094 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-11-28T11:08:49.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-11-28T11:08:49.096 DEBUG:teuthology.parallel:result is None 2023-11-28T11:08:49.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 -- 172.21.15.125:0/3605675030 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45480682c0 msgr2=0x7f454806a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45480682c0 0x7f454806a770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f455c000c00 tx=0x7f455c008030 comp rx=0 tx=0).stop 2023-11-28T11:08:49.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 -- 172.21.15.125:0/3605675030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f456806cdd0 msgr2=0x7f45681f3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f456806cdd0 0x7f45681f3ae0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f455800ea00 tx=0x7f455800ed10 comp rx=0 tx=0).stop 2023-11-28T11:08:49.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 -- 172.21.15.125:0/3605675030 shutdown_connections 2023-11-28T11:08:49.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45681609c0 0x7f45681f9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f456806cdd0 0x7f45681f3ae0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45480682c0 0x7f454806a770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 --2- 172.21.15.125:0/3605675030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45680b0a80 0x7f45681f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 -- 172.21.15.125:0/3605675030 >> 172.21.15.125:0/3605675030 conn(0x7f456806aed0 msgr2=0x7f4568070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 -- 172.21.15.125:0/3605675030 shutdown_connections 2023-11-28T11:08:49.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.096+0000 7f456cabc700 1 -- 172.21.15.125:0/3605675030 wait complete. 2023-11-28T11:08:49.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-11-28T11:08:49.106 DEBUG:teuthology.parallel:result is None 2023-11-28T11:08:49.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-11-28T11:08:49.106 DEBUG:teuthology.parallel:result is None 2023-11-28T11:08:49.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.110+0000 7f47187cb700 1 -- 172.21.15.125:0/3384794261 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f46f80055a0 con 0x7f471006d230 2023-11-28T11:08:49.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.110+0000 7f4706ffd700 1 -- 172.21.15.125:0/3384794261 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4700015020 con 0x7f471006d230 2023-11-28T11:08:49.111 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-11-28T11:08:49.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.112+0000 7f47187cb700 1 -- 172.21.15.125:0/3384794261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f46f40683c0 msgr2=0x7f46f406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.112+0000 7f47187cb700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f46f40683c0 0x7f46f406a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f47100ae130 tx=0x7f470c009040 comp rx=0 tx=0).stop 2023-11-28T11:08:49.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.112+0000 7f47187cb700 1 -- 172.21.15.125:0/3384794261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f471006d230 msgr2=0x7f471016b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.112+0000 7f47187cb700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f471006d230 0x7f471016b110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4700009630 tx=0x7f4700004750 comp rx=0 tx=0).stop 2023-11-28T11:08:49.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.113+0000 7f47187cb700 1 -- 172.21.15.125:0/3384794261 shutdown_connections 2023-11-28T11:08:49.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.113+0000 7f47187cb700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4710158980 0x7f471014aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.113+0000 7f47187cb700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f471006d230 0x7f471016b110 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.113+0000 7f47187cb700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f46f40683c0 0x7f46f406a870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.113+0000 7f47187cb700 1 --2- 172.21.15.125:0/3384794261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47100b0c50 0x7f47101ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.113+0000 7f47187cb700 1 -- 172.21.15.125:0/3384794261 >> 172.21.15.125:0/3384794261 conn(0x7f471006aed0 msgr2=0x7f47100b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.113+0000 7f47187cb700 1 -- 172.21.15.125:0/3384794261 shutdown_connections 2023-11-28T11:08:49.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.113+0000 7f47187cb700 1 -- 172.21.15.125:0/3384794261 wait complete. 2023-11-28T11:08:49.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-11-28T11:08:49.120 DEBUG:teuthology.parallel:result is None 2023-11-28T11:08:49.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-11-28T11:08:49.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.126+0000 7f08a96d1700 1 -- 172.21.15.125:0/1703540455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f08840055a0 con 0x7f08a40ce1f0 2023-11-28T11:08:49.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.126+0000 7f088b7fe700 1 -- 172.21.15.125:0/1703540455 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0898017030 con 0x7f08a40ce1f0 2023-11-28T11:08:49.127 DEBUG:teuthology.parallel:result is None 2023-11-28T11:08:49.128 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-11-28T11:08:49.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.128+0000 7f08a96d1700 1 -- 172.21.15.125:0/1703540455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f08900683c0 msgr2=0x7f089006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.128+0000 7f08a96d1700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f08900683c0 0x7f089006a870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f089c00e190 tx=0x7f089c00b040 comp rx=0 tx=0).stop 2023-11-28T11:08:49.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.128+0000 7f08a96d1700 1 -- 172.21.15.125:0/1703540455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08a40ce1f0 msgr2=0x7f08a4133de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.128+0000 7f08a96d1700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08a40ce1f0 0x7f08a4133de0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0898001eb0 tx=0x7f089800c860 comp rx=0 tx=0).stop 2023-11-28T11:08:49.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.128+0000 7f08a96d1700 1 -- 172.21.15.125:0/1703540455 shutdown_connections 2023-11-28T11:08:49.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.128+0000 7f08a96d1700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f08900683c0 0x7f089006a870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.129+0000 7f08a96d1700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08a40ce5c0 0x7f08a4134320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.129+0000 7f08a96d1700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08a40ae1c0 0x7f08a4140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.129+0000 7f08a96d1700 1 --2- 172.21.15.125:0/1703540455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08a40ce1f0 0x7f08a4133de0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.129+0000 7f08a96d1700 1 -- 172.21.15.125:0/1703540455 >> 172.21.15.125:0/1703540455 conn(0x7f08a40cb410 msgr2=0x7f08a40c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.129+0000 7f08a96d1700 1 -- 172.21.15.125:0/1703540455 shutdown_connections 2023-11-28T11:08:49.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.129+0000 7f08a96d1700 1 -- 172.21.15.125:0/1703540455 wait complete. 2023-11-28T11:08:49.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-11-28T11:08:49.141 DEBUG:teuthology.parallel:result is None 2023-11-28T11:08:49.141 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T11:08:49.141 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:08:49.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.300+0000 7f7d1df9c700 1 Processor -- start 2023-11-28T11:08:49.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.300+0000 7f7d1df9c700 1 -- start start 2023-11-28T11:08:49.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d1df9c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d180ce040 0x7f7d1815d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d1df9c700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7d18142db0 0x7f7d1813ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d1df9c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d180b1770 0x7f7d180b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d1df9c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d180b2110 con 0x7f7d180ce040 2023-11-28T11:08:49.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d1df9c700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1813fc90 con 0x7f7d18142db0 2023-11-28T11:08:49.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d1df9c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1813f6d0 con 0x7f7d180b1770 2023-11-28T11:08:49.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d177fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d180ce040 0x7f7d1815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d177fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d180ce040 0x7f7d1815d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57262/0 (socket says 172.21.15.125:57262) 2023-11-28T11:08:49.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d177fe700 1 -- 172.21.15.125:0/2379191517 learned_addr learned my addr 172.21.15.125:0/2379191517 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:49.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d17fff700 1 --2- 172.21.15.125:0/2379191517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d180b1770 0x7f7d180b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d16ffd700 1 --2- 172.21.15.125:0/2379191517 >> v2:172.21.15.167:3300/0 conn(0x7f7d18142db0 0x7f7d1813ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d177fe700 1 -- 172.21.15.125:0/2379191517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d180b1770 msgr2=0x7f7d180b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:49.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d177fe700 1 --2- 172.21.15.125:0/2379191517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d180b1770 0x7f7d180b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d177fe700 1 -- 172.21.15.125:0/2379191517 >> v2:172.21.15.167:3300/0 conn(0x7f7d18142db0 msgr2=0x7f7d1813ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:49.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d177fe700 1 --2- 172.21.15.125:0/2379191517 >> v2:172.21.15.167:3300/0 conn(0x7f7d18142db0 0x7f7d1813ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d177fe700 1 -- 172.21.15.125:0/2379191517 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1813f9b0 con 0x7f7d180ce040 2023-11-28T11:08:49.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.301+0000 7f7d17fff700 1 --2- 172.21.15.125:0/2379191517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d180b1770 0x7f7d180b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:49.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d177fe700 1 --2- 172.21.15.125:0/2379191517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d180ce040 0x7f7d1815d900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7d180cfc20 tx=0x7f7d0000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3145fb4c8dd37f74 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:49.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d167fc700 1 -- 172.21.15.125:0/2379191517 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000dd30 con 0x7f7d180ce040 2023-11-28T11:08:49.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d167fc700 1 -- 172.21.15.125:0/2379191517 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0000de90 con 0x7f7d180ce040 2023-11-28T11:08:49.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d167fc700 1 -- 172.21.15.125:0/2379191517 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00010690 con 0x7f7d180ce040 2023-11-28T11:08:49.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d1df9c700 1 -- 172.21.15.125:0/2379191517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d180ce040 msgr2=0x7f7d1815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d1df9c700 1 --2- 172.21.15.125:0/2379191517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d180ce040 0x7f7d1815d900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7d180cfc20 tx=0x7f7d0000be70 comp rx=0 tx=0).stop 2023-11-28T11:08:49.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d1df9c700 1 -- 172.21.15.125:0/2379191517 shutdown_connections 2023-11-28T11:08:49.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d1df9c700 1 --2- 172.21.15.125:0/2379191517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d180b1770 0x7f7d180b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d1df9c700 1 --2- 172.21.15.125:0/2379191517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d180ce040 0x7f7d1815d900 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d1df9c700 1 --2- 172.21.15.125:0/2379191517 >> v2:172.21.15.167:3300/0 conn(0x7f7d18142db0 0x7f7d1813ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d1df9c700 1 -- 172.21.15.125:0/2379191517 >> 172.21.15.125:0/2379191517 conn(0x7f7d1806c010 msgr2=0x7f7d180cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d1df9c700 1 -- 172.21.15.125:0/2379191517 shutdown_connections 2023-11-28T11:08:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.302+0000 7f7d1df9c700 1 -- 172.21.15.125:0/2379191517 wait complete. 2023-11-28T11:08:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.303+0000 7f7d1df9c700 1 Processor -- start 2023-11-28T11:08:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.304+0000 7f7d1df9c700 1 -- start start 2023-11-28T11:08:49.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.304+0000 7f7d1df9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d180b1770 0x7f7d180b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.304+0000 7f7d1df9c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d180ce040 0x7f7d1815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.304+0000 7f7d1df9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d18142db0 0x7f7d1815b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.304+0000 7f7d1df9c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180b4cc0 con 0x7f7d180b1770 2023-11-28T11:08:49.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.304+0000 7f7d1df9c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180b4ef0 con 0x7f7d18142db0 2023-11-28T11:08:49.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.304+0000 7f7d1df9c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180b51d0 con 0x7f7d180ce040 2023-11-28T11:08:49.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.304+0000 7f7d177fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d180b1770 0x7f7d180b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.304+0000 7f7d177fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d180b1770 0x7f7d180b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57268/0 (socket says 172.21.15.125:57268) 2023-11-28T11:08:49.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d177fe700 1 -- 172.21.15.125:0/548175767 learned_addr learned my addr 172.21.15.125:0/548175767 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:49.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d17fff700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d18142db0 0x7f7d1815b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d177fe700 1 -- 172.21.15.125:0/548175767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d180ce040 msgr2=0x7f7d1815b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d16ffd700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d180ce040 0x7f7d1815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d177fe700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d180ce040 0x7f7d1815b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d177fe700 1 -- 172.21.15.125:0/548175767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d18142db0 msgr2=0x7f7d1815b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d177fe700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d18142db0 0x7f7d1815b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d177fe700 1 -- 172.21.15.125:0/548175767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0000b7f0 con 0x7f7d180b1770 2023-11-28T11:08:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d177fe700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d180b1770 0x7f7d180b4780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000beb0 tx=0x7f7d00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d0ffff700 1 -- 172.21.15.125:0/548175767 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00003da0 con 0x7f7d180b1770 2023-11-28T11:08:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d0ffff700 1 -- 172.21.15.125:0/548175767 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d00010470 con 0x7f7d180b1770 2023-11-28T11:08:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d0ffff700 1 -- 172.21.15.125:0/548175767 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00010800 con 0x7f7d180b1770 2023-11-28T11:08:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d1df9c700 1 -- 172.21.15.125:0/548175767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1815d3e0 con 0x7f7d180b1770 2023-11-28T11:08:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.305+0000 7f7d1df9c700 1 -- 172.21.15.125:0/548175767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1815d100 con 0x7f7d180b1770 2023-11-28T11:08:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.306+0000 7f7d1df9c700 1 -- 172.21.15.125:0/548175767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d180ce410 con 0x7f7d180b1770 2023-11-28T11:08:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.306+0000 7f7d0ffff700 1 -- 172.21.15.125:0/548175767 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7d00019400 con 0x7f7d180b1770 2023-11-28T11:08:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.307+0000 7f7d0ffff700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7cf80682f0 0x7f7cf806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.307+0000 7f7d0ffff700 1 -- 172.21.15.125:0/548175767 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d00087340 con 0x7f7d180b1770 2023-11-28T11:08:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.307+0000 7f7d16ffd700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7cf80682f0 0x7f7cf806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.307+0000 7f7d16ffd700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7cf80682f0 0x7f7cf806a7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7d181423c0 tx=0x7f7d08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:49.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.311+0000 7f7d0ffff700 1 -- 172.21.15.125:0/548175767 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7d00053ac0 con 0x7f7d180b1770 2023-11-28T11:08:49.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.487+0000 7f7d1df9c700 1 -- 172.21.15.125:0/548175767 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d18068450 con 0x7f7cf80682f0 2023-11-28T11:08:49.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.495+0000 7f7d0ffff700 1 -- 172.21.15.125:0/548175767 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286568 (secure 0 0 0) 0x7f7d18068450 con 0x7f7cf80682f0 2023-11-28T11:08:49.499 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:49.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 -- 172.21.15.125:0/548175767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7cf80682f0 msgr2=0x7f7cf806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7cf80682f0 0x7f7cf806a7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7d181423c0 tx=0x7f7d08008040 comp rx=0 tx=0).stop 2023-11-28T11:08:49.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 -- 172.21.15.125:0/548175767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d180b1770 msgr2=0x7f7d180b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d180b1770 0x7f7d180b4780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000beb0 tx=0x7f7d00004750 comp rx=0 tx=0).stop 2023-11-28T11:08:49.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 -- 172.21.15.125:0/548175767 shutdown_connections 2023-11-28T11:08:49.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d18142db0 0x7f7d1815b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d180b1770 0x7f7d180b4780 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7cf80682f0 0x7f7cf806a7a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 --2- 172.21.15.125:0/548175767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d180ce040 0x7f7d1815b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 -- 172.21.15.125:0/548175767 >> 172.21.15.125:0/548175767 conn(0x7f7d1806c010 msgr2=0x7f7d1806ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 -- 172.21.15.125:0/548175767 shutdown_connections 2023-11-28T11:08:49.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.498+0000 7f7d1df9c700 1 -- 172.21.15.125:0/548175767 wait complete. 2023-11-28T11:08:49.503 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:08:49.511 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-11-28T11:08:47.624227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66440,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":63168,"kb_avail":754908280,"statfs":{"total":773094113280,"available":773026078720,"internally_reserved":0,"allocated":3284992,"data_stored":1939556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64684032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.237736"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527689+0000","last_change":"2023-11-28T11:08:36.416297+0000","last_active":"2023-11-28T11:08:37.527689+0000","last_peered":"2023-11-28T11:08:37.527689+0000","last_clean":"2023-11-28T11:08:37.527689+0000","last_became_active":"2023-11-28T11:08:36.415977+0000","last_became_peered":"2023-11-28T11:08:36.415977+0000","last_unstale":"2023-11-28T11:08:37.527689+0000","last_undegraded":"2023-11-28T11:08:37.527689+0000","last_fullsized":"2023-11-28T11:08:37.527689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:48.481042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029908+0000","last_change":"2023-11-28T11:08:36.400367+0000","last_active":"2023-11-28T11:08:38.029908+0000","last_peered":"2023-11-28T11:08:38.029908+0000","last_clean":"2023-11-28T11:08:38.029908+0000","last_became_active":"2023-11-28T11:08:36.400076+0000","last_became_peered":"2023-11-28T11:08:36.400076+0000","last_unstale":"2023-11-28T11:08:38.029908+0000","last_undegraded":"2023-11-28T11:08:38.029908+0000","last_fullsized":"2023-11-28T11:08:38.029908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029428+0000","last_change":"2023-11-28T11:08:36.406078+0000","last_active":"2023-11-28T11:08:38.029428+0000","last_peered":"2023-11-28T11:08:38.029428+0000","last_clean":"2023-11-28T11:08:38.029428+0000","last_became_active":"2023-11-28T11:08:36.405448+0000","last_became_peered":"2023-11-28T11:08:36.405448+0000","last_unstale":"2023-11-28T11:08:38.029428+0000","last_undegraded":"2023-11-28T11:08:38.029428+0000","last_fullsized":"2023-11-28T11:08:38.029428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:34:58.025630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389721+0000","last_change":"2023-11-28T11:08:36.411547+0000","last_active":"2023-11-28T11:08:37.389721+0000","last_peered":"2023-11-28T11:08:37.389721+0000","last_clean":"2023-11-28T11:08:37.389721+0000","last_became_active":"2023-11-28T11:08:36.411251+0000","last_became_peered":"2023-11-28T11:08:36.411251+0000","last_unstale":"2023-11-28T11:08:37.389721+0000","last_undegraded":"2023-11-28T11:08:37.389721+0000","last_fullsized":"2023-11-28T11:08:37.389721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:30.748107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388308+0000","last_change":"2023-11-28T11:08:36.408744+0000","last_active":"2023-11-28T11:08:37.388308+0000","last_peered":"2023-11-28T11:08:37.388308+0000","last_clean":"2023-11-28T11:08:37.388308+0000","last_became_active":"2023-11-28T11:08:36.408499+0000","last_became_peered":"2023-11-28T11:08:36.408499+0000","last_unstale":"2023-11-28T11:08:37.388308+0000","last_undegraded":"2023-11-28T11:08:37.388308+0000","last_fullsized":"2023-11-28T11:08:37.388308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029988+0000","last_change":"2023-11-28T11:08:36.404949+0000","last_active":"2023-11-28T11:08:38.029988+0000","last_peered":"2023-11-28T11:08:38.029988+0000","last_clean":"2023-11-28T11:08:38.029988+0000","last_became_active":"2023-11-28T11:08:36.404662+0000","last_became_peered":"2023-11-28T11:08:36.404662+0000","last_unstale":"2023-11-28T11:08:38.029988+0000","last_undegraded":"2023-11-28T11:08:38.029988+0000","last_fullsized":"2023-11-28T11:08:38.029988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:50.488364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389610+0000","last_change":"2023-11-28T11:08:36.407228+0000","last_active":"2023-11-28T11:08:37.389610+0000","last_peered":"2023-11-28T11:08:37.389610+0000","last_clean":"2023-11-28T11:08:37.389610+0000","last_became_active":"2023-11-28T11:08:36.406568+0000","last_became_peered":"2023-11-28T11:08:36.406568+0000","last_unstale":"2023-11-28T11:08:37.389610+0000","last_undegraded":"2023-11-28T11:08:37.389610+0000","last_fullsized":"2023-11-28T11:08:37.389610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029317+0000","last_change":"2023-11-28T11:08:36.404585+0000","last_active":"2023-11-28T11:08:38.029317+0000","last_peered":"2023-11-28T11:08:38.029317+0000","last_clean":"2023-11-28T11:08:38.029317+0000","last_became_active":"2023-11-28T11:08:36.404273+0000","last_became_peered":"2023-11-28T11:08:36.404273+0000","last_unstale":"2023-11-28T11:08:38.029317+0000","last_undegraded":"2023-11-28T11:08:38.029317+0000","last_fullsized":"2023-11-28T11:08:38.029317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388542+0000","last_change":"2023-11-28T11:08:36.416209+0000","last_active":"2023-11-28T11:08:37.388542+0000","last_peered":"2023-11-28T11:08:37.388542+0000","last_clean":"2023-11-28T11:08:37.388542+0000","last_became_active":"2023-11-28T11:08:36.415945+0000","last_became_peered":"2023-11-28T11:08:36.415945+0000","last_unstale":"2023-11-28T11:08:37.388542+0000","last_undegraded":"2023-11-28T11:08:37.388542+0000","last_fullsized":"2023-11-28T11:08:37.388542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029484+0000","last_change":"2023-11-28T11:08:36.393913+0000","last_active":"2023-11-28T11:08:38.029484+0000","last_peered":"2023-11-28T11:08:38.029484+0000","last_clean":"2023-11-28T11:08:38.029484+0000","last_became_active":"2023-11-28T11:08:36.393400+0000","last_became_peered":"2023-11-28T11:08:36.393400+0000","last_unstale":"2023-11-28T11:08:38.029484+0000","last_undegraded":"2023-11-28T11:08:38.029484+0000","last_fullsized":"2023-11-28T11:08:38.029484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029534+0000","last_change":"2023-11-28T11:08:36.405268+0000","last_active":"2023-11-28T11:08:38.029534+0000","last_peered":"2023-11-28T11:08:38.029534+0000","last_clean":"2023-11-28T11:08:38.029534+0000","last_became_active":"2023-11-28T11:08:36.404990+0000","last_became_peered":"2023-11-28T11:08:36.404990+0000","last_unstale":"2023-11-28T11:08:38.029534+0000","last_undegraded":"2023-11-28T11:08:38.029534+0000","last_fullsized":"2023-11-28T11:08:38.029534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:45:33.470588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527660+0000","last_change":"2023-11-28T11:08:36.405351+0000","last_active":"2023-11-28T11:08:37.527660+0000","last_peered":"2023-11-28T11:08:37.527660+0000","last_clean":"2023-11-28T11:08:37.527660+0000","last_became_active":"2023-11-28T11:08:36.405078+0000","last_became_peered":"2023-11-28T11:08:36.405078+0000","last_unstale":"2023-11-28T11:08:37.527660+0000","last_undegraded":"2023-11-28T11:08:37.527660+0000","last_fullsized":"2023-11-28T11:08:37.527660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:30.748107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527570+0000","last_change":"2023-11-28T11:08:36.408661+0000","last_active":"2023-11-28T11:08:37.527570+0000","last_peered":"2023-11-28T11:08:37.527570+0000","last_clean":"2023-11-28T11:08:37.527570+0000","last_became_active":"2023-11-28T11:08:36.408387+0000","last_became_peered":"2023-11-28T11:08:36.408387+0000","last_unstale":"2023-11-28T11:08:37.527570+0000","last_undegraded":"2023-11-28T11:08:37.527570+0000","last_fullsized":"2023-11-28T11:08:37.527570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:13.215556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029184+0000","last_change":"2023-11-28T11:08:36.401781+0000","last_active":"2023-11-28T11:08:38.029184+0000","last_peered":"2023-11-28T11:08:38.029184+0000","last_clean":"2023-11-28T11:08:38.029184+0000","last_became_active":"2023-11-28T11:08:36.401490+0000","last_became_peered":"2023-11-28T11:08:36.401490+0000","last_unstale":"2023-11-28T11:08:38.029184+0000","last_undegraded":"2023-11-28T11:08:38.029184+0000","last_fullsized":"2023-11-28T11:08:38.029184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390010+0000","last_change":"2023-11-28T11:08:36.407391+0000","last_active":"2023-11-28T11:08:37.390010+0000","last_peered":"2023-11-28T11:08:37.390010+0000","last_clean":"2023-11-28T11:08:37.390010+0000","last_became_active":"2023-11-28T11:08:36.406934+0000","last_became_peered":"2023-11-28T11:08:36.406934+0000","last_unstale":"2023-11-28T11:08:37.390010+0000","last_undegraded":"2023-11-28T11:08:37.390010+0000","last_fullsized":"2023-11-28T11:08:37.390010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029297+0000","last_change":"2023-11-28T11:08:36.405277+0000","last_active":"2023-11-28T11:08:38.029297+0000","last_peered":"2023-11-28T11:08:38.029297+0000","last_clean":"2023-11-28T11:08:38.029297+0000","last_became_active":"2023-11-28T11:08:36.405034+0000","last_became_peered":"2023-11-28T11:08:36.405034+0000","last_unstale":"2023-11-28T11:08:38.029297+0000","last_undegraded":"2023-11-28T11:08:38.029297+0000","last_fullsized":"2023-11-28T11:08:38.029297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:51.071881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388626+0000","last_change":"2023-11-28T11:08:36.416839+0000","last_active":"2023-11-28T11:08:37.388626+0000","last_peered":"2023-11-28T11:08:37.388626+0000","last_clean":"2023-11-28T11:08:37.388626+0000","last_became_active":"2023-11-28T11:08:36.416606+0000","last_became_peered":"2023-11-28T11:08:36.416606+0000","last_unstale":"2023-11-28T11:08:37.388626+0000","last_undegraded":"2023-11-28T11:08:37.388626+0000","last_fullsized":"2023-11-28T11:08:37.388626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029699+0000","last_change":"2023-11-28T11:08:36.403858+0000","last_active":"2023-11-28T11:08:38.029699+0000","last_peered":"2023-11-28T11:08:38.029699+0000","last_clean":"2023-11-28T11:08:38.029699+0000","last_became_active":"2023-11-28T11:08:36.403584+0000","last_became_peered":"2023-11-28T11:08:36.403584+0000","last_unstale":"2023-11-28T11:08:38.029699+0000","last_undegraded":"2023-11-28T11:08:38.029699+0000","last_fullsized":"2023-11-28T11:08:38.029699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527667+0000","last_change":"2023-11-28T11:08:36.413070+0000","last_active":"2023-11-28T11:08:37.527667+0000","last_peered":"2023-11-28T11:08:37.527667+0000","last_clean":"2023-11-28T11:08:37.527667+0000","last_became_active":"2023-11-28T11:08:36.412782+0000","last_became_peered":"2023-11-28T11:08:36.412782+0000","last_unstale":"2023-11-28T11:08:37.527667+0000","last_undegraded":"2023-11-28T11:08:37.527667+0000","last_fullsized":"2023-11-28T11:08:37.527667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:09.866075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029903+0000","last_change":"2023-11-28T11:08:36.412148+0000","last_active":"2023-11-28T11:08:38.029903+0000","last_peered":"2023-11-28T11:08:38.029903+0000","last_clean":"2023-11-28T11:08:38.029903+0000","last_became_active":"2023-11-28T11:08:36.411873+0000","last_became_peered":"2023-11-28T11:08:36.411873+0000","last_unstale":"2023-11-28T11:08:38.029903+0000","last_undegraded":"2023-11-28T11:08:38.029903+0000","last_fullsized":"2023-11-28T11:08:38.029903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:34:13.560527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390150+0000","last_change":"2023-11-28T11:08:36.416108+0000","last_active":"2023-11-28T11:08:37.390150+0000","last_peered":"2023-11-28T11:08:37.390150+0000","last_clean":"2023-11-28T11:08:37.390150+0000","last_became_active":"2023-11-28T11:08:36.415831+0000","last_became_peered":"2023-11-28T11:08:36.415831+0000","last_unstale":"2023-11-28T11:08:37.390150+0000","last_undegraded":"2023-11-28T11:08:37.390150+0000","last_fullsized":"2023-11-28T11:08:37.390150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388133+0000","last_change":"2023-11-28T11:08:36.404227+0000","last_active":"2023-11-28T11:08:37.388133+0000","last_peered":"2023-11-28T11:08:37.388133+0000","last_clean":"2023-11-28T11:08:37.388133+0000","last_became_active":"2023-11-28T11:08:36.403978+0000","last_became_peered":"2023-11-28T11:08:36.403978+0000","last_unstale":"2023-11-28T11:08:37.388133+0000","last_undegraded":"2023-11-28T11:08:37.388133+0000","last_fullsized":"2023-11-28T11:08:37.388133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028811+0000","last_change":"2023-11-28T11:08:36.405775+0000","last_active":"2023-11-28T11:08:38.028811+0000","last_peered":"2023-11-28T11:08:38.028811+0000","last_clean":"2023-11-28T11:08:38.028811+0000","last_became_active":"2023-11-28T11:08:36.405525+0000","last_became_peered":"2023-11-28T11:08:36.405525+0000","last_unstale":"2023-11-28T11:08:38.028811+0000","last_undegraded":"2023-11-28T11:08:38.028811+0000","last_fullsized":"2023-11-28T11:08:38.028811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390248+0000","last_change":"2023-11-28T11:08:36.416121+0000","last_active":"2023-11-28T11:08:37.390248+0000","last_peered":"2023-11-28T11:08:37.390248+0000","last_clean":"2023-11-28T11:08:37.390248+0000","last_became_active":"2023-11-28T11:08:36.415874+0000","last_became_peered":"2023-11-28T11:08:36.415874+0000","last_unstale":"2023-11-28T11:08:37.390248+0000","last_undegraded":"2023-11-28T11:08:37.390248+0000","last_fullsized":"2023-11-28T11:08:37.390248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029011+0000","last_change":"2023-11-28T11:08:36.409665+0000","last_active":"2023-11-28T11:08:38.029011+0000","last_peered":"2023-11-28T11:08:38.029011+0000","last_clean":"2023-11-28T11:08:38.029011+0000","last_became_active":"2023-11-28T11:08:36.409096+0000","last_became_peered":"2023-11-28T11:08:36.409096+0000","last_unstale":"2023-11-28T11:08:38.029011+0000","last_undegraded":"2023-11-28T11:08:38.029011+0000","last_fullsized":"2023-11-28T11:08:38.029011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028947+0000","last_change":"2023-11-28T11:08:36.401914+0000","last_active":"2023-11-28T11:08:38.028947+0000","last_peered":"2023-11-28T11:08:38.028947+0000","last_clean":"2023-11-28T11:08:38.028947+0000","last_became_active":"2023-11-28T11:08:36.401600+0000","last_became_peered":"2023-11-28T11:08:36.401600+0000","last_unstale":"2023-11-28T11:08:38.028947+0000","last_undegraded":"2023-11-28T11:08:38.028947+0000","last_fullsized":"2023-11-28T11:08:38.028947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029901+0000","last_change":"2023-11-28T11:08:36.409423+0000","last_active":"2023-11-28T11:08:38.029901+0000","last_peered":"2023-11-28T11:08:38.029901+0000","last_clean":"2023-11-28T11:08:38.029901+0000","last_became_active":"2023-11-28T11:08:36.409119+0000","last_became_peered":"2023-11-28T11:08:36.409119+0000","last_unstale":"2023-11-28T11:08:38.029901+0000","last_undegraded":"2023-11-28T11:08:38.029901+0000","last_fullsized":"2023-11-28T11:08:38.029901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030088+0000","last_change":"2023-11-28T11:08:36.008194+0000","last_active":"2023-11-28T11:08:38.030088+0000","last_peered":"2023-11-28T11:08:38.030088+0000","last_clean":"2023-11-28T11:08:38.030088+0000","last_became_active":"2023-11-28T11:08:36.007906+0000","last_became_peered":"2023-11-28T11:08:36.007906+0000","last_unstale":"2023-11-28T11:08:38.030088+0000","last_undegraded":"2023-11-28T11:08:38.030088+0000","last_fullsized":"2023-11-28T11:08:38.030088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:55:11.905711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029123+0000","last_change":"2023-11-28T11:08:36.408516+0000","last_active":"2023-11-28T11:08:38.029123+0000","last_peered":"2023-11-28T11:08:38.029123+0000","last_clean":"2023-11-28T11:08:38.029123+0000","last_became_active":"2023-11-28T11:08:36.408251+0000","last_became_peered":"2023-11-28T11:08:36.408251+0000","last_unstale":"2023-11-28T11:08:38.029123+0000","last_undegraded":"2023-11-28T11:08:38.029123+0000","last_fullsized":"2023-11-28T11:08:38.029123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028954+0000","last_change":"2023-11-28T11:08:36.011280+0000","last_active":"2023-11-28T11:08:38.028954+0000","last_peered":"2023-11-28T11:08:38.028954+0000","last_clean":"2023-11-28T11:08:38.028954+0000","last_became_active":"2023-11-28T11:08:36.011033+0000","last_became_peered":"2023-11-28T11:08:36.011033+0000","last_unstale":"2023-11-28T11:08:38.028954+0000","last_undegraded":"2023-11-28T11:08:38.028954+0000","last_fullsized":"2023-11-28T11:08:38.028954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388540+0000","last_change":"2023-11-28T11:08:36.407287+0000","last_active":"2023-11-28T11:08:37.388540+0000","last_peered":"2023-11-28T11:08:37.388540+0000","last_clean":"2023-11-28T11:08:37.388540+0000","last_became_active":"2023-11-28T11:08:36.407061+0000","last_became_peered":"2023-11-28T11:08:36.407061+0000","last_unstale":"2023-11-28T11:08:37.388540+0000","last_undegraded":"2023-11-28T11:08:37.388540+0000","last_fullsized":"2023-11-28T11:08:37.388540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028703+0000","last_change":"2023-11-28T11:08:36.001278+0000","last_active":"2023-11-28T11:08:38.028703+0000","last_peered":"2023-11-28T11:08:38.028703+0000","last_clean":"2023-11-28T11:08:38.028703+0000","last_became_active":"2023-11-28T11:08:36.000628+0000","last_became_peered":"2023-11-28T11:08:36.000628+0000","last_unstale":"2023-11-28T11:08:38.028703+0000","last_undegraded":"2023-11-28T11:08:38.028703+0000","last_fullsized":"2023-11-28T11:08:38.028703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390139+0000","last_change":"2023-11-28T11:08:36.408310+0000","last_active":"2023-11-28T11:08:37.390139+0000","last_peered":"2023-11-28T11:08:37.390139+0000","last_clean":"2023-11-28T11:08:37.390139+0000","last_became_active":"2023-11-28T11:08:36.407978+0000","last_became_peered":"2023-11-28T11:08:36.407978+0000","last_unstale":"2023-11-28T11:08:37.390139+0000","last_undegraded":"2023-11-28T11:08:37.390139+0000","last_fullsized":"2023-11-28T11:08:37.390139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:39.663018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388676+0000","last_change":"2023-11-28T11:08:36.002015+0000","last_active":"2023-11-28T11:08:37.388676+0000","last_peered":"2023-11-28T11:08:37.388676+0000","last_clean":"2023-11-28T11:08:37.388676+0000","last_became_active":"2023-11-28T11:08:36.001559+0000","last_became_peered":"2023-11-28T11:08:36.001559+0000","last_unstale":"2023-11-28T11:08:37.388676+0000","last_undegraded":"2023-11-28T11:08:37.388676+0000","last_fullsized":"2023-11-28T11:08:37.388676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:55:11.905711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028605+0000","last_change":"2023-11-28T11:08:36.408653+0000","last_active":"2023-11-28T11:08:38.028605+0000","last_peered":"2023-11-28T11:08:38.028605+0000","last_clean":"2023-11-28T11:08:38.028605+0000","last_became_active":"2023-11-28T11:08:36.408400+0000","last_became_peered":"2023-11-28T11:08:36.408400+0000","last_unstale":"2023-11-28T11:08:38.028605+0000","last_undegraded":"2023-11-28T11:08:38.028605+0000","last_fullsized":"2023-11-28T11:08:38.028605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029355+0000","last_change":"2023-11-28T11:08:36.005909+0000","last_active":"2023-11-28T11:08:38.029355+0000","last_peered":"2023-11-28T11:08:38.029355+0000","last_clean":"2023-11-28T11:08:38.029355+0000","last_became_active":"2023-11-28T11:08:36.005626+0000","last_became_peered":"2023-11-28T11:08:36.005626+0000","last_unstale":"2023-11-28T11:08:38.029355+0000","last_undegraded":"2023-11-28T11:08:38.029355+0000","last_fullsized":"2023-11-28T11:08:38.029355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028717+0000","last_change":"2023-11-28T11:08:36.410036+0000","last_active":"2023-11-28T11:08:38.028717+0000","last_peered":"2023-11-28T11:08:38.028717+0000","last_clean":"2023-11-28T11:08:38.028717+0000","last_became_active":"2023-11-28T11:08:36.409785+0000","last_became_peered":"2023-11-28T11:08:36.409785+0000","last_unstale":"2023-11-28T11:08:38.028717+0000","last_undegraded":"2023-11-28T11:08:38.028717+0000","last_fullsized":"2023-11-28T11:08:38.028717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:38:35.406909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390346+0000","last_change":"2023-11-28T11:08:36.008706+0000","last_active":"2023-11-28T11:08:37.390346+0000","last_peered":"2023-11-28T11:08:37.390346+0000","last_clean":"2023-11-28T11:08:37.390346+0000","last_became_active":"2023-11-28T11:08:36.008279+0000","last_became_peered":"2023-11-28T11:08:36.008279+0000","last_unstale":"2023-11-28T11:08:37.390346+0000","last_undegraded":"2023-11-28T11:08:37.390346+0000","last_fullsized":"2023-11-28T11:08:37.390346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028730+0000","last_change":"2023-11-28T11:08:36.413891+0000","last_active":"2023-11-28T11:08:38.028730+0000","last_peered":"2023-11-28T11:08:38.028730+0000","last_clean":"2023-11-28T11:08:38.028730+0000","last_became_active":"2023-11-28T11:08:36.413613+0000","last_became_peered":"2023-11-28T11:08:36.413613+0000","last_unstale":"2023-11-28T11:08:38.028730+0000","last_undegraded":"2023-11-28T11:08:38.028730+0000","last_fullsized":"2023-11-28T11:08:38.028730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030012+0000","last_change":"2023-11-28T11:08:36.009147+0000","last_active":"2023-11-28T11:08:38.030012+0000","last_peered":"2023-11-28T11:08:38.030012+0000","last_clean":"2023-11-28T11:08:38.030012+0000","last_became_active":"2023-11-28T11:08:36.008847+0000","last_became_peered":"2023-11-28T11:08:36.008847+0000","last_unstale":"2023-11-28T11:08:38.030012+0000","last_undegraded":"2023-11-28T11:08:38.030012+0000","last_fullsized":"2023-11-28T11:08:38.030012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029178+0000","last_change":"2023-11-28T11:08:36.410776+0000","last_active":"2023-11-28T11:08:38.029178+0000","last_peered":"2023-11-28T11:08:38.029178+0000","last_clean":"2023-11-28T11:08:38.029178+0000","last_became_active":"2023-11-28T11:08:36.410335+0000","last_became_peered":"2023-11-28T11:08:36.410335+0000","last_unstale":"2023-11-28T11:08:38.029178+0000","last_undegraded":"2023-11-28T11:08:38.029178+0000","last_fullsized":"2023-11-28T11:08:38.029178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:38:35.406909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390017+0000","last_change":"2023-11-28T11:08:36.011427+0000","last_active":"2023-11-28T11:08:37.390017+0000","last_peered":"2023-11-28T11:08:37.390017+0000","last_clean":"2023-11-28T11:08:37.390017+0000","last_became_active":"2023-11-28T11:08:36.011137+0000","last_became_peered":"2023-11-28T11:08:36.011137+0000","last_unstale":"2023-11-28T11:08:37.390017+0000","last_undegraded":"2023-11-28T11:08:37.390017+0000","last_fullsized":"2023-11-28T11:08:37.390017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:32:07.107062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029099+0000","last_change":"2023-11-28T11:08:36.408216+0000","last_active":"2023-11-28T11:08:38.029099+0000","last_peered":"2023-11-28T11:08:38.029099+0000","last_clean":"2023-11-28T11:08:38.029099+0000","last_became_active":"2023-11-28T11:08:36.407897+0000","last_became_peered":"2023-11-28T11:08:36.407897+0000","last_unstale":"2023-11-28T11:08:38.029099+0000","last_undegraded":"2023-11-28T11:08:38.029099+0000","last_fullsized":"2023-11-28T11:08:38.029099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:15.750770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388082+0000","last_change":"2023-11-28T11:08:35.994749+0000","last_active":"2023-11-28T11:08:37.388082+0000","last_peered":"2023-11-28T11:08:37.388082+0000","last_clean":"2023-11-28T11:08:37.388082+0000","last_became_active":"2023-11-28T11:08:35.994475+0000","last_became_peered":"2023-11-28T11:08:35.994475+0000","last_unstale":"2023-11-28T11:08:37.388082+0000","last_undegraded":"2023-11-28T11:08:37.388082+0000","last_fullsized":"2023-11-28T11:08:37.388082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:27.258902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029441+0000","last_change":"2023-11-28T11:08:36.409070+0000","last_active":"2023-11-28T11:08:38.029441+0000","last_peered":"2023-11-28T11:08:38.029441+0000","last_clean":"2023-11-28T11:08:38.029441+0000","last_became_active":"2023-11-28T11:08:36.408778+0000","last_became_peered":"2023-11-28T11:08:36.408778+0000","last_unstale":"2023-11-28T11:08:38.029441+0000","last_undegraded":"2023-11-28T11:08:38.029441+0000","last_fullsized":"2023-11-28T11:08:38.029441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390361+0000","last_change":"2023-11-28T11:08:36.010605+0000","last_active":"2023-11-28T11:08:37.390361+0000","last_peered":"2023-11-28T11:08:37.390361+0000","last_clean":"2023-11-28T11:08:37.390361+0000","last_became_active":"2023-11-28T11:08:36.010210+0000","last_became_peered":"2023-11-28T11:08:36.010210+0000","last_unstale":"2023-11-28T11:08:37.390361+0000","last_undegraded":"2023-11-28T11:08:37.390361+0000","last_fullsized":"2023-11-28T11:08:37.390361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:22:26.583310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388452+0000","last_change":"2023-11-28T11:08:36.413052+0000","last_active":"2023-11-28T11:08:37.388452+0000","last_peered":"2023-11-28T11:08:37.388452+0000","last_clean":"2023-11-28T11:08:37.388452+0000","last_became_active":"2023-11-28T11:08:36.412807+0000","last_became_peered":"2023-11-28T11:08:36.412807+0000","last_unstale":"2023-11-28T11:08:37.388452+0000","last_undegraded":"2023-11-28T11:08:37.388452+0000","last_fullsized":"2023-11-28T11:08:37.388452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389225+0000","last_change":"2023-11-28T11:08:36.004568+0000","last_active":"2023-11-28T11:08:37.389225+0000","last_peered":"2023-11-28T11:08:37.389225+0000","last_clean":"2023-11-28T11:08:37.389225+0000","last_became_active":"2023-11-28T11:08:36.004282+0000","last_became_peered":"2023-11-28T11:08:36.004282+0000","last_unstale":"2023-11-28T11:08:37.389225+0000","last_undegraded":"2023-11-28T11:08:37.389225+0000","last_fullsized":"2023-11-28T11:08:37.389225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:27:44.586581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029444+0000","last_change":"2023-11-28T11:08:36.410178+0000","last_active":"2023-11-28T11:08:38.029444+0000","last_peered":"2023-11-28T11:08:38.029444+0000","last_clean":"2023-11-28T11:08:38.029444+0000","last_became_active":"2023-11-28T11:08:36.409914+0000","last_became_peered":"2023-11-28T11:08:36.409914+0000","last_unstale":"2023-11-28T11:08:38.029444+0000","last_undegraded":"2023-11-28T11:08:38.029444+0000","last_fullsized":"2023-11-28T11:08:38.029444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390215+0000","last_change":"2023-11-28T11:08:36.006868+0000","last_active":"2023-11-28T11:08:37.390215+0000","last_peered":"2023-11-28T11:08:37.390215+0000","last_clean":"2023-11-28T11:08:37.390215+0000","last_became_active":"2023-11-28T11:08:36.006544+0000","last_became_peered":"2023-11-28T11:08:36.006544+0000","last_unstale":"2023-11-28T11:08:37.390215+0000","last_undegraded":"2023-11-28T11:08:37.390215+0000","last_fullsized":"2023-11-28T11:08:37.390215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:38.660821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029014+0000","last_change":"2023-11-28T11:08:36.409753+0000","last_active":"2023-11-28T11:08:38.029014+0000","last_peered":"2023-11-28T11:08:38.029014+0000","last_clean":"2023-11-28T11:08:38.029014+0000","last_became_active":"2023-11-28T11:08:36.409427+0000","last_became_peered":"2023-11-28T11:08:36.409427+0000","last_unstale":"2023-11-28T11:08:38.029014+0000","last_undegraded":"2023-11-28T11:08:38.029014+0000","last_fullsized":"2023-11-28T11:08:38.029014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390044+0000","last_change":"2023-11-28T11:08:36.006987+0000","last_active":"2023-11-28T11:08:37.390044+0000","last_peered":"2023-11-28T11:08:37.390044+0000","last_clean":"2023-11-28T11:08:37.390044+0000","last_became_active":"2023-11-28T11:08:36.006697+0000","last_became_peered":"2023-11-28T11:08:36.006697+0000","last_unstale":"2023-11-28T11:08:37.390044+0000","last_undegraded":"2023-11-28T11:08:37.390044+0000","last_fullsized":"2023-11-28T11:08:37.390044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:50.422704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029242+0000","last_change":"2023-11-28T11:08:36.404777+0000","last_active":"2023-11-28T11:08:38.029242+0000","last_peered":"2023-11-28T11:08:38.029242+0000","last_clean":"2023-11-28T11:08:38.029242+0000","last_became_active":"2023-11-28T11:08:36.404490+0000","last_became_peered":"2023-11-28T11:08:36.404490+0000","last_unstale":"2023-11-28T11:08:38.029242+0000","last_undegraded":"2023-11-28T11:08:38.029242+0000","last_fullsized":"2023-11-28T11:08:38.029242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:04:03.572831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390457+0000","last_change":"2023-11-28T11:08:36.005444+0000","last_active":"2023-11-28T11:08:37.390457+0000","last_peered":"2023-11-28T11:08:37.390457+0000","last_clean":"2023-11-28T11:08:37.390457+0000","last_became_active":"2023-11-28T11:08:36.005138+0000","last_became_peered":"2023-11-28T11:08:36.005138+0000","last_unstale":"2023-11-28T11:08:37.390457+0000","last_undegraded":"2023-11-28T11:08:37.390457+0000","last_fullsized":"2023-11-28T11:08:37.390457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:59:24.537181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389803+0000","last_change":"2023-11-28T11:08:36.411990+0000","last_active":"2023-11-28T11:08:37.389803+0000","last_peered":"2023-11-28T11:08:37.389803+0000","last_clean":"2023-11-28T11:08:37.389803+0000","last_became_active":"2023-11-28T11:08:36.411669+0000","last_became_peered":"2023-11-28T11:08:36.411669+0000","last_unstale":"2023-11-28T11:08:37.389803+0000","last_undegraded":"2023-11-28T11:08:37.389803+0000","last_fullsized":"2023-11-28T11:08:37.389803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:03.044603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029851+0000","last_change":"2023-11-28T11:08:36.011735+0000","last_active":"2023-11-28T11:08:38.029851+0000","last_peered":"2023-11-28T11:08:38.029851+0000","last_clean":"2023-11-28T11:08:38.029851+0000","last_became_active":"2023-11-28T11:08:36.011491+0000","last_became_peered":"2023-11-28T11:08:36.011491+0000","last_unstale":"2023-11-28T11:08:38.029851+0000","last_undegraded":"2023-11-28T11:08:38.029851+0000","last_fullsized":"2023-11-28T11:08:38.029851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388243+0000","last_change":"2023-11-28T11:08:36.400761+0000","last_active":"2023-11-28T11:08:37.388243+0000","last_peered":"2023-11-28T11:08:37.388243+0000","last_clean":"2023-11-28T11:08:37.388243+0000","last_became_active":"2023-11-28T11:08:36.400410+0000","last_became_peered":"2023-11-28T11:08:36.400410+0000","last_unstale":"2023-11-28T11:08:37.388243+0000","last_undegraded":"2023-11-28T11:08:37.388243+0000","last_fullsized":"2023-11-28T11:08:37.388243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:15.750770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029008+0000","last_change":"2023-11-28T11:08:36.008241+0000","last_active":"2023-11-28T11:08:38.029008+0000","last_peered":"2023-11-28T11:08:38.029008+0000","last_clean":"2023-11-28T11:08:38.029008+0000","last_became_active":"2023-11-28T11:08:36.007905+0000","last_became_peered":"2023-11-28T11:08:36.007905+0000","last_unstale":"2023-11-28T11:08:38.029008+0000","last_undegraded":"2023-11-28T11:08:38.029008+0000","last_fullsized":"2023-11-28T11:08:38.029008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029892+0000","last_change":"2023-11-28T11:08:36.414154+0000","last_active":"2023-11-28T11:08:38.029892+0000","last_peered":"2023-11-28T11:08:38.029892+0000","last_clean":"2023-11-28T11:08:38.029892+0000","last_became_active":"2023-11-28T11:08:36.413893+0000","last_became_peered":"2023-11-28T11:08:36.413893+0000","last_unstale":"2023-11-28T11:08:38.029892+0000","last_undegraded":"2023-11-28T11:08:38.029892+0000","last_fullsized":"2023-11-28T11:08:38.029892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389697+0000","last_change":"2023-11-28T11:08:36.010954+0000","last_active":"2023-11-28T11:08:37.389697+0000","last_peered":"2023-11-28T11:08:37.389697+0000","last_clean":"2023-11-28T11:08:37.389697+0000","last_became_active":"2023-11-28T11:08:36.010641+0000","last_became_peered":"2023-11-28T11:08:36.010641+0000","last_unstale":"2023-11-28T11:08:37.389697+0000","last_undegraded":"2023-11-28T11:08:37.389697+0000","last_fullsized":"2023-11-28T11:08:37.389697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:25:48.509520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029750+0000","last_change":"2023-11-28T11:08:36.403947+0000","last_active":"2023-11-28T11:08:38.029750+0000","last_peered":"2023-11-28T11:08:38.029750+0000","last_clean":"2023-11-28T11:08:38.029750+0000","last_became_active":"2023-11-28T11:08:36.403015+0000","last_became_peered":"2023-11-28T11:08:36.403015+0000","last_unstale":"2023-11-28T11:08:38.029750+0000","last_undegraded":"2023-11-28T11:08:38.029750+0000","last_fullsized":"2023-11-28T11:08:38.029750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:56.135916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029783+0000","last_change":"2023-11-28T11:08:36.008497+0000","last_active":"2023-11-28T11:08:38.029783+0000","last_peered":"2023-11-28T11:08:38.029783+0000","last_clean":"2023-11-28T11:08:38.029783+0000","last_became_active":"2023-11-28T11:08:36.008076+0000","last_became_peered":"2023-11-28T11:08:36.008076+0000","last_unstale":"2023-11-28T11:08:38.029783+0000","last_undegraded":"2023-11-28T11:08:38.029783+0000","last_fullsized":"2023-11-28T11:08:38.029783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029879+0000","last_change":"2023-11-28T11:08:36.408545+0000","last_active":"2023-11-28T11:08:38.029879+0000","last_peered":"2023-11-28T11:08:38.029879+0000","last_clean":"2023-11-28T11:08:38.029879+0000","last_became_active":"2023-11-28T11:08:36.408324+0000","last_became_peered":"2023-11-28T11:08:36.408324+0000","last_unstale":"2023-11-28T11:08:38.029879+0000","last_undegraded":"2023-11-28T11:08:38.029879+0000","last_fullsized":"2023-11-28T11:08:38.029879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029222+0000","last_change":"2023-11-28T11:08:36.008197+0000","last_active":"2023-11-28T11:08:38.029222+0000","last_peered":"2023-11-28T11:08:38.029222+0000","last_clean":"2023-11-28T11:08:38.029222+0000","last_became_active":"2023-11-28T11:08:36.007930+0000","last_became_peered":"2023-11-28T11:08:36.007930+0000","last_unstale":"2023-11-28T11:08:38.029222+0000","last_undegraded":"2023-11-28T11:08:38.029222+0000","last_fullsized":"2023-11-28T11:08:38.029222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029235+0000","last_change":"2023-11-28T11:08:36.414124+0000","last_active":"2023-11-28T11:08:38.029235+0000","last_peered":"2023-11-28T11:08:38.029235+0000","last_clean":"2023-11-28T11:08:38.029235+0000","last_became_active":"2023-11-28T11:08:36.413627+0000","last_became_peered":"2023-11-28T11:08:36.413627+0000","last_unstale":"2023-11-28T11:08:38.029235+0000","last_undegraded":"2023-11-28T11:08:38.029235+0000","last_fullsized":"2023-11-28T11:08:38.029235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.395305+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:08:36.395305+0000","last_peered":"2023-11-28T11:08:36.395305+0000","last_clean":"2023-11-28T11:08:36.395305+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:08:36.395305+0000","last_undegraded":"2023-11-28T11:08:36.395305+0000","last_fullsized":"2023-11-28T11:08:36.395305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029614+0000","last_change":"2023-11-28T11:08:36.012422+0000","last_active":"2023-11-28T11:08:38.029614+0000","last_peered":"2023-11-28T11:08:38.029614+0000","last_clean":"2023-11-28T11:08:38.029614+0000","last_became_active":"2023-11-28T11:08:36.012145+0000","last_became_peered":"2023-11-28T11:08:36.012145+0000","last_unstale":"2023-11-28T11:08:38.029614+0000","last_undegraded":"2023-11-28T11:08:38.029614+0000","last_fullsized":"2023-11-28T11:08:38.029614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029445+0000","last_change":"2023-11-28T11:08:36.404785+0000","last_active":"2023-11-28T11:08:38.029445+0000","last_peered":"2023-11-28T11:08:38.029445+0000","last_clean":"2023-11-28T11:08:38.029445+0000","last_became_active":"2023-11-28T11:08:36.404512+0000","last_became_peered":"2023-11-28T11:08:36.404512+0000","last_unstale":"2023-11-28T11:08:38.029445+0000","last_undegraded":"2023-11-28T11:08:38.029445+0000","last_fullsized":"2023-11-28T11:08:38.029445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.390894+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:08:36.390894+0000","last_peered":"2023-11-28T11:08:36.390894+0000","last_clean":"2023-11-28T11:08:36.390894+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:08:36.390894+0000","last_undegraded":"2023-11-28T11:08:36.390894+0000","last_fullsized":"2023-11-28T11:08:36.390894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029511+0000","last_change":"2023-11-28T11:08:36.011603+0000","last_active":"2023-11-28T11:08:38.029511+0000","last_peered":"2023-11-28T11:08:38.029511+0000","last_clean":"2023-11-28T11:08:38.029511+0000","last_became_active":"2023-11-28T11:08:36.011343+0000","last_became_peered":"2023-11-28T11:08:36.011343+0000","last_unstale":"2023-11-28T11:08:38.029511+0000","last_undegraded":"2023-11-28T11:08:38.029511+0000","last_fullsized":"2023-11-28T11:08:38.029511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:27.258902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029473+0000","last_change":"2023-11-28T11:08:36.398461+0000","last_active":"2023-11-28T11:08:38.029473+0000","last_peered":"2023-11-28T11:08:38.029473+0000","last_clean":"2023-11-28T11:08:38.029473+0000","last_became_active":"2023-11-28T11:08:36.398208+0000","last_became_peered":"2023-11-28T11:08:36.398208+0000","last_unstale":"2023-11-28T11:08:38.029473+0000","last_undegraded":"2023-11-28T11:08:38.029473+0000","last_fullsized":"2023-11-28T11:08:38.029473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.394283+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:08:36.394283+0000","last_peered":"2023-11-28T11:08:36.394283+0000","last_clean":"2023-11-28T11:08:36.394283+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:08:36.394283+0000","last_undegraded":"2023-11-28T11:08:36.394283+0000","last_fullsized":"2023-11-28T11:08:36.394283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028711+0000","last_change":"2023-11-28T11:08:36.003399+0000","last_active":"2023-11-28T11:08:38.028711+0000","last_peered":"2023-11-28T11:08:38.028711+0000","last_clean":"2023-11-28T11:08:38.028711+0000","last_became_active":"2023-11-28T11:08:36.003098+0000","last_became_peered":"2023-11-28T11:08:36.003098+0000","last_unstale":"2023-11-28T11:08:38.028711+0000","last_undegraded":"2023-11-28T11:08:38.028711+0000","last_fullsized":"2023-11-28T11:08:38.028711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029328+0000","last_change":"2023-11-28T11:08:36.402922+0000","last_active":"2023-11-28T11:08:38.029328+0000","last_peered":"2023-11-28T11:08:38.029328+0000","last_clean":"2023-11-28T11:08:38.029328+0000","last_became_active":"2023-11-28T11:08:36.402567+0000","last_became_peered":"2023-11-28T11:08:36.402567+0000","last_unstale":"2023-11-28T11:08:38.029328+0000","last_undegraded":"2023-11-28T11:08:38.029328+0000","last_fullsized":"2023-11-28T11:08:38.029328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.390396+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:08:36.390396+0000","last_peered":"2023-11-28T11:08:36.390396+0000","last_clean":"2023-11-28T11:08:36.390396+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:08:36.390396+0000","last_undegraded":"2023-11-28T11:08:36.390396+0000","last_fullsized":"2023-11-28T11:08:36.390396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.397551+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:08:36.397551+0000","last_peered":"2023-11-28T11:08:36.397551+0000","last_clean":"2023-11-28T11:08:36.397551+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:08:36.397551+0000","last_undegraded":"2023-11-28T11:08:36.397551+0000","last_fullsized":"2023-11-28T11:08:36.397551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029536+0000","last_change":"2023-11-28T11:08:36.005814+0000","last_active":"2023-11-28T11:08:38.029536+0000","last_peered":"2023-11-28T11:08:38.029536+0000","last_clean":"2023-11-28T11:08:38.029536+0000","last_became_active":"2023-11-28T11:08:36.005597+0000","last_became_peered":"2023-11-28T11:08:36.005597+0000","last_unstale":"2023-11-28T11:08:38.029536+0000","last_undegraded":"2023-11-28T11:08:38.029536+0000","last_fullsized":"2023-11-28T11:08:38.029536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389609+0000","last_change":"2023-11-28T11:08:36.412276+0000","last_active":"2023-11-28T11:08:37.389609+0000","last_peered":"2023-11-28T11:08:37.389609+0000","last_clean":"2023-11-28T11:08:37.389609+0000","last_became_active":"2023-11-28T11:08:36.411972+0000","last_became_peered":"2023-11-28T11:08:36.411972+0000","last_unstale":"2023-11-28T11:08:37.389609+0000","last_undegraded":"2023-11-28T11:08:37.389609+0000","last_fullsized":"2023-11-28T11:08:37.389609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:51.424901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.397737+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:08:36.397737+0000","last_peered":"2023-11-28T11:08:36.397737+0000","last_clean":"2023-11-28T11:08:36.397737+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:08:36.397737+0000","last_undegraded":"2023-11-28T11:08:36.397737+0000","last_fullsized":"2023-11-28T11:08:36.397737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388014+0000","last_change":"2023-11-28T11:08:36.007167+0000","last_active":"2023-11-28T11:08:37.388014+0000","last_peered":"2023-11-28T11:08:37.388014+0000","last_clean":"2023-11-28T11:08:37.388014+0000","last_became_active":"2023-11-28T11:08:36.006824+0000","last_became_peered":"2023-11-28T11:08:36.006824+0000","last_unstale":"2023-11-28T11:08:37.388014+0000","last_undegraded":"2023-11-28T11:08:37.388014+0000","last_fullsized":"2023-11-28T11:08:37.388014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388714+0000","last_change":"2023-11-28T11:08:36.400076+0000","last_active":"2023-11-28T11:08:37.388714+0000","last_peered":"2023-11-28T11:08:37.388714+0000","last_clean":"2023-11-28T11:08:37.388714+0000","last_became_active":"2023-11-28T11:08:36.399490+0000","last_became_peered":"2023-11-28T11:08:36.399490+0000","last_unstale":"2023-11-28T11:08:37.388714+0000","last_undegraded":"2023-11-28T11:08:37.388714+0000","last_fullsized":"2023-11-28T11:08:37.388714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.399615+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:08:36.399615+0000","last_peered":"2023-11-28T11:08:36.399615+0000","last_clean":"2023-11-28T11:08:36.399615+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:08:36.399615+0000","last_undegraded":"2023-11-28T11:08:36.399615+0000","last_fullsized":"2023-11-28T11:08:36.399615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029477+0000","last_change":"2023-11-28T11:08:36.001037+0000","last_active":"2023-11-28T11:08:38.029477+0000","last_peered":"2023-11-28T11:08:38.029477+0000","last_clean":"2023-11-28T11:08:38.029477+0000","last_became_active":"2023-11-28T11:08:36.000535+0000","last_became_peered":"2023-11-28T11:08:36.000535+0000","last_unstale":"2023-11-28T11:08:38.029477+0000","last_undegraded":"2023-11-28T11:08:38.029477+0000","last_fullsized":"2023-11-28T11:08:38.029477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388339+0000","last_change":"2023-11-28T11:08:36.395350+0000","last_active":"2023-11-28T11:08:37.388339+0000","last_peered":"2023-11-28T11:08:37.388339+0000","last_clean":"2023-11-28T11:08:37.388339+0000","last_became_active":"2023-11-28T11:08:36.394962+0000","last_became_peered":"2023-11-28T11:08:36.394962+0000","last_unstale":"2023-11-28T11:08:37.388339+0000","last_undegraded":"2023-11-28T11:08:37.388339+0000","last_fullsized":"2023-11-28T11:08:37.388339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029389+0000","last_change":"2023-11-28T11:08:36.008154+0000","last_active":"2023-11-28T11:08:38.029389+0000","last_peered":"2023-11-28T11:08:38.029389+0000","last_clean":"2023-11-28T11:08:38.029389+0000","last_became_active":"2023-11-28T11:08:36.007856+0000","last_became_peered":"2023-11-28T11:08:36.007856+0000","last_unstale":"2023-11-28T11:08:38.029389+0000","last_undegraded":"2023-11-28T11:08:38.029389+0000","last_fullsized":"2023-11-28T11:08:38.029389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.395415+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:08:36.395415+0000","last_peered":"2023-11-28T11:08:36.395415+0000","last_clean":"2023-11-28T11:08:36.395415+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:08:36.395415+0000","last_undegraded":"2023-11-28T11:08:36.395415+0000","last_fullsized":"2023-11-28T11:08:36.395415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028493+0000","last_change":"2023-11-28T11:08:36.409355+0000","last_active":"2023-11-28T11:08:38.028493+0000","last_peered":"2023-11-28T11:08:38.028493+0000","last_clean":"2023-11-28T11:08:38.028493+0000","last_became_active":"2023-11-28T11:08:36.409102+0000","last_became_peered":"2023-11-28T11:08:36.409102+0000","last_unstale":"2023-11-28T11:08:38.028493+0000","last_undegraded":"2023-11-28T11:08:38.028493+0000","last_fullsized":"2023-11-28T11:08:38.028493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:17:00.028902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.398519+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:08:36.398519+0000","last_peered":"2023-11-28T11:08:36.398519+0000","last_clean":"2023-11-28T11:08:36.398519+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:08:36.398519+0000","last_undegraded":"2023-11-28T11:08:36.398519+0000","last_fullsized":"2023-11-28T11:08:36.398519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388624+0000","last_change":"2023-11-28T11:08:36.003130+0000","last_active":"2023-11-28T11:08:37.388624+0000","last_peered":"2023-11-28T11:08:37.388624+0000","last_clean":"2023-11-28T11:08:37.388624+0000","last_became_active":"2023-11-28T11:08:36.002603+0000","last_became_peered":"2023-11-28T11:08:36.002603+0000","last_unstale":"2023-11-28T11:08:37.388624+0000","last_undegraded":"2023-11-28T11:08:37.388624+0000","last_fullsized":"2023-11-28T11:08:37.388624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:37:12.961779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029185+0000","last_change":"2023-11-28T11:08:36.404217+0000","last_active":"2023-11-28T11:08:38.029185+0000","last_peered":"2023-11-28T11:08:38.029185+0000","last_clean":"2023-11-28T11:08:38.029185+0000","last_became_active":"2023-11-28T11:08:36.403929+0000","last_became_peered":"2023-11-28T11:08:36.403929+0000","last_unstale":"2023-11-28T11:08:38.029185+0000","last_undegraded":"2023-11-28T11:08:38.029185+0000","last_fullsized":"2023-11-28T11:08:38.029185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:13.390834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388389+0000","last_change":"2023-11-28T11:08:36.010521+0000","last_active":"2023-11-28T11:08:37.388389+0000","last_peered":"2023-11-28T11:08:37.388389+0000","last_clean":"2023-11-28T11:08:37.388389+0000","last_became_active":"2023-11-28T11:08:36.010235+0000","last_became_peered":"2023-11-28T11:08:36.010235+0000","last_unstale":"2023-11-28T11:08:37.388389+0000","last_undegraded":"2023-11-28T11:08:37.388389+0000","last_fullsized":"2023-11-28T11:08:37.388389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527702+0000","last_change":"2023-11-28T11:08:36.399755+0000","last_active":"2023-11-28T11:08:37.527702+0000","last_peered":"2023-11-28T11:08:37.527702+0000","last_clean":"2023-11-28T11:08:37.527702+0000","last_became_active":"2023-11-28T11:08:36.399504+0000","last_became_peered":"2023-11-28T11:08:36.399504+0000","last_unstale":"2023-11-28T11:08:37.527702+0000","last_undegraded":"2023-11-28T11:08:37.527702+0000","last_fullsized":"2023-11-28T11:08:37.527702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:13.661118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029388+0000","last_change":"2023-11-28T11:08:36.010768+0000","last_active":"2023-11-28T11:08:38.029388+0000","last_peered":"2023-11-28T11:08:38.029388+0000","last_clean":"2023-11-28T11:08:38.029388+0000","last_became_active":"2023-11-28T11:08:36.010442+0000","last_became_peered":"2023-11-28T11:08:36.010442+0000","last_unstale":"2023-11-28T11:08:38.029388+0000","last_undegraded":"2023-11-28T11:08:38.029388+0000","last_fullsized":"2023-11-28T11:08:38.029388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029576+0000","last_change":"2023-11-28T11:08:36.410581+0000","last_active":"2023-11-28T11:08:38.029576+0000","last_peered":"2023-11-28T11:08:38.029576+0000","last_clean":"2023-11-28T11:08:38.029576+0000","last_became_active":"2023-11-28T11:08:36.410010+0000","last_became_peered":"2023-11-28T11:08:36.410010+0000","last_unstale":"2023-11-28T11:08:38.029576+0000","last_undegraded":"2023-11-28T11:08:38.029576+0000","last_fullsized":"2023-11-28T11:08:38.029576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:31.911633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029714+0000","last_change":"2023-11-28T11:08:36.010817+0000","last_active":"2023-11-28T11:08:38.029714+0000","last_peered":"2023-11-28T11:08:38.029714+0000","last_clean":"2023-11-28T11:08:38.029714+0000","last_became_active":"2023-11-28T11:08:36.010516+0000","last_became_peered":"2023-11-28T11:08:36.010516+0000","last_unstale":"2023-11-28T11:08:38.029714+0000","last_undegraded":"2023-11-28T11:08:38.029714+0000","last_fullsized":"2023-11-28T11:08:38.029714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030156+0000","last_change":"2023-11-28T11:08:36.414691+0000","last_active":"2023-11-28T11:08:38.030156+0000","last_peered":"2023-11-28T11:08:38.030156+0000","last_clean":"2023-11-28T11:08:38.030156+0000","last_became_active":"2023-11-28T11:08:36.412582+0000","last_became_peered":"2023-11-28T11:08:36.412582+0000","last_unstale":"2023-11-28T11:08:38.030156+0000","last_undegraded":"2023-11-28T11:08:38.030156+0000","last_fullsized":"2023-11-28T11:08:38.030156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:27.723848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028818+0000","last_change":"2023-11-28T11:08:36.004724+0000","last_active":"2023-11-28T11:08:38.028818+0000","last_peered":"2023-11-28T11:08:38.028818+0000","last_clean":"2023-11-28T11:08:38.028818+0000","last_became_active":"2023-11-28T11:08:36.004413+0000","last_became_peered":"2023-11-28T11:08:36.004413+0000","last_unstale":"2023-11-28T11:08:38.028818+0000","last_undegraded":"2023-11-28T11:08:38.028818+0000","last_fullsized":"2023-11-28T11:08:38.028818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028617+0000","last_change":"2023-11-28T11:08:36.405263+0000","last_active":"2023-11-28T11:08:38.028617+0000","last_peered":"2023-11-28T11:08:38.028617+0000","last_clean":"2023-11-28T11:08:38.028617+0000","last_became_active":"2023-11-28T11:08:36.405009+0000","last_became_peered":"2023-11-28T11:08:36.405009+0000","last_unstale":"2023-11-28T11:08:38.028617+0000","last_undegraded":"2023-11-28T11:08:38.028617+0000","last_fullsized":"2023-11-28T11:08:38.028617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:56.135916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388734+0000","last_change":"2023-11-28T11:08:36.004954+0000","last_active":"2023-11-28T11:08:37.388734+0000","last_peered":"2023-11-28T11:08:37.388734+0000","last_clean":"2023-11-28T11:08:37.388734+0000","last_became_active":"2023-11-28T11:08:36.004689+0000","last_became_peered":"2023-11-28T11:08:36.004689+0000","last_unstale":"2023-11-28T11:08:37.388734+0000","last_undegraded":"2023-11-28T11:08:37.388734+0000","last_fullsized":"2023-11-28T11:08:37.388734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029176+0000","last_change":"2023-11-28T11:08:36.409550+0000","last_active":"2023-11-28T11:08:38.029176+0000","last_peered":"2023-11-28T11:08:38.029176+0000","last_clean":"2023-11-28T11:08:38.029176+0000","last_became_active":"2023-11-28T11:08:36.409256+0000","last_became_peered":"2023-11-28T11:08:36.409256+0000","last_unstale":"2023-11-28T11:08:38.029176+0000","last_undegraded":"2023-11-28T11:08:38.029176+0000","last_fullsized":"2023-11-28T11:08:38.029176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389289+0000","last_change":"2023-11-28T11:08:36.408453+0000","last_active":"2023-11-28T11:08:37.389289+0000","last_peered":"2023-11-28T11:08:37.389289+0000","last_clean":"2023-11-28T11:08:37.389289+0000","last_became_active":"2023-11-28T11:08:36.408159+0000","last_became_peered":"2023-11-28T11:08:36.408159+0000","last_unstale":"2023-11-28T11:08:37.389289+0000","last_undegraded":"2023-11-28T11:08:37.389289+0000","last_fullsized":"2023-11-28T11:08:37.389289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:59:25.539378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029482+0000","last_change":"2023-11-28T11:08:36.408287+0000","last_active":"2023-11-28T11:08:38.029482+0000","last_peered":"2023-11-28T11:08:38.029482+0000","last_clean":"2023-11-28T11:08:38.029482+0000","last_became_active":"2023-11-28T11:08:36.408035+0000","last_became_peered":"2023-11-28T11:08:36.408035+0000","last_unstale":"2023-11-28T11:08:38.029482+0000","last_undegraded":"2023-11-28T11:08:38.029482+0000","last_fullsized":"2023-11-28T11:08:38.029482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:45:33.470588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030002+0000","last_change":"2023-11-28T11:08:36.414705+0000","last_active":"2023-11-28T11:08:38.030002+0000","last_peered":"2023-11-28T11:08:38.030002+0000","last_clean":"2023-11-28T11:08:38.030002+0000","last_became_active":"2023-11-28T11:08:36.414428+0000","last_became_peered":"2023-11-28T11:08:36.414428+0000","last_unstale":"2023-11-28T11:08:38.030002+0000","last_undegraded":"2023-11-28T11:08:38.030002+0000","last_fullsized":"2023-11-28T11:08:38.030002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:05.744622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029115+0000","last_change":"2023-11-28T11:08:36.409051+0000","last_active":"2023-11-28T11:08:38.029115+0000","last_peered":"2023-11-28T11:08:38.029115+0000","last_clean":"2023-11-28T11:08:38.029115+0000","last_became_active":"2023-11-28T11:08:36.408827+0000","last_became_peered":"2023-11-28T11:08:36.408827+0000","last_unstale":"2023-11-28T11:08:38.029115+0000","last_undegraded":"2023-11-28T11:08:38.029115+0000","last_fullsized":"2023-11-28T11:08:38.029115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:05.744622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029371+0000","last_change":"2023-11-28T11:08:36.410425+0000","last_active":"2023-11-28T11:08:38.029371+0000","last_peered":"2023-11-28T11:08:38.029371+0000","last_clean":"2023-11-28T11:08:38.029371+0000","last_became_active":"2023-11-28T11:08:36.409787+0000","last_became_peered":"2023-11-28T11:08:36.409787+0000","last_unstale":"2023-11-28T11:08:38.029371+0000","last_undegraded":"2023-11-28T11:08:38.029371+0000","last_fullsized":"2023-11-28T11:08:38.029371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:37:56.065831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":685204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:08:49.515 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:08:49.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.671+0000 7f83ef514700 1 Processor -- start 2023-11-28T11:08:49.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.671+0000 7f83ef514700 1 -- start start 2023-11-28T11:08:49.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83ef514700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e806a270 0x7f83e8071f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83ef514700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f83e80ac420 0x7f83e80ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83ef514700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e80af0c0 con 0x7f83e80ae520 2023-11-28T11:08:49.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83ef514700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e80b0590 con 0x7f83e80ac420 2023-11-28T11:08:49.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83ef514700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8159280 con 0x7f83e806a270 2023-11-28T11:08:49.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83ecaaf700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f83e80ae520 0x7f83e806a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41398/0 (socket says 172.21.15.125:41398) 2023-11-28T11:08:49.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83ecaaf700 1 -- 172.21.15.125:0/3484799669 learned_addr learned my addr 172.21.15.125:0/3484799669 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:49.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83edab1700 1 --2- 172.21.15.125:0/3484799669 >> v2:172.21.15.167:3300/0 conn(0x7f83e80ac420 0x7f83e80ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83ed2b0700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e806a270 0x7f83e8071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283150686 0 0) 0x7f83e80af0c0 con 0x7f83e80ae520 2023-11-28T11:08:49.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d40035b0 con 0x7f83e80ae520 2023-11-28T11:08:49.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4283504616 0 0) 0x7f83d40035b0 con 0x7f83e80ae520 2023-11-28T11:08:49.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e806a270 msgr2=0x7f83e8071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:49.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83dffff700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e806a270 0x7f83e8071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 >> v2:172.21.15.167:3300/0 conn(0x7f83e80ac420 msgr2=0x7f83e80ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:49.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83dffff700 1 --2- 172.21.15.125:0/3484799669 >> v2:172.21.15.167:3300/0 conn(0x7f83e80ac420 0x7f83e80ac8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e80b0d10 con 0x7f83e80ae520 2023-11-28T11:08:49.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.672+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f83d8001670 con 0x7f83e80ae520 2023-11-28T11:08:49.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 >> v1:172.21.15.125:6789/0 conn(0x7f83e80ae520 legacy=0x7f83e806a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83dffff700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4003a00 0x7f83d4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83dffff700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e806a270 0x7f83d4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83dffff700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83d4004d90 0x7f83d4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80b0590 con 0x7f83d4004d90 2023-11-28T11:08:49.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8159280 con 0x7f83d4003a00 2023-11-28T11:08:49.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d400ba10 con 0x7f83e806a270 2023-11-28T11:08:49.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83edab1700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83d4004d90 0x7f83d4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83ed2b0700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4003a00 0x7f83d4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83ecaaf700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e806a270 0x7f83d4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83edab1700 1 -- 172.21.15.125:0/3484799669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e806a270 msgr2=0x7f83d4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:49.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83edab1700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e806a270 0x7f83d4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83edab1700 1 -- 172.21.15.125:0/3484799669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4003a00 msgr2=0x7f83d4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:49.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83edab1700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4003a00 0x7f83d4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83edab1700 1 -- 172.21.15.125:0/3484799669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d40035b0 con 0x7f83d4004d90 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83edab1700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83d4004d90 0x7f83d4005200 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f83e00102c0 tx=0x7f83d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661a19edded1b820 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0010b80 con 0x7f83d4004d90 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e0010ce0 con 0x7f83d4004d90 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.673+0000 7f83dffff700 1 -- 172.21.15.125:0/3484799669 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0015620 con 0x7f83d4004d90 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.674+0000 7f83ef514700 1 -- 172.21.15.125:0/3484799669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83d4004d90 msgr2=0x7f83d4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.674+0000 7f83ef514700 1 --2- 172.21.15.125:0/3484799669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83d4004d90 0x7f83d4005200 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f83e00102c0 tx=0x7f83d4005880 comp rx=0 tx=0).stop 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.674+0000 7f83edab1700 1 -- 172.21.15.125:0/3484799669 reap_dead start 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.674+0000 7f83ef514700 1 -- 172.21.15.125:0/3484799669 shutdown_connections 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.674+0000 7f83ef514700 1 -- 172.21.15.125:0/3484799669 >> 172.21.15.125:0/3484799669 conn(0x7f83e80b2fc0 msgr2=0x7f83e8071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.674+0000 7f83ef514700 1 -- 172.21.15.125:0/3484799669 shutdown_connections 2023-11-28T11:08:49.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.674+0000 7f83ef514700 1 -- 172.21.15.125:0/3484799669 wait complete. 2023-11-28T11:08:49.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.675+0000 7f83ef514700 1 Processor -- start 2023-11-28T11:08:49.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.675+0000 7f83ef514700 1 -- start start 2023-11-28T11:08:49.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ef514700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4004d90 0x7f83e81f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ef514700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e8098360 0x7f83e80c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ef514700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e80c4a70 0x7f83e80c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ef514700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80c6000 con 0x7f83e80c4a70 2023-11-28T11:08:49.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ef514700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80c5760 con 0x7f83d4004d90 2023-11-28T11:08:49.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ef514700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80c5a40 con 0x7f83e8098360 2023-11-28T11:08:49.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83edab1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e80c4a70 0x7f83e80c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83edab1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e80c4a70 0x7f83e80c4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57288/0 (socket says 172.21.15.125:57288) 2023-11-28T11:08:49.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83edab1700 1 -- 172.21.15.125:0/790771345 learned_addr learned my addr 172.21.15.125:0/790771345 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:49.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ed2b0700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4004d90 0x7f83e81f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ecaaf700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e8098360 0x7f83e80c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83edab1700 1 -- 172.21.15.125:0/790771345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e8098360 msgr2=0x7f83e80c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83edab1700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e8098360 0x7f83e80c2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83edab1700 1 -- 172.21.15.125:0/790771345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4004d90 msgr2=0x7f83e81f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83edab1700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4004d90 0x7f83e81f0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83edab1700 1 -- 172.21.15.125:0/790771345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e80afc60 con 0x7f83e80c4a70 2023-11-28T11:08:49.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ecaaf700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e8098360 0x7f83e80c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:49.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83edab1700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e80c4a70 0x7f83e80c4ef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f83e0017000 tx=0x7f83e0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:49.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ddffb700 1 -- 172.21.15.125:0/790771345 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0010b80 con 0x7f83e80c4a70 2023-11-28T11:08:49.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ddffb700 1 -- 172.21.15.125:0/790771345 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e0009410 con 0x7f83e80c4a70 2023-11-28T11:08:49.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ddffb700 1 -- 172.21.15.125:0/790771345 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e001e870 con 0x7f83e80c4a70 2023-11-28T11:08:49.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.676+0000 7f83ef514700 1 -- 172.21.15.125:0/790771345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e8072670 con 0x7f83e80c4a70 2023-11-28T11:08:49.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.677+0000 7f83ef514700 1 -- 172.21.15.125:0/790771345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e80aff40 con 0x7f83e80c4a70 2023-11-28T11:08:49.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.677+0000 7f83ef514700 1 -- 172.21.15.125:0/790771345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e80743f0 con 0x7f83e80c4a70 2023-11-28T11:08:49.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.678+0000 7f83ddffb700 1 -- 172.21.15.125:0/790771345 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f83e002d070 con 0x7f83e80c4a70 2023-11-28T11:08:49.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.678+0000 7f83ddffb700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83cc0682e0 0x7f83cc06a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:49.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.678+0000 7f83ed2b0700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83cc0682e0 0x7f83cc06a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:49.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.678+0000 7f83ddffb700 1 -- 172.21.15.125:0/790771345 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f83e00873b0 con 0x7f83e80c4a70 2023-11-28T11:08:49.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.679+0000 7f83ed2b0700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83cc0682e0 0x7f83cc06a790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f83e80acfa0 tx=0x7f83e4009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:49.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.682+0000 7f83ddffb700 1 -- 172.21.15.125:0/790771345 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f83e0053c10 con 0x7f83e80c4a70 2023-11-28T11:08:49.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.861+0000 7f83ef514700 1 -- 172.21.15.125:0/790771345 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83e8157c60 con 0x7f83cc0682e0 2023-11-28T11:08:49.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.868+0000 7f83ddffb700 1 -- 172.21.15.125:0/790771345 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286568 (secure 0 0 0) 0x7f83e8157c60 con 0x7f83cc0682e0 2023-11-28T11:08:49.872 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:49.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.871+0000 7f83ef514700 1 -- 172.21.15.125:0/790771345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83cc0682e0 msgr2=0x7f83cc06a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.871+0000 7f83ef514700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83cc0682e0 0x7f83cc06a790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f83e80acfa0 tx=0x7f83e4009210 comp rx=0 tx=0).stop 2023-11-28T11:08:49.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.871+0000 7f83ef514700 1 -- 172.21.15.125:0/790771345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e80c4a70 msgr2=0x7f83e80c4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:49.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.871+0000 7f83ef514700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e80c4a70 0x7f83e80c4ef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f83e0017000 tx=0x7f83e0009750 comp rx=0 tx=0).stop 2023-11-28T11:08:49.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.871+0000 7f83ef514700 1 -- 172.21.15.125:0/790771345 shutdown_connections 2023-11-28T11:08:49.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.871+0000 7f83ef514700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83e80c4a70 0x7f83e80c4ef0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.871+0000 7f83ef514700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83d4004d90 0x7f83e81f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.871+0000 7f83ef514700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83cc0682e0 0x7f83cc06a790 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.871+0000 7f83ef514700 1 --2- 172.21.15.125:0/790771345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e8098360 0x7f83e80c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:49.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.871+0000 7f83ef514700 1 -- 172.21.15.125:0/790771345 >> 172.21.15.125:0/790771345 conn(0x7f83e80b2fc0 msgr2=0x7f83e80ad920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:49.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.872+0000 7f83ef514700 1 -- 172.21.15.125:0/790771345 shutdown_connections 2023-11-28T11:08:49.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:49.872+0000 7f83ef514700 1 -- 172.21.15.125:0/790771345 wait complete. 2023-11-28T11:08:49.877 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:08:49.884 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-11-28T11:08:49.624767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66440,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":63168,"kb_avail":754908280,"statfs":{"total":773094113280,"available":773026078720,"internally_reserved":0,"allocated":3284992,"data_stored":1939556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64684032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002804"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527689+0000","last_change":"2023-11-28T11:08:36.416297+0000","last_active":"2023-11-28T11:08:37.527689+0000","last_peered":"2023-11-28T11:08:37.527689+0000","last_clean":"2023-11-28T11:08:37.527689+0000","last_became_active":"2023-11-28T11:08:36.415977+0000","last_became_peered":"2023-11-28T11:08:36.415977+0000","last_unstale":"2023-11-28T11:08:37.527689+0000","last_undegraded":"2023-11-28T11:08:37.527689+0000","last_fullsized":"2023-11-28T11:08:37.527689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:48.481042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029908+0000","last_change":"2023-11-28T11:08:36.400367+0000","last_active":"2023-11-28T11:08:38.029908+0000","last_peered":"2023-11-28T11:08:38.029908+0000","last_clean":"2023-11-28T11:08:38.029908+0000","last_became_active":"2023-11-28T11:08:36.400076+0000","last_became_peered":"2023-11-28T11:08:36.400076+0000","last_unstale":"2023-11-28T11:08:38.029908+0000","last_undegraded":"2023-11-28T11:08:38.029908+0000","last_fullsized":"2023-11-28T11:08:38.029908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029428+0000","last_change":"2023-11-28T11:08:36.406078+0000","last_active":"2023-11-28T11:08:38.029428+0000","last_peered":"2023-11-28T11:08:38.029428+0000","last_clean":"2023-11-28T11:08:38.029428+0000","last_became_active":"2023-11-28T11:08:36.405448+0000","last_became_peered":"2023-11-28T11:08:36.405448+0000","last_unstale":"2023-11-28T11:08:38.029428+0000","last_undegraded":"2023-11-28T11:08:38.029428+0000","last_fullsized":"2023-11-28T11:08:38.029428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:34:58.025630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389721+0000","last_change":"2023-11-28T11:08:36.411547+0000","last_active":"2023-11-28T11:08:37.389721+0000","last_peered":"2023-11-28T11:08:37.389721+0000","last_clean":"2023-11-28T11:08:37.389721+0000","last_became_active":"2023-11-28T11:08:36.411251+0000","last_became_peered":"2023-11-28T11:08:36.411251+0000","last_unstale":"2023-11-28T11:08:37.389721+0000","last_undegraded":"2023-11-28T11:08:37.389721+0000","last_fullsized":"2023-11-28T11:08:37.389721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:30.748107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388308+0000","last_change":"2023-11-28T11:08:36.408744+0000","last_active":"2023-11-28T11:08:37.388308+0000","last_peered":"2023-11-28T11:08:37.388308+0000","last_clean":"2023-11-28T11:08:37.388308+0000","last_became_active":"2023-11-28T11:08:36.408499+0000","last_became_peered":"2023-11-28T11:08:36.408499+0000","last_unstale":"2023-11-28T11:08:37.388308+0000","last_undegraded":"2023-11-28T11:08:37.388308+0000","last_fullsized":"2023-11-28T11:08:37.388308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029988+0000","last_change":"2023-11-28T11:08:36.404949+0000","last_active":"2023-11-28T11:08:38.029988+0000","last_peered":"2023-11-28T11:08:38.029988+0000","last_clean":"2023-11-28T11:08:38.029988+0000","last_became_active":"2023-11-28T11:08:36.404662+0000","last_became_peered":"2023-11-28T11:08:36.404662+0000","last_unstale":"2023-11-28T11:08:38.029988+0000","last_undegraded":"2023-11-28T11:08:38.029988+0000","last_fullsized":"2023-11-28T11:08:38.029988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:50.488364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389610+0000","last_change":"2023-11-28T11:08:36.407228+0000","last_active":"2023-11-28T11:08:37.389610+0000","last_peered":"2023-11-28T11:08:37.389610+0000","last_clean":"2023-11-28T11:08:37.389610+0000","last_became_active":"2023-11-28T11:08:36.406568+0000","last_became_peered":"2023-11-28T11:08:36.406568+0000","last_unstale":"2023-11-28T11:08:37.389610+0000","last_undegraded":"2023-11-28T11:08:37.389610+0000","last_fullsized":"2023-11-28T11:08:37.389610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029317+0000","last_change":"2023-11-28T11:08:36.404585+0000","last_active":"2023-11-28T11:08:38.029317+0000","last_peered":"2023-11-28T11:08:38.029317+0000","last_clean":"2023-11-28T11:08:38.029317+0000","last_became_active":"2023-11-28T11:08:36.404273+0000","last_became_peered":"2023-11-28T11:08:36.404273+0000","last_unstale":"2023-11-28T11:08:38.029317+0000","last_undegraded":"2023-11-28T11:08:38.029317+0000","last_fullsized":"2023-11-28T11:08:38.029317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388542+0000","last_change":"2023-11-28T11:08:36.416209+0000","last_active":"2023-11-28T11:08:37.388542+0000","last_peered":"2023-11-28T11:08:37.388542+0000","last_clean":"2023-11-28T11:08:37.388542+0000","last_became_active":"2023-11-28T11:08:36.415945+0000","last_became_peered":"2023-11-28T11:08:36.415945+0000","last_unstale":"2023-11-28T11:08:37.388542+0000","last_undegraded":"2023-11-28T11:08:37.388542+0000","last_fullsized":"2023-11-28T11:08:37.388542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029484+0000","last_change":"2023-11-28T11:08:36.393913+0000","last_active":"2023-11-28T11:08:38.029484+0000","last_peered":"2023-11-28T11:08:38.029484+0000","last_clean":"2023-11-28T11:08:38.029484+0000","last_became_active":"2023-11-28T11:08:36.393400+0000","last_became_peered":"2023-11-28T11:08:36.393400+0000","last_unstale":"2023-11-28T11:08:38.029484+0000","last_undegraded":"2023-11-28T11:08:38.029484+0000","last_fullsized":"2023-11-28T11:08:38.029484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029534+0000","last_change":"2023-11-28T11:08:36.405268+0000","last_active":"2023-11-28T11:08:38.029534+0000","last_peered":"2023-11-28T11:08:38.029534+0000","last_clean":"2023-11-28T11:08:38.029534+0000","last_became_active":"2023-11-28T11:08:36.404990+0000","last_became_peered":"2023-11-28T11:08:36.404990+0000","last_unstale":"2023-11-28T11:08:38.029534+0000","last_undegraded":"2023-11-28T11:08:38.029534+0000","last_fullsized":"2023-11-28T11:08:38.029534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:45:33.470588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527660+0000","last_change":"2023-11-28T11:08:36.405351+0000","last_active":"2023-11-28T11:08:37.527660+0000","last_peered":"2023-11-28T11:08:37.527660+0000","last_clean":"2023-11-28T11:08:37.527660+0000","last_became_active":"2023-11-28T11:08:36.405078+0000","last_became_peered":"2023-11-28T11:08:36.405078+0000","last_unstale":"2023-11-28T11:08:37.527660+0000","last_undegraded":"2023-11-28T11:08:37.527660+0000","last_fullsized":"2023-11-28T11:08:37.527660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:30.748107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527570+0000","last_change":"2023-11-28T11:08:36.408661+0000","last_active":"2023-11-28T11:08:37.527570+0000","last_peered":"2023-11-28T11:08:37.527570+0000","last_clean":"2023-11-28T11:08:37.527570+0000","last_became_active":"2023-11-28T11:08:36.408387+0000","last_became_peered":"2023-11-28T11:08:36.408387+0000","last_unstale":"2023-11-28T11:08:37.527570+0000","last_undegraded":"2023-11-28T11:08:37.527570+0000","last_fullsized":"2023-11-28T11:08:37.527570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:13.215556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029184+0000","last_change":"2023-11-28T11:08:36.401781+0000","last_active":"2023-11-28T11:08:38.029184+0000","last_peered":"2023-11-28T11:08:38.029184+0000","last_clean":"2023-11-28T11:08:38.029184+0000","last_became_active":"2023-11-28T11:08:36.401490+0000","last_became_peered":"2023-11-28T11:08:36.401490+0000","last_unstale":"2023-11-28T11:08:38.029184+0000","last_undegraded":"2023-11-28T11:08:38.029184+0000","last_fullsized":"2023-11-28T11:08:38.029184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390010+0000","last_change":"2023-11-28T11:08:36.407391+0000","last_active":"2023-11-28T11:08:37.390010+0000","last_peered":"2023-11-28T11:08:37.390010+0000","last_clean":"2023-11-28T11:08:37.390010+0000","last_became_active":"2023-11-28T11:08:36.406934+0000","last_became_peered":"2023-11-28T11:08:36.406934+0000","last_unstale":"2023-11-28T11:08:37.390010+0000","last_undegraded":"2023-11-28T11:08:37.390010+0000","last_fullsized":"2023-11-28T11:08:37.390010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029297+0000","last_change":"2023-11-28T11:08:36.405277+0000","last_active":"2023-11-28T11:08:38.029297+0000","last_peered":"2023-11-28T11:08:38.029297+0000","last_clean":"2023-11-28T11:08:38.029297+0000","last_became_active":"2023-11-28T11:08:36.405034+0000","last_became_peered":"2023-11-28T11:08:36.405034+0000","last_unstale":"2023-11-28T11:08:38.029297+0000","last_undegraded":"2023-11-28T11:08:38.029297+0000","last_fullsized":"2023-11-28T11:08:38.029297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:51.071881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388626+0000","last_change":"2023-11-28T11:08:36.416839+0000","last_active":"2023-11-28T11:08:37.388626+0000","last_peered":"2023-11-28T11:08:37.388626+0000","last_clean":"2023-11-28T11:08:37.388626+0000","last_became_active":"2023-11-28T11:08:36.416606+0000","last_became_peered":"2023-11-28T11:08:36.416606+0000","last_unstale":"2023-11-28T11:08:37.388626+0000","last_undegraded":"2023-11-28T11:08:37.388626+0000","last_fullsized":"2023-11-28T11:08:37.388626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029699+0000","last_change":"2023-11-28T11:08:36.403858+0000","last_active":"2023-11-28T11:08:38.029699+0000","last_peered":"2023-11-28T11:08:38.029699+0000","last_clean":"2023-11-28T11:08:38.029699+0000","last_became_active":"2023-11-28T11:08:36.403584+0000","last_became_peered":"2023-11-28T11:08:36.403584+0000","last_unstale":"2023-11-28T11:08:38.029699+0000","last_undegraded":"2023-11-28T11:08:38.029699+0000","last_fullsized":"2023-11-28T11:08:38.029699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527667+0000","last_change":"2023-11-28T11:08:36.413070+0000","last_active":"2023-11-28T11:08:37.527667+0000","last_peered":"2023-11-28T11:08:37.527667+0000","last_clean":"2023-11-28T11:08:37.527667+0000","last_became_active":"2023-11-28T11:08:36.412782+0000","last_became_peered":"2023-11-28T11:08:36.412782+0000","last_unstale":"2023-11-28T11:08:37.527667+0000","last_undegraded":"2023-11-28T11:08:37.527667+0000","last_fullsized":"2023-11-28T11:08:37.527667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:09.866075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029903+0000","last_change":"2023-11-28T11:08:36.412148+0000","last_active":"2023-11-28T11:08:38.029903+0000","last_peered":"2023-11-28T11:08:38.029903+0000","last_clean":"2023-11-28T11:08:38.029903+0000","last_became_active":"2023-11-28T11:08:36.411873+0000","last_became_peered":"2023-11-28T11:08:36.411873+0000","last_unstale":"2023-11-28T11:08:38.029903+0000","last_undegraded":"2023-11-28T11:08:38.029903+0000","last_fullsized":"2023-11-28T11:08:38.029903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:34:13.560527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390150+0000","last_change":"2023-11-28T11:08:36.416108+0000","last_active":"2023-11-28T11:08:37.390150+0000","last_peered":"2023-11-28T11:08:37.390150+0000","last_clean":"2023-11-28T11:08:37.390150+0000","last_became_active":"2023-11-28T11:08:36.415831+0000","last_became_peered":"2023-11-28T11:08:36.415831+0000","last_unstale":"2023-11-28T11:08:37.390150+0000","last_undegraded":"2023-11-28T11:08:37.390150+0000","last_fullsized":"2023-11-28T11:08:37.390150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388133+0000","last_change":"2023-11-28T11:08:36.404227+0000","last_active":"2023-11-28T11:08:37.388133+0000","last_peered":"2023-11-28T11:08:37.388133+0000","last_clean":"2023-11-28T11:08:37.388133+0000","last_became_active":"2023-11-28T11:08:36.403978+0000","last_became_peered":"2023-11-28T11:08:36.403978+0000","last_unstale":"2023-11-28T11:08:37.388133+0000","last_undegraded":"2023-11-28T11:08:37.388133+0000","last_fullsized":"2023-11-28T11:08:37.388133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028811+0000","last_change":"2023-11-28T11:08:36.405775+0000","last_active":"2023-11-28T11:08:38.028811+0000","last_peered":"2023-11-28T11:08:38.028811+0000","last_clean":"2023-11-28T11:08:38.028811+0000","last_became_active":"2023-11-28T11:08:36.405525+0000","last_became_peered":"2023-11-28T11:08:36.405525+0000","last_unstale":"2023-11-28T11:08:38.028811+0000","last_undegraded":"2023-11-28T11:08:38.028811+0000","last_fullsized":"2023-11-28T11:08:38.028811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390248+0000","last_change":"2023-11-28T11:08:36.416121+0000","last_active":"2023-11-28T11:08:37.390248+0000","last_peered":"2023-11-28T11:08:37.390248+0000","last_clean":"2023-11-28T11:08:37.390248+0000","last_became_active":"2023-11-28T11:08:36.415874+0000","last_became_peered":"2023-11-28T11:08:36.415874+0000","last_unstale":"2023-11-28T11:08:37.390248+0000","last_undegraded":"2023-11-28T11:08:37.390248+0000","last_fullsized":"2023-11-28T11:08:37.390248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029011+0000","last_change":"2023-11-28T11:08:36.409665+0000","last_active":"2023-11-28T11:08:38.029011+0000","last_peered":"2023-11-28T11:08:38.029011+0000","last_clean":"2023-11-28T11:08:38.029011+0000","last_became_active":"2023-11-28T11:08:36.409096+0000","last_became_peered":"2023-11-28T11:08:36.409096+0000","last_unstale":"2023-11-28T11:08:38.029011+0000","last_undegraded":"2023-11-28T11:08:38.029011+0000","last_fullsized":"2023-11-28T11:08:38.029011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028947+0000","last_change":"2023-11-28T11:08:36.401914+0000","last_active":"2023-11-28T11:08:38.028947+0000","last_peered":"2023-11-28T11:08:38.028947+0000","last_clean":"2023-11-28T11:08:38.028947+0000","last_became_active":"2023-11-28T11:08:36.401600+0000","last_became_peered":"2023-11-28T11:08:36.401600+0000","last_unstale":"2023-11-28T11:08:38.028947+0000","last_undegraded":"2023-11-28T11:08:38.028947+0000","last_fullsized":"2023-11-28T11:08:38.028947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029901+0000","last_change":"2023-11-28T11:08:36.409423+0000","last_active":"2023-11-28T11:08:38.029901+0000","last_peered":"2023-11-28T11:08:38.029901+0000","last_clean":"2023-11-28T11:08:38.029901+0000","last_became_active":"2023-11-28T11:08:36.409119+0000","last_became_peered":"2023-11-28T11:08:36.409119+0000","last_unstale":"2023-11-28T11:08:38.029901+0000","last_undegraded":"2023-11-28T11:08:38.029901+0000","last_fullsized":"2023-11-28T11:08:38.029901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030088+0000","last_change":"2023-11-28T11:08:36.008194+0000","last_active":"2023-11-28T11:08:38.030088+0000","last_peered":"2023-11-28T11:08:38.030088+0000","last_clean":"2023-11-28T11:08:38.030088+0000","last_became_active":"2023-11-28T11:08:36.007906+0000","last_became_peered":"2023-11-28T11:08:36.007906+0000","last_unstale":"2023-11-28T11:08:38.030088+0000","last_undegraded":"2023-11-28T11:08:38.030088+0000","last_fullsized":"2023-11-28T11:08:38.030088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:55:11.905711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029123+0000","last_change":"2023-11-28T11:08:36.408516+0000","last_active":"2023-11-28T11:08:38.029123+0000","last_peered":"2023-11-28T11:08:38.029123+0000","last_clean":"2023-11-28T11:08:38.029123+0000","last_became_active":"2023-11-28T11:08:36.408251+0000","last_became_peered":"2023-11-28T11:08:36.408251+0000","last_unstale":"2023-11-28T11:08:38.029123+0000","last_undegraded":"2023-11-28T11:08:38.029123+0000","last_fullsized":"2023-11-28T11:08:38.029123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028954+0000","last_change":"2023-11-28T11:08:36.011280+0000","last_active":"2023-11-28T11:08:38.028954+0000","last_peered":"2023-11-28T11:08:38.028954+0000","last_clean":"2023-11-28T11:08:38.028954+0000","last_became_active":"2023-11-28T11:08:36.011033+0000","last_became_peered":"2023-11-28T11:08:36.011033+0000","last_unstale":"2023-11-28T11:08:38.028954+0000","last_undegraded":"2023-11-28T11:08:38.028954+0000","last_fullsized":"2023-11-28T11:08:38.028954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388540+0000","last_change":"2023-11-28T11:08:36.407287+0000","last_active":"2023-11-28T11:08:37.388540+0000","last_peered":"2023-11-28T11:08:37.388540+0000","last_clean":"2023-11-28T11:08:37.388540+0000","last_became_active":"2023-11-28T11:08:36.407061+0000","last_became_peered":"2023-11-28T11:08:36.407061+0000","last_unstale":"2023-11-28T11:08:37.388540+0000","last_undegraded":"2023-11-28T11:08:37.388540+0000","last_fullsized":"2023-11-28T11:08:37.388540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:16.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028703+0000","last_change":"2023-11-28T11:08:36.001278+0000","last_active":"2023-11-28T11:08:38.028703+0000","last_peered":"2023-11-28T11:08:38.028703+0000","last_clean":"2023-11-28T11:08:38.028703+0000","last_became_active":"2023-11-28T11:08:36.000628+0000","last_became_peered":"2023-11-28T11:08:36.000628+0000","last_unstale":"2023-11-28T11:08:38.028703+0000","last_undegraded":"2023-11-28T11:08:38.028703+0000","last_fullsized":"2023-11-28T11:08:38.028703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390139+0000","last_change":"2023-11-28T11:08:36.408310+0000","last_active":"2023-11-28T11:08:37.390139+0000","last_peered":"2023-11-28T11:08:37.390139+0000","last_clean":"2023-11-28T11:08:37.390139+0000","last_became_active":"2023-11-28T11:08:36.407978+0000","last_became_peered":"2023-11-28T11:08:36.407978+0000","last_unstale":"2023-11-28T11:08:37.390139+0000","last_undegraded":"2023-11-28T11:08:37.390139+0000","last_fullsized":"2023-11-28T11:08:37.390139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:39.663018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388676+0000","last_change":"2023-11-28T11:08:36.002015+0000","last_active":"2023-11-28T11:08:37.388676+0000","last_peered":"2023-11-28T11:08:37.388676+0000","last_clean":"2023-11-28T11:08:37.388676+0000","last_became_active":"2023-11-28T11:08:36.001559+0000","last_became_peered":"2023-11-28T11:08:36.001559+0000","last_unstale":"2023-11-28T11:08:37.388676+0000","last_undegraded":"2023-11-28T11:08:37.388676+0000","last_fullsized":"2023-11-28T11:08:37.388676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:55:11.905711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028605+0000","last_change":"2023-11-28T11:08:36.408653+0000","last_active":"2023-11-28T11:08:38.028605+0000","last_peered":"2023-11-28T11:08:38.028605+0000","last_clean":"2023-11-28T11:08:38.028605+0000","last_became_active":"2023-11-28T11:08:36.408400+0000","last_became_peered":"2023-11-28T11:08:36.408400+0000","last_unstale":"2023-11-28T11:08:38.028605+0000","last_undegraded":"2023-11-28T11:08:38.028605+0000","last_fullsized":"2023-11-28T11:08:38.028605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029355+0000","last_change":"2023-11-28T11:08:36.005909+0000","last_active":"2023-11-28T11:08:38.029355+0000","last_peered":"2023-11-28T11:08:38.029355+0000","last_clean":"2023-11-28T11:08:38.029355+0000","last_became_active":"2023-11-28T11:08:36.005626+0000","last_became_peered":"2023-11-28T11:08:36.005626+0000","last_unstale":"2023-11-28T11:08:38.029355+0000","last_undegraded":"2023-11-28T11:08:38.029355+0000","last_fullsized":"2023-11-28T11:08:38.029355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028717+0000","last_change":"2023-11-28T11:08:36.410036+0000","last_active":"2023-11-28T11:08:38.028717+0000","last_peered":"2023-11-28T11:08:38.028717+0000","last_clean":"2023-11-28T11:08:38.028717+0000","last_became_active":"2023-11-28T11:08:36.409785+0000","last_became_peered":"2023-11-28T11:08:36.409785+0000","last_unstale":"2023-11-28T11:08:38.028717+0000","last_undegraded":"2023-11-28T11:08:38.028717+0000","last_fullsized":"2023-11-28T11:08:38.028717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:38:35.406909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390346+0000","last_change":"2023-11-28T11:08:36.008706+0000","last_active":"2023-11-28T11:08:37.390346+0000","last_peered":"2023-11-28T11:08:37.390346+0000","last_clean":"2023-11-28T11:08:37.390346+0000","last_became_active":"2023-11-28T11:08:36.008279+0000","last_became_peered":"2023-11-28T11:08:36.008279+0000","last_unstale":"2023-11-28T11:08:37.390346+0000","last_undegraded":"2023-11-28T11:08:37.390346+0000","last_fullsized":"2023-11-28T11:08:37.390346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028730+0000","last_change":"2023-11-28T11:08:36.413891+0000","last_active":"2023-11-28T11:08:38.028730+0000","last_peered":"2023-11-28T11:08:38.028730+0000","last_clean":"2023-11-28T11:08:38.028730+0000","last_became_active":"2023-11-28T11:08:36.413613+0000","last_became_peered":"2023-11-28T11:08:36.413613+0000","last_unstale":"2023-11-28T11:08:38.028730+0000","last_undegraded":"2023-11-28T11:08:38.028730+0000","last_fullsized":"2023-11-28T11:08:38.028730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030012+0000","last_change":"2023-11-28T11:08:36.009147+0000","last_active":"2023-11-28T11:08:38.030012+0000","last_peered":"2023-11-28T11:08:38.030012+0000","last_clean":"2023-11-28T11:08:38.030012+0000","last_became_active":"2023-11-28T11:08:36.008847+0000","last_became_peered":"2023-11-28T11:08:36.008847+0000","last_unstale":"2023-11-28T11:08:38.030012+0000","last_undegraded":"2023-11-28T11:08:38.030012+0000","last_fullsized":"2023-11-28T11:08:38.030012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029178+0000","last_change":"2023-11-28T11:08:36.410776+0000","last_active":"2023-11-28T11:08:38.029178+0000","last_peered":"2023-11-28T11:08:38.029178+0000","last_clean":"2023-11-28T11:08:38.029178+0000","last_became_active":"2023-11-28T11:08:36.410335+0000","last_became_peered":"2023-11-28T11:08:36.410335+0000","last_unstale":"2023-11-28T11:08:38.029178+0000","last_undegraded":"2023-11-28T11:08:38.029178+0000","last_fullsized":"2023-11-28T11:08:38.029178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:38:35.406909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390017+0000","last_change":"2023-11-28T11:08:36.011427+0000","last_active":"2023-11-28T11:08:37.390017+0000","last_peered":"2023-11-28T11:08:37.390017+0000","last_clean":"2023-11-28T11:08:37.390017+0000","last_became_active":"2023-11-28T11:08:36.011137+0000","last_became_peered":"2023-11-28T11:08:36.011137+0000","last_unstale":"2023-11-28T11:08:37.390017+0000","last_undegraded":"2023-11-28T11:08:37.390017+0000","last_fullsized":"2023-11-28T11:08:37.390017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:32:07.107062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029099+0000","last_change":"2023-11-28T11:08:36.408216+0000","last_active":"2023-11-28T11:08:38.029099+0000","last_peered":"2023-11-28T11:08:38.029099+0000","last_clean":"2023-11-28T11:08:38.029099+0000","last_became_active":"2023-11-28T11:08:36.407897+0000","last_became_peered":"2023-11-28T11:08:36.407897+0000","last_unstale":"2023-11-28T11:08:38.029099+0000","last_undegraded":"2023-11-28T11:08:38.029099+0000","last_fullsized":"2023-11-28T11:08:38.029099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:15.750770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388082+0000","last_change":"2023-11-28T11:08:35.994749+0000","last_active":"2023-11-28T11:08:37.388082+0000","last_peered":"2023-11-28T11:08:37.388082+0000","last_clean":"2023-11-28T11:08:37.388082+0000","last_became_active":"2023-11-28T11:08:35.994475+0000","last_became_peered":"2023-11-28T11:08:35.994475+0000","last_unstale":"2023-11-28T11:08:37.388082+0000","last_undegraded":"2023-11-28T11:08:37.388082+0000","last_fullsized":"2023-11-28T11:08:37.388082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:27.258902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029441+0000","last_change":"2023-11-28T11:08:36.409070+0000","last_active":"2023-11-28T11:08:38.029441+0000","last_peered":"2023-11-28T11:08:38.029441+0000","last_clean":"2023-11-28T11:08:38.029441+0000","last_became_active":"2023-11-28T11:08:36.408778+0000","last_became_peered":"2023-11-28T11:08:36.408778+0000","last_unstale":"2023-11-28T11:08:38.029441+0000","last_undegraded":"2023-11-28T11:08:38.029441+0000","last_fullsized":"2023-11-28T11:08:38.029441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390361+0000","last_change":"2023-11-28T11:08:36.010605+0000","last_active":"2023-11-28T11:08:37.390361+0000","last_peered":"2023-11-28T11:08:37.390361+0000","last_clean":"2023-11-28T11:08:37.390361+0000","last_became_active":"2023-11-28T11:08:36.010210+0000","last_became_peered":"2023-11-28T11:08:36.010210+0000","last_unstale":"2023-11-28T11:08:37.390361+0000","last_undegraded":"2023-11-28T11:08:37.390361+0000","last_fullsized":"2023-11-28T11:08:37.390361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:22:26.583310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388452+0000","last_change":"2023-11-28T11:08:36.413052+0000","last_active":"2023-11-28T11:08:37.388452+0000","last_peered":"2023-11-28T11:08:37.388452+0000","last_clean":"2023-11-28T11:08:37.388452+0000","last_became_active":"2023-11-28T11:08:36.412807+0000","last_became_peered":"2023-11-28T11:08:36.412807+0000","last_unstale":"2023-11-28T11:08:37.388452+0000","last_undegraded":"2023-11-28T11:08:37.388452+0000","last_fullsized":"2023-11-28T11:08:37.388452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389225+0000","last_change":"2023-11-28T11:08:36.004568+0000","last_active":"2023-11-28T11:08:37.389225+0000","last_peered":"2023-11-28T11:08:37.389225+0000","last_clean":"2023-11-28T11:08:37.389225+0000","last_became_active":"2023-11-28T11:08:36.004282+0000","last_became_peered":"2023-11-28T11:08:36.004282+0000","last_unstale":"2023-11-28T11:08:37.389225+0000","last_undegraded":"2023-11-28T11:08:37.389225+0000","last_fullsized":"2023-11-28T11:08:37.389225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:27:44.586581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029444+0000","last_change":"2023-11-28T11:08:36.410178+0000","last_active":"2023-11-28T11:08:38.029444+0000","last_peered":"2023-11-28T11:08:38.029444+0000","last_clean":"2023-11-28T11:08:38.029444+0000","last_became_active":"2023-11-28T11:08:36.409914+0000","last_became_peered":"2023-11-28T11:08:36.409914+0000","last_unstale":"2023-11-28T11:08:38.029444+0000","last_undegraded":"2023-11-28T11:08:38.029444+0000","last_fullsized":"2023-11-28T11:08:38.029444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:28:02.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390215+0000","last_change":"2023-11-28T11:08:36.006868+0000","last_active":"2023-11-28T11:08:37.390215+0000","last_peered":"2023-11-28T11:08:37.390215+0000","last_clean":"2023-11-28T11:08:37.390215+0000","last_became_active":"2023-11-28T11:08:36.006544+0000","last_became_peered":"2023-11-28T11:08:36.006544+0000","last_unstale":"2023-11-28T11:08:37.390215+0000","last_undegraded":"2023-11-28T11:08:37.390215+0000","last_fullsized":"2023-11-28T11:08:37.390215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:38.660821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029014+0000","last_change":"2023-11-28T11:08:36.409753+0000","last_active":"2023-11-28T11:08:38.029014+0000","last_peered":"2023-11-28T11:08:38.029014+0000","last_clean":"2023-11-28T11:08:38.029014+0000","last_became_active":"2023-11-28T11:08:36.409427+0000","last_became_peered":"2023-11-28T11:08:36.409427+0000","last_unstale":"2023-11-28T11:08:38.029014+0000","last_undegraded":"2023-11-28T11:08:38.029014+0000","last_fullsized":"2023-11-28T11:08:38.029014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390044+0000","last_change":"2023-11-28T11:08:36.006987+0000","last_active":"2023-11-28T11:08:37.390044+0000","last_peered":"2023-11-28T11:08:37.390044+0000","last_clean":"2023-11-28T11:08:37.390044+0000","last_became_active":"2023-11-28T11:08:36.006697+0000","last_became_peered":"2023-11-28T11:08:36.006697+0000","last_unstale":"2023-11-28T11:08:37.390044+0000","last_undegraded":"2023-11-28T11:08:37.390044+0000","last_fullsized":"2023-11-28T11:08:37.390044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:50.422704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029242+0000","last_change":"2023-11-28T11:08:36.404777+0000","last_active":"2023-11-28T11:08:38.029242+0000","last_peered":"2023-11-28T11:08:38.029242+0000","last_clean":"2023-11-28T11:08:38.029242+0000","last_became_active":"2023-11-28T11:08:36.404490+0000","last_became_peered":"2023-11-28T11:08:36.404490+0000","last_unstale":"2023-11-28T11:08:38.029242+0000","last_undegraded":"2023-11-28T11:08:38.029242+0000","last_fullsized":"2023-11-28T11:08:38.029242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:04:03.572831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.390457+0000","last_change":"2023-11-28T11:08:36.005444+0000","last_active":"2023-11-28T11:08:37.390457+0000","last_peered":"2023-11-28T11:08:37.390457+0000","last_clean":"2023-11-28T11:08:37.390457+0000","last_became_active":"2023-11-28T11:08:36.005138+0000","last_became_peered":"2023-11-28T11:08:36.005138+0000","last_unstale":"2023-11-28T11:08:37.390457+0000","last_undegraded":"2023-11-28T11:08:37.390457+0000","last_fullsized":"2023-11-28T11:08:37.390457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:59:24.537181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389803+0000","last_change":"2023-11-28T11:08:36.411990+0000","last_active":"2023-11-28T11:08:37.389803+0000","last_peered":"2023-11-28T11:08:37.389803+0000","last_clean":"2023-11-28T11:08:37.389803+0000","last_became_active":"2023-11-28T11:08:36.411669+0000","last_became_peered":"2023-11-28T11:08:36.411669+0000","last_unstale":"2023-11-28T11:08:37.389803+0000","last_undegraded":"2023-11-28T11:08:37.389803+0000","last_fullsized":"2023-11-28T11:08:37.389803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:03.044603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029851+0000","last_change":"2023-11-28T11:08:36.011735+0000","last_active":"2023-11-28T11:08:38.029851+0000","last_peered":"2023-11-28T11:08:38.029851+0000","last_clean":"2023-11-28T11:08:38.029851+0000","last_became_active":"2023-11-28T11:08:36.011491+0000","last_became_peered":"2023-11-28T11:08:36.011491+0000","last_unstale":"2023-11-28T11:08:38.029851+0000","last_undegraded":"2023-11-28T11:08:38.029851+0000","last_fullsized":"2023-11-28T11:08:38.029851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388243+0000","last_change":"2023-11-28T11:08:36.400761+0000","last_active":"2023-11-28T11:08:37.388243+0000","last_peered":"2023-11-28T11:08:37.388243+0000","last_clean":"2023-11-28T11:08:37.388243+0000","last_became_active":"2023-11-28T11:08:36.400410+0000","last_became_peered":"2023-11-28T11:08:36.400410+0000","last_unstale":"2023-11-28T11:08:37.388243+0000","last_undegraded":"2023-11-28T11:08:37.388243+0000","last_fullsized":"2023-11-28T11:08:37.388243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:15.750770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029008+0000","last_change":"2023-11-28T11:08:36.008241+0000","last_active":"2023-11-28T11:08:38.029008+0000","last_peered":"2023-11-28T11:08:38.029008+0000","last_clean":"2023-11-28T11:08:38.029008+0000","last_became_active":"2023-11-28T11:08:36.007905+0000","last_became_peered":"2023-11-28T11:08:36.007905+0000","last_unstale":"2023-11-28T11:08:38.029008+0000","last_undegraded":"2023-11-28T11:08:38.029008+0000","last_fullsized":"2023-11-28T11:08:38.029008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029892+0000","last_change":"2023-11-28T11:08:36.414154+0000","last_active":"2023-11-28T11:08:38.029892+0000","last_peered":"2023-11-28T11:08:38.029892+0000","last_clean":"2023-11-28T11:08:38.029892+0000","last_became_active":"2023-11-28T11:08:36.413893+0000","last_became_peered":"2023-11-28T11:08:36.413893+0000","last_unstale":"2023-11-28T11:08:38.029892+0000","last_undegraded":"2023-11-28T11:08:38.029892+0000","last_fullsized":"2023-11-28T11:08:38.029892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389697+0000","last_change":"2023-11-28T11:08:36.010954+0000","last_active":"2023-11-28T11:08:37.389697+0000","last_peered":"2023-11-28T11:08:37.389697+0000","last_clean":"2023-11-28T11:08:37.389697+0000","last_became_active":"2023-11-28T11:08:36.010641+0000","last_became_peered":"2023-11-28T11:08:36.010641+0000","last_unstale":"2023-11-28T11:08:37.389697+0000","last_undegraded":"2023-11-28T11:08:37.389697+0000","last_fullsized":"2023-11-28T11:08:37.389697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:25:48.509520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029750+0000","last_change":"2023-11-28T11:08:36.403947+0000","last_active":"2023-11-28T11:08:38.029750+0000","last_peered":"2023-11-28T11:08:38.029750+0000","last_clean":"2023-11-28T11:08:38.029750+0000","last_became_active":"2023-11-28T11:08:36.403015+0000","last_became_peered":"2023-11-28T11:08:36.403015+0000","last_unstale":"2023-11-28T11:08:38.029750+0000","last_undegraded":"2023-11-28T11:08:38.029750+0000","last_fullsized":"2023-11-28T11:08:38.029750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:56.135916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029783+0000","last_change":"2023-11-28T11:08:36.008497+0000","last_active":"2023-11-28T11:08:38.029783+0000","last_peered":"2023-11-28T11:08:38.029783+0000","last_clean":"2023-11-28T11:08:38.029783+0000","last_became_active":"2023-11-28T11:08:36.008076+0000","last_became_peered":"2023-11-28T11:08:36.008076+0000","last_unstale":"2023-11-28T11:08:38.029783+0000","last_undegraded":"2023-11-28T11:08:38.029783+0000","last_fullsized":"2023-11-28T11:08:38.029783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029879+0000","last_change":"2023-11-28T11:08:36.408545+0000","last_active":"2023-11-28T11:08:38.029879+0000","last_peered":"2023-11-28T11:08:38.029879+0000","last_clean":"2023-11-28T11:08:38.029879+0000","last_became_active":"2023-11-28T11:08:36.408324+0000","last_became_peered":"2023-11-28T11:08:36.408324+0000","last_unstale":"2023-11-28T11:08:38.029879+0000","last_undegraded":"2023-11-28T11:08:38.029879+0000","last_fullsized":"2023-11-28T11:08:38.029879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:11.108501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029222+0000","last_change":"2023-11-28T11:08:36.008197+0000","last_active":"2023-11-28T11:08:38.029222+0000","last_peered":"2023-11-28T11:08:38.029222+0000","last_clean":"2023-11-28T11:08:38.029222+0000","last_became_active":"2023-11-28T11:08:36.007930+0000","last_became_peered":"2023-11-28T11:08:36.007930+0000","last_unstale":"2023-11-28T11:08:38.029222+0000","last_undegraded":"2023-11-28T11:08:38.029222+0000","last_fullsized":"2023-11-28T11:08:38.029222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029235+0000","last_change":"2023-11-28T11:08:36.414124+0000","last_active":"2023-11-28T11:08:38.029235+0000","last_peered":"2023-11-28T11:08:38.029235+0000","last_clean":"2023-11-28T11:08:38.029235+0000","last_became_active":"2023-11-28T11:08:36.413627+0000","last_became_peered":"2023-11-28T11:08:36.413627+0000","last_unstale":"2023-11-28T11:08:38.029235+0000","last_undegraded":"2023-11-28T11:08:38.029235+0000","last_fullsized":"2023-11-28T11:08:38.029235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.395305+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:08:36.395305+0000","last_peered":"2023-11-28T11:08:36.395305+0000","last_clean":"2023-11-28T11:08:36.395305+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:08:36.395305+0000","last_undegraded":"2023-11-28T11:08:36.395305+0000","last_fullsized":"2023-11-28T11:08:36.395305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029614+0000","last_change":"2023-11-28T11:08:36.012422+0000","last_active":"2023-11-28T11:08:38.029614+0000","last_peered":"2023-11-28T11:08:38.029614+0000","last_clean":"2023-11-28T11:08:38.029614+0000","last_became_active":"2023-11-28T11:08:36.012145+0000","last_became_peered":"2023-11-28T11:08:36.012145+0000","last_unstale":"2023-11-28T11:08:38.029614+0000","last_undegraded":"2023-11-28T11:08:38.029614+0000","last_fullsized":"2023-11-28T11:08:38.029614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029445+0000","last_change":"2023-11-28T11:08:36.404785+0000","last_active":"2023-11-28T11:08:38.029445+0000","last_peered":"2023-11-28T11:08:38.029445+0000","last_clean":"2023-11-28T11:08:38.029445+0000","last_became_active":"2023-11-28T11:08:36.404512+0000","last_became_peered":"2023-11-28T11:08:36.404512+0000","last_unstale":"2023-11-28T11:08:38.029445+0000","last_undegraded":"2023-11-28T11:08:38.029445+0000","last_fullsized":"2023-11-28T11:08:38.029445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:57.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.390894+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:08:36.390894+0000","last_peered":"2023-11-28T11:08:36.390894+0000","last_clean":"2023-11-28T11:08:36.390894+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:08:36.390894+0000","last_undegraded":"2023-11-28T11:08:36.390894+0000","last_fullsized":"2023-11-28T11:08:36.390894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029511+0000","last_change":"2023-11-28T11:08:36.011603+0000","last_active":"2023-11-28T11:08:38.029511+0000","last_peered":"2023-11-28T11:08:38.029511+0000","last_clean":"2023-11-28T11:08:38.029511+0000","last_became_active":"2023-11-28T11:08:36.011343+0000","last_became_peered":"2023-11-28T11:08:36.011343+0000","last_unstale":"2023-11-28T11:08:38.029511+0000","last_undegraded":"2023-11-28T11:08:38.029511+0000","last_fullsized":"2023-11-28T11:08:38.029511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:27.258902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029473+0000","last_change":"2023-11-28T11:08:36.398461+0000","last_active":"2023-11-28T11:08:38.029473+0000","last_peered":"2023-11-28T11:08:38.029473+0000","last_clean":"2023-11-28T11:08:38.029473+0000","last_became_active":"2023-11-28T11:08:36.398208+0000","last_became_peered":"2023-11-28T11:08:36.398208+0000","last_unstale":"2023-11-28T11:08:38.029473+0000","last_undegraded":"2023-11-28T11:08:38.029473+0000","last_fullsized":"2023-11-28T11:08:38.029473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:03.292923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.394283+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:08:36.394283+0000","last_peered":"2023-11-28T11:08:36.394283+0000","last_clean":"2023-11-28T11:08:36.394283+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:08:36.394283+0000","last_undegraded":"2023-11-28T11:08:36.394283+0000","last_fullsized":"2023-11-28T11:08:36.394283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028711+0000","last_change":"2023-11-28T11:08:36.003399+0000","last_active":"2023-11-28T11:08:38.028711+0000","last_peered":"2023-11-28T11:08:38.028711+0000","last_clean":"2023-11-28T11:08:38.028711+0000","last_became_active":"2023-11-28T11:08:36.003098+0000","last_became_peered":"2023-11-28T11:08:36.003098+0000","last_unstale":"2023-11-28T11:08:38.028711+0000","last_undegraded":"2023-11-28T11:08:38.028711+0000","last_fullsized":"2023-11-28T11:08:38.028711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029328+0000","last_change":"2023-11-28T11:08:36.402922+0000","last_active":"2023-11-28T11:08:38.029328+0000","last_peered":"2023-11-28T11:08:38.029328+0000","last_clean":"2023-11-28T11:08:38.029328+0000","last_became_active":"2023-11-28T11:08:36.402567+0000","last_became_peered":"2023-11-28T11:08:36.402567+0000","last_unstale":"2023-11-28T11:08:38.029328+0000","last_undegraded":"2023-11-28T11:08:38.029328+0000","last_fullsized":"2023-11-28T11:08:38.029328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:30.620083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.390396+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:08:36.390396+0000","last_peered":"2023-11-28T11:08:36.390396+0000","last_clean":"2023-11-28T11:08:36.390396+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:08:36.390396+0000","last_undegraded":"2023-11-28T11:08:36.390396+0000","last_fullsized":"2023-11-28T11:08:36.390396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.397551+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:08:36.397551+0000","last_peered":"2023-11-28T11:08:36.397551+0000","last_clean":"2023-11-28T11:08:36.397551+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:08:36.397551+0000","last_undegraded":"2023-11-28T11:08:36.397551+0000","last_fullsized":"2023-11-28T11:08:36.397551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029536+0000","last_change":"2023-11-28T11:08:36.005814+0000","last_active":"2023-11-28T11:08:38.029536+0000","last_peered":"2023-11-28T11:08:38.029536+0000","last_clean":"2023-11-28T11:08:38.029536+0000","last_became_active":"2023-11-28T11:08:36.005597+0000","last_became_peered":"2023-11-28T11:08:36.005597+0000","last_unstale":"2023-11-28T11:08:38.029536+0000","last_undegraded":"2023-11-28T11:08:38.029536+0000","last_fullsized":"2023-11-28T11:08:38.029536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389609+0000","last_change":"2023-11-28T11:08:36.412276+0000","last_active":"2023-11-28T11:08:37.389609+0000","last_peered":"2023-11-28T11:08:37.389609+0000","last_clean":"2023-11-28T11:08:37.389609+0000","last_became_active":"2023-11-28T11:08:36.411972+0000","last_became_peered":"2023-11-28T11:08:36.411972+0000","last_unstale":"2023-11-28T11:08:37.389609+0000","last_undegraded":"2023-11-28T11:08:37.389609+0000","last_fullsized":"2023-11-28T11:08:37.389609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:51.424901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.397737+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:08:36.397737+0000","last_peered":"2023-11-28T11:08:36.397737+0000","last_clean":"2023-11-28T11:08:36.397737+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:08:36.397737+0000","last_undegraded":"2023-11-28T11:08:36.397737+0000","last_fullsized":"2023-11-28T11:08:36.397737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388014+0000","last_change":"2023-11-28T11:08:36.007167+0000","last_active":"2023-11-28T11:08:37.388014+0000","last_peered":"2023-11-28T11:08:37.388014+0000","last_clean":"2023-11-28T11:08:37.388014+0000","last_became_active":"2023-11-28T11:08:36.006824+0000","last_became_peered":"2023-11-28T11:08:36.006824+0000","last_unstale":"2023-11-28T11:08:37.388014+0000","last_undegraded":"2023-11-28T11:08:37.388014+0000","last_fullsized":"2023-11-28T11:08:37.388014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:48:08.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388714+0000","last_change":"2023-11-28T11:08:36.400076+0000","last_active":"2023-11-28T11:08:37.388714+0000","last_peered":"2023-11-28T11:08:37.388714+0000","last_clean":"2023-11-28T11:08:37.388714+0000","last_became_active":"2023-11-28T11:08:36.399490+0000","last_became_peered":"2023-11-28T11:08:36.399490+0000","last_unstale":"2023-11-28T11:08:37.388714+0000","last_undegraded":"2023-11-28T11:08:37.388714+0000","last_fullsized":"2023-11-28T11:08:37.388714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.399615+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:08:36.399615+0000","last_peered":"2023-11-28T11:08:36.399615+0000","last_clean":"2023-11-28T11:08:36.399615+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:08:36.399615+0000","last_undegraded":"2023-11-28T11:08:36.399615+0000","last_fullsized":"2023-11-28T11:08:36.399615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029477+0000","last_change":"2023-11-28T11:08:36.001037+0000","last_active":"2023-11-28T11:08:38.029477+0000","last_peered":"2023-11-28T11:08:38.029477+0000","last_clean":"2023-11-28T11:08:38.029477+0000","last_became_active":"2023-11-28T11:08:36.000535+0000","last_became_peered":"2023-11-28T11:08:36.000535+0000","last_unstale":"2023-11-28T11:08:38.029477+0000","last_undegraded":"2023-11-28T11:08:38.029477+0000","last_fullsized":"2023-11-28T11:08:38.029477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388339+0000","last_change":"2023-11-28T11:08:36.395350+0000","last_active":"2023-11-28T11:08:37.388339+0000","last_peered":"2023-11-28T11:08:37.388339+0000","last_clean":"2023-11-28T11:08:37.388339+0000","last_became_active":"2023-11-28T11:08:36.394962+0000","last_became_peered":"2023-11-28T11:08:36.394962+0000","last_unstale":"2023-11-28T11:08:37.388339+0000","last_undegraded":"2023-11-28T11:08:37.388339+0000","last_fullsized":"2023-11-28T11:08:37.388339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:31.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029389+0000","last_change":"2023-11-28T11:08:36.008154+0000","last_active":"2023-11-28T11:08:38.029389+0000","last_peered":"2023-11-28T11:08:38.029389+0000","last_clean":"2023-11-28T11:08:38.029389+0000","last_became_active":"2023-11-28T11:08:36.007856+0000","last_became_peered":"2023-11-28T11:08:36.007856+0000","last_unstale":"2023-11-28T11:08:38.029389+0000","last_undegraded":"2023-11-28T11:08:38.029389+0000","last_fullsized":"2023-11-28T11:08:38.029389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:47.478845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.395415+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:08:36.395415+0000","last_peered":"2023-11-28T11:08:36.395415+0000","last_clean":"2023-11-28T11:08:36.395415+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:08:36.395415+0000","last_undegraded":"2023-11-28T11:08:36.395415+0000","last_fullsized":"2023-11-28T11:08:36.395415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028493+0000","last_change":"2023-11-28T11:08:36.409355+0000","last_active":"2023-11-28T11:08:38.028493+0000","last_peered":"2023-11-28T11:08:38.028493+0000","last_clean":"2023-11-28T11:08:38.028493+0000","last_became_active":"2023-11-28T11:08:36.409102+0000","last_became_peered":"2023-11-28T11:08:36.409102+0000","last_unstale":"2023-11-28T11:08:38.028493+0000","last_undegraded":"2023-11-28T11:08:38.028493+0000","last_fullsized":"2023-11-28T11:08:38.028493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:17:00.028902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T11:08:36.398519+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:08:36.398519+0000","last_peered":"2023-11-28T11:08:36.398519+0000","last_clean":"2023-11-28T11:08:36.398519+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:08:36.398519+0000","last_undegraded":"2023-11-28T11:08:36.398519+0000","last_fullsized":"2023-11-28T11:08:36.398519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388624+0000","last_change":"2023-11-28T11:08:36.003130+0000","last_active":"2023-11-28T11:08:37.388624+0000","last_peered":"2023-11-28T11:08:37.388624+0000","last_clean":"2023-11-28T11:08:37.388624+0000","last_became_active":"2023-11-28T11:08:36.002603+0000","last_became_peered":"2023-11-28T11:08:36.002603+0000","last_unstale":"2023-11-28T11:08:37.388624+0000","last_undegraded":"2023-11-28T11:08:37.388624+0000","last_fullsized":"2023-11-28T11:08:37.388624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:37:12.961779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029185+0000","last_change":"2023-11-28T11:08:36.404217+0000","last_active":"2023-11-28T11:08:38.029185+0000","last_peered":"2023-11-28T11:08:38.029185+0000","last_clean":"2023-11-28T11:08:38.029185+0000","last_became_active":"2023-11-28T11:08:36.403929+0000","last_became_peered":"2023-11-28T11:08:36.403929+0000","last_unstale":"2023-11-28T11:08:38.029185+0000","last_undegraded":"2023-11-28T11:08:38.029185+0000","last_fullsized":"2023-11-28T11:08:38.029185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:13.390834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388389+0000","last_change":"2023-11-28T11:08:36.010521+0000","last_active":"2023-11-28T11:08:37.388389+0000","last_peered":"2023-11-28T11:08:37.388389+0000","last_clean":"2023-11-28T11:08:37.388389+0000","last_became_active":"2023-11-28T11:08:36.010235+0000","last_became_peered":"2023-11-28T11:08:36.010235+0000","last_unstale":"2023-11-28T11:08:37.388389+0000","last_undegraded":"2023-11-28T11:08:37.388389+0000","last_fullsized":"2023-11-28T11:08:37.388389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:12.213359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.527702+0000","last_change":"2023-11-28T11:08:36.399755+0000","last_active":"2023-11-28T11:08:37.527702+0000","last_peered":"2023-11-28T11:08:37.527702+0000","last_clean":"2023-11-28T11:08:37.527702+0000","last_became_active":"2023-11-28T11:08:36.399504+0000","last_became_peered":"2023-11-28T11:08:36.399504+0000","last_unstale":"2023-11-28T11:08:37.527702+0000","last_undegraded":"2023-11-28T11:08:37.527702+0000","last_fullsized":"2023-11-28T11:08:37.527702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:13.661118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029388+0000","last_change":"2023-11-28T11:08:36.010768+0000","last_active":"2023-11-28T11:08:38.029388+0000","last_peered":"2023-11-28T11:08:38.029388+0000","last_clean":"2023-11-28T11:08:38.029388+0000","last_became_active":"2023-11-28T11:08:36.010442+0000","last_became_peered":"2023-11-28T11:08:36.010442+0000","last_unstale":"2023-11-28T11:08:38.029388+0000","last_undegraded":"2023-11-28T11:08:38.029388+0000","last_fullsized":"2023-11-28T11:08:38.029388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029576+0000","last_change":"2023-11-28T11:08:36.410581+0000","last_active":"2023-11-28T11:08:38.029576+0000","last_peered":"2023-11-28T11:08:38.029576+0000","last_clean":"2023-11-28T11:08:38.029576+0000","last_became_active":"2023-11-28T11:08:36.410010+0000","last_became_peered":"2023-11-28T11:08:36.410010+0000","last_unstale":"2023-11-28T11:08:38.029576+0000","last_undegraded":"2023-11-28T11:08:38.029576+0000","last_fullsized":"2023-11-28T11:08:38.029576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:31.911633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029714+0000","last_change":"2023-11-28T11:08:36.010817+0000","last_active":"2023-11-28T11:08:38.029714+0000","last_peered":"2023-11-28T11:08:38.029714+0000","last_clean":"2023-11-28T11:08:38.029714+0000","last_became_active":"2023-11-28T11:08:36.010516+0000","last_became_peered":"2023-11-28T11:08:36.010516+0000","last_unstale":"2023-11-28T11:08:38.029714+0000","last_undegraded":"2023-11-28T11:08:38.029714+0000","last_fullsized":"2023-11-28T11:08:38.029714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:25:02.042406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030156+0000","last_change":"2023-11-28T11:08:36.414691+0000","last_active":"2023-11-28T11:08:38.030156+0000","last_peered":"2023-11-28T11:08:38.030156+0000","last_clean":"2023-11-28T11:08:38.030156+0000","last_became_active":"2023-11-28T11:08:36.412582+0000","last_became_peered":"2023-11-28T11:08:36.412582+0000","last_unstale":"2023-11-28T11:08:38.030156+0000","last_undegraded":"2023-11-28T11:08:38.030156+0000","last_fullsized":"2023-11-28T11:08:38.030156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:27.723848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028818+0000","last_change":"2023-11-28T11:08:36.004724+0000","last_active":"2023-11-28T11:08:38.028818+0000","last_peered":"2023-11-28T11:08:38.028818+0000","last_clean":"2023-11-28T11:08:38.028818+0000","last_became_active":"2023-11-28T11:08:36.004413+0000","last_became_peered":"2023-11-28T11:08:36.004413+0000","last_unstale":"2023-11-28T11:08:38.028818+0000","last_undegraded":"2023-11-28T11:08:38.028818+0000","last_fullsized":"2023-11-28T11:08:38.028818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:29.745910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.028617+0000","last_change":"2023-11-28T11:08:36.405263+0000","last_active":"2023-11-28T11:08:38.028617+0000","last_peered":"2023-11-28T11:08:38.028617+0000","last_clean":"2023-11-28T11:08:38.028617+0000","last_became_active":"2023-11-28T11:08:36.405009+0000","last_became_peered":"2023-11-28T11:08:36.405009+0000","last_unstale":"2023-11-28T11:08:38.028617+0000","last_undegraded":"2023-11-28T11:08:38.028617+0000","last_fullsized":"2023-11-28T11:08:38.028617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:56.135916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.388734+0000","last_change":"2023-11-28T11:08:36.004954+0000","last_active":"2023-11-28T11:08:37.388734+0000","last_peered":"2023-11-28T11:08:37.388734+0000","last_clean":"2023-11-28T11:08:37.388734+0000","last_became_active":"2023-11-28T11:08:36.004689+0000","last_became_peered":"2023-11-28T11:08:36.004689+0000","last_unstale":"2023-11-28T11:08:37.388734+0000","last_undegraded":"2023-11-28T11:08:37.388734+0000","last_fullsized":"2023-11-28T11:08:37.388734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:34.977874+0000","last_clean_scrub_stamp":"2023-11-28T11:08:34.977874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:26:12.658921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029176+0000","last_change":"2023-11-28T11:08:36.409550+0000","last_active":"2023-11-28T11:08:38.029176+0000","last_peered":"2023-11-28T11:08:38.029176+0000","last_clean":"2023-11-28T11:08:38.029176+0000","last_became_active":"2023-11-28T11:08:36.409256+0000","last_became_peered":"2023-11-28T11:08:36.409256+0000","last_unstale":"2023-11-28T11:08:38.029176+0000","last_undegraded":"2023-11-28T11:08:38.029176+0000","last_fullsized":"2023-11-28T11:08:38.029176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:04.049045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:37.389289+0000","last_change":"2023-11-28T11:08:36.408453+0000","last_active":"2023-11-28T11:08:37.389289+0000","last_peered":"2023-11-28T11:08:37.389289+0000","last_clean":"2023-11-28T11:08:37.389289+0000","last_became_active":"2023-11-28T11:08:36.408159+0000","last_became_peered":"2023-11-28T11:08:36.408159+0000","last_unstale":"2023-11-28T11:08:37.389289+0000","last_undegraded":"2023-11-28T11:08:37.389289+0000","last_fullsized":"2023-11-28T11:08:37.389289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:59:25.539378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029482+0000","last_change":"2023-11-28T11:08:36.408287+0000","last_active":"2023-11-28T11:08:38.029482+0000","last_peered":"2023-11-28T11:08:38.029482+0000","last_clean":"2023-11-28T11:08:38.029482+0000","last_became_active":"2023-11-28T11:08:36.408035+0000","last_became_peered":"2023-11-28T11:08:36.408035+0000","last_unstale":"2023-11-28T11:08:38.029482+0000","last_undegraded":"2023-11-28T11:08:38.029482+0000","last_fullsized":"2023-11-28T11:08:38.029482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:45:33.470588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.030002+0000","last_change":"2023-11-28T11:08:36.414705+0000","last_active":"2023-11-28T11:08:38.030002+0000","last_peered":"2023-11-28T11:08:38.030002+0000","last_clean":"2023-11-28T11:08:38.030002+0000","last_became_active":"2023-11-28T11:08:36.414428+0000","last_became_peered":"2023-11-28T11:08:36.414428+0000","last_unstale":"2023-11-28T11:08:38.030002+0000","last_undegraded":"2023-11-28T11:08:38.030002+0000","last_fullsized":"2023-11-28T11:08:38.030002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:05.744622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029115+0000","last_change":"2023-11-28T11:08:36.409051+0000","last_active":"2023-11-28T11:08:38.029115+0000","last_peered":"2023-11-28T11:08:38.029115+0000","last_clean":"2023-11-28T11:08:38.029115+0000","last_became_active":"2023-11-28T11:08:36.408827+0000","last_became_peered":"2023-11-28T11:08:36.408827+0000","last_unstale":"2023-11-28T11:08:38.029115+0000","last_undegraded":"2023-11-28T11:08:38.029115+0000","last_fullsized":"2023-11-28T11:08:38.029115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:05.744622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:08:38.029371+0000","last_change":"2023-11-28T11:08:36.410425+0000","last_active":"2023-11-28T11:08:38.029371+0000","last_peered":"2023-11-28T11:08:38.029371+0000","last_clean":"2023-11-28T11:08:38.029371+0000","last_became_active":"2023-11-28T11:08:36.409787+0000","last_became_peered":"2023-11-28T11:08:36.409787+0000","last_unstale":"2023-11-28T11:08:38.029371+0000","last_undegraded":"2023-11-28T11:08:38.029371+0000","last_fullsized":"2023-11-28T11:08:38.029371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:35.980071+0000","last_clean_scrub_stamp":"2023-11-28T11:08:35.980071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:37:56.065831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":685204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:08:49.889 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T11:08:49.890 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T11:08:49.890 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T11:08:49.890 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:08:50.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.044+0000 7f974de65700 1 Processor -- start 2023-11-28T11:08:50.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.044+0000 7f974de65700 1 -- start start 2023-11-28T11:08:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f974de65700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9748070d90 0x7f97480711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f974de65700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9748151a50 con 0x7f974815e0b0 2023-11-28T11:08:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f974de65700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974815b440 con 0x7f974806a270 2023-11-28T11:08:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f974de65700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9748071ac0 con 0x7f9748070d90 2023-11-28T11:08:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f9747fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f974815e0b0 0x7f974815e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41420/0 (socket says 172.21.15.125:41420) 2023-11-28T11:08:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f9747fff700 1 -- 172.21.15.125:0/2179463591 learned_addr learned my addr 172.21.15.125:0/2179463591 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f9746ffd700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9748070d90 0x7f97480711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104854068 0 0) 0x7f9748151a50 con 0x7f974815e0b0 2023-11-28T11:08:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97300035b0 con 0x7f974815e0b0 2023-11-28T11:08:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595179177 0 0) 0x7f974815b440 con 0x7f974806a270 2023-11-28T11:08:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9748151a50 con 0x7f974806a270 2023-11-28T11:08:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 454942667 0 0) 0x7f97300035b0 con 0x7f974815e0b0 2023-11-28T11:08:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9748070d90 msgr2=0x7f97480711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9748070d90 0x7f97480711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 >> v1:172.21.15.167:6789/0 conn(0x7f974806a270 legacy=0x7f974806a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974815adf0 con 0x7f974815e0b0 2023-11-28T11:08:50.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f97400019f0 con 0x7f974815e0b0 2023-11-28T11:08:50.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 >> v1:172.21.15.125:6789/0 conn(0x7f974815e0b0 legacy=0x7f974815e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.045+0000 7f97467fc700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9730003bc0 0x7f9730003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f97467fc700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9748070d90 0x7f9730004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f97467fc700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9730004d90 0x7f9730005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748071ac0 con 0x7f9730004d90 2023-11-28T11:08:50.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973000bac0 con 0x7f9730003bc0 2023-11-28T11:08:50.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973000bc30 con 0x7f9748070d90 2023-11-28T11:08:50.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f9747fff700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9730004d90 0x7f9730005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f97477fe700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9730003bc0 0x7f9730003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f9746ffd700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9748070d90 0x7f9730004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f9747fff700 1 -- 172.21.15.125:0/2179463591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9748070d90 msgr2=0x7f9730004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:50.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f9747fff700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9748070d90 0x7f9730004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f9747fff700 1 -- 172.21.15.125:0/2179463591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9730003bc0 msgr2=0x7f9730003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:50.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f9747fff700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9730003bc0 0x7f9730003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f9747fff700 1 -- 172.21.15.125:0/2179463591 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300035b0 con 0x7f9730004d90 2023-11-28T11:08:50.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f9747fff700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9730004d90 0x7f9730005200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f974000a7a0 tx=0x7f9730005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b44847af1c2605 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:50.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400072d0 con 0x7f9730004d90 2023-11-28T11:08:50.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740007450 con 0x7f9730004d90 2023-11-28T11:08:50.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.046+0000 7f97467fc700 1 -- 172.21.15.125:0/2179463591 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740007800 con 0x7f9730004d90 2023-11-28T11:08:50.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.047+0000 7f974de65700 1 -- 172.21.15.125:0/2179463591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9730004d90 msgr2=0x7f9730005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.047+0000 7f974de65700 1 --2- 172.21.15.125:0/2179463591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9730004d90 0x7f9730005200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f974000a7a0 tx=0x7f9730005880 comp rx=0 tx=0).stop 2023-11-28T11:08:50.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.047+0000 7f9747fff700 1 -- 172.21.15.125:0/2179463591 reap_dead start 2023-11-28T11:08:50.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.047+0000 7f974de65700 1 -- 172.21.15.125:0/2179463591 shutdown_connections 2023-11-28T11:08:50.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.047+0000 7f974de65700 1 -- 172.21.15.125:0/2179463591 >> 172.21.15.125:0/2179463591 conn(0x7f974806c010 msgr2=0x7f97480cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:50.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.047+0000 7f974de65700 1 -- 172.21.15.125:0/2179463591 shutdown_connections 2023-11-28T11:08:50.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.047+0000 7f974de65700 1 -- 172.21.15.125:0/2179463591 wait complete. 2023-11-28T11:08:50.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.048+0000 7f974de65700 1 Processor -- start 2023-11-28T11:08:50.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.048+0000 7f974de65700 1 -- start start 2023-11-28T11:08:50.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.049+0000 7f974de65700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974814be90 0x7f97480c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.049+0000 7f974de65700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97480cb210 0x7f97480cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.049+0000 7f974de65700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97480ae640 0x7f97480aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.049+0000 7f974de65700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480cbbc0 con 0x7f97480ae640 2023-11-28T11:08:50.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.049+0000 7f974de65700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480af020 con 0x7f974814be90 2023-11-28T11:08:50.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.049+0000 7f974de65700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97481f2720 con 0x7f97480cb210 2023-11-28T11:08:50.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.049+0000 7f9747fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97480ae640 0x7f97480aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.049+0000 7f9747fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97480ae640 0x7f97480aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57308/0 (socket says 172.21.15.125:57308) 2023-11-28T11:08:50.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.049+0000 7f9747fff700 1 -- 172.21.15.125:0/755788420 learned_addr learned my addr 172.21.15.125:0/755788420 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:50.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f9746ffd700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97480cb210 0x7f97480cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f97477fe700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974814be90 0x7f97480c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f9747fff700 1 -- 172.21.15.125:0/755788420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97480cb210 msgr2=0x7f97480cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f9747fff700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97480cb210 0x7f97480cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f9747fff700 1 -- 172.21.15.125:0/755788420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974814be90 msgr2=0x7f97480c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f9747fff700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974814be90 0x7f97480c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f9747fff700 1 -- 172.21.15.125:0/755788420 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974815aac0 con 0x7f97480ae640 2023-11-28T11:08:50.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f97477fe700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974814be90 0x7f97480c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:50.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f9747fff700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97480ae640 0x7f97480aeae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9740001c30 tx=0x7f9740001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:50.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f972ffff700 1 -- 172.21.15.125:0/755788420 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400019b0 con 0x7f97480ae640 2023-11-28T11:08:50.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f972ffff700 1 -- 172.21.15.125:0/755788420 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740012400 con 0x7f97480ae640 2023-11-28T11:08:50.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f974de65700 1 -- 172.21.15.125:0/755788420 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974815b0d0 con 0x7f97480ae640 2023-11-28T11:08:50.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f972ffff700 1 -- 172.21.15.125:0/755788420 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740012790 con 0x7f97480ae640 2023-11-28T11:08:50.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.050+0000 7f974de65700 1 -- 172.21.15.125:0/755788420 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97480b23e0 con 0x7f97480ae640 2023-11-28T11:08:50.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.051+0000 7f974de65700 1 -- 172.21.15.125:0/755788420 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97480743f0 con 0x7f97480ae640 2023-11-28T11:08:50.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.052+0000 7f972ffff700 1 -- 172.21.15.125:0/755788420 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9740010070 con 0x7f97480ae640 2023-11-28T11:08:50.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.052+0000 7f972ffff700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97340682f0 0x7f973406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.052+0000 7f972ffff700 1 -- 172.21.15.125:0/755788420 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9740087520 con 0x7f97480ae640 2023-11-28T11:08:50.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.052+0000 7f97477fe700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97340682f0 0x7f973406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.053+0000 7f97477fe700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97340682f0 0x7f973406a7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f97480cfaa0 tx=0x7f9738009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:50.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.056+0000 7f972ffff700 1 -- 172.21.15.125:0/755788420 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9740053dd0 con 0x7f97480ae640 2023-11-28T11:08:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.284+0000 7f974de65700 1 -- 172.21.15.125:0/755788420 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f97480cd520 con 0x7f97480ae640 2023-11-28T11:08:50.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.284+0000 7f972ffff700 1 -- 172.21.15.125:0/755788420 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f97400573f0 con 0x7f97480ae640 2023-11-28T11:08:50.285 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:50.285 INFO:teuthology.orchestra.run.smithi125.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T11:08:50.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 -- 172.21.15.125:0/755788420 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97340682f0 msgr2=0x7f973406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97340682f0 0x7f973406a7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f97480cfaa0 tx=0x7f9738009040 comp rx=0 tx=0).stop 2023-11-28T11:08:50.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 -- 172.21.15.125:0/755788420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97480ae640 msgr2=0x7f97480aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97480ae640 0x7f97480aeae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9740001c30 tx=0x7f9740001d00 comp rx=0 tx=0).stop 2023-11-28T11:08:50.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 -- 172.21.15.125:0/755788420 shutdown_connections 2023-11-28T11:08:50.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97480ae640 0x7f97480aeae0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f974814be90 0x7f97480c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97340682f0 0x7f973406a7a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 --2- 172.21.15.125:0/755788420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97480cb210 0x7f97480cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 -- 172.21.15.125:0/755788420 >> 172.21.15.125:0/755788420 conn(0x7f974806c010 msgr2=0x7f97480cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:50.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 -- 172.21.15.125:0/755788420 shutdown_connections 2023-11-28T11:08:50.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.286+0000 7f974de65700 1 -- 172.21.15.125:0/755788420 wait complete. 2023-11-28T11:08:50.298 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T11:08:50.299 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:08:50.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.419+0000 7f600a041700 1 Processor -- start 2023-11-28T11:08:50.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.419+0000 7f600a041700 1 -- start start 2023-11-28T11:08:50.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f600a041700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f600406a270 0x7f600406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f600a041700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406e570 0x7f6004070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f600a041700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600406ab80 con 0x7f600415cc80 2023-11-28T11:08:50.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f600a041700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60040b2490 con 0x7f600406a270 2023-11-28T11:08:50.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f600a041700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60040b1810 con 0x7f600406e570 2023-11-28T11:08:50.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f6003fff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406e570 0x7f6004070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f60037fe700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f600406a270 0x7f600406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f6003fff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406e570 0x7f6004070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:52322/0 (socket says 172.21.15.125:52322) 2023-11-28T11:08:50.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f6003fff700 1 -- 172.21.15.125:0/2124124019 learned_addr learned my addr 172.21.15.125:0/2124124019 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:50.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f6003fff700 1 -- 172.21.15.125:0/2124124019 >> v2:172.21.15.167:3300/0 conn(0x7f600406a270 msgr2=0x7f600406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:50.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f6003fff700 1 --2- 172.21.15.125:0/2124124019 >> v2:172.21.15.167:3300/0 conn(0x7f600406a270 0x7f600406a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f6003fff700 1 -- 172.21.15.125:0/2124124019 >> v1:172.21.15.167:6789/0 conn(0x7f600415cc80 legacy=0x7f600406de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f6003fff700 1 -- 172.21.15.125:0/2124124019 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040b1af0 con 0x7f600406e570 2023-11-28T11:08:50.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.420+0000 7f60037fe700 1 --2- 172.21.15.125:0/2124124019 >> v2:172.21.15.167:3300/0 conn(0x7f600406a270 0x7f600406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:50.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f6003fff700 1 --2- 172.21.15.125:0/2124124019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406e570 0x7f6004070d20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009e50 tx=0x7f5ffc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23b2bfe7c9df9755 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:50.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f60027fc700 1 -- 172.21.15.125:0/2124124019 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc00e070 con 0x7f600406e570 2023-11-28T11:08:50.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f60027fc700 1 -- 172.21.15.125:0/2124124019 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc00b910 con 0x7f600406e570 2023-11-28T11:08:50.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f60027fc700 1 -- 172.21.15.125:0/2124124019 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc00bcc0 con 0x7f600406e570 2023-11-28T11:08:50.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f600a041700 1 -- 172.21.15.125:0/2124124019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406e570 msgr2=0x7f6004070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f600a041700 1 --2- 172.21.15.125:0/2124124019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406e570 0x7f6004070d20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009e50 tx=0x7f5ffc00b330 comp rx=0 tx=0).stop 2023-11-28T11:08:50.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f600a041700 1 -- 172.21.15.125:0/2124124019 shutdown_connections 2023-11-28T11:08:50.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f600a041700 1 --2- 172.21.15.125:0/2124124019 >> v2:172.21.15.167:3300/0 conn(0x7f600406a270 0x7f600406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f600a041700 1 --2- 172.21.15.125:0/2124124019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406e570 0x7f6004070d20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f600a041700 1 -- 172.21.15.125:0/2124124019 >> 172.21.15.125:0/2124124019 conn(0x7f600406c010 msgr2=0x7f60040cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:50.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f600a041700 1 -- 172.21.15.125:0/2124124019 shutdown_connections 2023-11-28T11:08:50.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.421+0000 7f600a041700 1 -- 172.21.15.125:0/2124124019 wait complete. 2023-11-28T11:08:50.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.423+0000 7f600a041700 1 Processor -- start 2023-11-28T11:08:50.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.423+0000 7f600a041700 1 -- start start 2023-11-28T11:08:50.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.423+0000 7f600a041700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406a270 0x7f6004145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.423+0000 7f600a041700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f600406e570 0x7f600415c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.423+0000 7f600a041700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600415cc80 0x7f60041e6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.423+0000 7f600a041700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600415eda0 con 0x7f600406e570 2023-11-28T11:08:50.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.423+0000 7f600a041700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600415e120 con 0x7f600415cc80 2023-11-28T11:08:50.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.423+0000 7f600a041700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600415e400 con 0x7f600406a270 2023-11-28T11:08:50.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f6002ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f600406e570 0x7f600415c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f6002ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f600406e570 0x7f600415c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57318/0 (socket says 172.21.15.125:57318) 2023-11-28T11:08:50.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f6002ffd700 1 -- 172.21.15.125:0/1008171902 learned_addr learned my addr 172.21.15.125:0/1008171902 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:50.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f6003fff700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600415cc80 0x7f60041e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f60037fe700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406a270 0x7f6004145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f6002ffd700 1 -- 172.21.15.125:0/1008171902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406a270 msgr2=0x7f6004145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f6002ffd700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406a270 0x7f6004145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f6002ffd700 1 -- 172.21.15.125:0/1008171902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600415cc80 msgr2=0x7f60041e6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f6002ffd700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600415cc80 0x7f60041e6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f6002ffd700 1 -- 172.21.15.125:0/1008171902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80094a0 con 0x7f600406e570 2023-11-28T11:08:50.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f6002ffd700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f600406e570 0x7f600415c250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c4e0 tx=0x7f5ff400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:50.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f5febfff700 1 -- 172.21.15.125:0/1008171902 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff40052d0 con 0x7f600406e570 2023-11-28T11:08:50.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f5febfff700 1 -- 172.21.15.125:0/1008171902 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff4005430 con 0x7f600406e570 2023-11-28T11:08:50.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f600a041700 1 -- 172.21.15.125:0/1008171902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc009b30 con 0x7f600406e570 2023-11-28T11:08:50.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f5febfff700 1 -- 172.21.15.125:0/1008171902 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff40038c0 con 0x7f600406e570 2023-11-28T11:08:50.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.424+0000 7f600a041700 1 -- 172.21.15.125:0/1008171902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60040b20b0 con 0x7f600406e570 2023-11-28T11:08:50.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.425+0000 7f600a041700 1 -- 172.21.15.125:0/1008171902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60040b1dd0 con 0x7f600406e570 2023-11-28T11:08:50.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.426+0000 7f5febfff700 1 -- 172.21.15.125:0/1008171902 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5ff4019030 con 0x7f600406e570 2023-11-28T11:08:50.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.426+0000 7f5febfff700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ff00682f0 0x7f5ff006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.426+0000 7f5febfff700 1 -- 172.21.15.125:0/1008171902 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ff4084eb0 con 0x7f600406e570 2023-11-28T11:08:50.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.426+0000 7f60037fe700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ff00682f0 0x7f5ff006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.426+0000 7f60037fe700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ff00682f0 0x7f5ff006a7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009cd0 tx=0x7f5ff8009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:50.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.430+0000 7f5febfff700 1 -- 172.21.15.125:0/1008171902 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5ff4051710 con 0x7f600406e570 2023-11-28T11:08:50.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.614+0000 7f600a041700 1 -- 172.21.15.125:0/1008171902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f600415daa0 con 0x7f600406e570 2023-11-28T11:08:50.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.615+0000 7f5febfff700 1 -- 172.21.15.125:0/1008171902 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f5ff4017090 con 0x7f600406e570 2023-11-28T11:08:50.616 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:50.616 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:08:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 -- 172.21.15.125:0/1008171902 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ff00682f0 msgr2=0x7f5ff006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ff00682f0 0x7f5ff006a7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009cd0 tx=0x7f5ff8009210 comp rx=0 tx=0).stop 2023-11-28T11:08:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 -- 172.21.15.125:0/1008171902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f600406e570 msgr2=0x7f600415c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f600406e570 0x7f600415c250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c4e0 tx=0x7f5ff400c7f0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 -- 172.21.15.125:0/1008171902 shutdown_connections 2023-11-28T11:08:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600415cc80 0x7f60041e6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ff00682f0 0x7f5ff006a7a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600406a270 0x7f6004145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 --2- 172.21.15.125:0/1008171902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f600406e570 0x7f600415c250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 -- 172.21.15.125:0/1008171902 >> 172.21.15.125:0/1008171902 conn(0x7f600406c010 msgr2=0x7f60040b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 -- 172.21.15.125:0/1008171902 shutdown_connections 2023-11-28T11:08:50.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.617+0000 7f600a041700 1 -- 172.21.15.125:0/1008171902 wait complete. 2023-11-28T11:08:50.630 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:08:50.631 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:08:50.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.753+0000 7ff01ac61700 1 Processor -- start 2023-11-28T11:08:50.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.754+0000 7ff01ac61700 1 -- start start 2023-11-28T11:08:50.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.754+0000 7ff01ac61700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff014159710 0x7ff014070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.754+0000 7ff01ac61700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0140cee40 0x7ff0140cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.754+0000 7ff01ac61700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff0140c9a50 0x7ff0140c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.754+0000 7ff01ac61700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0140cf290 con 0x7ff014159710 2023-11-28T11:08:50.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.754+0000 7ff01ac61700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0140ca410 con 0x7ff0140c9a50 2023-11-28T11:08:50.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.754+0000 7ff01ac61700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01406a310 con 0x7ff0140cee40 2023-11-28T11:08:50.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.754+0000 7ff0189fd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff014159710 0x7ff014070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.754+0000 7ff0189fd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff014159710 0x7ff014070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57324/0 (socket says 172.21.15.125:57324) 2023-11-28T11:08:50.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff0189fd700 1 -- 172.21.15.125:0/1812675399 learned_addr learned my addr 172.21.15.125:0/1812675399 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:50.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff0191fe700 1 --2- 172.21.15.125:0/1812675399 >> v2:172.21.15.167:3300/0 conn(0x7ff0140c9a50 0x7ff0140c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff013fff700 1 --2- 172.21.15.125:0/1812675399 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0140cee40 0x7ff0140cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff0189fd700 1 -- 172.21.15.125:0/1812675399 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0140cee40 msgr2=0x7ff0140cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff0189fd700 1 --2- 172.21.15.125:0/1812675399 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0140cee40 0x7ff0140cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff0189fd700 1 -- 172.21.15.125:0/1812675399 >> v2:172.21.15.167:3300/0 conn(0x7ff0140c9a50 msgr2=0x7ff0140c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff0189fd700 1 --2- 172.21.15.125:0/1812675399 >> v2:172.21.15.167:3300/0 conn(0x7ff0140c9a50 0x7ff0140c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff0189fd700 1 -- 172.21.15.125:0/1812675399 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0140ce530 con 0x7ff014159710 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff0189fd700 1 --2- 172.21.15.125:0/1812675399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff014159710 0x7ff014070370 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff014070170 tx=0x7ff008009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dc355ca0f66c5f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff0137fe700 1 -- 172.21.15.125:0/1812675399 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00800b870 con 0x7ff014159710 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff0137fe700 1 -- 172.21.15.125:0/1812675399 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00800b9d0 con 0x7ff014159710 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.755+0000 7ff0137fe700 1 -- 172.21.15.125:0/1812675399 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00800bd60 con 0x7ff014159710 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.756+0000 7ff01ac61700 1 -- 172.21.15.125:0/1812675399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff014159710 msgr2=0x7ff014070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.756+0000 7ff01ac61700 1 --2- 172.21.15.125:0/1812675399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff014159710 0x7ff014070370 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff014070170 tx=0x7ff008009bd0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.756+0000 7ff01ac61700 1 -- 172.21.15.125:0/1812675399 shutdown_connections 2023-11-28T11:08:50.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.756+0000 7ff01ac61700 1 --2- 172.21.15.125:0/1812675399 >> v2:172.21.15.167:3300/0 conn(0x7ff0140c9a50 0x7ff0140c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.756+0000 7ff01ac61700 1 --2- 172.21.15.125:0/1812675399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff014159710 0x7ff014070370 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.756+0000 7ff01ac61700 1 --2- 172.21.15.125:0/1812675399 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0140cee40 0x7ff0140cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.756+0000 7ff01ac61700 1 -- 172.21.15.125:0/1812675399 >> 172.21.15.125:0/1812675399 conn(0x7ff0140cf400 msgr2=0x7ff0140cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:50.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.756+0000 7ff01ac61700 1 -- 172.21.15.125:0/1812675399 shutdown_connections 2023-11-28T11:08:50.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.756+0000 7ff01ac61700 1 -- 172.21.15.125:0/1812675399 wait complete. 2023-11-28T11:08:50.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.757+0000 7ff01ac61700 1 Processor -- start 2023-11-28T11:08:50.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.757+0000 7ff01ac61700 1 -- start start 2023-11-28T11:08:50.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff01ac61700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0140c9a50 0x7ff01415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff01ac61700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0140cee40 0x7ff014157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff01ac61700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff014159710 0x7ff0140c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff01ac61700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0140c80e0 con 0x7ff014159710 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff01ac61700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff014158160 con 0x7ff0140c9a50 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff01ac61700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01415caa0 con 0x7ff0140cee40 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0191fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff014159710 0x7ff0140c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0191fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff014159710 0x7ff0140c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57334/0 (socket says 172.21.15.125:57334) 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0191fe700 1 -- 172.21.15.125:0/2305401496 learned_addr learned my addr 172.21.15.125:0/2305401496 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0189fd700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0140c9a50 0x7ff01415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff013fff700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0140cee40 0x7ff014157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0191fe700 1 -- 172.21.15.125:0/2305401496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0140cee40 msgr2=0x7ff014157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0191fe700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0140cee40 0x7ff014157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0191fe700 1 -- 172.21.15.125:0/2305401496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0140c9a50 msgr2=0x7ff01415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0191fe700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0140c9a50 0x7ff01415c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0191fe700 1 -- 172.21.15.125:0/2305401496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008009550 con 0x7ff014159710 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0191fe700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff014159710 0x7ff0140c4260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff00c007e60 tx=0x7ff00c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0117fa700 1 -- 172.21.15.125:0/2305401496 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00ed30 con 0x7ff014159710 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0117fa700 1 -- 172.21.15.125:0/2305401496 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c014420 con 0x7ff014159710 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff01ac61700 1 -- 172.21.15.125:0/2305401496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01406a5b0 con 0x7ff014159710 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.758+0000 7ff0117fa700 1 -- 172.21.15.125:0/2305401496 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c0147d0 con 0x7ff014159710 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.759+0000 7ff01ac61700 1 -- 172.21.15.125:0/2305401496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0140ce7e0 con 0x7ff014159710 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.759+0000 7ff01ac61700 1 -- 172.21.15.125:0/2305401496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01406a890 con 0x7ff014159710 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.760+0000 7ff0117fa700 1 -- 172.21.15.125:0/2305401496 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff00c012050 con 0x7ff014159710 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.760+0000 7ff0117fa700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feff80682f0 0x7feff806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.760+0000 7ff0117fa700 1 -- 172.21.15.125:0/2305401496 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff00c086140 con 0x7ff014159710 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.760+0000 7ff0189fd700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feff80682f0 0x7feff806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:50.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.761+0000 7ff0189fd700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feff80682f0 0x7feff806a7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff008000c00 tx=0x7ff008008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:50.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.764+0000 7ff0117fa700 1 -- 172.21.15.125:0/2305401496 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff00c0529a0 con 0x7ff014159710 2023-11-28T11:08:50.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.946+0000 7ff01ac61700 1 -- 172.21.15.125:0/2305401496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0140743f0 con 0x7ff014159710 2023-11-28T11:08:50.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.946+0000 7ff0117fa700 1 -- 172.21.15.125:0/2305401496 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff00c055fc0 con 0x7ff014159710 2023-11-28T11:08:50.947 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:08:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 -- 172.21.15.125:0/2305401496 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feff80682f0 msgr2=0x7feff806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feff80682f0 0x7feff806a7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff008000c00 tx=0x7ff008008030 comp rx=0 tx=0).stop 2023-11-28T11:08:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 -- 172.21.15.125:0/2305401496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff014159710 msgr2=0x7ff0140c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff014159710 0x7ff0140c4260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff00c007e60 tx=0x7ff00c00e3c0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 -- 172.21.15.125:0/2305401496 shutdown_connections 2023-11-28T11:08:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff014159710 0x7ff0140c4260 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0140c9a50 0x7ff01415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feff80682f0 0x7feff806a7a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 --2- 172.21.15.125:0/2305401496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0140cee40 0x7ff014157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 -- 172.21.15.125:0/2305401496 >> 172.21.15.125:0/2305401496 conn(0x7ff0140cf400 msgr2=0x7ff0140cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 -- 172.21.15.125:0/2305401496 shutdown_connections 2023-11-28T11:08:50.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:50.948+0000 7ff01ac61700 1 -- 172.21.15.125:0/2305401496 wait complete. 2023-11-28T11:08:50.961 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:08:51.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.084+0000 7efc76cc3700 1 Processor -- start 2023-11-28T11:08:51.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.084+0000 7efc76cc3700 1 -- start start 2023-11-28T11:08:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc76cc3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efc7006d170 0x7efc700b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc76cc3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc700b27d0 0x7efc700b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc76cc3700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc70161370 con 0x7efc7015fe50 2023-11-28T11:08:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc76cc3700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7006d5c0 con 0x7efc7006d170 2023-11-28T11:08:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc76cc3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc700b3190 con 0x7efc700b27d0 2023-11-28T11:08:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc6ffff700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efc7006d170 0x7efc700b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc75260700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc700b27d0 0x7efc700b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc6ffff700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efc7006d170 0x7efc700b3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:54070/0 (socket says 172.21.15.125:54070) 2023-11-28T11:08:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc74a5f700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7efc7015fe50 0x7efc70160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:44264/0 (socket says 172.21.15.125:44264) 2023-11-28T11:08:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc6ffff700 1 -- 172.21.15.125:0/1478724089 learned_addr learned my addr 172.21.15.125:0/1478724089 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc75260700 1 -- 172.21.15.125:0/1478724089 >> v2:172.21.15.167:3300/0 conn(0x7efc7006d170 msgr2=0x7efc700b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc75260700 1 --2- 172.21.15.125:0/1478724089 >> v2:172.21.15.167:3300/0 conn(0x7efc7006d170 0x7efc700b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc75260700 1 -- 172.21.15.125:0/1478724089 >> v1:172.21.15.167:6789/0 conn(0x7efc7015fe50 legacy=0x7efc70160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc75260700 1 -- 172.21.15.125:0/1478724089 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc700cf700 con 0x7efc700b27d0 2023-11-28T11:08:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.085+0000 7efc6ffff700 1 --2- 172.21.15.125:0/1478724089 >> v2:172.21.15.167:3300/0 conn(0x7efc7006d170 0x7efc700b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc75260700 1 --2- 172.21.15.125:0/1478724089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc700b27d0 0x7efc700b2c50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efc68009d90 tx=0x7efc6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9320b2adc2e512c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc6f7fe700 1 -- 172.21.15.125:0/1478724089 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6800e070 con 0x7efc700b27d0 2023-11-28T11:08:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc6f7fe700 1 -- 172.21.15.125:0/1478724089 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6800bb20 con 0x7efc700b27d0 2023-11-28T11:08:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc6f7fe700 1 -- 172.21.15.125:0/1478724089 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68012430 con 0x7efc700b27d0 2023-11-28T11:08:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc76cc3700 1 -- 172.21.15.125:0/1478724089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc700b27d0 msgr2=0x7efc700b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc76cc3700 1 --2- 172.21.15.125:0/1478724089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc700b27d0 0x7efc700b2c50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efc68009d90 tx=0x7efc6800b330 comp rx=0 tx=0).stop 2023-11-28T11:08:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc76cc3700 1 -- 172.21.15.125:0/1478724089 shutdown_connections 2023-11-28T11:08:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc76cc3700 1 --2- 172.21.15.125:0/1478724089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc700b27d0 0x7efc700b2c50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc76cc3700 1 --2- 172.21.15.125:0/1478724089 >> v2:172.21.15.167:3300/0 conn(0x7efc7006d170 0x7efc700b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc76cc3700 1 -- 172.21.15.125:0/1478724089 >> 172.21.15.125:0/1478724089 conn(0x7efc7006ea80 msgr2=0x7efc7006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:51.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc76cc3700 1 -- 172.21.15.125:0/1478724089 shutdown_connections 2023-11-28T11:08:51.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.086+0000 7efc76cc3700 1 -- 172.21.15.125:0/1478724089 wait complete. 2023-11-28T11:08:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.088+0000 7efc76cc3700 1 Processor -- start 2023-11-28T11:08:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.088+0000 7efc76cc3700 1 -- start start 2023-11-28T11:08:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.088+0000 7efc76cc3700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc7006d170 0x7efc701f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.088+0000 7efc76cc3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc700b27d0 0x7efc7015b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.088+0000 7efc76cc3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc7015fe50 0x7efc700c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.088+0000 7efc76cc3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7015b8b0 con 0x7efc700b27d0 2023-11-28T11:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.088+0000 7efc76cc3700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc701f2270 con 0x7efc7006d170 2023-11-28T11:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.088+0000 7efc76cc3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc700c8380 con 0x7efc7015fe50 2023-11-28T11:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc700b27d0 0x7efc7015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc700b27d0 0x7efc7015b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57346/0 (socket says 172.21.15.125:57346) 2023-11-28T11:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6ffff700 1 -- 172.21.15.125:0/2470355172 learned_addr learned my addr 172.21.15.125:0/2470355172 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc74a5f700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc7006d170 0x7efc701f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc75260700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc7015fe50 0x7efc700c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6ffff700 1 -- 172.21.15.125:0/2470355172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc7015fe50 msgr2=0x7efc700c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6ffff700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc7015fe50 0x7efc700c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6ffff700 1 -- 172.21.15.125:0/2470355172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc7006d170 msgr2=0x7efc701f36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6ffff700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc7006d170 0x7efc701f36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6ffff700 1 -- 172.21.15.125:0/2470355172 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c009550 con 0x7efc700b27d0 2023-11-28T11:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6ffff700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc700b27d0 0x7efc7015b370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00ec10 tx=0x7efc5c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6d7fa700 1 -- 172.21.15.125:0/2470355172 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00c850 con 0x7efc700b27d0 2023-11-28T11:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6d7fa700 1 -- 172.21.15.125:0/2470355172 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c00c9b0 con 0x7efc700b27d0 2023-11-28T11:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc76cc3700 1 -- 172.21.15.125:0/2470355172 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc68009a70 con 0x7efc700b27d0 2023-11-28T11:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc6d7fa700 1 -- 172.21.15.125:0/2470355172 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00cd40 con 0x7efc700b27d0 2023-11-28T11:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.089+0000 7efc76cc3700 1 -- 172.21.15.125:0/2470355172 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc700cf0b0 con 0x7efc700b27d0 2023-11-28T11:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.090+0000 7efc76cc3700 1 -- 172.21.15.125:0/2470355172 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc700cedd0 con 0x7efc700b27d0 2023-11-28T11:08:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.091+0000 7efc6d7fa700 1 -- 172.21.15.125:0/2470355172 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efc5c019030 con 0x7efc700b27d0 2023-11-28T11:08:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.091+0000 7efc6d7fa700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc540682f0 0x7efc5406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.091+0000 7efc6d7fa700 1 -- 172.21.15.125:0/2470355172 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc5c085cb0 con 0x7efc700b27d0 2023-11-28T11:08:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.091+0000 7efc74a5f700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc540682f0 0x7efc5406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.091+0000 7efc74a5f700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc540682f0 0x7efc5406a7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efc64000f60 tx=0x7efc64007ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.095+0000 7efc6d7fa700 1 -- 172.21.15.125:0/2470355172 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7efc5c052510 con 0x7efc700b27d0 2023-11-28T11:08:51.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.277+0000 7efc76cc3700 1 -- 172.21.15.125:0/2470355172 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efc700cf390 con 0x7efc700b27d0 2023-11-28T11:08:51.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.278+0000 7efc6d7fa700 1 -- 172.21.15.125:0/2470355172 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7efc5c0210a0 con 0x7efc700b27d0 2023-11-28T11:08:51.278 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:08:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.279+0000 7efc76cc3700 1 -- 172.21.15.125:0/2470355172 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc540682f0 msgr2=0x7efc5406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.279+0000 7efc76cc3700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc540682f0 0x7efc5406a7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efc64000f60 tx=0x7efc64007ed0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.279+0000 7efc76cc3700 1 -- 172.21.15.125:0/2470355172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc700b27d0 msgr2=0x7efc7015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.279+0000 7efc76cc3700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc700b27d0 0x7efc7015b370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00ec10 tx=0x7efc5c00ef20 comp rx=0 tx=0).stop 2023-11-28T11:08:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.280+0000 7efc76cc3700 1 -- 172.21.15.125:0/2470355172 shutdown_connections 2023-11-28T11:08:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.280+0000 7efc76cc3700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc540682f0 0x7efc5406a7a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.280+0000 7efc76cc3700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc7015fe50 0x7efc700c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.280+0000 7efc76cc3700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc7006d170 0x7efc701f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.280+0000 7efc76cc3700 1 --2- 172.21.15.125:0/2470355172 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc700b27d0 0x7efc7015b370 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.280+0000 7efc76cc3700 1 -- 172.21.15.125:0/2470355172 >> 172.21.15.125:0/2470355172 conn(0x7efc7006ea80 msgr2=0x7efc700b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.280+0000 7efc76cc3700 1 -- 172.21.15.125:0/2470355172 shutdown_connections 2023-11-28T11:08:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.280+0000 7efc76cc3700 1 -- 172.21.15.125:0/2470355172 wait complete. 2023-11-28T11:08:51.292 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:08:51.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.414+0000 7f8d64cc2700 1 Processor -- start 2023-11-28T11:08:51.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.414+0000 7f8d64cc2700 1 -- start start 2023-11-28T11:08:51.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.415+0000 7f8d64cc2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8d600b2ee0 0x7f8d600d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.415+0000 7f8d64cc2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6015a9c0 con 0x7f8d600cc200 2023-11-28T11:08:51.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.415+0000 7f8d64cc2700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d600c7b80 con 0x7f8d6015a5f0 2023-11-28T11:08:51.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.415+0000 7f8d64cc2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d600cc990 con 0x7f8d600b2ee0 2023-11-28T11:08:51.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.415+0000 7f8d5dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8d600b2ee0 0x7f8d600d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.415+0000 7f8d5ed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8d600cc200 0x7f8d600ced30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41480/0 (socket says 172.21.15.125:41480) 2023-11-28T11:08:51.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.415+0000 7f8d5ed9d700 1 -- 172.21.15.125:0/1615986993 learned_addr learned my addr 172.21.15.125:0/1615986993 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:51.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d5dd9b700 1 -- 172.21.15.125:0/1615986993 >> v1:172.21.15.167:6789/0 conn(0x7f8d6015a5f0 legacy=0x7f8d600b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d5dd9b700 1 -- 172.21.15.125:0/1615986993 >> v1:172.21.15.125:6789/0 conn(0x7f8d600cc200 legacy=0x7f8d600ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d5dd9b700 1 -- 172.21.15.125:0/1615986993 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d600ccc70 con 0x7f8d600b2ee0 2023-11-28T11:08:51.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d5dd9b700 1 --2- 172.21.15.125:0/1615986993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d600b2ee0 0x7f8d600d0ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009840 tx=0x7f8d50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8159ad0ec77cc1ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:51.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d5d59a700 1 -- 172.21.15.125:0/1615986993 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50011830 con 0x7f8d600b2ee0 2023-11-28T11:08:51.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d5d59a700 1 -- 172.21.15.125:0/1615986993 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d50011990 con 0x7f8d600b2ee0 2023-11-28T11:08:51.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d5d59a700 1 -- 172.21.15.125:0/1615986993 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50011d20 con 0x7f8d600b2ee0 2023-11-28T11:08:51.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d64cc2700 1 -- 172.21.15.125:0/1615986993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d600b2ee0 msgr2=0x7f8d600d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d64cc2700 1 --2- 172.21.15.125:0/1615986993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d600b2ee0 0x7f8d600d0ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009840 tx=0x7f8d50009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:51.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d64cc2700 1 -- 172.21.15.125:0/1615986993 shutdown_connections 2023-11-28T11:08:51.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d64cc2700 1 --2- 172.21.15.125:0/1615986993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d600b2ee0 0x7f8d600d0ad0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d64cc2700 1 -- 172.21.15.125:0/1615986993 >> 172.21.15.125:0/1615986993 conn(0x7f8d6006ea80 msgr2=0x7f8d6006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:51.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.416+0000 7f8d64cc2700 1 -- 172.21.15.125:0/1615986993 shutdown_connections 2023-11-28T11:08:51.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.417+0000 7f8d64cc2700 1 -- 172.21.15.125:0/1615986993 wait complete. 2023-11-28T11:08:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.418+0000 7f8d64cc2700 1 Processor -- start 2023-11-28T11:08:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.418+0000 7f8d64cc2700 1 -- start start 2023-11-28T11:08:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d64cc2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d600b2ee0 0x7f8d601e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d64cc2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d600cc200 0x7f8d60146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d64cc2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6015a5f0 0x7f8d601e3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d64cc2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d601e5590 con 0x7f8d600b2ee0 2023-11-28T11:08:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d64cc2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d601e4910 con 0x7f8d6015a5f0 2023-11-28T11:08:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d64cc2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d601e4bf0 con 0x7f8d600cc200 2023-11-28T11:08:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d5e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d600b2ee0 0x7f8d601e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d5e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d600b2ee0 0x7f8d601e59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57358/0 (socket says 172.21.15.125:57358) 2023-11-28T11:08:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d5e59c700 1 -- 172.21.15.125:0/2667028538 learned_addr learned my addr 172.21.15.125:0/2667028538 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d5dd9b700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d600cc200 0x7f8d60146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d5ed9d700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6015a5f0 0x7f8d601e3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d5e59c700 1 -- 172.21.15.125:0/2667028538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d600cc200 msgr2=0x7f8d60146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d5e59c700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d600cc200 0x7f8d60146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d5e59c700 1 -- 172.21.15.125:0/2667028538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6015a5f0 msgr2=0x7f8d601e3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d5e59c700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6015a5f0 0x7f8d601e3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d5e59c700 1 -- 172.21.15.125:0/2667028538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500094a0 con 0x7f8d600b2ee0 2023-11-28T11:08:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d5e59c700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d600b2ee0 0x7f8d601e59b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400c4e0 tx=0x7f8d5400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d4effd700 1 -- 172.21.15.125:0/2667028538 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d540052d0 con 0x7f8d600b2ee0 2023-11-28T11:08:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d4effd700 1 -- 172.21.15.125:0/2667028538 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d54005430 con 0x7f8d600b2ee0 2023-11-28T11:08:51.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d64cc2700 1 -- 172.21.15.125:0/2667028538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d600cd230 con 0x7f8d600b2ee0 2023-11-28T11:08:51.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d4effd700 1 -- 172.21.15.125:0/2667028538 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d540038c0 con 0x7f8d600b2ee0 2023-11-28T11:08:51.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.419+0000 7f8d64cc2700 1 -- 172.21.15.125:0/2667028538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d600ccf50 con 0x7f8d600b2ee0 2023-11-28T11:08:51.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.420+0000 7f8d64cc2700 1 -- 172.21.15.125:0/2667028538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d600cd510 con 0x7f8d600b2ee0 2023-11-28T11:08:51.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.421+0000 7f8d4effd700 1 -- 172.21.15.125:0/2667028538 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8d54019030 con 0x7f8d600b2ee0 2023-11-28T11:08:51.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.421+0000 7f8d4effd700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d400682f0 0x7f8d4006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.421+0000 7f8d5dd9b700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d400682f0 0x7f8d4006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.421+0000 7f8d4effd700 1 -- 172.21.15.125:0/2667028538 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d54084ef0 con 0x7f8d600b2ee0 2023-11-28T11:08:51.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.421+0000 7f8d5dd9b700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d400682f0 0x7f8d4006a7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8d600b32d0 tx=0x7f8d5001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.425+0000 7f8d4effd700 1 -- 172.21.15.125:0/2667028538 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8d54051750 con 0x7f8d600b2ee0 2023-11-28T11:08:51.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.606+0000 7f8d64cc2700 1 -- 172.21.15.125:0/2667028538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d600743f0 con 0x7f8d600b2ee0 2023-11-28T11:08:51.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.606+0000 7f8d4effd700 1 -- 172.21.15.125:0/2667028538 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d54017020 con 0x7f8d600b2ee0 2023-11-28T11:08:51.607 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:08:51.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.608+0000 7f8d64cc2700 1 -- 172.21.15.125:0/2667028538 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d400682f0 msgr2=0x7f8d4006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.608+0000 7f8d64cc2700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d400682f0 0x7f8d4006a7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8d600b32d0 tx=0x7f8d5001c040 comp rx=0 tx=0).stop 2023-11-28T11:08:51.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.608+0000 7f8d64cc2700 1 -- 172.21.15.125:0/2667028538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d600b2ee0 msgr2=0x7f8d601e59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.608+0000 7f8d64cc2700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d600b2ee0 0x7f8d601e59b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400c4e0 tx=0x7f8d5400c7f0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.608+0000 7f8d64cc2700 1 -- 172.21.15.125:0/2667028538 shutdown_connections 2023-11-28T11:08:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.608+0000 7f8d64cc2700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6015a5f0 0x7f8d601e3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.608+0000 7f8d64cc2700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d600b2ee0 0x7f8d601e59b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.608+0000 7f8d64cc2700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d400682f0 0x7f8d4006a7a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.608+0000 7f8d64cc2700 1 --2- 172.21.15.125:0/2667028538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d600cc200 0x7f8d60146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.608+0000 7f8d64cc2700 1 -- 172.21.15.125:0/2667028538 >> 172.21.15.125:0/2667028538 conn(0x7f8d6006ea80 msgr2=0x7f8d600b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.609+0000 7f8d64cc2700 1 -- 172.21.15.125:0/2667028538 shutdown_connections 2023-11-28T11:08:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.609+0000 7f8d64cc2700 1 -- 172.21.15.125:0/2667028538 wait complete. 2023-11-28T11:08:51.621 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:08:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.743+0000 7fd1879c4700 1 Processor -- start 2023-11-28T11:08:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.743+0000 7fd1879c4700 1 -- start start 2023-11-28T11:08:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd1879c4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1801599b0 0x7fd18015d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd1879c4700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1800af0a0 0x7fd18015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd1879c4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd180159ec0 con 0x7fd1800b1650 2023-11-28T11:08:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd1879c4700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18015d8a0 con 0x7fd1800af0a0 2023-11-28T11:08:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd1879c4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18015db80 con 0x7fd1801599b0 2023-11-28T11:08:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd185760700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd1800b1650 0x7fd1800b1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41490/0 (socket says 172.21.15.125:41490) 2023-11-28T11:08:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd185760700 1 -- 172.21.15.125:0/4174802793 learned_addr learned my addr 172.21.15.125:0/4174802793 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd185f61700 1 --2- 172.21.15.125:0/4174802793 >> v2:172.21.15.167:3300/0 conn(0x7fd1800af0a0 0x7fd18015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd184f5f700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1801599b0 0x7fd18015d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790430360 0 0) 0x7fd180159ec0 con 0x7fd1800b1650 2023-11-28T11:08:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd16c0035b0 con 0x7fd1800b1650 2023-11-28T11:08:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3458952857 0 0) 0x7fd16c0035b0 con 0x7fd1800b1650 2023-11-28T11:08:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1801599b0 msgr2=0x7fd18015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1801599b0 0x7fd18015d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 >> v2:172.21.15.167:3300/0 conn(0x7fd1800af0a0 msgr2=0x7fd18015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 --2- 172.21.15.125:0/4174802793 >> v2:172.21.15.167:3300/0 conn(0x7fd1800af0a0 0x7fd18015a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18015de60 con 0x7fd1800b1650 2023-11-28T11:08:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fd17c001670 con 0x7fd1800b1650 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 >> v1:172.21.15.125:6789/0 conn(0x7fd1800b1650 legacy=0x7fd1800b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd16c003a00 0x7fd16c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd16c004350 0x7fd16c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16c004e80 0x7fd16c0052f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18015d8a0 con 0x7fd16c004350 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18015db80 con 0x7fd16c004e80 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c00bd70 con 0x7fd16c003a00 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd185f61700 1 --2- 172.21.15.125:0/4174802793 >> v2:172.21.15.167:3300/0 conn(0x7fd1800af0a0 0x7fd18015a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd184f5f700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd16c004350 0x7fd16c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.744+0000 7fd185760700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd16c003a00 0x7fd16c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd185f61700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16c004e80 0x7fd16c0052f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd184f5f700 1 -- 172.21.15.125:0/4174802793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd16c003a00 msgr2=0x7fd16c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd184f5f700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd16c003a00 0x7fd16c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd184f5f700 1 -- 172.21.15.125:0/4174802793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16c004e80 msgr2=0x7fd16c0052f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd184f5f700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16c004e80 0x7fd16c0052f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd184f5f700 1 -- 172.21.15.125:0/4174802793 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c0035b0 con 0x7fd16c004350 2023-11-28T11:08:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd184f5f700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd16c004350 0x7fd16c004850 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd170009b30 tx=0x7fd16c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb5739f849fb506 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000e6c0 con 0x7fd16c004350 2023-11-28T11:08:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17000e820 con 0x7fd16c004350 2023-11-28T11:08:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd177fff700 1 -- 172.21.15.125:0/4174802793 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000eb90 con 0x7fd16c004350 2023-11-28T11:08:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd1879c4700 1 -- 172.21.15.125:0/4174802793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd16c004350 msgr2=0x7fd16c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd1879c4700 1 --2- 172.21.15.125:0/4174802793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd16c004350 0x7fd16c004850 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd170009b30 tx=0x7fd16c005880 comp rx=0 tx=0).stop 2023-11-28T11:08:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd185f61700 1 -- 172.21.15.125:0/4174802793 reap_dead start 2023-11-28T11:08:51.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd1879c4700 1 -- 172.21.15.125:0/4174802793 shutdown_connections 2023-11-28T11:08:51.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd1879c4700 1 -- 172.21.15.125:0/4174802793 >> 172.21.15.125:0/4174802793 conn(0x7fd18006c010 msgr2=0x7fd1800cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:51.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.745+0000 7fd1879c4700 1 -- 172.21.15.125:0/4174802793 shutdown_connections 2023-11-28T11:08:51.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.746+0000 7fd1879c4700 1 -- 172.21.15.125:0/4174802793 wait complete. 2023-11-28T11:08:51.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.747+0000 7fd1879c4700 1 Processor -- start 2023-11-28T11:08:51.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.747+0000 7fd1879c4700 1 -- start start 2023-11-28T11:08:51.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.747+0000 7fd1879c4700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16c004350 0x7fd180158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.747+0000 7fd1879c4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1801586d0 0x7fd1800b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.747+0000 7fd1879c4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1800c7a60 0x7fd1800b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.747+0000 7fd1879c4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1801593a0 con 0x7fd1800c7a60 2023-11-28T11:08:51.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.747+0000 7fd1879c4700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1800b4c50 con 0x7fd16c004350 2023-11-28T11:08:51.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.747+0000 7fd1879c4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1800c6ca0 con 0x7fd1801586d0 2023-11-28T11:08:51.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.747+0000 7fd185f61700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1800c7a60 0x7fd1800b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd185f61700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1800c7a60 0x7fd1800b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57382/0 (socket says 172.21.15.125:57382) 2023-11-28T11:08:51.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd185f61700 1 -- 172.21.15.125:0/1037381325 learned_addr learned my addr 172.21.15.125:0/1037381325 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:51.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd184f5f700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1801586d0 0x7fd1800b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd185f61700 1 -- 172.21.15.125:0/1037381325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1801586d0 msgr2=0x7fd1800b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd185760700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16c004350 0x7fd180158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd185f61700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1801586d0 0x7fd1800b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd185f61700 1 -- 172.21.15.125:0/1037381325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16c004350 msgr2=0x7fd180158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd185f61700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16c004350 0x7fd180158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd185f61700 1 -- 172.21.15.125:0/1037381325 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18015aa20 con 0x7fd1800c7a60 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd185f61700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1800c7a60 0x7fd1800b0750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd18006e010 tx=0x7fd178009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd175ffb700 1 -- 172.21.15.125:0/1037381325 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17800e070 con 0x7fd1800c7a60 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd175ffb700 1 -- 172.21.15.125:0/1037381325 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd178011cd0 con 0x7fd1800c7a60 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd1879c4700 1 -- 172.21.15.125:0/1037381325 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18015a890 con 0x7fd1800c7a60 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd175ffb700 1 -- 172.21.15.125:0/1037381325 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd178011e60 con 0x7fd1800c7a60 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.748+0000 7fd1879c4700 1 -- 172.21.15.125:0/1037381325 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18015d050 con 0x7fd1800c7a60 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.749+0000 7fd1879c4700 1 -- 172.21.15.125:0/1037381325 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1800743f0 con 0x7fd1800c7a60 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.750+0000 7fd175ffb700 1 -- 172.21.15.125:0/1037381325 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd178003a20 con 0x7fd1800c7a60 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.750+0000 7fd175ffb700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd1640682f0 0x7fd16406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:51.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.750+0000 7fd185760700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd1640682f0 0x7fd16406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:51.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.750+0000 7fd175ffb700 1 -- 172.21.15.125:0/1037381325 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd178086490 con 0x7fd1800c7a60 2023-11-28T11:08:51.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.750+0000 7fd185760700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd1640682f0 0x7fd16406a7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000c00 tx=0x7fd17c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:51.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.754+0000 7fd175ffb700 1 -- 172.21.15.125:0/1037381325 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd178052cf0 con 0x7fd1800c7a60 2023-11-28T11:08:51.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.937+0000 7fd1879c4700 1 -- 172.21.15.125:0/1037381325 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1800c7f60 con 0x7fd1800c7a60 2023-11-28T11:08:51.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.937+0000 7fd175ffb700 1 -- 172.21.15.125:0/1037381325 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd178003cb0 con 0x7fd1800c7a60 2023-11-28T11:08:51.938 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:08:51.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.939+0000 7fd1879c4700 1 -- 172.21.15.125:0/1037381325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd1640682f0 msgr2=0x7fd16406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.939+0000 7fd1879c4700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd1640682f0 0x7fd16406a7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000c00 tx=0x7fd17c009040 comp rx=0 tx=0).stop 2023-11-28T11:08:51.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.939+0000 7fd1879c4700 1 -- 172.21.15.125:0/1037381325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1800c7a60 msgr2=0x7fd1800b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:51.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.939+0000 7fd1879c4700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1800c7a60 0x7fd1800b0750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd18006e010 tx=0x7fd178009f90 comp rx=0 tx=0).stop 2023-11-28T11:08:51.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.940+0000 7fd1879c4700 1 -- 172.21.15.125:0/1037381325 shutdown_connections 2023-11-28T11:08:51.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.940+0000 7fd1879c4700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1800c7a60 0x7fd1800b0750 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.940+0000 7fd1879c4700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd16c004350 0x7fd180158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.940+0000 7fd1879c4700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd1640682f0 0x7fd16406a7a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.940+0000 7fd1879c4700 1 --2- 172.21.15.125:0/1037381325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1801586d0 0x7fd1800b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:51.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.940+0000 7fd1879c4700 1 -- 172.21.15.125:0/1037381325 >> 172.21.15.125:0/1037381325 conn(0x7fd18006c010 msgr2=0x7fd180071190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:51.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.940+0000 7fd1879c4700 1 -- 172.21.15.125:0/1037381325 shutdown_connections 2023-11-28T11:08:51.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:51.940+0000 7fd1879c4700 1 -- 172.21.15.125:0/1037381325 wait complete. 2023-11-28T11:08:51.952 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:08:52.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.075+0000 7f3d72f95700 1 Processor -- start 2023-11-28T11:08:52.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.075+0000 7f3d72f95700 1 -- start start 2023-11-28T11:08:52.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.076+0000 7f3d72f95700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d6c0ce040 0x7f3d6c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.076+0000 7f3d72f95700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3d6c142db0 0x7f3d6c13ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.076+0000 7f3d72f95700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c13fc90 con 0x7f3d6c0b1770 2023-11-28T11:08:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.076+0000 7f3d72f95700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c13f6d0 con 0x7f3d6c142db0 2023-11-28T11:08:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.076+0000 7f3d72f95700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c13f9b0 con 0x7f3d6c0ce040 2023-11-28T11:08:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.076+0000 7f3d6bfff700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3d6c142db0 0x7f3d6c13ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.076+0000 7f3d70d31700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d6c0ce040 0x7f3d6c15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.076+0000 7f3d71532700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3d6c0b1770 0x7f3d6c13cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:44316/0 (socket says 172.21.15.125:44316) 2023-11-28T11:08:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.076+0000 7f3d71532700 1 -- 172.21.15.125:0/2355086844 learned_addr learned my addr 172.21.15.125:0/2355086844 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.077+0000 7f3d70d31700 1 -- 172.21.15.125:0/2355086844 >> v2:172.21.15.167:3300/0 conn(0x7f3d6c142db0 msgr2=0x7f3d6c13ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.077+0000 7f3d70d31700 1 --2- 172.21.15.125:0/2355086844 >> v2:172.21.15.167:3300/0 conn(0x7f3d6c142db0 0x7f3d6c13ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.077+0000 7f3d70d31700 1 -- 172.21.15.125:0/2355086844 >> v1:172.21.15.167:6789/0 conn(0x7f3d6c0b1770 legacy=0x7f3d6c13cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.077+0000 7f3d70d31700 1 -- 172.21.15.125:0/2355086844 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c15d100 con 0x7f3d6c0ce040 2023-11-28T11:08:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.077+0000 7f3d70d31700 1 --2- 172.21.15.125:0/2355086844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d6c0ce040 0x7f3d6c15d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009840 tx=0x7f3d60009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5f0e6ed5dd110f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.077+0000 7f3d6b7fe700 1 -- 172.21.15.125:0/2355086844 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60011830 con 0x7f3d6c0ce040 2023-11-28T11:08:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.077+0000 7f3d6b7fe700 1 -- 172.21.15.125:0/2355086844 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d60011990 con 0x7f3d6c0ce040 2023-11-28T11:08:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.077+0000 7f3d6b7fe700 1 -- 172.21.15.125:0/2355086844 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60011d20 con 0x7f3d6c0ce040 2023-11-28T11:08:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.077+0000 7f3d72f95700 1 -- 172.21.15.125:0/2355086844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d6c0ce040 msgr2=0x7f3d6c15d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.077+0000 7f3d72f95700 1 --2- 172.21.15.125:0/2355086844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d6c0ce040 0x7f3d6c15d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009840 tx=0x7f3d60009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.078+0000 7f3d72f95700 1 -- 172.21.15.125:0/2355086844 shutdown_connections 2023-11-28T11:08:52.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.078+0000 7f3d72f95700 1 --2- 172.21.15.125:0/2355086844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d6c0ce040 0x7f3d6c15d900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.078+0000 7f3d72f95700 1 --2- 172.21.15.125:0/2355086844 >> v2:172.21.15.167:3300/0 conn(0x7f3d6c142db0 0x7f3d6c13ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.078+0000 7f3d72f95700 1 -- 172.21.15.125:0/2355086844 >> 172.21.15.125:0/2355086844 conn(0x7f3d6c06c010 msgr2=0x7f3d6c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:52.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.078+0000 7f3d72f95700 1 -- 172.21.15.125:0/2355086844 shutdown_connections 2023-11-28T11:08:52.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.078+0000 7f3d72f95700 1 -- 172.21.15.125:0/2355086844 wait complete. 2023-11-28T11:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.079+0000 7f3d72f95700 1 Processor -- start 2023-11-28T11:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.079+0000 7f3d72f95700 1 -- start start 2023-11-28T11:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.080+0000 7f3d72f95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d6c0b1770 0x7f3d6c0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.080+0000 7f3d72f95700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d6c0ce040 0x7f3d6c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.080+0000 7f3d72f95700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d6c142db0 0x7f3d6c0c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.080+0000 7f3d72f95700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c155620 con 0x7f3d6c0b1770 2023-11-28T11:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.080+0000 7f3d72f95700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0c5c30 con 0x7f3d6c0ce040 2023-11-28T11:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.080+0000 7f3d72f95700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0b3d80 con 0x7f3d6c142db0 2023-11-28T11:08:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.080+0000 7f3d70d31700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d6c0b1770 0x7f3d6c0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.080+0000 7f3d70d31700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d6c0b1770 0x7f3d6c0b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57392/0 (socket says 172.21.15.125:57392) 2023-11-28T11:08:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.080+0000 7f3d70d31700 1 -- 172.21.15.125:0/625106707 learned_addr learned my addr 172.21.15.125:0/625106707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.080+0000 7f3d6bfff700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d6c0ce040 0x7f3d6c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d71532700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d6c142db0 0x7f3d6c0c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d70d31700 1 -- 172.21.15.125:0/625106707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d6c142db0 msgr2=0x7f3d6c0c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d70d31700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d6c142db0 0x7f3d6c0c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d70d31700 1 -- 172.21.15.125:0/625106707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d6c0ce040 msgr2=0x7f3d6c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d70d31700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d6c0ce040 0x7f3d6c1550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d70d31700 1 -- 172.21.15.125:0/625106707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600094a0 con 0x7f3d6c0b1770 2023-11-28T11:08:52.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d70d31700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d6c0b1770 0x7f3d6c0b2b20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009fd0 tx=0x7f3d60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:52.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d697fa700 1 -- 172.21.15.125:0/625106707 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600036a0 con 0x7f3d6c0b1770 2023-11-28T11:08:52.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d697fa700 1 -- 172.21.15.125:0/625106707 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6001f070 con 0x7f3d6c0b1770 2023-11-28T11:08:52.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d72f95700 1 -- 172.21.15.125:0/625106707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c0ce410 con 0x7f3d6c0b1770 2023-11-28T11:08:52.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d697fa700 1 -- 172.21.15.125:0/625106707 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60003a60 con 0x7f3d6c0b1770 2023-11-28T11:08:52.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.081+0000 7f3d72f95700 1 -- 172.21.15.125:0/625106707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c15d3e0 con 0x7f3d6c0b1770 2023-11-28T11:08:52.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.082+0000 7f3d72f95700 1 -- 172.21.15.125:0/625106707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c0ce5a0 con 0x7f3d6c0b1770 2023-11-28T11:08:52.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.082+0000 7f3d697fa700 1 -- 172.21.15.125:0/625106707 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3d6000f050 con 0x7f3d6c0b1770 2023-11-28T11:08:52.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.083+0000 7f3d697fa700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3d500682f0 0x7f3d5006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.083+0000 7f3d697fa700 1 -- 172.21.15.125:0/625106707 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d60021070 con 0x7f3d6c0b1770 2023-11-28T11:08:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.083+0000 7f3d6bfff700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3d500682f0 0x7f3d5006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.083+0000 7f3d6bfff700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3d500682f0 0x7f3d5006a7a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0b1740 tx=0x7f3d58009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.087+0000 7f3d697fa700 1 -- 172.21.15.125:0/625106707 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3d60053d00 con 0x7f3d6c0b1770 2023-11-28T11:08:52.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.311+0000 7f3d72f95700 1 -- 172.21.15.125:0/625106707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d6c0b4060 con 0x7f3d6c0b1770 2023-11-28T11:08:52.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.311+0000 7f3d697fa700 1 -- 172.21.15.125:0/625106707 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f3d60057320 con 0x7f3d6c0b1770 2023-11-28T11:08:52.312 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:08:52.313 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/678190712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":678190712},{"type":"v1","addr":"172.21.15.167:6835","nonce":678190712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2090095557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2090095557},{"type":"v1","addr":"172.21.15.167:6834","nonce":2090095557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3827244932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3827244932},{"type":"v1","addr":"172.21.15.125:6836","nonce":3827244932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:08:36.383224+0000","modified":"2023-11-28T11:08:39.391168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/573741186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":573741186},{"type":"v1","addr":"172.21.15.125:6837","nonce":573741186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:08:52.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 -- 172.21.15.125:0/625106707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3d500682f0 msgr2=0x7f3d5006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3d500682f0 0x7f3d5006a7a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0b1740 tx=0x7f3d58009210 comp rx=0 tx=0).stop 2023-11-28T11:08:52.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 -- 172.21.15.125:0/625106707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d6c0b1770 msgr2=0x7f3d6c0b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d6c0b1770 0x7f3d6c0b2b20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009fd0 tx=0x7f3d60004750 comp rx=0 tx=0).stop 2023-11-28T11:08:52.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 -- 172.21.15.125:0/625106707 shutdown_connections 2023-11-28T11:08:52.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3d500682f0 0x7f3d5006a7a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d6c142db0 0x7f3d6c0c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d6c0b1770 0x7f3d6c0b2b20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 --2- 172.21.15.125:0/625106707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d6c0ce040 0x7f3d6c1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 -- 172.21.15.125:0/625106707 >> 172.21.15.125:0/625106707 conn(0x7f3d6c06c010 msgr2=0x7f3d6c1407d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 -- 172.21.15.125:0/625106707 shutdown_connections 2023-11-28T11:08:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.313+0000 7f3d72f95700 1 -- 172.21.15.125:0/625106707 wait complete. 2023-11-28T11:08:52.316 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-11-28T11:08:52.730 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:08:36.383224+0000', 'modified': '2023-11-28T11:08:39.391168+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4299}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4299': {'gid': 4299, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6837/573741186', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6835', 'nonce': 573741186}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 573741186}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:08:52.730 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:08:52.730 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T11:08:52.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.852+0000 7f2ee4f73700 1 Processor -- start 2023-11-28T11:08:52.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.852+0000 7f2ee4f73700 1 -- start start 2023-11-28T11:08:52.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.853+0000 7f2ee4f73700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ee00b2ee0 0x7f2ee00d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.853+0000 7f2ee4f73700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee015a9c0 con 0x7f2ee00cc200 2023-11-28T11:08:52.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.853+0000 7f2ee4f73700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee00c7b80 con 0x7f2ee015a5f0 2023-11-28T11:08:52.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.853+0000 7f2ee4f73700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee00cc990 con 0x7f2ee00b2ee0 2023-11-28T11:08:52.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.853+0000 7f2eded9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2ee00cc200 0x7f2ee00ced30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41528/0 (socket says 172.21.15.125:41528) 2023-11-28T11:08:52.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.853+0000 7f2eded9d700 1 -- 172.21.15.125:0/3020147244 learned_addr learned my addr 172.21.15.125:0/3020147244 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/3020147244 >> v2:172.21.15.167:3300/0 conn(0x7f2ee00b2ee0 0x7f2ee00d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236128080 0 0) 0x7f2ee015a9c0 con 0x7f2ee00cc200 2023-11-28T11:08:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec80035b0 con 0x7f2ee00cc200 2023-11-28T11:08:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017302528 0 0) 0x7f2ee00c7b80 con 0x7f2ee015a5f0 2023-11-28T11:08:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee015a9c0 con 0x7f2ee015a5f0 2023-11-28T11:08:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2624750054 0 0) 0x7f2ec80035b0 con 0x7f2ee00cc200 2023-11-28T11:08:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 >> v2:172.21.15.167:3300/0 conn(0x7f2ee00b2ee0 msgr2=0x7f2ee00d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 --2- 172.21.15.125:0/3020147244 >> v2:172.21.15.167:3300/0 conn(0x7f2ee00b2ee0 0x7f2ee00d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 >> v1:172.21.15.167:6789/0 conn(0x7f2ee015a5f0 legacy=0x7f2ee00b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee00ccc70 con 0x7f2ee00cc200 2023-11-28T11:08:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f2ed80019f0 con 0x7f2ee00cc200 2023-11-28T11:08:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 >> v1:172.21.15.125:6789/0 conn(0x7f2ee00cc200 legacy=0x7f2ee00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ec8003b90 0x7f2ec8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ec8004850 0x7f2ec8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ec8005200 0x7f2ec800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00cc990 con 0x7f2ec8005200 2023-11-28T11:08:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec800c060 con 0x7f2ec8004850 2023-11-28T11:08:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec800c220 con 0x7f2ec8003b90 2023-11-28T11:08:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2eded9d700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ec8005200 0x7f2ec800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ec8004850 0x7f2ec8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2ede59c700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ec8003b90 0x7f2ec8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2eded9d700 1 -- 172.21.15.125:0/3020147244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ec8003b90 msgr2=0x7f2ec8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2eded9d700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ec8003b90 0x7f2ec8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2eded9d700 1 -- 172.21.15.125:0/3020147244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ec8004850 msgr2=0x7f2ec8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2eded9d700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ec8004850 0x7f2ec8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2eded9d700 1 -- 172.21.15.125:0/3020147244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec80035b0 con 0x7f2ec8005200 2023-11-28T11:08:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2ede59c700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ec8003b90 0x7f2ec8003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2eded9d700 1 -- 172.21.15.125:0/3020147244 reap_dead start 2023-11-28T11:08:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.854+0000 7f2eded9d700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ec8005200 0x7f2ec800ba10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800a7c0 tx=0x7f2ec8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5577a878f07eee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.855+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8012600 con 0x7f2ec8005200 2023-11-28T11:08:52.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.855+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed8012780 con 0x7f2ec8005200 2023-11-28T11:08:52.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.855+0000 7f2edd59a700 1 -- 172.21.15.125:0/3020147244 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8012b30 con 0x7f2ec8005200 2023-11-28T11:08:52.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.855+0000 7f2ee4f73700 1 -- 172.21.15.125:0/3020147244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ec8005200 msgr2=0x7f2ec800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.855+0000 7f2ee4f73700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ec8005200 0x7f2ec800ba10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800a7c0 tx=0x7f2ec8005880 comp rx=0 tx=0).stop 2023-11-28T11:08:52.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.855+0000 7f2ee4f73700 1 -- 172.21.15.125:0/3020147244 shutdown_connections 2023-11-28T11:08:52.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.855+0000 7f2ee4f73700 1 --2- 172.21.15.125:0/3020147244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ec8005200 0x7f2ec800ba10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.855+0000 7f2ee4f73700 1 -- 172.21.15.125:0/3020147244 >> 172.21.15.125:0/3020147244 conn(0x7f2ee006ea80 msgr2=0x7f2ee006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:52.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.855+0000 7f2ee4f73700 1 -- 172.21.15.125:0/3020147244 shutdown_connections 2023-11-28T11:08:52.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.855+0000 7f2ee4f73700 1 -- 172.21.15.125:0/3020147244 wait complete. 2023-11-28T11:08:52.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.857+0000 7f2ee4f73700 1 Processor -- start 2023-11-28T11:08:52.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.857+0000 7f2ee4f73700 1 -- start start 2023-11-28T11:08:52.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.857+0000 7f2ee4f73700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ec8005200 0x7f2ee01eff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.857+0000 7f2ee4f73700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ee0158720 0x7f2ee0156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.857+0000 7f2ee4f73700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ee0156bc0 0x7f2ee0152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.857+0000 7f2ee4f73700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee0157030 con 0x7f2ee0156bc0 2023-11-28T11:08:52.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.857+0000 7f2ee4f73700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee01599f0 con 0x7f2ec8005200 2023-11-28T11:08:52.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.857+0000 7f2ee4f73700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee0158b90 con 0x7f2ee0158720 2023-11-28T11:08:52.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.857+0000 7f2eded9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ee0156bc0 0x7f2ee0152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.857+0000 7f2eded9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ee0156bc0 0x7f2ee0152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57416/0 (socket says 172.21.15.125:57416) 2023-11-28T11:08:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.857+0000 7f2eded9d700 1 -- 172.21.15.125:0/355526341 learned_addr learned my addr 172.21.15.125:0/355526341 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ee0158720 0x7f2ee0156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2ede59c700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ec8005200 0x7f2ee01eff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2eded9d700 1 -- 172.21.15.125:0/355526341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ee0158720 msgr2=0x7f2ee0156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2eded9d700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ee0158720 0x7f2ee0156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2eded9d700 1 -- 172.21.15.125:0/355526341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ec8005200 msgr2=0x7f2ee01eff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2eded9d700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ec8005200 0x7f2ee01eff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2eded9d700 1 -- 172.21.15.125:0/355526341 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee00cd230 con 0x7f2ee0156bc0 2023-11-28T11:08:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2eded9d700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ee0156bc0 0x7f2ee0152210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8002230 tx=0x7f2ed8001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2eceffd700 1 -- 172.21.15.125:0/355526341 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80019b0 con 0x7f2ee0156bc0 2023-11-28T11:08:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2eceffd700 1 -- 172.21.15.125:0/355526341 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed8012610 con 0x7f2ee0156bc0 2023-11-28T11:08:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2ee4f73700 1 -- 172.21.15.125:0/355526341 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee00ccf50 con 0x7f2ee0156bc0 2023-11-28T11:08:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2eceffd700 1 -- 172.21.15.125:0/355526341 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed801e670 con 0x7f2ee0156bc0 2023-11-28T11:08:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.858+0000 7f2ee4f73700 1 -- 172.21.15.125:0/355526341 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee00cd510 con 0x7f2ee0156bc0 2023-11-28T11:08:52.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.859+0000 7f2eceffd700 1 -- 172.21.15.125:0/355526341 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2ed8010070 con 0x7f2ee0156bc0 2023-11-28T11:08:52.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.860+0000 7f2eceffd700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ec00682f0 0x7f2ec006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.860+0000 7f2ede59c700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ec00682f0 0x7f2ec006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.860+0000 7f2eceffd700 1 -- 172.21.15.125:0/355526341 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ed80873c0 con 0x7f2ee0156bc0 2023-11-28T11:08:52.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.860+0000 7f2ede59c700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ec00682f0 0x7f2ec006a7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40016b0 tx=0x7f2ed4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:52.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.862+0000 7f2ef10fcb80 1 Processor -- start 2023-11-28T11:08:52.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.862+0000 7f2ef10fcb80 1 -- start start 2023-11-28T11:08:52.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2afa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2d7130 0x55c15b2d9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2da120 0x55c15b2f5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b199bc0 con 0x55c15b2d9810 2023-11-28T11:08:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b208350 con 0x55c15b2da120 2023-11-28T11:08:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c15b201880 con 0x55c15b2d7130 2023-11-28T11:08:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ede59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ede59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57420/0 (socket says 172.21.15.125:57420) 2023-11-28T11:08:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ede59c700 1 -- 172.21.15.125:0/2104790504 learned_addr learned my addr 172.21.15.125:0/2104790504 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/2104790504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2d7130 0x55c15b2d9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ede59c700 1 -- 172.21.15.125:0/2104790504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2d7130 msgr2=0x55c15b2d9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ede59c700 1 --2- 172.21.15.125:0/2104790504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2d7130 0x55c15b2d9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2eded9d700 1 --2- 172.21.15.125:0/2104790504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2da120 0x55c15b2f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ede59c700 1 -- 172.21.15.125:0/2104790504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2da120 msgr2=0x55c15b2f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ede59c700 1 --2- 172.21.15.125:0/2104790504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2da120 0x55c15b2f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ede59c700 1 -- 172.21.15.125:0/2104790504 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c15b0835e0 con 0x55c15b2d9810 2023-11-28T11:08:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ede59c700 1 --2- 172.21.15.125:0/2104790504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2afa20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40146b0 tx=0x7f2ed4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4cf0896155ae0b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ebffff700 1 -- 172.21.15.125:0/2104790504 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4020410 con 0x55c15b2d9810 2023-11-28T11:08:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ebffff700 1 -- 172.21.15.125:0/2104790504 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed400d050 con 0x55c15b2d9810 2023-11-28T11:08:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.863+0000 7f2ebffff700 1 -- 172.21.15.125:0/2104790504 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40207d0 con 0x55c15b2d9810 2023-11-28T11:08:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.864+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2104790504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 msgr2=0x55c15b2afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.864+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/2104790504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2afa20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40146b0 tx=0x7f2ed4012000 comp rx=0 tx=0).stop 2023-11-28T11:08:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.864+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2104790504 shutdown_connections 2023-11-28T11:08:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.864+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/2104790504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2da120 0x55c15b2f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.864+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/2104790504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2afa20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.864+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/2104790504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2d7130 0x55c15b2d9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.864+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2104790504 >> 172.21.15.125:0/2104790504 conn(0x55c15b2acd60 msgr2=0x55c15b2ad6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.864+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2104790504 shutdown_connections 2023-11-28T11:08:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.864+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2104790504 wait complete. 2023-11-28T11:08:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.865+0000 7f2ef10fcb80 1 -- start start 2023-11-28T11:08:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.865+0000 7f2ef10fcb80 1 Processor -- start 2023-11-28T11:08:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d7130 0x55c15b2db4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2d9810 0x55c15b2dba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2da120 0x55c15b2d75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b0858d0 con 0x55c15b2d7130 2023-11-28T11:08:52.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b2d8610 con 0x55c15b2da120 2023-11-28T11:08:52.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c15b2dc0f0 con 0x55c15b2d9810 2023-11-28T11:08:52.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ef10fcb80 10 client.0 _ll_register_callbacks cb 0x55c15b0a7240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:08:52.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ede59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d7130 0x55c15b2db4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ede59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d7130 0x55c15b2db4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57426/0 (socket says 172.21.15.125:57426) 2023-11-28T11:08:52.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ede59c700 1 -- 172.21.15.125:0/2994310418 learned_addr learned my addr 172.21.15.125:0/2994310418 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:52.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2d9810 0x55c15b2dba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2eded9d700 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2da120 0x55c15b2d75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ede59c700 1 -- 172.21.15.125:0/2994310418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2d9810 msgr2=0x55c15b2dba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ede59c700 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2d9810 0x55c15b2dba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ede59c700 1 -- 172.21.15.125:0/2994310418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2da120 msgr2=0x55c15b2d75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ede59c700 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2da120 0x55c15b2d75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ede59c700 1 -- 172.21.15.125:0/2994310418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee015a9c0 con 0x55c15b2d7130 2023-11-28T11:08:52.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2eded9d700 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2da120 0x55c15b2d75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:52.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2d9810 0x55c15b2dba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:52.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ede59c700 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d7130 0x55c15b2db4c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4001e00 tx=0x7f2ed40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a3e88cd763c3c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:52.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ebd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:08:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/2994310418 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed402a410 con 0x55c15b2d7130 2023-11-28T11:08:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/2994310418 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ed401c040 con 0x55c15b2d7130 2023-11-28T11:08:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2994310418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c15b1cf140 con 0x55c15b2d7130 2023-11-28T11:08:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/2994310418 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ed402a570 con 0x55c15b2d7130 2023-11-28T11:08:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ef10fcb80 10 client.4653 fetch_fsmap learned FSMap version 7 2023-11-28T11:08:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.866+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2994310418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c15b02fd90 con 0x55c15b2d7130 2023-11-28T11:08:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.867+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/2994310418 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c15b1cf140 con 0x55c15b2d7130 2023-11-28T11:08:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.867+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/2994310418 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 7) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2ed402a790 con 0x55c15b2d7130 2023-11-28T11:08:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.867+0000 7f2ef10fcb80 10 client.4653 fetch_fsmap finished waiting for FSMap version 7 2023-11-28T11:08:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.867+0000 7f2ef10fcb80 10 client.4653 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:08:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.867+0000 7f2ef10fcb80 20 client.4653 populate_metadata read hostname 'smithi125' 2023-11-28T11:08:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.867+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.125:6835/573741186,v1:172.21.15.125:6837/573741186] conn(0x55c15b2c8e60 0x55c15b311630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.867+0000 7f2ef10fcb80 4 client.4653 mds_command: new command op to 4299 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:08:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.867+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2994310418 --> [v2:172.21.15.125:6835/573741186,v1:172.21.15.125:6837/573741186] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c15b085f10 con 0x55c15b2c8e60 2023-11-28T11:08:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.867+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.125:6835/573741186,v1:172.21.15.125:6837/573741186] conn(0x55c15b2c8e60 0x55c15b311630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.867+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.125:6835/573741186,v1:172.21.15.125:6837/573741186] conn(0x55c15b2c8e60 0x55c15b311630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e07861547c9dd6aa server_cookie=d439695eb98989e in_seq=0 out_seq=0 2023-11-28T11:08:52.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.867+0000 7f2ebd7fa700 10 client.4653 ms_handle_connect on v2:172.21.15.125:6835/573741186 2023-11-28T11:08:52.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/2994310418 <== mds.0 v2:172.21.15.125:6835/573741186 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55c15b085f10 con 0x55c15b2c8e60 2023-11-28T11:08:52.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ebd7fa700 10 client.4653 handle_command_reply: tid=0 2023-11-28T11:08:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 1 client.4653 shutdown 2023-11-28T11:08:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2994310418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d7130 msgr2=0x55c15b2db4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d7130 0x55c15b2db4c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4001e00 tx=0x7f2ed40012d0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2994310418 shutdown_connections 2023-11-28T11:08:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.125:6835/573741186,v1:172.21.15.125:6837/573741186] conn(0x55c15b2c8e60 0x55c15b311630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2da120 0x55c15b2d75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d7130 0x55c15b2db4c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/2994310418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2d9810 0x55c15b2dba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ebd7fa700 0 client.4653 ms_handle_reset on v2:172.21.15.125:6835/573741186 2023-11-28T11:08:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2994310418 >> 172.21.15.125:0/2994310418 conn(0x55c15b2acd60 msgr2=0x55c15b2af990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2994310418 shutdown_connections 2023-11-28T11:08:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/2994310418 wait complete. 2023-11-28T11:08:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.868+0000 7f2ef10fcb80 20 client.4653 trim_cache size 0 max 16384 2023-11-28T11:08:52.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.885+0000 7f2ef10fcb80 1 Processor -- start 2023-11-28T11:08:52.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.885+0000 7f2ef10fcb80 1 -- start start 2023-11-28T11:08:52.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2d7130 0x55c15b2aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2a8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2da120 0x55c15b2a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b2caae0 con 0x55c15b2d9810 2023-11-28T11:08:52.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b2ae540 con 0x55c15b2d7130 2023-11-28T11:08:52.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c15b2c74c0 con 0x55c15b2da120 2023-11-28T11:08:52.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eddd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eddd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2a8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57436/0 (socket says 172.21.15.125:57436) 2023-11-28T11:08:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eddd9b700 1 -- 172.21.15.125:0/1789232012 learned_addr learned my addr 172.21.15.125:0/1789232012 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2ede59c700 1 --2- 172.21.15.125:0/1789232012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2d7130 0x55c15b2aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eded9d700 1 --2- 172.21.15.125:0/1789232012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2da120 0x55c15b2a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eddd9b700 1 -- 172.21.15.125:0/1789232012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2da120 msgr2=0x55c15b2a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/1789232012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2da120 0x55c15b2a8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eddd9b700 1 -- 172.21.15.125:0/1789232012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2d7130 msgr2=0x55c15b2aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/1789232012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2d7130 0x55c15b2aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eddd9b700 1 -- 172.21.15.125:0/1789232012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c15b1c8140 con 0x55c15b2d9810 2023-11-28T11:08:52.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/1789232012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2a8450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00b32d0 tx=0x7f2ed0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4319f815afada7e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:52.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eccff9700 1 -- 172.21.15.125:0/1789232012 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed001f320 con 0x55c15b2d9810 2023-11-28T11:08:52.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eccff9700 1 -- 172.21.15.125:0/1789232012 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed00178b0 con 0x55c15b2d9810 2023-11-28T11:08:52.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.886+0000 7f2eccff9700 1 -- 172.21.15.125:0/1789232012 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0017c60 con 0x55c15b2d9810 2023-11-28T11:08:52.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.887+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/1789232012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 msgr2=0x55c15b2a8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.887+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/1789232012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2a8450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00b32d0 tx=0x7f2ed0008040 comp rx=0 tx=0).stop 2023-11-28T11:08:52.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.887+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/1789232012 shutdown_connections 2023-11-28T11:08:52.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.887+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/1789232012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2da120 0x55c15b2a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.887+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/1789232012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2d7130 0x55c15b2aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.887+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/1789232012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2a8450 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.887+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/1789232012 >> 172.21.15.125:0/1789232012 conn(0x55c15b2acd60 msgr2=0x55c15b2ad510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:52.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.887+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/1789232012 shutdown_connections 2023-11-28T11:08:52.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.887+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/1789232012 wait complete. 2023-11-28T11:08:52.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.888+0000 7f2ef10fcb80 1 -- start start 2023-11-28T11:08:52.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.888+0000 7f2ef10fcb80 1 Processor -- start 2023-11-28T11:08:52.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.888+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2d7130 0x55c15b35dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.888+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2db2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.888+0000 7f2ef10fcb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2da120 0x55c15b2db810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.888+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b2dca30 con 0x55c15b2d9810 2023-11-28T11:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.888+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b35fab0 con 0x55c15b2d7130 2023-11-28T11:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ef10fcb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c15b2aa150 con 0x55c15b2da120 2023-11-28T11:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ef10fcb80 10 client.0 _ll_register_callbacks cb 0x55c15b0a7240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2eddd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2db2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2eddd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2db2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57442/0 (socket says 172.21.15.125:57442) 2023-11-28T11:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2eddd9b700 1 -- 172.21.15.125:0/709642524 learned_addr learned my addr 172.21.15.125:0/709642524 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ede59c700 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2d7130 0x55c15b35dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2eded9d700 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2da120 0x55c15b2db810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2eddd9b700 1 -- 172.21.15.125:0/709642524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2da120 msgr2=0x55c15b2db810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2da120 0x55c15b2db810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2eddd9b700 1 -- 172.21.15.125:0/709642524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2d7130 msgr2=0x55c15b35dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:52.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2d7130 0x55c15b35dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2eddd9b700 1 -- 172.21.15.125:0/709642524 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed0009c30 con 0x55c15b2d9810 2023-11-28T11:08:52.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2eded9d700 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2da120 0x55c15b2db810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:52.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2eddd9b700 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2db2d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55c15b2cac20 tx=0x7f2ed4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbb3d530882ebcb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:52.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ebd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:08:52.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/709642524 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed002c030 con 0x55c15b2d9810 2023-11-28T11:08:52.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/709642524 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ed002d070 con 0x55c15b2d9810 2023-11-28T11:08:52.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/709642524 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c15b1bf160 con 0x55c15b2d9810 2023-11-28T11:08:52.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/709642524 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ed0004240 con 0x55c15b2d9810 2023-11-28T11:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ef10fcb80 10 client.4659 fetch_fsmap learned FSMap version 7 2023-11-28T11:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/709642524 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c15b056200 con 0x55c15b2d9810 2023-11-28T11:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/709642524 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c15b1bf160 con 0x55c15b2d9810 2023-11-28T11:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/709642524 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 7) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2ed00043a0 con 0x55c15b2d9810 2023-11-28T11:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.889+0000 7f2ef10fcb80 10 client.4659 fetch_fsmap finished waiting for FSMap version 7 2023-11-28T11:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 10 client.4659 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 20 client.4659 populate_metadata read hostname 'smithi125' 2023-11-28T11:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.125:6835/573741186,v1:172.21.15.125:6837/573741186] conn(0x55c15b30d8a0 0x55c15b30dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:52.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 4 client.4659 mds_command: new command op to 4299 tid=0[{"prefix": "status"}] 2023-11-28T11:08:52.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/709642524 --> [v2:172.21.15.125:6835/573741186,v1:172.21.15.125:6837/573741186] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c15b1a9170 con 0x55c15b30d8a0 2023-11-28T11:08:52.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ede59c700 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.125:6835/573741186,v1:172.21.15.125:6837/573741186] conn(0x55c15b30d8a0 0x55c15b30dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:52.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ebd7fa700 10 client.4659 ms_handle_connect on v2:172.21.15.125:6835/573741186 2023-11-28T11:08:52.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ede59c700 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.125:6835/573741186,v1:172.21.15.125:6837/573741186] conn(0x55c15b30d8a0 0x55c15b30dc70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96078e7d3c1bce37 server_cookie=4712fd0bc2fb5753 in_seq=0 out_seq=0 2023-11-28T11:08:52.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ebd7fa700 1 -- 172.21.15.125:0/709642524 <== mds.0 v2:172.21.15.125:6835/573741186 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c15b1a9170 con 0x55c15b30d8a0 2023-11-28T11:08:52.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ebd7fa700 10 client.4659 handle_command_reply: tid=0 2023-11-28T11:08:52.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 client.4659 shutdown 2023-11-28T11:08:52.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/709642524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 msgr2=0x55c15b2db2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2db2d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55c15b2cac20 tx=0x7f2ed4014000 comp rx=0 tx=0).stop 2023-11-28T11:08:52.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/709642524 shutdown_connections 2023-11-28T11:08:52.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.125:6835/573741186,v1:172.21.15.125:6837/573741186] conn(0x55c15b30d8a0 0x55c15b30dc70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c15b2da120 0x55c15b2db810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ebd7fa700 0 client.4659 ms_handle_reset on v2:172.21.15.125:6835/573741186 2023-11-28T11:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c15b2d7130 0x55c15b35dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 --2- 172.21.15.125:0/709642524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c15b2d9810 0x55c15b2db2d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/709642524 >> 172.21.15.125:0/709642524 conn(0x55c15b2acd60 msgr2=0x55c15b2b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/709642524 shutdown_connections 2023-11-28T11:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.890+0000 7f2ef10fcb80 1 -- 172.21.15.125:0/709642524 wait complete. 2023-11-28T11:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ef10fcb80 20 client.4659 trim_cache size 0 max 16384 2023-11-28T11:08:52.906 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:08:52.906 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea", 2023-11-28T11:08:52.906 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-11-28T11:08:52.906 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4299, 2023-11-28T11:08:52.906 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-11-28T11:08:52.907 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-11-28T11:08:52.907 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-11-28T11:08:52.907 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 16.505937262, 2023-11-28T11:08:52.907 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 7, 2023-11-28T11:08:52.907 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 24, 2023-11-28T11:08:52.907 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 24, 2023-11-28T11:08:52.907 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 20.996684642000002 2023-11-28T11:08:52.907 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 -- 172.21.15.125:0/355526341 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ec00682f0 msgr2=0x7f2ec006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ec00682f0 0x7f2ec006a7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40016b0 tx=0x7f2ed4009040 comp rx=0 tx=0).stop 2023-11-28T11:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 -- 172.21.15.125:0/355526341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ee0156bc0 msgr2=0x7f2ee0152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ee0156bc0 0x7f2ee0152210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8002230 tx=0x7f2ed8001d00 comp rx=0 tx=0).stop 2023-11-28T11:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 -- 172.21.15.125:0/355526341 shutdown_connections 2023-11-28T11:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ee0156bc0 0x7f2ee0152210 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ec8005200 0x7f2ee01eff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ec00682f0 0x7f2ec006a7a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 --2- 172.21.15.125:0/355526341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ee0158720 0x7f2ee0156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:52.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 -- 172.21.15.125:0/355526341 >> 172.21.15.125:0/355526341 conn(0x7f2ee006ea80 msgr2=0x7f2ee00b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:52.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 -- 172.21.15.125:0/355526341 shutdown_connections 2023-11-28T11:08:52.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:52.891+0000 7f2ee4f73700 1 -- 172.21.15.125:0/355526341 wait complete. 2023-11-28T11:08:52.910 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-28T11:08:52.932 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-28T11:08:52.932 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-28T11:08:52.932 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-28T11:08:52.933 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:08:52.933 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:08:52.933 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-28T11:08:52.933 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:08:52.933 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T11:08:52.933 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-28T11:08:52.933 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:08:52.933 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T11:08:52.933 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-28T11:08:52.934 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:08:52.934 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T11:08:52.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:52.934 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-11-28T11:08:52.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:52.952 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2023-11-28T11:08:53.021 INFO:teuthology.orchestra.run.smithi125.stderr:Cannot find device "ceph-brx" 2023-11-28T11:08:53.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:08:53.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:53.022 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-11-28T11:08:53.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:53.044 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2023-11-28T11:08:53.119 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2023-11-28T11:08:53.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:08:53.120 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-28T11:08:53.121 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:08:53.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.241+0000 7faf90b5f700 1 Processor -- start 2023-11-28T11:08:53.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.242+0000 7faf90b5f700 1 -- start start 2023-11-28T11:08:53.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.242+0000 7faf90b5f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c06ab10 0x7faf8c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:53.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.242+0000 7faf90b5f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf8c0d0450 0x7faf8c160a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:53.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf90b5f700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8c0d1ee0 con 0x7faf8c0cd5a0 2023-11-28T11:08:53.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf90b5f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8c06b420 con 0x7faf8c0d0450 2023-11-28T11:08:53.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf90b5f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0cdb10 con 0x7faf8c06ab10 2023-11-28T11:08:53.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf8c0d0450 0x7faf8c160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:53.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf8c0d0450 0x7faf8c160a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57452/0 (socket says 172.21.15.125:57452) 2023-11-28T11:08:53.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8ad9d700 1 -- 172.21.15.125:0/4082977294 learned_addr learned my addr 172.21.15.125:0/4082977294 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:53.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8a59c700 1 --2- 172.21.15.125:0/4082977294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c06ab10 0x7faf8c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:53.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8ad9d700 1 -- 172.21.15.125:0/4082977294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c06ab10 msgr2=0x7faf8c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:53.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8ad9d700 1 --2- 172.21.15.125:0/4082977294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c06ab10 0x7faf8c06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8ad9d700 1 -- 172.21.15.125:0/4082977294 >> v1:172.21.15.167:6789/0 conn(0x7faf8c0cd5a0 legacy=0x7faf8c160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8ad9d700 1 -- 172.21.15.125:0/4082977294 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c0d1890 con 0x7faf8c0d0450 2023-11-28T11:08:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8a59c700 1 --2- 172.21.15.125:0/4082977294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c06ab10 0x7faf8c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8ad9d700 1 --2- 172.21.15.125:0/4082977294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf8c0d0450 0x7faf8c160a10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faf84009e50 tx=0x7faf8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ff6c7ae45c1d13 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8959a700 1 -- 172.21.15.125:0/4082977294 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400e070 con 0x7faf8c0d0450 2023-11-28T11:08:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8959a700 1 -- 172.21.15.125:0/4082977294 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8400b9c0 con 0x7faf8c0d0450 2023-11-28T11:08:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.243+0000 7faf8959a700 1 -- 172.21.15.125:0/4082977294 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400bd70 con 0x7faf8c0d0450 2023-11-28T11:08:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.244+0000 7faf90b5f700 1 -- 172.21.15.125:0/4082977294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf8c0d0450 msgr2=0x7faf8c160a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.244+0000 7faf90b5f700 1 --2- 172.21.15.125:0/4082977294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf8c0d0450 0x7faf8c160a10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faf84009e50 tx=0x7faf8400b330 comp rx=0 tx=0).stop 2023-11-28T11:08:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.244+0000 7faf90b5f700 1 -- 172.21.15.125:0/4082977294 shutdown_connections 2023-11-28T11:08:53.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.244+0000 7faf90b5f700 1 --2- 172.21.15.125:0/4082977294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf8c0d0450 0x7faf8c160a10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.244+0000 7faf90b5f700 1 --2- 172.21.15.125:0/4082977294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c06ab10 0x7faf8c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.244+0000 7faf90b5f700 1 -- 172.21.15.125:0/4082977294 >> 172.21.15.125:0/4082977294 conn(0x7faf8c06c520 msgr2=0x7faf8c06c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.244+0000 7faf90b5f700 1 -- 172.21.15.125:0/4082977294 shutdown_connections 2023-11-28T11:08:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.244+0000 7faf90b5f700 1 -- 172.21.15.125:0/4082977294 wait complete. 2023-11-28T11:08:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.245+0000 7faf90b5f700 1 Processor -- start 2023-11-28T11:08:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.245+0000 7faf90b5f700 1 -- start start 2023-11-28T11:08:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf90b5f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf8c06ab10 0x7faf8c14ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf90b5f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c0cd5a0 0x7faf8c14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf90b5f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf8c0d0450 0x7faf8c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf90b5f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0ca950 con 0x7faf8c06ab10 2023-11-28T11:08:53.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf90b5f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c1505c0 con 0x7faf8c0d0450 2023-11-28T11:08:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf90b5f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0ca020 con 0x7faf8c0cd5a0 2023-11-28T11:08:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf8a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf8c06ab10 0x7faf8c14ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf8a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf8c06ab10 0x7faf8c14ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57454/0 (socket says 172.21.15.125:57454) 2023-11-28T11:08:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf8a59c700 1 -- 172.21.15.125:0/3560935382 learned_addr learned my addr 172.21.15.125:0/3560935382 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf89d9b700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c0cd5a0 0x7faf8c14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf8ad9d700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf8c0d0450 0x7faf8c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:53.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf8a59c700 1 -- 172.21.15.125:0/3560935382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c0cd5a0 msgr2=0x7faf8c14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf8a59c700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c0cd5a0 0x7faf8c14fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf8a59c700 1 -- 172.21.15.125:0/3560935382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf8c0d0450 msgr2=0x7faf8c151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf8a59c700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf8c0d0450 0x7faf8c151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf8a59c700 1 -- 172.21.15.125:0/3560935382 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84009b30 con 0x7faf8c06ab10 2023-11-28T11:08:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf89d9b700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c0cd5a0 0x7faf8c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.246+0000 7faf8ad9d700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf8c0d0450 0x7faf8c151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.247+0000 7faf8a59c700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf8c06ab10 0x7faf8c14ed30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00e760 tx=0x7faf7c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.247+0000 7faf82ffd700 1 -- 172.21.15.125:0/3560935382 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c013610 con 0x7faf8c06ab10 2023-11-28T11:08:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.247+0000 7faf82ffd700 1 -- 172.21.15.125:0/3560935382 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c013770 con 0x7faf8c06ab10 2023-11-28T11:08:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.247+0000 7faf90b5f700 1 -- 172.21.15.125:0/3560935382 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8c15cad0 con 0x7faf8c06ab10 2023-11-28T11:08:53.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.247+0000 7faf82ffd700 1 -- 172.21.15.125:0/3560935382 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c013b20 con 0x7faf8c06ab10 2023-11-28T11:08:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.247+0000 7faf90b5f700 1 -- 172.21.15.125:0/3560935382 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8c0d1b70 con 0x7faf8c06ab10 2023-11-28T11:08:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.248+0000 7faf90b5f700 1 -- 172.21.15.125:0/3560935382 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8c0b1ec0 con 0x7faf8c06ab10 2023-11-28T11:08:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.248+0000 7faf82ffd700 1 -- 172.21.15.125:0/3560935382 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7faf7c023070 con 0x7faf8c06ab10 2023-11-28T11:08:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.248+0000 7faf82ffd700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faf6c0682f0 0x7faf6c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.249+0000 7faf89d9b700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faf6c0682f0 0x7faf6c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.249+0000 7faf82ffd700 1 -- 172.21.15.125:0/3560935382 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf7c085830 con 0x7faf8c06ab10 2023-11-28T11:08:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.249+0000 7faf89d9b700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faf6c0682f0 0x7faf6c06a7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0c96e0 tx=0x7faf74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:53.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.253+0000 7faf82ffd700 1 -- 172.21.15.125:0/3560935382 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7faf7c052090 con 0x7faf8c06ab10 2023-11-28T11:08:53.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.478+0000 7faf90b5f700 1 -- 172.21.15.125:0/3560935382 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faf8c0743f0 con 0x7faf8c06ab10 2023-11-28T11:08:53.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.478+0000 7faf82ffd700 1 -- 172.21.15.125:0/3560935382 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7faf7c0556b0 con 0x7faf8c06ab10 2023-11-28T11:08:53.480 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:08:53.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 -- 172.21.15.125:0/3560935382 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faf6c0682f0 msgr2=0x7faf6c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:53.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faf6c0682f0 0x7faf6c06a7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0c96e0 tx=0x7faf74009040 comp rx=0 tx=0).stop 2023-11-28T11:08:53.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 -- 172.21.15.125:0/3560935382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf8c06ab10 msgr2=0x7faf8c14ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:53.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf8c06ab10 0x7faf8c14ed30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00e760 tx=0x7faf7c00eb20 comp rx=0 tx=0).stop 2023-11-28T11:08:53.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 -- 172.21.15.125:0/3560935382 shutdown_connections 2023-11-28T11:08:53.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf8c0d0450 0x7faf8c151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:53.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf8c06ab10 0x7faf8c14ed30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:53.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7faf6c0682f0 0x7faf6c06a7a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:53.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 --2- 172.21.15.125:0/3560935382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf8c0cd5a0 0x7faf8c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:53.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 -- 172.21.15.125:0/3560935382 >> 172.21.15.125:0/3560935382 conn(0x7faf8c06c520 msgr2=0x7faf8c0b49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:53.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 -- 172.21.15.125:0/3560935382 shutdown_connections 2023-11-28T11:08:53.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:53.480+0000 7faf90b5f700 1 -- 172.21.15.125:0/3560935382 wait complete. 2023-11-28T11:08:53.494 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:08:53.494 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:08:53.494 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-11-28T11:08:53.494 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:08:53.494 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:08:53.495 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:08:53.495 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:08:53.495 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:08:53.495 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:08:53.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:53.496 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-11-28T11:08:53.514 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:08:53.514 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:08:53.514 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:08:53.514 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:53.514 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-11-28T11:08:53.514 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:53.515 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:08:53.515 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:53.515 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:08:53.515 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:53.515 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:08:53.515 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:53.516 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:08:53.516 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:53.516 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-28T11:08:53.516 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42337sec preferred_lft 42337sec 2023-11-28T11:08:53.516 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::af9c:3934:f827:ab8e/64 scope link noprefixroute 2023-11-28T11:08:53.516 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:53.517 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T11:08:53.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:53.517 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:08:53.518 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:08:53.518 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add name ceph-brx type bridge 2023-11-28T11:08:53.518 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr flush dev ceph-brx 2023-11-28T11:08:53.518 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set ceph-brx up 2023-11-28T11:08:53.518 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T11:08:53.518 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:08:53.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:53.678 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:08:53.705 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-11-28T11:08:53.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:53.707 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-11-28T11:08:53.786 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-11-28T11:08:53.786 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:08:53.787 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T11:08:53.787 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T11:08:53.787 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:08:53.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:53.788 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:08:53.788 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:08:53.788 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T11:08:53.788 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T11:08:53.788 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T11:08:53.789 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:08:54.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:54.038 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-11-28T11:08:54.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:54.055 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2023-11-28T11:08:54.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:54.111 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:08:54.112 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:08:54.112 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:08:54.112 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T11:08:54.112 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:08:54.204 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T11:08:54.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:54.205 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:08:54.205 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:08:54.205 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T11:08:54.205 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T11:08:54.205 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T11:08:54.205 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T11:08:54.205 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T11:08:54.206 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:08:54.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:54.413 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:08:54.413 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:08:54.413 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-11-28T11:08:54.413 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T11:08:54.413 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:08:54.514 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T11:08:54.514 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:08:54.515 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:08:54.534 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:08:54.535 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:08:54.535 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:08:54.590 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-11-28T11:08:54.659 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:08:54.659 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:08:54.725 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:08:54.726 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:08:54.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:54.726 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-28T11:08:54.783 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:08:54.783 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T11:08:54.826 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-11-28T11:08:54.852 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:08:54.852 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:08:54.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2023-11-28T11:08:54.916+0000 7efc22e7c5c0 -1 init, newargv = 0x5617f7cfbb70 newargc=15 2023-11-28T11:08:54.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[112827]: starting ceph client 2023-11-28T11:08:54.919 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:08:54.920 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:08:54.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:54.921 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-28T11:08:54.922 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[112827]: starting fuse 2023-11-28T11:08:54.938 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-11-28T11:08:54.938 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-11-28T11:08:54.939 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:08:54.939 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-11-28T11:08:54.939 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-11-28T11:08:54.939 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:08:54.939 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-11-28T11:08:54.939 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:08:54.939 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-11-28T11:08:54.939 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T11:08:54.939 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-11-28T11:08:54.939 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T11:08:54.939 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-11-28T11:08:54.940 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-11-28T11:08:54.941 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:08:54.941 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:08:54.941 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.0")) 2023-11-28T11:08:54.941 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:08:55.060 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.112827.asok 2023-11-28T11:08:55.243 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112827.asok 2023-11-28T11:08:55.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:55.243 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112827.asok status 2023-11-28T11:08:55.399 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:08:55.399 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-11-28T11:08:55.399 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:08:55.399 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:08:55.399 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2023-11-28T11:08:55.399 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-11-28T11:08:55.400 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T11:08:55.400 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "112827", 2023-11-28T11:08:55.400 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-11-28T11:08:55.400 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:08:55.400 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-11-28T11:08:55.400 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-11-28T11:08:55.400 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4671, 2023-11-28T11:08:55.400 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-11-28T11:08:55.400 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-11-28T11:08:55.400 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-11-28T11:08:55.400 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 4671 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 618291296 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 618291296 2023-11-28T11:08:55.401 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:08:55.402 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.4671 192.168.0.1:0/618291296", 2023-11-28T11:08:55.402 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/618291296", 2023-11-28T11:08:55.402 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-11-28T11:08:55.402 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 7, 2023-11-28T11:08:55.402 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 24, 2023-11-28T11:08:55.402 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:08:55.402 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-11-28T11:08:55.402 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-11-28T11:08:55.402 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:08:55.409 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:08:55.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.531+0000 7f8d426e5700 1 Processor -- start 2023-11-28T11:08:55.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.531+0000 7f8d426e5700 1 -- start start 2023-11-28T11:08:55.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.532+0000 7f8d426e5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3c06ab10 0x7f8d3c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:55.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.532+0000 7f8d426e5700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8d3c0cd5a0 0x7f8d3c160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:55.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.532+0000 7f8d426e5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3c0d1ee0 con 0x7f8d3c0b22a0 2023-11-28T11:08:55.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.532+0000 7f8d426e5700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3c06b420 con 0x7f8d3c0cd5a0 2023-11-28T11:08:55.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.532+0000 7f8d426e5700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0cdb10 con 0x7f8d3c06ab10 2023-11-28T11:08:55.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.532+0000 7f8d40c82700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8d3c0b22a0 0x7f8d3c160840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41604/0 (socket says 172.21.15.125:41604) 2023-11-28T11:08:55.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.532+0000 7f8d40c82700 1 -- 172.21.15.125:0/1390406881 learned_addr learned my addr 172.21.15.125:0/1390406881 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:08:55.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.532+0000 7f8d3bfff700 1 --2- 172.21.15.125:0/1390406881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3c06ab10 0x7f8d3c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:55.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.532+0000 7f8d3b7fe700 1 --2- 172.21.15.125:0/1390406881 >> v2:172.21.15.167:3300/0 conn(0x7f8d3c0cd5a0 0x7f8d3c160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:55.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3affd700 1 -- 172.21.15.125:0/1390406881 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393334962 0 0) 0x7f8d3c0d1ee0 con 0x7f8d3c0b22a0 2023-11-28T11:08:55.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3affd700 1 -- 172.21.15.125:0/1390406881 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d240035b0 con 0x7f8d3c0b22a0 2023-11-28T11:08:55.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3bfff700 1 -- 172.21.15.125:0/1390406881 >> v2:172.21.15.167:3300/0 conn(0x7f8d3c0cd5a0 msgr2=0x7f8d3c160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:55.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3bfff700 1 --2- 172.21.15.125:0/1390406881 >> v2:172.21.15.167:3300/0 conn(0x7f8d3c0cd5a0 0x7f8d3c160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:55.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3affd700 1 -- 172.21.15.125:0/1390406881 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 449868298 0 0) 0x7f8d240035b0 con 0x7f8d3c0b22a0 2023-11-28T11:08:55.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3bfff700 1 -- 172.21.15.125:0/1390406881 >> v1:172.21.15.125:6789/0 conn(0x7f8d3c0b22a0 legacy=0x7f8d3c160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:55.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3bfff700 1 -- 172.21.15.125:0/1390406881 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c0d1890 con 0x7f8d3c06ab10 2023-11-28T11:08:55.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3b7fe700 1 --2- 172.21.15.125:0/1390406881 >> v2:172.21.15.167:3300/0 conn(0x7f8d3c0cd5a0 0x7f8d3c160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:08:55.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3bfff700 1 --2- 172.21.15.125:0/1390406881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3c06ab10 0x7f8d3c06aee0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009840 tx=0x7f8d30009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f453153b23e520ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:55.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3affd700 1 -- 172.21.15.125:0/1390406881 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340019f0 con 0x7f8d3c06ab10 2023-11-28T11:08:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3affd700 1 -- 172.21.15.125:0/1390406881 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d30004030 con 0x7f8d3c06ab10 2023-11-28T11:08:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.533+0000 7f8d3affd700 1 -- 172.21.15.125:0/1390406881 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d300043c0 con 0x7f8d3c06ab10 2023-11-28T11:08:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.534+0000 7f8d426e5700 1 -- 172.21.15.125:0/1390406881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3c06ab10 msgr2=0x7f8d3c06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.534+0000 7f8d426e5700 1 --2- 172.21.15.125:0/1390406881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3c06ab10 0x7f8d3c06aee0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009840 tx=0x7f8d30009b50 comp rx=0 tx=0).stop 2023-11-28T11:08:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.534+0000 7f8d426e5700 1 -- 172.21.15.125:0/1390406881 shutdown_connections 2023-11-28T11:08:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.534+0000 7f8d426e5700 1 --2- 172.21.15.125:0/1390406881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3c06ab10 0x7f8d3c06aee0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.534+0000 7f8d426e5700 1 --2- 172.21.15.125:0/1390406881 >> v2:172.21.15.167:3300/0 conn(0x7f8d3c0cd5a0 0x7f8d3c160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.534+0000 7f8d426e5700 1 -- 172.21.15.125:0/1390406881 >> 172.21.15.125:0/1390406881 conn(0x7f8d3c06c520 msgr2=0x7f8d3c06c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.534+0000 7f8d426e5700 1 -- 172.21.15.125:0/1390406881 shutdown_connections 2023-11-28T11:08:55.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.534+0000 7f8d426e5700 1 -- 172.21.15.125:0/1390406881 wait complete. 2023-11-28T11:08:55.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.535+0000 7f8d426e5700 1 Processor -- start 2023-11-28T11:08:55.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.535+0000 7f8d426e5700 1 -- start start 2023-11-28T11:08:55.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d426e5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d3c06ab10 0x7f8d3c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:55.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d426e5700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3c0b22a0 0x7f8d3c0c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:55.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d426e5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3c0cd5a0 0x7f8d3c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:55.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d426e5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0c8cc0 con 0x7f8d3c06ab10 2023-11-28T11:08:55.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d426e5700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c1e66d0 con 0x7f8d3c0b22a0 2023-11-28T11:08:55.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d426e5700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0c79d0 con 0x7f8d3c0cd5a0 2023-11-28T11:08:55.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d3bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d3c06ab10 0x7f8d3c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:55.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d3bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d3c06ab10 0x7f8d3c0c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57482/0 (socket says 172.21.15.125:57482) 2023-11-28T11:08:55.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d3bfff700 1 -- 172.21.15.125:0/4270352155 learned_addr learned my addr 172.21.15.125:0/4270352155 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:55.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d40c82700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3c0cd5a0 0x7f8d3c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:55.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d3b7fe700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3c0b22a0 0x7f8d3c0c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:55.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d3bfff700 1 -- 172.21.15.125:0/4270352155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3c0cd5a0 msgr2=0x7f8d3c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:55.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d3bfff700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3c0cd5a0 0x7f8d3c0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:55.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d3bfff700 1 -- 172.21.15.125:0/4270352155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3c0b22a0 msgr2=0x7f8d3c0c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d3bfff700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3c0b22a0 0x7f8d3c0c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d3bfff700 1 -- 172.21.15.125:0/4270352155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c0094a0 con 0x7f8d3c06ab10 2023-11-28T11:08:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.536+0000 7f8d3b7fe700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3c0b22a0 0x7f8d3c0c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:08:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.537+0000 7f8d3bfff700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d3c06ab10 0x7f8d3c0c7490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000a010 tx=0x7f8d30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.537+0000 7f8d38ff9700 1 -- 172.21.15.125:0/4270352155 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30003b90 con 0x7f8d3c06ab10 2023-11-28T11:08:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.537+0000 7f8d38ff9700 1 -- 172.21.15.125:0/4270352155 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3001f070 con 0x7f8d3c06ab10 2023-11-28T11:08:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.537+0000 7f8d426e5700 1 -- 172.21.15.125:0/4270352155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d300094a0 con 0x7f8d3c06ab10 2023-11-28T11:08:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.537+0000 7f8d38ff9700 1 -- 172.21.15.125:0/4270352155 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30011630 con 0x7f8d3c06ab10 2023-11-28T11:08:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.537+0000 7f8d426e5700 1 -- 172.21.15.125:0/4270352155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c15cad0 con 0x7f8d3c06ab10 2023-11-28T11:08:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.538+0000 7f8d426e5700 1 -- 172.21.15.125:0/4270352155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3c0d1b70 con 0x7f8d3c06ab10 2023-11-28T11:08:55.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.538+0000 7f8d38ff9700 1 -- 172.21.15.125:0/4270352155 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8d3002a020 con 0x7f8d3c06ab10 2023-11-28T11:08:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.538+0000 7f8d38ff9700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d280682f0 0x7f8d2806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.538+0000 7f8d38ff9700 1 -- 172.21.15.125:0/4270352155 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d30087100 con 0x7f8d3c06ab10 2023-11-28T11:08:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.538+0000 7f8d3b7fe700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d280682f0 0x7f8d2806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.539+0000 7f8d3b7fe700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d280682f0 0x7f8d2806a7a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0b2a20 tx=0x7f8d2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:55.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.543+0000 7f8d38ff9700 1 -- 172.21.15.125:0/4270352155 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8d300538e0 con 0x7f8d3c06ab10 2023-11-28T11:08:55.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.768+0000 7f8d426e5700 1 -- 172.21.15.125:0/4270352155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d3c0743f0 con 0x7f8d3c06ab10 2023-11-28T11:08:55.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.769+0000 7f8d38ff9700 1 -- 172.21.15.125:0/4270352155 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8d30056f00 con 0x7f8d3c06ab10 2023-11-28T11:08:55.769 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:08:55.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.770+0000 7f8d426e5700 1 -- 172.21.15.125:0/4270352155 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d280682f0 msgr2=0x7f8d2806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:55.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.770+0000 7f8d426e5700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d280682f0 0x7f8d2806a7a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0b2a20 tx=0x7f8d2c008040 comp rx=0 tx=0).stop 2023-11-28T11:08:55.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.770+0000 7f8d426e5700 1 -- 172.21.15.125:0/4270352155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d3c06ab10 msgr2=0x7f8d3c0c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:55.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.770+0000 7f8d426e5700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d3c06ab10 0x7f8d3c0c7490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000a010 tx=0x7f8d30004750 comp rx=0 tx=0).stop 2023-11-28T11:08:55.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.771+0000 7f8d426e5700 1 -- 172.21.15.125:0/4270352155 shutdown_connections 2023-11-28T11:08:55.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.771+0000 7f8d426e5700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8d280682f0 0x7f8d2806a7a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:55.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.771+0000 7f8d426e5700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3c0cd5a0 0x7f8d3c0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:55.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.771+0000 7f8d426e5700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d3c06ab10 0x7f8d3c0c7490 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:55.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.771+0000 7f8d426e5700 1 --2- 172.21.15.125:0/4270352155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3c0b22a0 0x7f8d3c0c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:55.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.771+0000 7f8d426e5700 1 -- 172.21.15.125:0/4270352155 >> 172.21.15.125:0/4270352155 conn(0x7f8d3c06c520 msgr2=0x7f8d3c0b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:55.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.771+0000 7f8d426e5700 1 -- 172.21.15.125:0/4270352155 shutdown_connections 2023-11-28T11:08:55.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:55.771+0000 7f8d426e5700 1 -- 172.21.15.125:0/4270352155 wait complete. 2023-11-28T11:08:55.783 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:08:55.783 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:08:55.783 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-11-28T11:08:55.783 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-28T11:08:55.784 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T11:08:55.784 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:08:55.784 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:08:55.784 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:08:55.784 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-28T11:08:55.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:55.784 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-11-28T11:08:55.802 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:08:55.802 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:08:55.802 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:08:55.802 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:55.803 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-11-28T11:08:55.803 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:55.803 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:08:55.804 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:55.804 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:08:55.804 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:55.804 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:08:55.804 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:55.805 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:08:55.805 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:55.805 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-28T11:08:55.805 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42335sec preferred_lft 42335sec 2023-11-28T11:08:55.805 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::af9c:3934:f827:ab8e/64 scope link noprefixroute 2023-11-28T11:08:55.805 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:55.805 INFO:teuthology.orchestra.run.smithi125.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:08:55.806 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 8a:65:01:86:2c:a8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:55.806 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:08:55.806 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:55.806 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::2847:a7ff:fe7f:fad9/64 scope link 2023-11-28T11:08:55.806 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:55.806 INFO:teuthology.orchestra.run.smithi125.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:08:55.806 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 8a:65:01:86:2c:a8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:08:55.806 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::8865:1ff:fe86:2ca8/64 scope link tentative 2023-11-28T11:08:55.807 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:55.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:55.807 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:08:55.870 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-11-28T11:08:55.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:55.872 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-11-28T11:08:55.930 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-11-28T11:08:55.930 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:08:55.930 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T11:08:55.930 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T11:08:55.930 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:08:55.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:55.931 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:08:55.931 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:08:55.931 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T11:08:55.931 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T11:08:55.931 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T11:08:55.931 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:08:56.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:56.035 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-11-28T11:08:56.051 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:08:56.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:56.052 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2023-11-28T11:08:56.108 INFO:teuthology.orchestra.run.smithi125.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-28T11:08:56.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:56.108 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:08:56.108 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:08:56.108 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:08:56.108 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-28T11:08:56.109 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:08:56.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:56.201 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T11:08:56.238 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:08:56.239 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:08:56.239 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:08:56.239 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:56.239 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-11-28T11:08:56.239 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:56.239 INFO:teuthology.orchestra.run.smithi125.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:08:56.240 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether e6:17:ca:a3:7e:44 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:08:56.240 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:08:56.240 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:56.240 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::e417:caff:fea3:7e44/64 scope link 2023-11-28T11:08:56.240 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:56.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:56.247 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T11:08:56.326 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:08:56.326 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:08:56.327 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:08:56.327 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:56.327 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-11-28T11:08:56.327 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:56.327 INFO:teuthology.orchestra.run.smithi125.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:08:56.327 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether e6:17:ca:a3:7e:44 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:08:56.327 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:08:56.327 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:56.327 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::e417:caff:fea3:7e44/64 scope link 2023-11-28T11:08:56.327 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:56.340 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-28T11:08:56.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:56.340 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:08:56.340 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:08:56.340 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-28T11:08:56.340 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T11:08:56.341 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-28T11:08:56.341 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-28T11:08:56.341 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-28T11:08:56.341 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:08:56.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:56.581 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:08:56.581 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:08:56.581 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.1 up 2023-11-28T11:08:56.581 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T11:08:56.581 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:08:56.695 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-28T11:08:56.696 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:08:56.696 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-28T11:08:56.718 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-28T11:08:56.718 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:08:56.718 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-28T11:08:56.774 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-11-28T11:08:56.843 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:08:56.843 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:08:56.909 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:08:56.910 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:08:56.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:56.911 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-28T11:08:56.968 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-11-28T11:08:56.969 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-11-28T11:08:56.969 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2 --client_mountpoint=/) 2023-11-28T11:08:57.010 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-11-28T11:08:57.042 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:08:57.042 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:08:57.097 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi125.stderr:2023-11-28T11:08:57.097+0000 7f004c2765c0 -1 init, newargv = 0x55e5d823abb0 newargc=15 2023-11-28T11:08:57.097 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi125.stderr:ceph-fuse[113478]: starting ceph client 2023-11-28T11:08:57.102 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi125.stderr:ceph-fuse[113478]: starting fuse 2023-11-28T11:08:57.110 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:08:57.111 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:08:57.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:57.112 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-28T11:08:57.169 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-11-28T11:08:57.169 INFO:teuthology.orchestra.run.smithi125.stdout:48 2023-11-28T11:08:57.169 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-11-28T11:08:57.169 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:08:57.169 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-11-28T11:08:57.169 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-11-28T11:08:57.170 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.2")) 2023-11-28T11:08:57.171 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:08:57.291 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.2.113478.asok 2023-11-28T11:08:57.474 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.113478.asok 2023-11-28T11:08:57.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:57.474 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.113478.asok status 2023-11-28T11:08:57.631 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:08:57.631 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-11-28T11:08:57.631 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:08:57.631 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:08:57.631 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "2", 2023-11-28T11:08:57.631 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-11-28T11:08:57.631 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-28T11:08:57.631 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "113478", 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4686, 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 4686 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-28T11:08:57.632 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-28T11:08:57.633 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.2:0", 2023-11-28T11:08:57.633 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 133274125 2023-11-28T11:08:57.633 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:08:57.633 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:08:57.633 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-28T11:08:57.633 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-28T11:08:57.633 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.2:0", 2023-11-28T11:08:57.633 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 133274125 2023-11-28T11:08:57.633 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:08:57.633 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.4686 192.168.0.2:0/133274125", 2023-11-28T11:08:57.633 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.2:0/133274125", 2023-11-28T11:08:57.634 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-11-28T11:08:57.634 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 7, 2023-11-28T11:08:57.634 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 24, 2023-11-28T11:08:57.634 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:08:57.634 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-11-28T11:08:57.634 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-11-28T11:08:57.634 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:08:57.641 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:08:57.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.760+0000 7f4981612700 1 Processor -- start 2023-11-28T11:08:57.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.760+0000 7f4981612700 1 -- start start 2023-11-28T11:08:57.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.760+0000 7f4981612700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f497c0d0c60 0x7f497c0b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:57.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f4981612700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f497c06e400 0x7f497c0d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:57.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f4981612700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c0d1570 con 0x7f497c160e70 2023-11-28T11:08:57.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f4981612700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c06e900 con 0x7f497c06e400 2023-11-28T11:08:57.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f4981612700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c160390 con 0x7f497c0d0c60 2023-11-28T11:08:57.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f497a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f497c06e400 0x7f497c0d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:57.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f497a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f497c06e400 0x7f497c0d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57506/0 (socket says 172.21.15.125:57506) 2023-11-28T11:08:57.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f497a7fc700 1 -- 172.21.15.125:0/3831754905 learned_addr learned my addr 172.21.15.125:0/3831754905 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:57.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f497affd700 1 --2- 172.21.15.125:0/3831754905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f497c0d0c60 0x7f497c0b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:57.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f497a7fc700 1 -- 172.21.15.125:0/3831754905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f497c0d0c60 msgr2=0x7f497c0b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:08:57.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f497a7fc700 1 --2- 172.21.15.125:0/3831754905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f497c0d0c60 0x7f497c0b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:57.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f497a7fc700 1 -- 172.21.15.125:0/3831754905 >> v1:172.21.15.167:6789/0 conn(0x7f497c160e70 legacy=0x7f497c06f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:57.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f497a7fc700 1 -- 172.21.15.125:0/3831754905 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c160670 con 0x7f497c06e400 2023-11-28T11:08:57.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f497a7fc700 1 --2- 172.21.15.125:0/3831754905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f497c06e400 0x7f497c0d1030 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f49700098f0 tx=0x7f4970009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460486bc0e4274c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:57.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f4979ffb700 1 -- 172.21.15.125:0/3831754905 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970011830 con 0x7f497c06e400 2023-11-28T11:08:57.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f4979ffb700 1 -- 172.21.15.125:0/3831754905 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970011990 con 0x7f497c06e400 2023-11-28T11:08:57.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.761+0000 7f4979ffb700 1 -- 172.21.15.125:0/3831754905 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970011d20 con 0x7f497c06e400 2023-11-28T11:08:57.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.762+0000 7f4981612700 1 -- 172.21.15.125:0/3831754905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f497c06e400 msgr2=0x7f497c0d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:57.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.762+0000 7f4981612700 1 --2- 172.21.15.125:0/3831754905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f497c06e400 0x7f497c0d1030 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f49700098f0 tx=0x7f4970009c00 comp rx=0 tx=0).stop 2023-11-28T11:08:57.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.762+0000 7f4981612700 1 -- 172.21.15.125:0/3831754905 shutdown_connections 2023-11-28T11:08:57.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.762+0000 7f4981612700 1 --2- 172.21.15.125:0/3831754905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f497c0d0c60 0x7f497c0b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:57.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.762+0000 7f4981612700 1 --2- 172.21.15.125:0/3831754905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f497c06e400 0x7f497c0d1030 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:57.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.762+0000 7f4981612700 1 -- 172.21.15.125:0/3831754905 >> 172.21.15.125:0/3831754905 conn(0x7f497c06a270 msgr2=0x7f497c06a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:57.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.762+0000 7f4981612700 1 -- 172.21.15.125:0/3831754905 shutdown_connections 2023-11-28T11:08:57.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.762+0000 7f4981612700 1 -- 172.21.15.125:0/3831754905 wait complete. 2023-11-28T11:08:57.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.763+0000 7f4981612700 1 Processor -- start 2023-11-28T11:08:57.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.763+0000 7f4981612700 1 -- start start 2023-11-28T11:08:57.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f4981612700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f497c06e400 0x7f497c157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:57.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f4981612700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f497c0d0c60 0x7f497c150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:57.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f4981612700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f497c160e70 0x7f497c0b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:57.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f4981612700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c155210 con 0x7f497c06e400 2023-11-28T11:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f4981612700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0b1030 con 0x7f497c0d0c60 2023-11-28T11:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f4981612700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c154f30 con 0x7f497c160e70 2023-11-28T11:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f497affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f497c06e400 0x7f497c157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f497affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f497c06e400 0x7f497c157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57512/0 (socket says 172.21.15.125:57512) 2023-11-28T11:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f497affd700 1 -- 172.21.15.125:0/1020567514 learned_addr learned my addr 172.21.15.125:0/1020567514 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f497b7fe700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f497c160e70 0x7f497c0b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f497a7fc700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f497c0d0c60 0x7f497c150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f497affd700 1 -- 172.21.15.125:0/1020567514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f497c160e70 msgr2=0x7f497c0b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f497affd700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f497c160e70 0x7f497c0b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f497affd700 1 -- 172.21.15.125:0/1020567514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f497c0d0c60 msgr2=0x7f497c150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f497affd700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f497c0d0c60 0x7f497c150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f497affd700 1 -- 172.21.15.125:0/1020567514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4970009550 con 0x7f497c06e400 2023-11-28T11:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.764+0000 7f497affd700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f497c06e400 0x7f497c157ca0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f496c00e9b0 tx=0x7f496c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.765+0000 7f49637fe700 1 -- 172.21.15.125:0/1020567514 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c009710 con 0x7f497c06e400 2023-11-28T11:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.765+0000 7f49637fe700 1 -- 172.21.15.125:0/1020567514 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c00ee50 con 0x7f497c06e400 2023-11-28T11:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.765+0000 7f4981612700 1 -- 172.21.15.125:0/1020567514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c0d0740 con 0x7f497c06e400 2023-11-28T11:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.765+0000 7f49637fe700 1 -- 172.21.15.125:0/1020567514 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c00ca50 con 0x7f497c06e400 2023-11-28T11:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.765+0000 7f4981612700 1 -- 172.21.15.125:0/1020567514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c160950 con 0x7f497c06e400 2023-11-28T11:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.766+0000 7f4981612700 1 -- 172.21.15.125:0/1020567514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c15d980 con 0x7f497c06e400 2023-11-28T11:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.766+0000 7f49637fe700 1 -- 172.21.15.125:0/1020567514 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f496c019030 con 0x7f497c06e400 2023-11-28T11:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.766+0000 7f49637fe700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f49680682f0 0x7f496806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.766+0000 7f49637fe700 1 -- 172.21.15.125:0/1020567514 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f496c085b80 con 0x7f497c06e400 2023-11-28T11:08:57.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.766+0000 7f497a7fc700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f49680682f0 0x7f496806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:08:57.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.767+0000 7f497a7fc700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f49680682f0 0x7f496806a7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f497c06e830 tx=0x7f4970008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:08:57.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:57.771+0000 7f49637fe700 1 -- 172.21.15.125:0/1020567514 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f496c052380 con 0x7f497c06e400 2023-11-28T11:08:58.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.002+0000 7f4981612700 1 -- 172.21.15.125:0/1020567514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f497c0743f0 con 0x7f497c06e400 2023-11-28T11:08:58.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.002+0000 7f49637fe700 1 -- 172.21.15.125:0/1020567514 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f496c017060 con 0x7f497c06e400 2023-11-28T11:08:58.003 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:08:58.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.004+0000 7f4981612700 1 -- 172.21.15.125:0/1020567514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f49680682f0 msgr2=0x7f496806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:58.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.005+0000 7f4981612700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f49680682f0 0x7f496806a7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f497c06e830 tx=0x7f4970008030 comp rx=0 tx=0).stop 2023-11-28T11:08:58.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.005+0000 7f4981612700 1 -- 172.21.15.125:0/1020567514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f497c06e400 msgr2=0x7f497c157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:08:58.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.005+0000 7f4981612700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f497c06e400 0x7f497c157ca0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f496c00e9b0 tx=0x7f496c00ecc0 comp rx=0 tx=0).stop 2023-11-28T11:08:58.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.005+0000 7f4981612700 1 -- 172.21.15.125:0/1020567514 shutdown_connections 2023-11-28T11:08:58.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.005+0000 7f4981612700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f49680682f0 0x7f496806a7a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:58.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.005+0000 7f4981612700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f497c160e70 0x7f497c0b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:58.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.005+0000 7f4981612700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f497c06e400 0x7f497c157ca0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:58.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.005+0000 7f4981612700 1 --2- 172.21.15.125:0/1020567514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f497c0d0c60 0x7f497c150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:08:58.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.005+0000 7f4981612700 1 -- 172.21.15.125:0/1020567514 >> 172.21.15.125:0/1020567514 conn(0x7f497c06a270 msgr2=0x7f497c15a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:08:58.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.005+0000 7f4981612700 1 -- 172.21.15.125:0/1020567514 shutdown_connections 2023-11-28T11:08:58.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:08:58.005+0000 7f4981612700 1 -- 172.21.15.125:0/1020567514 wait complete. 2023-11-28T11:08:58.017 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:08:58.017 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:08:58.017 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2023-11-28T11:08:58.017 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T11:08:58.017 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T11:08:58.018 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:08:58.018 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:08:58.018 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:08:58.018 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T11:08:58.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:58.018 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2023-11-28T11:08:58.040 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:08:58.040 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:08:58.040 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:08:58.040 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:58.040 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2023-11-28T11:08:58.040 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:58.040 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:08:58.040 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:58.040 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:08:58.041 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:58.041 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:08:58.041 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:58.041 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:08:58.041 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:08:58.041 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-28T11:08:58.041 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42344sec preferred_lft 42344sec 2023-11-28T11:08:58.041 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::64c5:f2ff:19b9:82ad/64 scope link noprefixroute 2023-11-28T11:08:58.041 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:08:58.041 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T11:08:58.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:58.042 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T11:08:58.042 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T11:08:58.043 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add name ceph-brx type bridge 2023-11-28T11:08:58.043 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr flush dev ceph-brx 2023-11-28T11:08:58.043 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set ceph-brx up 2023-11-28T11:08:58.043 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T11:08:58.043 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T11:08:58.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:58.226 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:08:58.254 INFO:teuthology.orchestra.run.smithi167.stdout:1 2023-11-28T11:08:58.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:58.255 DEBUG:teuthology.orchestra.run.smithi167:> route 2023-11-28T11:08:58.325 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2023-11-28T11:08:58.326 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:08:58.326 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T11:08:58.326 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T11:08:58.326 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:08:58.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:58.326 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T11:08:58.326 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T11:08:58.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T11:08:58.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T11:08:58.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T11:08:58.327 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T11:08:58.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:58.572 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-11-28T11:08:58.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:58.590 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2023-11-28T11:08:58.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:58.647 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T11:08:58.647 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T11:08:58.647 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T11:08:58.647 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-28T11:08:58.647 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T11:08:58.741 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-28T11:08:58.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:58.741 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T11:08:58.741 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T11:08:58.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-28T11:08:58.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T11:08:58.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-28T11:08:58.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-28T11:08:58.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-28T11:08:58.742 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T11:08:58.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:58.954 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T11:08:58.955 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T11:08:58.955 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2023-11-28T11:08:58.955 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T11:08:58.955 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T11:08:59.065 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-28T11:08:59.066 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:08:59.066 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T11:08:59.087 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T11:08:59.088 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:08:59.088 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T11:08:59.144 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-11-28T11:08:59.213 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:08:59.213 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:08:59.278 INFO:teuthology.orchestra.run.smithi167.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:08:59.279 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:08:59.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:59.280 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-11-28T11:08:59.337 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:08:59.338 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_mountpoint=/) 2023-11-28T11:08:59.381 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-11-28T11:08:59.407 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:08:59.407 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:08:59.473 INFO:teuthology.orchestra.run.smithi167.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:08:59.475 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:08:59.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:59.476 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-11-28T11:08:59.478 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi167.stderr:2023-11-28T11:08:59.478+0000 7f92df8705c0 -1 init, newargv = 0x55f6e2bbbfc0 newargc=15 2023-11-28T11:08:59.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi167.stderr:ceph-fuse[109960]: starting ceph client 2023-11-28T11:08:59.483 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi167.stderr:ceph-fuse[109960]: starting fuse 2023-11-28T11:08:59.497 INFO:teuthology.orchestra.run.smithi167.stdout:46 2023-11-28T11:08:59.497 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-11-28T11:08:59.497 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> import glob 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> import re 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> import os 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> import subprocess 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> def _find_admin_socket(client_name): 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> files = glob.glob(asok_path) 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> # Given a non-glob path, it better be there 2023-11-28T11:08:59.498 DEBUG:teuthology.orchestra.run.smithi167:> if "*" not in asok_path: 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> assert(len(files) == 1) 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> return files[0] 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> for f in files: 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> contents = proc_f.read() 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> if mountpoint in contents: 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> return f 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T11:08:59.499 DEBUG:teuthology.orchestra.run.smithi167:> print(_find_admin_socket("client.1")) 2023-11-28T11:08:59.500 DEBUG:teuthology.orchestra.run.smithi167:> ' 2023-11-28T11:08:59.621 INFO:teuthology.orchestra.run.smithi167.stdout:/var/run/ceph/ceph-client.1.109960.asok 2023-11-28T11:08:59.804 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.109960.asok 2023-11-28T11:08:59.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:08:59.804 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.109960.asok status 2023-11-28T11:08:59.962 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T11:08:59.962 INFO:teuthology.orchestra.run.smithi167.stdout: "metadata": { 2023-11-28T11:08:59.962 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:08:59.962 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:08:59.962 INFO:teuthology.orchestra.run.smithi167.stdout: "entity_id": "1", 2023-11-28T11:08:59.962 INFO:teuthology.orchestra.run.smithi167.stdout: "hostname": "smithi167", 2023-11-28T11:08:59.963 INFO:teuthology.orchestra.run.smithi167.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-28T11:08:59.963 INFO:teuthology.orchestra.run.smithi167.stdout: "pid": "109960", 2023-11-28T11:08:59.963 INFO:teuthology.orchestra.run.smithi167.stdout: "root": "/" 2023-11-28T11:08:59.963 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T11:08:59.963 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_count": 0, 2023-11-28T11:08:59.963 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_pinned_count": 0, 2023-11-28T11:08:59.963 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4615, 2023-11-28T11:08:59.963 INFO:teuthology.orchestra.run.smithi167.stdout: "inst": { 2023-11-28T11:08:59.963 INFO:teuthology.orchestra.run.smithi167.stdout: "name": { 2023-11-28T11:08:59.963 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "client", 2023-11-28T11:08:59.964 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4615 2023-11-28T11:08:59.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T11:08:59.964 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-11-28T11:08:59.964 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T11:08:59.964 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:08:59.964 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 107186176 2023-11-28T11:08:59.964 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T11:08:59.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T11:08:59.965 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-11-28T11:08:59.965 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T11:08:59.965 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:08:59.965 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 107186176 2023-11-28T11:08:59.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T11:08:59.965 INFO:teuthology.orchestra.run.smithi167.stdout: "inst_str": "client.4615 192.168.0.1:0/107186176", 2023-11-28T11:08:59.965 INFO:teuthology.orchestra.run.smithi167.stdout: "addr_str": "192.168.0.1:0/107186176", 2023-11-28T11:08:59.965 INFO:teuthology.orchestra.run.smithi167.stdout: "inode_count": 1, 2023-11-28T11:08:59.965 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_epoch": 7, 2023-11-28T11:08:59.966 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch": 24, 2023-11-28T11:08:59.966 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:08:59.966 INFO:teuthology.orchestra.run.smithi167.stdout: "blocklisted": false, 2023-11-28T11:08:59.966 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs" 2023-11-28T11:08:59.966 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T11:08:59.972 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:09:00.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.110+0000 7f12a15cd700 1 Processor -- start 2023-11-28T11:09:00.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.110+0000 7f12a15cd700 1 -- start start 2023-11-28T11:09:00.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.111+0000 7f12a15cd700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f129c0b22a0 0x7f129c0cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:00.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.111+0000 7f12a15cd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0d1ee0 con 0x7f129c06ab10 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.111+0000 7f12a15cd700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0cdb10 con 0x7f129c0cd5a0 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.111+0000 7f12a15cd700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129c0d1890 con 0x7f129c0b22a0 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.111+0000 7f129affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f129c06ab10 0x7f129c06aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41642/0 (socket says 172.21.15.125:41642) 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.111+0000 7f129affd700 1 -- 172.21.15.125:0/1104515899 learned_addr learned my addr 172.21.15.125:0/1104515899 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.111+0000 7f129b7fe700 1 --2- 172.21.15.125:0/1104515899 >> v2:172.21.15.167:3300/0 conn(0x7f129c0b22a0 0x7f129c0cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.111+0000 7f1299ffb700 1 -- 172.21.15.125:0/1104515899 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470687592 0 0) 0x7f129c0d1ee0 con 0x7f129c06ab10 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.111+0000 7f1299ffb700 1 -- 172.21.15.125:0/1104515899 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12840035b0 con 0x7f129c06ab10 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.111+0000 7f1299ffb700 1 -- 172.21.15.125:0/1104515899 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200071484 0 0) 0x7f129c0cdb10 con 0x7f129c0cd5a0 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.111+0000 7f1299ffb700 1 -- 172.21.15.125:0/1104515899 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f129c0d1ee0 con 0x7f129c0cd5a0 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f129b7fe700 1 -- 172.21.15.125:0/1104515899 >> v1:172.21.15.167:6789/0 conn(0x7f129c0cd5a0 legacy=0x7f129c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f129b7fe700 1 -- 172.21.15.125:0/1104515899 >> v1:172.21.15.125:6789/0 conn(0x7f129c06ab10 legacy=0x7f129c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:00.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f129b7fe700 1 -- 172.21.15.125:0/1104515899 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0d1b70 con 0x7f129c0b22a0 2023-11-28T11:09:00.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f129b7fe700 1 --2- 172.21.15.125:0/1104515899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c0b22a0 0x7f129c0cfb50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1294009d90 tx=0x7f129400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1eb5022d00700928 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:00.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f1299ffb700 1 -- 172.21.15.125:0/1104515899 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129400e070 con 0x7f129c0b22a0 2023-11-28T11:09:00.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f1299ffb700 1 -- 172.21.15.125:0/1104515899 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129400bb20 con 0x7f129c0b22a0 2023-11-28T11:09:00.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f1299ffb700 1 -- 172.21.15.125:0/1104515899 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294012430 con 0x7f129c0b22a0 2023-11-28T11:09:00.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f12a15cd700 1 -- 172.21.15.125:0/1104515899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c0b22a0 msgr2=0x7f129c0cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:00.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f12a15cd700 1 --2- 172.21.15.125:0/1104515899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c0b22a0 0x7f129c0cfb50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1294009d90 tx=0x7f129400b330 comp rx=0 tx=0).stop 2023-11-28T11:09:00.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f12a15cd700 1 -- 172.21.15.125:0/1104515899 shutdown_connections 2023-11-28T11:09:00.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f12a15cd700 1 --2- 172.21.15.125:0/1104515899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c0b22a0 0x7f129c0cfb50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:00.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.112+0000 7f12a15cd700 1 -- 172.21.15.125:0/1104515899 >> 172.21.15.125:0/1104515899 conn(0x7f129c06c520 msgr2=0x7f129c06c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:00.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.113+0000 7f12a15cd700 1 -- 172.21.15.125:0/1104515899 shutdown_connections 2023-11-28T11:09:00.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.113+0000 7f12a15cd700 1 -- 172.21.15.125:0/1104515899 wait complete. 2023-11-28T11:09:00.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.114+0000 7f12a15cd700 1 Processor -- start 2023-11-28T11:09:00.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.114+0000 7f12a15cd700 1 -- start start 2023-11-28T11:09:00.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.115+0000 7f12a15cd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f129c06ab10 0x7f129c1474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.115+0000 7f12a15cd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c0b22a0 0x7f129c147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.115+0000 7f12a15cd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f129c0cd5a0 0x7f129c157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.115+0000 7f12a15cd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0cb1b0 con 0x7f129c0cd5a0 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.115+0000 7f12a15cd700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0cb490 con 0x7f129c0b22a0 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.115+0000 7f12a15cd700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0cb770 con 0x7f129c06ab10 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.115+0000 7f129b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f129c0cd5a0 0x7f129c157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.115+0000 7f129b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f129c0cd5a0 0x7f129c157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57528/0 (socket says 172.21.15.125:57528) 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.115+0000 7f129b7fe700 1 -- 172.21.15.125:0/3149533484 learned_addr learned my addr 172.21.15.125:0/3149533484 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f129a7fc700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c0b22a0 0x7f129c147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f129affd700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f129c06ab10 0x7f129c1474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f129b7fe700 1 -- 172.21.15.125:0/3149533484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f129c06ab10 msgr2=0x7f129c1474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:00.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f129b7fe700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f129c06ab10 0x7f129c1474c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f129b7fe700 1 -- 172.21.15.125:0/3149533484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c0b22a0 msgr2=0x7f129c147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f129b7fe700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c0b22a0 0x7f129c147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f129b7fe700 1 -- 172.21.15.125:0/3149533484 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294009a70 con 0x7f129c0cd5a0 2023-11-28T11:09:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f129a7fc700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c0b22a0 0x7f129c147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f129b7fe700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f129c0cd5a0 0x7f129c157ed0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f129c06d0f0 tx=0x7f1294004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f12837fe700 1 -- 172.21.15.125:0/3149533484 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129401b810 con 0x7f129c0cd5a0 2023-11-28T11:09:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f12837fe700 1 -- 172.21.15.125:0/3149533484 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1294020070 con 0x7f129c0cd5a0 2023-11-28T11:09:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f12837fe700 1 -- 172.21.15.125:0/3149533484 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129401bbb0 con 0x7f129c0cd5a0 2023-11-28T11:09:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f12a15cd700 1 -- 172.21.15.125:0/3149533484 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c0b1ec0 con 0x7f129c0cd5a0 2023-11-28T11:09:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.116+0000 7f12a15cd700 1 -- 172.21.15.125:0/3149533484 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c15cad0 con 0x7f129c0cd5a0 2023-11-28T11:09:00.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.117+0000 7f12a15cd700 1 -- 172.21.15.125:0/3149533484 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c0b2050 con 0x7f129c0cd5a0 2023-11-28T11:09:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.118+0000 7f12837fe700 1 -- 172.21.15.125:0/3149533484 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f129402e070 con 0x7f129c0cd5a0 2023-11-28T11:09:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.118+0000 7f12837fe700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12880682f0 0x7f128806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.118+0000 7f12837fe700 1 -- 172.21.15.125:0/3149533484 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1294022070 con 0x7f129c0cd5a0 2023-11-28T11:09:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.118+0000 7f129affd700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12880682f0 0x7f128806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.118+0000 7f129affd700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12880682f0 0x7f128806a7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1290000f60 tx=0x7f1290009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.122+0000 7f12837fe700 1 -- 172.21.15.125:0/3149533484 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1294054530 con 0x7f129c0cd5a0 2023-11-28T11:09:00.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.348+0000 7f12a15cd700 1 -- 172.21.15.125:0/3149533484 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f129c0743f0 con 0x7f129c0cd5a0 2023-11-28T11:09:00.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.349+0000 7f12837fe700 1 -- 172.21.15.125:0/3149533484 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f129402c020 con 0x7f129c0cd5a0 2023-11-28T11:09:00.349 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:09:00.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 -- 172.21.15.125:0/3149533484 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12880682f0 msgr2=0x7f128806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12880682f0 0x7f128806a7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1290000f60 tx=0x7f1290009040 comp rx=0 tx=0).stop 2023-11-28T11:09:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 -- 172.21.15.125:0/3149533484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f129c0cd5a0 msgr2=0x7f129c157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f129c0cd5a0 0x7f129c157ed0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f129c06d0f0 tx=0x7f1294004ad0 comp rx=0 tx=0).stop 2023-11-28T11:09:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 -- 172.21.15.125:0/3149533484 shutdown_connections 2023-11-28T11:09:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f129c0cd5a0 0x7f129c157ed0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12880682f0 0x7f128806a7a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f129c06ab10 0x7f129c1474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 --2- 172.21.15.125:0/3149533484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c0b22a0 0x7f129c147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 -- 172.21.15.125:0/3149533484 >> 172.21.15.125:0/3149533484 conn(0x7f129c06c520 msgr2=0x7f129c0b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:00.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 -- 172.21.15.125:0/3149533484 shutdown_connections 2023-11-28T11:09:00.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:00.351+0000 7f12a15cd700 1 -- 172.21.15.125:0/3149533484 wait complete. 2023-11-28T11:09:00.363 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:09:00.364 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:09:00.364 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2023-11-28T11:09:00.364 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-28T11:09:00.364 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T11:09:00.364 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:09:00.364 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:09:00.365 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:09:00.365 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-28T11:09:00.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:00.365 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2023-11-28T11:09:00.383 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:09:00.383 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:09:00.383 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:09:00.383 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.383 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2023-11-28T11:09:00.383 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.383 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:09:00.383 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:09:00.383 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:09:00.384 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:09:00.384 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:09:00.384 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:09:00.384 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:09:00.384 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:09:00.384 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-28T11:09:00.384 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42341sec preferred_lft 42341sec 2023-11-28T11:09:00.384 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::64c5:f2ff:19b9:82ad/64 scope link noprefixroute 2023-11-28T11:09:00.384 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.384 INFO:teuthology.orchestra.run.smithi167.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:09:00.384 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 72:c8:10:96:1b:3e brd ff:ff:ff:ff:ff:ff 2023-11-28T11:09:00.385 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:09:00.385 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.385 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::f05c:60ff:fe76:8c/64 scope link 2023-11-28T11:09:00.385 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.385 INFO:teuthology.orchestra.run.smithi167.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:09:00.385 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 72:c8:10:96:1b:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T11:09:00.385 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::70c8:10ff:fe96:1b3e/64 scope link tentative 2023-11-28T11:09:00.385 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:00.385 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:09:00.449 INFO:teuthology.orchestra.run.smithi167.stdout:1 2023-11-28T11:09:00.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:00.451 DEBUG:teuthology.orchestra.run.smithi167:> route 2023-11-28T11:09:00.509 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2023-11-28T11:09:00.509 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:09:00.510 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T11:09:00.510 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T11:09:00.510 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:09:00.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:00.510 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T11:09:00.510 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T11:09:00.510 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T11:09:00.510 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T11:09:00.511 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T11:09:00.511 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T11:09:00.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:00.615 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-11-28T11:09:00.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T11:09:00.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:00.632 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2023-11-28T11:09:00.688 INFO:teuthology.orchestra.run.smithi167.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-28T11:09:00.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:00.688 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T11:09:00.689 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T11:09:00.689 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T11:09:00.689 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-28T11:09:00.689 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T11:09:00.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:00.781 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T11:09:00.824 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:09:00.824 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:09:00.824 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:09:00.824 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.824 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2023-11-28T11:09:00.824 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.824 INFO:teuthology.orchestra.run.smithi167.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:09:00.825 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether d6:8c:70:64:f9:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:09:00.825 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:09:00.825 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.825 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::d48c:70ff:fe64:f92a/64 scope link 2023-11-28T11:09:00.825 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:00.838 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T11:09:00.912 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:09:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:09:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:09:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2023-11-28T11:09:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.913 INFO:teuthology.orchestra.run.smithi167.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:09:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether d6:8c:70:64:f9:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:09:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:09:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::d48c:70ff:fe64:f92a/64 scope link 2023-11-28T11:09:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:00.925 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-28T11:09:00.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:00.925 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T11:09:00.926 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T11:09:00.926 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-28T11:09:00.926 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T11:09:00.926 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-28T11:09:00.926 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-28T11:09:00.926 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-28T11:09:00.926 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T11:09:01.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:01.177 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T11:09:01.177 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T11:09:01.177 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.1 up 2023-11-28T11:09:01.177 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T11:09:01.177 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T11:09:01.286 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-28T11:09:01.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:09:01.286 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-28T11:09:01.305 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-28T11:09:01.306 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:09:01.306 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-28T11:09:01.362 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-11-28T11:09:01.429 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:09:01.429 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:09:01.494 INFO:teuthology.orchestra.run.smithi167.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:09:01.495 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:09:01.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:01.496 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-11-28T11:09:01.553 INFO:teuthology.orchestra.run.smithi167.stdout:46 2023-11-28T11:09:01.553 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-11-28T11:09:01.554 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3 --client_mountpoint=/) 2023-11-28T11:09:01.597 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-11-28T11:09:01.623 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:09:01.624 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:09:01.683 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi167.stderr:2023-11-28T11:09:01.682+0000 7f02686605c0 -1 init, newargv = 0x55b470cfa0e0 newargc=15 2023-11-28T11:09:01.684 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi167.stderr:ceph-fuse[110555]: starting ceph client 2023-11-28T11:09:01.688 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi167.stderr:ceph-fuse[110555]: starting fuse 2023-11-28T11:09:01.691 INFO:teuthology.orchestra.run.smithi167.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:09:01.692 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:09:01.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:01.694 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-11-28T11:09:01.750 INFO:teuthology.orchestra.run.smithi167.stdout:46 2023-11-28T11:09:01.751 INFO:teuthology.orchestra.run.smithi167.stdout:48 2023-11-28T11:09:01.751 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-11-28T11:09:01.751 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:09:01.751 DEBUG:teuthology.orchestra.run.smithi167:> import glob 2023-11-28T11:09:01.751 DEBUG:teuthology.orchestra.run.smithi167:> import re 2023-11-28T11:09:01.751 DEBUG:teuthology.orchestra.run.smithi167:> import os 2023-11-28T11:09:01.751 DEBUG:teuthology.orchestra.run.smithi167:> import subprocess 2023-11-28T11:09:01.751 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> def _find_admin_socket(client_name): 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> files = glob.glob(asok_path) 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> # Given a non-glob path, it better be there 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> if "*" not in asok_path: 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> assert(len(files) == 1) 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> return files[0] 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> for f in files: 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:09:01.752 DEBUG:teuthology.orchestra.run.smithi167:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:09:01.753 DEBUG:teuthology.orchestra.run.smithi167:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:09:01.753 DEBUG:teuthology.orchestra.run.smithi167:> contents = proc_f.read() 2023-11-28T11:09:01.753 DEBUG:teuthology.orchestra.run.smithi167:> if mountpoint in contents: 2023-11-28T11:09:01.753 DEBUG:teuthology.orchestra.run.smithi167:> return f 2023-11-28T11:09:01.753 DEBUG:teuthology.orchestra.run.smithi167:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:09:01.753 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T11:09:01.753 DEBUG:teuthology.orchestra.run.smithi167:> print(_find_admin_socket("client.3")) 2023-11-28T11:09:01.753 DEBUG:teuthology.orchestra.run.smithi167:> ' 2023-11-28T11:09:01.873 INFO:teuthology.orchestra.run.smithi167.stdout:/var/run/ceph/ceph-client.3.110555.asok 2023-11-28T11:09:02.055 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.110555.asok 2023-11-28T11:09:02.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:02.055 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.110555.asok status 2023-11-28T11:09:02.212 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T11:09:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "metadata": { 2023-11-28T11:09:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:09:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:09:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "entity_id": "3", 2023-11-28T11:09:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "hostname": "smithi167", 2023-11-28T11:09:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-28T11:09:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "pid": "110555", 2023-11-28T11:09:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "root": "/" 2023-11-28T11:09:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_count": 0, 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_pinned_count": 0, 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4499, 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "inst": { 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "name": { 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "client", 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4499 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.2:0", 2023-11-28T11:09:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 42553491 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.2:0", 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 42553491 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "inst_str": "client.4499 192.168.0.2:0/42553491", 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "addr_str": "192.168.0.2:0/42553491", 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "inode_count": 1, 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_epoch": 7, 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch": 24, 2023-11-28T11:09:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:09:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "blocklisted": false, 2023-11-28T11:09:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs" 2023-11-28T11:09:02.215 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T11:09:02.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:02.222 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-11-28T11:09:02.222 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T11:09:02.243 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-11-28T11:09:02.243 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T11:09:02.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:02.244 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:09:02.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:02.319 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-11-28T11:09:02.319 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-28T11:09:02.380 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-11-28T11:09:02.380 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-28T11:09:02.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:02.381 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-28T11:09:02.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:02.455 DEBUG:teuthology.orchestra.run.smithi167:> stat --file-system '--printf=%T 2023-11-28T11:09:02.455 DEBUG:teuthology.orchestra.run.smithi167:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-28T11:09:02.472 INFO:teuthology.orchestra.run.smithi167.stdout:fuseblk 2023-11-28T11:09:02.472 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-28T11:09:02.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:02.473 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T11:09:02.526 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:09:02.529 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:09:02.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:02.539 DEBUG:teuthology.orchestra.run.smithi167:> stat --file-system '--printf=%T 2023-11-28T11:09:02.539 DEBUG:teuthology.orchestra.run.smithi167:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-28T11:09:02.597 INFO:teuthology.orchestra.run.smithi167.stdout:fuseblk 2023-11-28T11:09:02.597 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-28T11:09:02.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:02.597 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-28T11:09:02.702 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T11:09:02.821 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:02.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.956+0000 7f251feda700 1 Processor -- start 2023-11-28T11:09:02.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.956+0000 7f251feda700 1 -- start start 2023-11-28T11:09:02.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.957+0000 7f251feda700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f251806a270 0x7f251806a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:02.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.957+0000 7f251feda700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251806ab80 con 0x7f251815cc80 2023-11-28T11:09:02.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.957+0000 7f251feda700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180b1810 con 0x7f251806e570 2023-11-28T11:09:02.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.957+0000 7f251feda700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180b2490 con 0x7f251806a270 2023-11-28T11:09:02.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.957+0000 7f251d475700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f251815cc80 0x7f251806de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41658/0 (socket says 172.21.15.125:41658) 2023-11-28T11:09:02.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.957+0000 7f251d475700 1 -- 172.21.15.125:0/3366461987 learned_addr learned my addr 172.21.15.125:0/3366461987 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:02.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.957+0000 7f251dc76700 1 --2- 172.21.15.125:0/3366461987 >> v2:172.21.15.167:3300/0 conn(0x7f251806a270 0x7f251806a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:02.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.957+0000 7f251cc74700 1 -- 172.21.15.125:0/3366461987 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511900482 0 0) 0x7f251806ab80 con 0x7f251815cc80 2023-11-28T11:09:02.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.957+0000 7f251cc74700 1 -- 172.21.15.125:0/3366461987 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25040035b0 con 0x7f251815cc80 2023-11-28T11:09:02.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.957+0000 7f251cc74700 1 -- 172.21.15.125:0/3366461987 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253663536 0 0) 0x7f25180b1810 con 0x7f251806e570 2023-11-28T11:09:02.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.958+0000 7f251cc74700 1 -- 172.21.15.125:0/3366461987 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f251806ab80 con 0x7f251806e570 2023-11-28T11:09:02.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.958+0000 7f251dc76700 1 -- 172.21.15.125:0/3366461987 >> v1:172.21.15.167:6789/0 conn(0x7f251806e570 legacy=0x7f2518070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:02.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.958+0000 7f251dc76700 1 -- 172.21.15.125:0/3366461987 >> v1:172.21.15.125:6789/0 conn(0x7f251815cc80 legacy=0x7f251806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:02.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.958+0000 7f251dc76700 1 -- 172.21.15.125:0/3366461987 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180b1af0 con 0x7f251806a270 2023-11-28T11:09:02.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.958+0000 7f251dc76700 1 --2- 172.21.15.125:0/3366461987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f251806a270 0x7f251806a640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2508009840 tx=0x7f2508009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eef0ecc45af5b2f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:02.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.958+0000 7f251cc74700 1 -- 172.21.15.125:0/3366461987 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508011830 con 0x7f251806a270 2023-11-28T11:09:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.958+0000 7f251cc74700 1 -- 172.21.15.125:0/3366461987 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508011990 con 0x7f251806a270 2023-11-28T11:09:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.958+0000 7f251cc74700 1 -- 172.21.15.125:0/3366461987 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508011d20 con 0x7f251806a270 2023-11-28T11:09:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.958+0000 7f251feda700 1 -- 172.21.15.125:0/3366461987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f251806a270 msgr2=0x7f251806a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.958+0000 7f251feda700 1 --2- 172.21.15.125:0/3366461987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f251806a270 0x7f251806a640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2508009840 tx=0x7f2508009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.959+0000 7f251feda700 1 -- 172.21.15.125:0/3366461987 shutdown_connections 2023-11-28T11:09:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.959+0000 7f251feda700 1 --2- 172.21.15.125:0/3366461987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f251806a270 0x7f251806a640 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.959+0000 7f251feda700 1 -- 172.21.15.125:0/3366461987 >> 172.21.15.125:0/3366461987 conn(0x7f251806c010 msgr2=0x7f25180cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.959+0000 7f251feda700 1 -- 172.21.15.125:0/3366461987 shutdown_connections 2023-11-28T11:09:02.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.959+0000 7f251feda700 1 -- 172.21.15.125:0/3366461987 wait complete. 2023-11-28T11:09:02.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.960+0000 7f251feda700 1 Processor -- start 2023-11-28T11:09:02.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.960+0000 7f251feda700 1 -- start start 2023-11-28T11:09:02.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.960+0000 7f251feda700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f251806a270 0x7f25180b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:02.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.960+0000 7f251feda700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f251806e570 0x7f2518149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:02.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251feda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f251815cc80 0x7f2518154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:02.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251feda700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180b4dc0 con 0x7f251815cc80 2023-11-28T11:09:02.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251feda700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2518153e00 con 0x7f251806e570 2023-11-28T11:09:02.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251feda700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25181540e0 con 0x7f251806a270 2023-11-28T11:09:02.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251e477700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f251815cc80 0x7f2518154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:02.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251e477700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f251815cc80 0x7f2518154bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57542/0 (socket says 172.21.15.125:57542) 2023-11-28T11:09:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251e477700 1 -- 172.21.15.125:0/1450761295 learned_addr learned my addr 172.21.15.125:0/1450761295 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251d475700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f251806e570 0x7f2518149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251dc76700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f251806a270 0x7f25180b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:02.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251e477700 1 -- 172.21.15.125:0/1450761295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f251806a270 msgr2=0x7f25180b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251e477700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f251806a270 0x7f25180b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251e477700 1 -- 172.21.15.125:0/1450761295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f251806e570 msgr2=0x7f2518149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251e477700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f251806e570 0x7f2518149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:02.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251e477700 1 -- 172.21.15.125:0/1450761295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25080094a0 con 0x7f251815cc80 2023-11-28T11:09:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251dc76700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f251806a270 0x7f25180b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251e477700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f251815cc80 0x7f2518154bc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f251000cbc0 tx=0x7f251000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f250e7fc700 1 -- 172.21.15.125:0/1450761295 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510003c00 con 0x7f251815cc80 2023-11-28T11:09:02.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f250e7fc700 1 -- 172.21.15.125:0/1450761295 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2510003d60 con 0x7f251815cc80 2023-11-28T11:09:02.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251feda700 1 -- 172.21.15.125:0/1450761295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25180b20b0 con 0x7f251815cc80 2023-11-28T11:09:02.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f250e7fc700 1 -- 172.21.15.125:0/1450761295 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251000ab00 con 0x7f251815cc80 2023-11-28T11:09:02.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.961+0000 7f251feda700 1 -- 172.21.15.125:0/1450761295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25180b1dd0 con 0x7f251815cc80 2023-11-28T11:09:02.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.962+0000 7f251feda700 1 -- 172.21.15.125:0/1450761295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251815daa0 con 0x7f251815cc80 2023-11-28T11:09:02.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.963+0000 7f250e7fc700 1 -- 172.21.15.125:0/1450761295 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2510010050 con 0x7f251815cc80 2023-11-28T11:09:02.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.963+0000 7f250e7fc700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24fc0682f0 0x7f24fc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:02.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.963+0000 7f250e7fc700 1 -- 172.21.15.125:0/1450761295 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2510085b80 con 0x7f251815cc80 2023-11-28T11:09:02.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.963+0000 7f251dc76700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24fc0682f0 0x7f24fc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:02.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.963+0000 7f251dc76700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24fc0682f0 0x7f24fc06a7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2508009fd0 tx=0x7f250801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:02.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:02.967+0000 7f250e7fc700 1 -- 172.21.15.125:0/1450761295 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f25100523e0 con 0x7f251815cc80 2023-11-28T11:09:03.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.154+0000 7f251feda700 1 -- 172.21.15.125:0/1450761295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25180743f0 con 0x7f251815cc80 2023-11-28T11:09:03.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.155+0000 7f250e7fc700 1 -- 172.21.15.125:0/1450761295 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f2510055a00 con 0x7f251815cc80 2023-11-28T11:09:03.157 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:03.157 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:03.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.157+0000 7f251feda700 1 -- 172.21.15.125:0/1450761295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24fc0682f0 msgr2=0x7f24fc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.157+0000 7f251feda700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24fc0682f0 0x7f24fc06a7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2508009fd0 tx=0x7f250801c040 comp rx=0 tx=0).stop 2023-11-28T11:09:03.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.157+0000 7f251feda700 1 -- 172.21.15.125:0/1450761295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f251815cc80 msgr2=0x7f2518154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.157+0000 7f251feda700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f251815cc80 0x7f2518154bc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f251000cbc0 tx=0x7f251000ced0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.158+0000 7f251feda700 1 -- 172.21.15.125:0/1450761295 shutdown_connections 2023-11-28T11:09:03.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.158+0000 7f251feda700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f251815cc80 0x7f2518154bc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.158+0000 7f251feda700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24fc0682f0 0x7f24fc06a7a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.158+0000 7f251feda700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f251806a270 0x7f25180b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.158+0000 7f251feda700 1 --2- 172.21.15.125:0/1450761295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f251806e570 0x7f2518149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.158+0000 7f251feda700 1 -- 172.21.15.125:0/1450761295 >> 172.21.15.125:0/1450761295 conn(0x7f251806c010 msgr2=0x7f2518070c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:03.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.158+0000 7f251feda700 1 -- 172.21.15.125:0/1450761295 shutdown_connections 2023-11-28T11:09:03.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.158+0000 7f251feda700 1 -- 172.21.15.125:0/1450761295 wait complete. 2023-11-28T11:09:03.171 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:03.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:03.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.293+0000 7f51e069d700 1 Processor -- start 2023-11-28T11:09:03.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.293+0000 7f51e069d700 1 -- start start 2023-11-28T11:09:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51e069d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51d815c810 0x7f51d8160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51e069d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51d80718e0 0x7f51d806c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51e069d700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d81607a0 con 0x7f51d806cdc0 2023-11-28T11:09:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51e069d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d815cbe0 con 0x7f51d80718e0 2023-11-28T11:09:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51e069d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d8160a50 con 0x7f51d815c810 2023-11-28T11:09:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51ddc38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51d80718e0 0x7f51d806c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51ddc38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51d80718e0 0x7f51d806c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57546/0 (socket says 172.21.15.125:57546) 2023-11-28T11:09:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51ddc38700 1 -- 172.21.15.125:0/3083438657 learned_addr learned my addr 172.21.15.125:0/3083438657 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51ddc38700 1 -- 172.21.15.125:0/3083438657 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51d815c810 msgr2=0x7f51d8160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51de439700 1 --2- 172.21.15.125:0/3083438657 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51d815c810 0x7f51d8160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51ddc38700 1 --2- 172.21.15.125:0/3083438657 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51d815c810 0x7f51d8160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51ddc38700 1 -- 172.21.15.125:0/3083438657 >> v1:172.21.15.167:6789/0 conn(0x7f51d806cdc0 legacy=0x7f51d806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51ddc38700 1 -- 172.21.15.125:0/3083438657 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8160d30 con 0x7f51d80718e0 2023-11-28T11:09:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.294+0000 7f51ddc38700 1 --2- 172.21.15.125:0/3083438657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d80718e0 0x7f51d806c880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f51c80098f0 tx=0x7f51c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690d96eb522994ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.295+0000 7f51dd437700 1 -- 172.21.15.125:0/3083438657 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c8004230 con 0x7f51d80718e0 2023-11-28T11:09:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.295+0000 7f51dd437700 1 -- 172.21.15.125:0/3083438657 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c8004390 con 0x7f51d80718e0 2023-11-28T11:09:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.295+0000 7f51dd437700 1 -- 172.21.15.125:0/3083438657 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c80036a0 con 0x7f51d80718e0 2023-11-28T11:09:03.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.295+0000 7f51e069d700 1 -- 172.21.15.125:0/3083438657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d80718e0 msgr2=0x7f51d806c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.295+0000 7f51e069d700 1 --2- 172.21.15.125:0/3083438657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d80718e0 0x7f51d806c880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f51c80098f0 tx=0x7f51c8009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:03.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.295+0000 7f51e069d700 1 -- 172.21.15.125:0/3083438657 shutdown_connections 2023-11-28T11:09:03.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.295+0000 7f51e069d700 1 --2- 172.21.15.125:0/3083438657 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51d815c810 0x7f51d8160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.295+0000 7f51e069d700 1 --2- 172.21.15.125:0/3083438657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d80718e0 0x7f51d806c880 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.295+0000 7f51e069d700 1 -- 172.21.15.125:0/3083438657 >> 172.21.15.125:0/3083438657 conn(0x7f51d806c010 msgr2=0x7f51d80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:03.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.295+0000 7f51e069d700 1 -- 172.21.15.125:0/3083438657 shutdown_connections 2023-11-28T11:09:03.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.295+0000 7f51e069d700 1 -- 172.21.15.125:0/3083438657 wait complete. 2023-11-28T11:09:03.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.296+0000 7f51e069d700 1 Processor -- start 2023-11-28T11:09:03.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.296+0000 7f51e069d700 1 -- start start 2023-11-28T11:09:03.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51e069d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d806cdc0 0x7f51d80c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51e069d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51d80718e0 0x7f51d80b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51e069d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51d815c810 0x7f51d8156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51e069d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80c6590 con 0x7f51d806cdc0 2023-11-28T11:09:03.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51e069d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80b2670 con 0x7f51d80718e0 2023-11-28T11:09:03.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51e069d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80c8dc0 con 0x7f51d815c810 2023-11-28T11:09:03.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51de439700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d806cdc0 0x7f51d80c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51de439700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d806cdc0 0x7f51d80c5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57550/0 (socket says 172.21.15.125:57550) 2023-11-28T11:09:03.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51de439700 1 -- 172.21.15.125:0/1865485247 learned_addr learned my addr 172.21.15.125:0/1865485247 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:03.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51de439700 1 -- 172.21.15.125:0/1865485247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51d815c810 msgr2=0x7f51d8156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51de439700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51d815c810 0x7f51d8156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51de439700 1 -- 172.21.15.125:0/1865485247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51d80718e0 msgr2=0x7f51d80b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51de439700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51d80718e0 0x7f51d80b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.297+0000 7f51de439700 1 -- 172.21.15.125:0/1865485247 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c8009550 con 0x7f51d806cdc0 2023-11-28T11:09:03.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.298+0000 7f51de439700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d806cdc0 0x7f51d80c5f60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c7f0 tx=0x7f51d400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:03.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.298+0000 7f51ceffd700 1 -- 172.21.15.125:0/1865485247 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4011800 con 0x7f51d806cdc0 2023-11-28T11:09:03.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.298+0000 7f51ceffd700 1 -- 172.21.15.125:0/1865485247 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d4011960 con 0x7f51d806cdc0 2023-11-28T11:09:03.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.298+0000 7f51ceffd700 1 -- 172.21.15.125:0/1865485247 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4011d10 con 0x7f51d806cdc0 2023-11-28T11:09:03.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.298+0000 7f51e069d700 1 -- 172.21.15.125:0/1865485247 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d80ceb20 con 0x7f51d806cdc0 2023-11-28T11:09:03.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.298+0000 7f51e069d700 1 -- 172.21.15.125:0/1865485247 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d8161010 con 0x7f51d806cdc0 2023-11-28T11:09:03.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.299+0000 7f51e069d700 1 -- 172.21.15.125:0/1865485247 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d80ce740 con 0x7f51d806cdc0 2023-11-28T11:09:03.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.299+0000 7f51ceffd700 1 -- 172.21.15.125:0/1865485247 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f51d4021070 con 0x7f51d806cdc0 2023-11-28T11:09:03.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.299+0000 7f51ceffd700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51bc0682f0 0x7f51bc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.300+0000 7f51ceffd700 1 -- 172.21.15.125:0/1865485247 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51d4085b20 con 0x7f51d806cdc0 2023-11-28T11:09:03.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.300+0000 7f51ddc38700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51bc0682f0 0x7f51bc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.300+0000 7f51ddc38700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51bc0682f0 0x7f51bc06a7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f51d80ccd80 tx=0x7f51c8010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:03.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.304+0000 7f51ceffd700 1 -- 172.21.15.125:0/1865485247 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f51d40522f0 con 0x7f51d806cdc0 2023-11-28T11:09:03.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.485+0000 7f51e069d700 1 -- 172.21.15.125:0/1865485247 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51d8068450 con 0x7f51d806cdc0 2023-11-28T11:09:03.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.485+0000 7f51ceffd700 1 -- 172.21.15.125:0/1865485247 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51d401f070 con 0x7f51d806cdc0 2023-11-28T11:09:03.487 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:03.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 -- 172.21.15.125:0/1865485247 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51bc0682f0 msgr2=0x7f51bc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51bc0682f0 0x7f51bc06a7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f51d80ccd80 tx=0x7f51c8010000 comp rx=0 tx=0).stop 2023-11-28T11:09:03.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 -- 172.21.15.125:0/1865485247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d806cdc0 msgr2=0x7f51d80c5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d806cdc0 0x7f51d80c5f60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c7f0 tx=0x7f51d400cbb0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 -- 172.21.15.125:0/1865485247 shutdown_connections 2023-11-28T11:09:03.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51bc0682f0 0x7f51bc06a7a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51d815c810 0x7f51d8156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51d806cdc0 0x7f51d80c5f60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 --2- 172.21.15.125:0/1865485247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51d80718e0 0x7f51d80b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 -- 172.21.15.125:0/1865485247 >> 172.21.15.125:0/1865485247 conn(0x7f51d806c010 msgr2=0x7f51d80cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:03.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 -- 172.21.15.125:0/1865485247 shutdown_connections 2023-11-28T11:09:03.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.487+0000 7f51e069d700 1 -- 172.21.15.125:0/1865485247 wait complete. 2023-11-28T11:09:03.501 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:03.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.621+0000 7f7962105700 1 Processor -- start 2023-11-28T11:09:03.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.621+0000 7f7962105700 1 -- start start 2023-11-28T11:09:03.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.622+0000 7f7962105700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f795c15c810 0x7f795c160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.622+0000 7f7962105700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795c0718e0 0x7f795c06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.622+0000 7f7962105700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f795c06cdc0 0x7f795c06a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.622+0000 7f7962105700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c15cbe0 con 0x7f795c06cdc0 2023-11-28T11:09:03.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.622+0000 7f7962105700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c1607a0 con 0x7f795c15c810 2023-11-28T11:09:03.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.622+0000 7f7962105700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c160a50 con 0x7f795c0718e0 2023-11-28T11:09:03.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.622+0000 7f795bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f795c06cdc0 0x7f795c06a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.622+0000 7f795affd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795c0718e0 0x7f795c06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.622+0000 7f795bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f795c06cdc0 0x7f795c06a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57562/0 (socket says 172.21.15.125:57562) 2023-11-28T11:09:03.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.622+0000 7f795bfff700 1 -- 172.21.15.125:0/3305834691 learned_addr learned my addr 172.21.15.125:0/3305834691 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:03.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.622+0000 7f795b7fe700 1 --2- 172.21.15.125:0/3305834691 >> v2:172.21.15.167:3300/0 conn(0x7f795c15c810 0x7f795c160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f795bfff700 1 -- 172.21.15.125:0/3305834691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795c0718e0 msgr2=0x7f795c06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:03.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f795bfff700 1 --2- 172.21.15.125:0/3305834691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795c0718e0 0x7f795c06c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f795bfff700 1 -- 172.21.15.125:0/3305834691 >> v2:172.21.15.167:3300/0 conn(0x7f795c15c810 msgr2=0x7f795c160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:03.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f795bfff700 1 --2- 172.21.15.125:0/3305834691 >> v2:172.21.15.167:3300/0 conn(0x7f795c15c810 0x7f795c160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f795bfff700 1 -- 172.21.15.125:0/3305834691 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c160d30 con 0x7f795c06cdc0 2023-11-28T11:09:03.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f795bfff700 1 --2- 172.21.15.125:0/3305834691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f795c06cdc0 0x7f795c06a270 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f795c0b27c0 tx=0x7f795400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104efac421271b09 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:03.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f795a7fc700 1 -- 172.21.15.125:0/3305834691 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795400e070 con 0x7f795c06cdc0 2023-11-28T11:09:03.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f795a7fc700 1 -- 172.21.15.125:0/3305834691 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795400b910 con 0x7f795c06cdc0 2023-11-28T11:09:03.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f795a7fc700 1 -- 172.21.15.125:0/3305834691 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795400bcc0 con 0x7f795c06cdc0 2023-11-28T11:09:03.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f7962105700 1 -- 172.21.15.125:0/3305834691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f795c06cdc0 msgr2=0x7f795c06a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f7962105700 1 --2- 172.21.15.125:0/3305834691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f795c06cdc0 0x7f795c06a270 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f795c0b27c0 tx=0x7f795400b330 comp rx=0 tx=0).stop 2023-11-28T11:09:03.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f7962105700 1 -- 172.21.15.125:0/3305834691 shutdown_connections 2023-11-28T11:09:03.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f7962105700 1 --2- 172.21.15.125:0/3305834691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f795c06cdc0 0x7f795c06a270 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f7962105700 1 --2- 172.21.15.125:0/3305834691 >> v2:172.21.15.167:3300/0 conn(0x7f795c15c810 0x7f795c160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f7962105700 1 --2- 172.21.15.125:0/3305834691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795c0718e0 0x7f795c06c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f7962105700 1 -- 172.21.15.125:0/3305834691 >> 172.21.15.125:0/3305834691 conn(0x7f795c06c010 msgr2=0x7f795c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:03.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.623+0000 7f7962105700 1 -- 172.21.15.125:0/3305834691 shutdown_connections 2023-11-28T11:09:03.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.624+0000 7f7962105700 1 -- 172.21.15.125:0/3305834691 wait complete. 2023-11-28T11:09:03.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.625+0000 7f7962105700 1 Processor -- start 2023-11-28T11:09:03.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.625+0000 7f7962105700 1 -- start start 2023-11-28T11:09:03.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f7962105700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795c06cdc0 0x7f795c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f7962105700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f795c0718e0 0x7f795c14e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f7962105700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f795c15c810 0x7f795c153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f7962105700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c0b3f50 con 0x7f795c15c810 2023-11-28T11:09:03.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f7962105700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c0b4230 con 0x7f795c0718e0 2023-11-28T11:09:03.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f7962105700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c0b4510 con 0x7f795c06cdc0 2023-11-28T11:09:03.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f795bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f795c15c810 0x7f795c153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f795bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f795c15c810 0x7f795c153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57568/0 (socket says 172.21.15.125:57568) 2023-11-28T11:09:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f795bfff700 1 -- 172.21.15.125:0/1609129359 learned_addr learned my addr 172.21.15.125:0/1609129359 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f795b7fe700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795c06cdc0 0x7f795c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f795bfff700 1 -- 172.21.15.125:0/1609129359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795c06cdc0 msgr2=0x7f795c157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f795affd700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f795c0718e0 0x7f795c14e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f795bfff700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795c06cdc0 0x7f795c157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f795bfff700 1 -- 172.21.15.125:0/1609129359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f795c0718e0 msgr2=0x7f795c14e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f795bfff700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f795c0718e0 0x7f795c14e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f795bfff700 1 -- 172.21.15.125:0/1609129359 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954009b30 con 0x7f795c15c810 2023-11-28T11:09:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f795bfff700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f795c15c810 0x7f795c153de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7954012000 tx=0x7f7954004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f7943fff700 1 -- 172.21.15.125:0/1609129359 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795400ce80 con 0x7f795c15c810 2023-11-28T11:09:03.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f7943fff700 1 -- 172.21.15.125:0/1609129359 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7954004250 con 0x7f795c15c810 2023-11-28T11:09:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f7962105700 1 -- 172.21.15.125:0/1609129359 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c0ceb20 con 0x7f795c15c810 2023-11-28T11:09:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f7943fff700 1 -- 172.21.15.125:0/1609129359 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954004600 con 0x7f795c15c810 2023-11-28T11:09:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.626+0000 7f7962105700 1 -- 172.21.15.125:0/1609129359 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c161010 con 0x7f795c15c810 2023-11-28T11:09:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.628+0000 7f7962105700 1 -- 172.21.15.125:0/1609129359 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c0ce740 con 0x7f795c15c810 2023-11-28T11:09:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.628+0000 7f7943fff700 1 -- 172.21.15.125:0/1609129359 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f795402c070 con 0x7f795c15c810 2023-11-28T11:09:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.629+0000 7f7943fff700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79480682f0 0x7f794806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.629+0000 7f7943fff700 1 -- 172.21.15.125:0/1609129359 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79540874b0 con 0x7f795c15c810 2023-11-28T11:09:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.629+0000 7f795b7fe700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79480682f0 0x7f794806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.629+0000 7f795b7fe700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79480682f0 0x7f794806a7a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7950009990 tx=0x7f7950008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:03.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.632+0000 7f7943fff700 1 -- 172.21.15.125:0/1609129359 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7954053ca0 con 0x7f795c15c810 2023-11-28T11:09:03.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.817+0000 7f7962105700 1 -- 172.21.15.125:0/1609129359 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f795c0743f0 con 0x7f795c15c810 2023-11-28T11:09:03.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.818+0000 7f7943fff700 1 -- 172.21.15.125:0/1609129359 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f79540572c0 con 0x7f795c15c810 2023-11-28T11:09:03.820 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 -- 172.21.15.125:0/1609129359 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79480682f0 msgr2=0x7f794806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79480682f0 0x7f794806a7a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7950009990 tx=0x7f7950008040 comp rx=0 tx=0).stop 2023-11-28T11:09:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 -- 172.21.15.125:0/1609129359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f795c15c810 msgr2=0x7f795c153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f795c15c810 0x7f795c153de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7954012000 tx=0x7f7954004ad0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 -- 172.21.15.125:0/1609129359 shutdown_connections 2023-11-28T11:09:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f795c15c810 0x7f795c153de0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79480682f0 0x7f794806a7a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795c06cdc0 0x7f795c157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 --2- 172.21.15.125:0/1609129359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f795c0718e0 0x7f795c14e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 -- 172.21.15.125:0/1609129359 >> 172.21.15.125:0/1609129359 conn(0x7f795c06c010 msgr2=0x7f795c0ac8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 -- 172.21.15.125:0/1609129359 shutdown_connections 2023-11-28T11:09:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.820+0000 7f7962105700 1 -- 172.21.15.125:0/1609129359 wait complete. 2023-11-28T11:09:03.833 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:03.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.956+0000 7f2ddb067700 1 Processor -- start 2023-11-28T11:09:03.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.956+0000 7f2ddb067700 1 -- start start 2023-11-28T11:09:03.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.956+0000 7f2ddb067700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd415a5f0 0x7f2dd40d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.956+0000 7f2ddb067700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2dd40cc200 0x7f2dd40b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.956+0000 7f2ddb067700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2dd40b2d10 0x7f2dd415e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.956+0000 7f2ddb067700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd40b3190 con 0x7f2dd40cc200 2023-11-28T11:09:03.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.956+0000 7f2ddb067700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd415a9c0 con 0x7f2dd40b2d10 2023-11-28T11:09:03.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.956+0000 7f2ddb067700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd40c7b80 con 0x7f2dd415a5f0 2023-11-28T11:09:03.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2dd40cc200 0x7f2dd40b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2dd40cc200 0x7f2dd40b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57576/0 (socket says 172.21.15.125:57576) 2023-11-28T11:09:03.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd3fff700 1 -- 172.21.15.125:0/1714061215 learned_addr learned my addr 172.21.15.125:0/1714061215 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:03.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd9604700 1 --2- 172.21.15.125:0/1714061215 >> v2:172.21.15.167:3300/0 conn(0x7f2dd40b2d10 0x7f2dd415e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd8e03700 1 --2- 172.21.15.125:0/1714061215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd415a5f0 0x7f2dd40d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd3fff700 1 -- 172.21.15.125:0/1714061215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd415a5f0 msgr2=0x7f2dd40d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:03.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd3fff700 1 --2- 172.21.15.125:0/1714061215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd415a5f0 0x7f2dd40d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd3fff700 1 -- 172.21.15.125:0/1714061215 >> v2:172.21.15.167:3300/0 conn(0x7f2dd40b2d10 msgr2=0x7f2dd415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:03.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd3fff700 1 --2- 172.21.15.125:0/1714061215 >> v2:172.21.15.167:3300/0 conn(0x7f2dd40b2d10 0x7f2dd415e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd3fff700 1 -- 172.21.15.125:0/1714061215 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd40cc990 con 0x7f2dd40cc200 2023-11-28T11:09:03.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd9604700 1 --2- 172.21.15.125:0/1714061215 >> v2:172.21.15.167:3300/0 conn(0x7f2dd40b2d10 0x7f2dd415e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:03.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd3fff700 1 --2- 172.21.15.125:0/1714061215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd40cc200 0x7f2dd40b27d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4073cf0 tx=0x7f2dc0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca792fce8a842c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:03.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd37fe700 1 -- 172.21.15.125:0/1714061215 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc000b870 con 0x7f2dd40cc200 2023-11-28T11:09:03.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd37fe700 1 -- 172.21.15.125:0/1714061215 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc000b9d0 con 0x7f2dd40cc200 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.957+0000 7f2dd37fe700 1 -- 172.21.15.125:0/1714061215 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc000bd60 con 0x7f2dd40cc200 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.958+0000 7f2ddb067700 1 -- 172.21.15.125:0/1714061215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd40cc200 msgr2=0x7f2dd40b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.958+0000 7f2ddb067700 1 --2- 172.21.15.125:0/1714061215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd40cc200 0x7f2dd40b27d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4073cf0 tx=0x7f2dc0009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.958+0000 7f2ddb067700 1 -- 172.21.15.125:0/1714061215 shutdown_connections 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.958+0000 7f2ddb067700 1 --2- 172.21.15.125:0/1714061215 >> v2:172.21.15.167:3300/0 conn(0x7f2dd40b2d10 0x7f2dd415e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.958+0000 7f2ddb067700 1 --2- 172.21.15.125:0/1714061215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd415a5f0 0x7f2dd40d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.958+0000 7f2ddb067700 1 --2- 172.21.15.125:0/1714061215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd40cc200 0x7f2dd40b27d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.958+0000 7f2ddb067700 1 -- 172.21.15.125:0/1714061215 >> 172.21.15.125:0/1714061215 conn(0x7f2dd406ea80 msgr2=0x7f2dd406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.958+0000 7f2ddb067700 1 -- 172.21.15.125:0/1714061215 shutdown_connections 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.958+0000 7f2ddb067700 1 -- 172.21.15.125:0/1714061215 wait complete. 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.959+0000 7f2ddb067700 1 Processor -- start 2023-11-28T11:09:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.959+0000 7f2ddb067700 1 -- start start 2023-11-28T11:09:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2ddb067700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd40b2d10 0x7f2dd40ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2ddb067700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd40cc200 0x7f2dd40c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2ddb067700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dd415a5f0 0x7f2dd40b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2ddb067700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd406bf30 con 0x7f2dd40b2d10 2023-11-28T11:09:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2ddb067700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd40c8ed0 con 0x7f2dd415a5f0 2023-11-28T11:09:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2ddb067700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd406ccb0 con 0x7f2dd40cc200 2023-11-28T11:09:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2dd8e03700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd40b2d10 0x7f2dd40ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2dd8e03700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd40b2d10 0x7f2dd40ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57578/0 (socket says 172.21.15.125:57578) 2023-11-28T11:09:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2dd8e03700 1 -- 172.21.15.125:0/238101134 learned_addr learned my addr 172.21.15.125:0/238101134 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2dd3fff700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd40cc200 0x7f2dd40c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2dd9604700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dd415a5f0 0x7f2dd40b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2dd8e03700 1 -- 172.21.15.125:0/238101134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd40cc200 msgr2=0x7f2dd40c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2dd8e03700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd40cc200 0x7f2dd40c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2dd8e03700 1 -- 172.21.15.125:0/238101134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dd415a5f0 msgr2=0x7f2dd40b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2dd8e03700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dd415a5f0 0x7f2dd40b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.960+0000 7f2dd8e03700 1 -- 172.21.15.125:0/238101134 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0009550 con 0x7f2dd40b2d10 2023-11-28T11:09:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.961+0000 7f2dd8e03700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd40b2d10 0x7f2dd40ca370 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800c7f0 tx=0x7f2dc800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.961+0000 7f2dd17fa700 1 -- 172.21.15.125:0/238101134 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8004220 con 0x7f2dd40b2d10 2023-11-28T11:09:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.961+0000 7f2dd17fa700 1 -- 172.21.15.125:0/238101134 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc8004380 con 0x7f2dd40b2d10 2023-11-28T11:09:03.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.961+0000 7f2ddb067700 1 -- 172.21.15.125:0/238101134 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd40ccf50 con 0x7f2dd40b2d10 2023-11-28T11:09:03.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.961+0000 7f2dd17fa700 1 -- 172.21.15.125:0/238101134 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc80036a0 con 0x7f2dd40b2d10 2023-11-28T11:09:03.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.961+0000 7f2ddb067700 1 -- 172.21.15.125:0/238101134 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd40ccc70 con 0x7f2dd40b2d10 2023-11-28T11:09:03.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.962+0000 7f2ddb067700 1 -- 172.21.15.125:0/238101134 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd40cd230 con 0x7f2dd40b2d10 2023-11-28T11:09:03.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.962+0000 7f2dd17fa700 1 -- 172.21.15.125:0/238101134 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2dc8020070 con 0x7f2dd40b2d10 2023-11-28T11:09:03.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.962+0000 7f2dd17fa700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db80682f0 0x7f2db806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:03.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.963+0000 7f2dd17fa700 1 -- 172.21.15.125:0/238101134 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2dc8085640 con 0x7f2dd40b2d10 2023-11-28T11:09:03.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.963+0000 7f2dd3fff700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db80682f0 0x7f2db806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:03.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.963+0000 7f2dd3fff700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db80682f0 0x7f2db806a7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0000c00 tx=0x7f2dc0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:03.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:03.967+0000 7f2dd17fa700 1 -- 172.21.15.125:0/238101134 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2dc8051e20 con 0x7f2dd40b2d10 2023-11-28T11:09:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.153+0000 7f2ddb067700 1 -- 172.21.15.125:0/238101134 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2dd40743f0 con 0x7f2dd40b2d10 2023-11-28T11:09:04.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.153+0000 7f2dd17fa700 1 -- 172.21.15.125:0/238101134 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2dc8055440 con 0x7f2dd40b2d10 2023-11-28T11:09:04.155 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 -- 172.21.15.125:0/238101134 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db80682f0 msgr2=0x7f2db806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db80682f0 0x7f2db806a7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0000c00 tx=0x7f2dc0008030 comp rx=0 tx=0).stop 2023-11-28T11:09:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 -- 172.21.15.125:0/238101134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd40b2d10 msgr2=0x7f2dd40ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd40b2d10 0x7f2dd40ca370 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800c7f0 tx=0x7f2dc800cb00 comp rx=0 tx=0).stop 2023-11-28T11:09:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 -- 172.21.15.125:0/238101134 shutdown_connections 2023-11-28T11:09:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dd415a5f0 0x7f2dd40b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd40b2d10 0x7f2dd40ca370 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db80682f0 0x7f2db806a7a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 --2- 172.21.15.125:0/238101134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd40cc200 0x7f2dd40c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 -- 172.21.15.125:0/238101134 >> 172.21.15.125:0/238101134 conn(0x7f2dd406ea80 msgr2=0x7f2dd40cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 -- 172.21.15.125:0/238101134 shutdown_connections 2023-11-28T11:09:04.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.155+0000 7f2ddb067700 1 -- 172.21.15.125:0/238101134 wait complete. 2023-11-28T11:09:04.169 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:04.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.289+0000 7f114de29700 1 Processor -- start 2023-11-28T11:09:04.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.289+0000 7f114de29700 1 -- start start 2023-11-28T11:09:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.289+0000 7f114de29700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480b2ee0 0x7f11480d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.289+0000 7f114de29700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f11480cc200 0x7f11480ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.289+0000 7f114de29700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114815a9c0 con 0x7f114815a5f0 2023-11-28T11:09:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.289+0000 7f114de29700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11480c7b80 con 0x7f11480cc200 2023-11-28T11:09:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.289+0000 7f114de29700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11480cc990 con 0x7f11480b2ee0 2023-11-28T11:09:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11477fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f114815a5f0 0x7f11480b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41710/0 (socket says 172.21.15.125:41710) 2023-11-28T11:09:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11477fe700 1 -- 172.21.15.125:0/3197693409 learned_addr learned my addr 172.21.15.125:0/3197693409 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f1147fff700 1 --2- 172.21.15.125:0/3197693409 >> v2:172.21.15.167:3300/0 conn(0x7f11480cc200 0x7f11480ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f1146ffd700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480b2ee0 0x7f11480d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290563056 0 0) 0x7f114815a9c0 con 0x7f114815a5f0 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11340035b0 con 0x7f114815a5f0 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4223657752 0 0) 0x7f11340035b0 con 0x7f114815a5f0 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480b2ee0 msgr2=0x7f11480d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480b2ee0 0x7f11480d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 >> v2:172.21.15.167:3300/0 conn(0x7f11480cc200 msgr2=0x7f11480ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 --2- 172.21.15.125:0/3197693409 >> v2:172.21.15.167:3300/0 conn(0x7f11480cc200 0x7f11480ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11480ccc70 con 0x7f114815a5f0 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f1130001670 con 0x7f114815a5f0 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 >> v1:172.21.15.125:6789/0 conn(0x7f114815a5f0 legacy=0x7f11480b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480b2ee0 0x7f1134003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1134003f80 0x7f1134004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1134004d90 0x7f1134005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11480c7b80 con 0x7f1134003f80 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11480cc990 con 0x7f1134004d90 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113400ba10 con 0x7f11480b2ee0 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f1146ffd700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1134003f80 0x7f1134004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f11477fe700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480b2ee0 0x7f1134003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.290+0000 7f1147fff700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1134004d90 0x7f1134005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f1146ffd700 1 -- 172.21.15.125:0/3197693409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480b2ee0 msgr2=0x7f1134003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f1146ffd700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480b2ee0 0x7f1134003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f1146ffd700 1 -- 172.21.15.125:0/3197693409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1134004d90 msgr2=0x7f1134005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f1146ffd700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1134004d90 0x7f1134005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f1146ffd700 1 -- 172.21.15.125:0/3197693409 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11340035b0 con 0x7f1134003f80 2023-11-28T11:09:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f1146ffd700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1134003f80 0x7f1134004850 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1138009b30 tx=0x7f1134005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c34119c2c37f8d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800e6c0 con 0x7f1134003f80 2023-11-28T11:09:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113800e820 con 0x7f1134003f80 2023-11-28T11:09:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f11467fc700 1 -- 172.21.15.125:0/3197693409 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800eb90 con 0x7f1134003f80 2023-11-28T11:09:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f114de29700 1 -- 172.21.15.125:0/3197693409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1134003f80 msgr2=0x7f1134004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f114de29700 1 --2- 172.21.15.125:0/3197693409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1134003f80 0x7f1134004850 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1138009b30 tx=0x7f1134005880 comp rx=0 tx=0).stop 2023-11-28T11:09:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f1147fff700 1 -- 172.21.15.125:0/3197693409 reap_dead start 2023-11-28T11:09:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f114de29700 1 -- 172.21.15.125:0/3197693409 shutdown_connections 2023-11-28T11:09:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f114de29700 1 -- 172.21.15.125:0/3197693409 >> 172.21.15.125:0/3197693409 conn(0x7f114806ea80 msgr2=0x7f114806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f114de29700 1 -- 172.21.15.125:0/3197693409 shutdown_connections 2023-11-28T11:09:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.291+0000 7f114de29700 1 -- 172.21.15.125:0/3197693409 wait complete. 2023-11-28T11:09:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.293+0000 7f114de29700 1 Processor -- start 2023-11-28T11:09:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.293+0000 7f114de29700 1 -- start start 2023-11-28T11:09:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f114de29700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1134003f80 0x7f11481e1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f114de29700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f114806c5c0 0x7f11481583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f114de29700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11481f2bd0 0x7f11481f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f114de29700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114806d390 con 0x7f114806c5c0 2023-11-28T11:09:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f114de29700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114806caf0 con 0x7f11481f2bd0 2023-11-28T11:09:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f114de29700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114806cdd0 con 0x7f1134003f80 2023-11-28T11:09:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f1146ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f114806c5c0 0x7f11481583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f1146ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f114806c5c0 0x7f11481583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57600/0 (socket says 172.21.15.125:57600) 2023-11-28T11:09:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f1146ffd700 1 -- 172.21.15.125:0/69419439 learned_addr learned my addr 172.21.15.125:0/69419439 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f11477fe700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1134003f80 0x7f11481e1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f1147fff700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11481f2bd0 0x7f11481f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f1146ffd700 1 -- 172.21.15.125:0/69419439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1134003f80 msgr2=0x7f11481e1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f1146ffd700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1134003f80 0x7f11481e1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f1146ffd700 1 -- 172.21.15.125:0/69419439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11481f2bd0 msgr2=0x7f11481f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f1146ffd700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11481f2bd0 0x7f11481f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f1146ffd700 1 -- 172.21.15.125:0/69419439 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11480cd230 con 0x7f114806c5c0 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f1146ffd700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f114806c5c0 0x7f11481583d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f11340046d0 tx=0x7f11380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f113ffff700 1 -- 172.21.15.125:0/69419439 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138021070 con 0x7f114806c5c0 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f113ffff700 1 -- 172.21.15.125:0/69419439 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138004590 con 0x7f114806c5c0 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f114de29700 1 -- 172.21.15.125:0/69419439 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11480ccf50 con 0x7f114806c5c0 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f113ffff700 1 -- 172.21.15.125:0/69419439 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800e6c0 con 0x7f114806c5c0 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.294+0000 7f114de29700 1 -- 172.21.15.125:0/69419439 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11480cd510 con 0x7f114806c5c0 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.295+0000 7f114de29700 1 -- 172.21.15.125:0/69419439 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11480743f0 con 0x7f114806c5c0 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.296+0000 7f113ffff700 1 -- 172.21.15.125:0/69419439 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f113802e030 con 0x7f114806c5c0 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.296+0000 7f113ffff700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11280682f0 0x7f112806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.296+0000 7f11477fe700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11280682f0 0x7f112806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.296+0000 7f113ffff700 1 -- 172.21.15.125:0/69419439 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1138086fa0 con 0x7f114806c5c0 2023-11-28T11:09:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.297+0000 7f11477fe700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11280682f0 0x7f112806a7a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1130000c00 tx=0x7f1130009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.301+0000 7f113ffff700 1 -- 172.21.15.125:0/69419439 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1138053800 con 0x7f114806c5c0 2023-11-28T11:09:04.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.481+0000 7f114de29700 1 -- 172.21.15.125:0/69419439 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1148157250 con 0x7f114806c5c0 2023-11-28T11:09:04.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.482+0000 7f113ffff700 1 -- 172.21.15.125:0/69419439 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1138056e20 con 0x7f114806c5c0 2023-11-28T11:09:04.484 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:04.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 -- 172.21.15.125:0/69419439 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11280682f0 msgr2=0x7f112806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11280682f0 0x7f112806a7a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1130000c00 tx=0x7f1130009040 comp rx=0 tx=0).stop 2023-11-28T11:09:04.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 -- 172.21.15.125:0/69419439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f114806c5c0 msgr2=0x7f11481583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f114806c5c0 0x7f11481583d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f11340046d0 tx=0x7f11380047c0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 -- 172.21.15.125:0/69419439 shutdown_connections 2023-11-28T11:09:04.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11481f2bd0 0x7f11481f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11280682f0 0x7f112806a7a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1134003f80 0x7f11481e1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 --2- 172.21.15.125:0/69419439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f114806c5c0 0x7f11481583d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 -- 172.21.15.125:0/69419439 >> 172.21.15.125:0/69419439 conn(0x7f114806ea80 msgr2=0x7f114806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:04.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 -- 172.21.15.125:0/69419439 shutdown_connections 2023-11-28T11:09:04.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.484+0000 7f114de29700 1 -- 172.21.15.125:0/69419439 wait complete. 2023-11-28T11:09:04.498 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:04.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.615+0000 7f62f2d46700 1 Processor -- start 2023-11-28T11:09:04.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.615+0000 7f62f2d46700 1 -- start start 2023-11-28T11:09:04.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.616+0000 7f62f2d46700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62ec15cc80 0x7f62ec06de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.616+0000 7f62f2d46700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f62ec06e3a0 0x7f62ec070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.616+0000 7f62f2d46700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ec0b1810 con 0x7f62ec06a270 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.616+0000 7f62f2d46700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ec0b2490 con 0x7f62ec06e3a0 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.616+0000 7f62f2d46700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0b1af0 con 0x7f62ec15cc80 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.616+0000 7f62ebfff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62ec15cc80 0x7f62ec06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.616+0000 7f62f12e3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f62ec06e3a0 0x7f62ec070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.616+0000 7f62f12e3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f62ec06e3a0 0x7f62ec070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:54340/0 (socket says 172.21.15.125:54340) 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.616+0000 7f62ebfff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62ec15cc80 0x7f62ec06de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:52616/0 (socket says 172.21.15.125:52616) 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.616+0000 7f62f0ae2700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f62ec06a270 0x7f62ec06a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:44532/0 (socket says 172.21.15.125:44532) 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.616+0000 7f62f12e3700 1 -- 172.21.15.125:0/4252475200 learned_addr learned my addr 172.21.15.125:0/4252475200 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.617+0000 7f62f12e3700 1 -- 172.21.15.125:0/4252475200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62ec15cc80 msgr2=0x7f62ec06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.617+0000 7f62f12e3700 1 --2- 172.21.15.125:0/4252475200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62ec15cc80 0x7f62ec06de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.617+0000 7f62f12e3700 1 -- 172.21.15.125:0/4252475200 >> v1:172.21.15.167:6789/0 conn(0x7f62ec06a270 legacy=0x7f62ec06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.617+0000 7f62f12e3700 1 -- 172.21.15.125:0/4252475200 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec0b1dd0 con 0x7f62ec06e3a0 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.617+0000 7f62f12e3700 1 --2- 172.21.15.125:0/4252475200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62ec06e3a0 0x7f62ec070d20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009e50 tx=0x7f62e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67e84eefe98d5434 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.617+0000 7f62eb7fe700 1 -- 172.21.15.125:0/4252475200 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e400e070 con 0x7f62ec06e3a0 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.617+0000 7f62eb7fe700 1 -- 172.21.15.125:0/4252475200 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e400b910 con 0x7f62ec06e3a0 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.617+0000 7f62eb7fe700 1 -- 172.21.15.125:0/4252475200 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e400bcc0 con 0x7f62ec06e3a0 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.618+0000 7f62f2d46700 1 -- 172.21.15.125:0/4252475200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62ec06e3a0 msgr2=0x7f62ec070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.618+0000 7f62f2d46700 1 --2- 172.21.15.125:0/4252475200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62ec06e3a0 0x7f62ec070d20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009e50 tx=0x7f62e400b330 comp rx=0 tx=0).stop 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.618+0000 7f62f2d46700 1 -- 172.21.15.125:0/4252475200 shutdown_connections 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.618+0000 7f62f2d46700 1 --2- 172.21.15.125:0/4252475200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62ec06e3a0 0x7f62ec070d20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.618+0000 7f62f2d46700 1 --2- 172.21.15.125:0/4252475200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62ec15cc80 0x7f62ec06de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.618+0000 7f62f2d46700 1 -- 172.21.15.125:0/4252475200 >> 172.21.15.125:0/4252475200 conn(0x7f62ec06c010 msgr2=0x7f62ec0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.618+0000 7f62f2d46700 1 -- 172.21.15.125:0/4252475200 shutdown_connections 2023-11-28T11:09:04.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.618+0000 7f62f2d46700 1 -- 172.21.15.125:0/4252475200 wait complete. 2023-11-28T11:09:04.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.619+0000 7f62f2d46700 1 Processor -- start 2023-11-28T11:09:04.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.619+0000 7f62f2d46700 1 -- start start 2023-11-28T11:09:04.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f2d46700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62ec06a270 0x7f62ec153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f2d46700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62ec06e3a0 0x7f62ec15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f2d46700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62ec15cc80 0x7f62ec15f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f2d46700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec153870 con 0x7f62ec06a270 2023-11-28T11:09:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f2d46700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0b0740 con 0x7f62ec15cc80 2023-11-28T11:09:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f2d46700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0b09e0 con 0x7f62ec06e3a0 2023-11-28T11:09:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f0ae2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62ec06a270 0x7f62ec153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f0ae2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62ec06a270 0x7f62ec153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57612/0 (socket says 172.21.15.125:57612) 2023-11-28T11:09:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f0ae2700 1 -- 172.21.15.125:0/1288419488 learned_addr learned my addr 172.21.15.125:0/1288419488 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f12e3700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62ec15cc80 0x7f62ec15f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62ebfff700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62ec06e3a0 0x7f62ec15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f0ae2700 1 -- 172.21.15.125:0/1288419488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62ec06e3a0 msgr2=0x7f62ec15ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f0ae2700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62ec06e3a0 0x7f62ec15ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f0ae2700 1 -- 172.21.15.125:0/1288419488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62ec15cc80 msgr2=0x7f62ec15f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f0ae2700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62ec15cc80 0x7f62ec15f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f0ae2700 1 -- 172.21.15.125:0/1288419488 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e4009b30 con 0x7f62ec06a270 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f12e3700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62ec15cc80 0x7f62ec15f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62f0ae2700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62ec06a270 0x7f62ec153330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c430 tx=0x7f62e000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.620+0000 7f62e97fa700 1 -- 172.21.15.125:0/1288419488 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0005ab0 con 0x7f62ec06a270 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.621+0000 7f62e97fa700 1 -- 172.21.15.125:0/1288419488 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e0005c10 con 0x7f62ec06a270 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.621+0000 7f62f2d46700 1 -- 172.21.15.125:0/1288419488 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ec06e7e0 con 0x7f62ec06a270 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.621+0000 7f62e97fa700 1 -- 172.21.15.125:0/1288419488 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e00070d0 con 0x7f62ec06a270 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.621+0000 7f62f2d46700 1 -- 172.21.15.125:0/1288419488 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ec0b20b0 con 0x7f62ec06a270 2023-11-28T11:09:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.621+0000 7f62f2d46700 1 -- 172.21.15.125:0/1288419488 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ec15daa0 con 0x7f62ec06a270 2023-11-28T11:09:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.622+0000 7f62e97fa700 1 -- 172.21.15.125:0/1288419488 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f62e0019030 con 0x7f62ec06a270 2023-11-28T11:09:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.622+0000 7f62e97fa700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f62d00682f0 0x7f62d006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.622+0000 7f62e97fa700 1 -- 172.21.15.125:0/1288419488 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62e0084dc0 con 0x7f62ec06a270 2023-11-28T11:09:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.622+0000 7f62ebfff700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f62d00682f0 0x7f62d006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.623+0000 7f62ebfff700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f62d00682f0 0x7f62d006a7a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0b3fc0 tx=0x7f62d8009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.626+0000 7f62e97fa700 1 -- 172.21.15.125:0/1288419488 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f62e004b5e0 con 0x7f62ec06a270 2023-11-28T11:09:04.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.811+0000 7f62f2d46700 1 -- 172.21.15.125:0/1288419488 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62ec0743f0 con 0x7f62ec06a270 2023-11-28T11:09:04.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.812+0000 7f62e97fa700 1 -- 172.21.15.125:0/1288419488 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f62e0017020 con 0x7f62ec06a270 2023-11-28T11:09:04.813 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:04.814 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:04.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 -- 172.21.15.125:0/1288419488 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f62d00682f0 msgr2=0x7f62d006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f62d00682f0 0x7f62d006a7a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0b3fc0 tx=0x7f62d8009210 comp rx=0 tx=0).stop 2023-11-28T11:09:04.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 -- 172.21.15.125:0/1288419488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62ec06a270 msgr2=0x7f62ec153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62ec06a270 0x7f62ec153330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c430 tx=0x7f62e000c740 comp rx=0 tx=0).stop 2023-11-28T11:09:04.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 -- 172.21.15.125:0/1288419488 shutdown_connections 2023-11-28T11:09:04.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62ec15cc80 0x7f62ec15f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62ec06a270 0x7f62ec153330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f62d00682f0 0x7f62d006a7a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 --2- 172.21.15.125:0/1288419488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62ec06e3a0 0x7f62ec15ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 -- 172.21.15.125:0/1288419488 >> 172.21.15.125:0/1288419488 conn(0x7f62ec06c010 msgr2=0x7f62ec15bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:04.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 -- 172.21.15.125:0/1288419488 shutdown_connections 2023-11-28T11:09:04.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.814+0000 7f62f2d46700 1 -- 172.21.15.125:0/1288419488 wait complete. 2023-11-28T11:09:04.827 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:04.828 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:04.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.949+0000 7f519a424700 1 Processor -- start 2023-11-28T11:09:04.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.949+0000 7f519a424700 1 -- start start 2023-11-28T11:09:04.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.950+0000 7f519a424700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51940af0a0 0x7f519415a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.950+0000 7f519a424700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5194159ec0 con 0x7f51940b1650 2023-11-28T11:09:04.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.950+0000 7f519a424700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519415d8a0 con 0x7f51941599b0 2023-11-28T11:09:04.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.950+0000 7f519a424700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519415db80 con 0x7f51940af0a0 2023-11-28T11:09:04.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.950+0000 7f5193fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f51940b1650 0x7f51940b1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41744/0 (socket says 172.21.15.125:41744) 2023-11-28T11:09:04.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.950+0000 7f5193fff700 1 -- 172.21.15.125:0/2429392307 learned_addr learned my addr 172.21.15.125:0/2429392307 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:04.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.950+0000 7f51989c1700 1 --2- 172.21.15.125:0/2429392307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51940af0a0 0x7f519415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.950+0000 7f5192ffd700 1 -- 172.21.15.125:0/2429392307 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078824396 0 0) 0x7f5194159ec0 con 0x7f51940b1650 2023-11-28T11:09:04.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.951+0000 7f5192ffd700 1 -- 172.21.15.125:0/2429392307 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f517c0035b0 con 0x7f51940b1650 2023-11-28T11:09:04.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.951+0000 7f5192ffd700 1 -- 172.21.15.125:0/2429392307 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507590435 0 0) 0x7f519415d8a0 con 0x7f51941599b0 2023-11-28T11:09:04.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.951+0000 7f5192ffd700 1 -- 172.21.15.125:0/2429392307 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5194159ec0 con 0x7f51941599b0 2023-11-28T11:09:04.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.951+0000 7f51989c1700 1 -- 172.21.15.125:0/2429392307 >> v1:172.21.15.167:6789/0 conn(0x7f51941599b0 legacy=0x7f519415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.951+0000 7f51989c1700 1 -- 172.21.15.125:0/2429392307 >> v1:172.21.15.125:6789/0 conn(0x7f51940b1650 legacy=0x7f51940b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.951+0000 7f51989c1700 1 -- 172.21.15.125:0/2429392307 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519415de60 con 0x7f51940af0a0 2023-11-28T11:09:04.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.951+0000 7f51989c1700 1 --2- 172.21.15.125:0/2429392307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51940af0a0 0x7f519415a350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f518c009dc0 tx=0x7f518c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=607e2623f1fcdbfb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:04.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.951+0000 7f5192ffd700 1 -- 172.21.15.125:0/2429392307 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c00e070 con 0x7f51940af0a0 2023-11-28T11:09:04.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.951+0000 7f5192ffd700 1 -- 172.21.15.125:0/2429392307 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c00bb20 con 0x7f51940af0a0 2023-11-28T11:09:04.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.951+0000 7f5192ffd700 1 -- 172.21.15.125:0/2429392307 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c012430 con 0x7f51940af0a0 2023-11-28T11:09:04.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.952+0000 7f519a424700 1 -- 172.21.15.125:0/2429392307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51940af0a0 msgr2=0x7f519415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.952+0000 7f519a424700 1 --2- 172.21.15.125:0/2429392307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51940af0a0 0x7f519415a350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f518c009dc0 tx=0x7f518c00b330 comp rx=0 tx=0).stop 2023-11-28T11:09:04.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.952+0000 7f519a424700 1 -- 172.21.15.125:0/2429392307 shutdown_connections 2023-11-28T11:09:04.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.952+0000 7f519a424700 1 --2- 172.21.15.125:0/2429392307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51940af0a0 0x7f519415a350 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.952+0000 7f519a424700 1 -- 172.21.15.125:0/2429392307 >> 172.21.15.125:0/2429392307 conn(0x7f519406c010 msgr2=0x7f51940cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:04.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.952+0000 7f519a424700 1 -- 172.21.15.125:0/2429392307 shutdown_connections 2023-11-28T11:09:04.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.952+0000 7f519a424700 1 -- 172.21.15.125:0/2429392307 wait complete. 2023-11-28T11:09:04.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.953+0000 7f519a424700 1 Processor -- start 2023-11-28T11:09:04.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.953+0000 7f519a424700 1 -- start start 2023-11-28T11:09:04.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f519a424700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51940af0a0 0x7f51940c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f519a424700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51940b1650 0x7f51941e5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f519a424700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51940c9080 0x7f51941e5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f519a424700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51940c7790 con 0x7f51940b1650 2023-11-28T11:09:04.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f519a424700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51940c7a70 con 0x7f51940c9080 2023-11-28T11:09:04.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f519a424700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51940c4670 con 0x7f51940af0a0 2023-11-28T11:09:04.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f51937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51940b1650 0x7f51941e5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f51937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51940b1650 0x7f51941e5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57628/0 (socket says 172.21.15.125:57628) 2023-11-28T11:09:04.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f51937fe700 1 -- 172.21.15.125:0/1817734939 learned_addr learned my addr 172.21.15.125:0/1817734939 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f51989c1700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51940c9080 0x7f51941e5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f5193fff700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51940af0a0 0x7f51940c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f51937fe700 1 -- 172.21.15.125:0/1817734939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51940af0a0 msgr2=0x7f51940c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f51937fe700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51940af0a0 0x7f51940c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f51937fe700 1 -- 172.21.15.125:0/1817734939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51940c9080 msgr2=0x7f51941e5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f51937fe700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51940c9080 0x7f51941e5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f51937fe700 1 -- 172.21.15.125:0/1817734939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c009a70 con 0x7f51940b1650 2023-11-28T11:09:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f51989c1700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51940c9080 0x7f51941e5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f51937fe700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51940b1650 0x7f51941e5450 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f518800c410 tx=0x7f518800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f5190ff9700 1 -- 172.21.15.125:0/1817734939 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51880052d0 con 0x7f51940b1650 2023-11-28T11:09:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.954+0000 7f519a424700 1 -- 172.21.15.125:0/1817734939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519415aa20 con 0x7f51940b1650 2023-11-28T11:09:04.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.955+0000 7f519a424700 1 -- 172.21.15.125:0/1817734939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519415a890 con 0x7f51940b1650 2023-11-28T11:09:04.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.955+0000 7f5190ff9700 1 -- 172.21.15.125:0/1817734939 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188005430 con 0x7f51940b1650 2023-11-28T11:09:04.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.955+0000 7f5190ff9700 1 -- 172.21.15.125:0/1817734939 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188003880 con 0x7f51940b1650 2023-11-28T11:09:04.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.956+0000 7f519a424700 1 -- 172.21.15.125:0/1817734939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51940c4b30 con 0x7f51940b1650 2023-11-28T11:09:04.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.956+0000 7f5190ff9700 1 -- 172.21.15.125:0/1817734939 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5188019030 con 0x7f51940b1650 2023-11-28T11:09:04.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.956+0000 7f5190ff9700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51800682f0 0x7f518006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:04.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.956+0000 7f5190ff9700 1 -- 172.21.15.125:0/1817734939 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5188084eb0 con 0x7f51940b1650 2023-11-28T11:09:04.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.956+0000 7f5193fff700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51800682f0 0x7f518006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:04.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.957+0000 7f5193fff700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51800682f0 0x7f518006a7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51840011e0 tx=0x7f5184009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:04.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:04.960+0000 7f5190ff9700 1 -- 172.21.15.125:0/1817734939 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f518804b5e0 con 0x7f51940b1650 2023-11-28T11:09:05.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.143+0000 7f519a424700 1 -- 172.21.15.125:0/1817734939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51940c78d0 con 0x7f51940b1650 2023-11-28T11:09:05.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.143+0000 7f5190ff9700 1 -- 172.21.15.125:0/1817734939 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51940c78d0 con 0x7f51940b1650 2023-11-28T11:09:05.145 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:05.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 -- 172.21.15.125:0/1817734939 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51800682f0 msgr2=0x7f518006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51800682f0 0x7f518006a7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51840011e0 tx=0x7f5184009040 comp rx=0 tx=0).stop 2023-11-28T11:09:05.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 -- 172.21.15.125:0/1817734939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51940b1650 msgr2=0x7f51941e5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51940b1650 0x7f51941e5450 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f518800c410 tx=0x7f518800c7d0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 -- 172.21.15.125:0/1817734939 shutdown_connections 2023-11-28T11:09:05.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51940c9080 0x7f51941e5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51800682f0 0x7f518006a7a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51940af0a0 0x7f51940c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 --2- 172.21.15.125:0/1817734939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51940b1650 0x7f51941e5450 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 -- 172.21.15.125:0/1817734939 >> 172.21.15.125:0/1817734939 conn(0x7f519406c010 msgr2=0x7f5194070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:05.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 -- 172.21.15.125:0/1817734939 shutdown_connections 2023-11-28T11:09:05.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.145+0000 7f519a424700 1 -- 172.21.15.125:0/1817734939 wait complete. 2023-11-28T11:09:05.158 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:05.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.278+0000 7f53dd4fa700 1 Processor -- start 2023-11-28T11:09:05.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.278+0000 7f53dd4fa700 1 -- start start 2023-11-28T11:09:05.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.279+0000 7f53dd4fa700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f53d806d170 0x7f53d80b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.279+0000 7f53dd4fa700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d8161370 con 0x7f53d815fe50 2023-11-28T11:09:05.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.279+0000 7f53dd4fa700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d80cf700 con 0x7f53d80b27d0 2023-11-28T11:09:05.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.279+0000 7f53dd4fa700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d806d5c0 con 0x7f53d806d170 2023-11-28T11:09:05.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.279+0000 7f53d6ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f53d815fe50 0x7f53d8160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41758/0 (socket says 172.21.15.125:41758) 2023-11-28T11:09:05.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.279+0000 7f53d6ffd700 1 -- 172.21.15.125:0/812099027 learned_addr learned my addr 172.21.15.125:0/812099027 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:05.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056162847 0 0) 0x7f53d8161370 con 0x7f53d815fe50 2023-11-28T11:09:05.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d67fc700 1 --2- 172.21.15.125:0/812099027 >> v2:172.21.15.167:3300/0 conn(0x7f53d806d170 0x7f53d80b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53c00035b0 con 0x7f53d815fe50 2023-11-28T11:09:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357214946 0 0) 0x7f53c00035b0 con 0x7f53d815fe50 2023-11-28T11:09:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 >> v2:172.21.15.167:3300/0 conn(0x7f53d806d170 msgr2=0x7f53d80b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 --2- 172.21.15.125:0/812099027 >> v2:172.21.15.167:3300/0 conn(0x7f53d806d170 0x7f53d80b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 >> v1:172.21.15.167:6789/0 conn(0x7f53d80b27d0 legacy=0x7f53d80cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80cedd0 con 0x7f53d815fe50 2023-11-28T11:09:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f53cc001670 con 0x7f53d815fe50 2023-11-28T11:09:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 >> v1:172.21.15.125:6789/0 conn(0x7f53d815fe50 legacy=0x7f53d8160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 --2- 172.21.15.125:0/812099027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 0x7f53c0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 --2- 172.21.15.125:0/812099027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53c0004850 0x7f53c0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 --2- 172.21.15.125:0/812099027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53c0005200 0x7f53c000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c000c050 con 0x7f53c0003a00 2023-11-28T11:09:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c000c1c0 con 0x7f53c0005200 2023-11-28T11:09:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c000c380 con 0x7f53c0004850 2023-11-28T11:09:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d6ffd700 1 --2- 172.21.15.125:0/812099027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 0x7f53c0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d67fc700 1 --2- 172.21.15.125:0/812099027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53c0004850 0x7f53c0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d77fe700 1 --2- 172.21.15.125:0/812099027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53c0005200 0x7f53c000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d6ffd700 1 -- 172.21.15.125:0/812099027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53c0004850 msgr2=0x7f53c0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d6ffd700 1 --2- 172.21.15.125:0/812099027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53c0004850 0x7f53c0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d6ffd700 1 -- 172.21.15.125:0/812099027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53c0005200 msgr2=0x7f53c000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d6ffd700 1 --2- 172.21.15.125:0/812099027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53c0005200 0x7f53c000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d77fe700 1 -- 172.21.15.125:0/812099027 reap_dead start 2023-11-28T11:09:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d6ffd700 1 -- 172.21.15.125:0/812099027 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00035b0 con 0x7f53c0003a00 2023-11-28T11:09:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d6ffd700 1 --2- 172.21.15.125:0/812099027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 0x7f53c0003e10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00c240 tx=0x7f53c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106e569eb63877d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.280+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc007c10 con 0x7f53c0003a00 2023-11-28T11:09:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.281+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc00ce00 con 0x7f53c0003a00 2023-11-28T11:09:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.281+0000 7f53d5ffb700 1 -- 172.21.15.125:0/812099027 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc005ba0 con 0x7f53c0003a00 2023-11-28T11:09:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.281+0000 7f53dd4fa700 1 -- 172.21.15.125:0/812099027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 msgr2=0x7f53c0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.281+0000 7f53dd4fa700 1 --2- 172.21.15.125:0/812099027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 0x7f53c0003e10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00c240 tx=0x7f53c0005880 comp rx=0 tx=0).stop 2023-11-28T11:09:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.281+0000 7f53dd4fa700 1 -- 172.21.15.125:0/812099027 shutdown_connections 2023-11-28T11:09:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.281+0000 7f53dd4fa700 1 --2- 172.21.15.125:0/812099027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 0x7f53c0003e10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.281+0000 7f53dd4fa700 1 -- 172.21.15.125:0/812099027 >> 172.21.15.125:0/812099027 conn(0x7f53d806ea80 msgr2=0x7f53d806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.281+0000 7f53dd4fa700 1 -- 172.21.15.125:0/812099027 shutdown_connections 2023-11-28T11:09:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.281+0000 7f53dd4fa700 1 -- 172.21.15.125:0/812099027 wait complete. 2023-11-28T11:09:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.282+0000 7f53dd4fa700 1 Processor -- start 2023-11-28T11:09:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.282+0000 7f53dd4fa700 1 -- start start 2023-11-28T11:09:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53dd4fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 0x7f53d80ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53dd4fa700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53d8149250 0x7f53d815dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53dd4fa700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53d81496c0 0x7f53d815e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53dd4fa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80cd570 con 0x7f53c0003a00 2023-11-28T11:09:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53dd4fa700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80cd850 con 0x7f53d8149250 2023-11-28T11:09:05.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53dd4fa700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80cdb30 con 0x7f53d81496c0 2023-11-28T11:09:05.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53d6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 0x7f53d80ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53d6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 0x7f53d80ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57644/0 (socket says 172.21.15.125:57644) 2023-11-28T11:09:05.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53d6ffd700 1 -- 172.21.15.125:0/1468432191 learned_addr learned my addr 172.21.15.125:0/1468432191 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:05.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53d6ffd700 1 -- 172.21.15.125:0/1468432191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53d81496c0 msgr2=0x7f53d815e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53d6ffd700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53d81496c0 0x7f53d815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53d6ffd700 1 -- 172.21.15.125:0/1468432191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53d8149250 msgr2=0x7f53d815dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.283+0000 7f53d6ffd700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53d8149250 0x7f53d815dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.284+0000 7f53d6ffd700 1 -- 172.21.15.125:0/1468432191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80cf390 con 0x7f53c0003a00 2023-11-28T11:09:05.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.284+0000 7f53d6ffd700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 0x7f53d80ca640 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f53cc000c00 tx=0x7f53cc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:05.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.284+0000 7f53bf7fe700 1 -- 172.21.15.125:0/1468432191 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc001670 con 0x7f53c0003a00 2023-11-28T11:09:05.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.284+0000 7f53bf7fe700 1 -- 172.21.15.125:0/1468432191 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc0070d0 con 0x7f53c0003a00 2023-11-28T11:09:05.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.284+0000 7f53dd4fa700 1 -- 172.21.15.125:0/1468432191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d80cf0b0 con 0x7f53c0003a00 2023-11-28T11:09:05.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.284+0000 7f53bf7fe700 1 -- 172.21.15.125:0/1468432191 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0074a0 con 0x7f53c0003a00 2023-11-28T11:09:05.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.284+0000 7f53dd4fa700 1 -- 172.21.15.125:0/1468432191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d80b3b80 con 0x7f53c0003a00 2023-11-28T11:09:05.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.285+0000 7f53dd4fa700 1 -- 172.21.15.125:0/1468432191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d80743f0 con 0x7f53c0003a00 2023-11-28T11:09:05.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.285+0000 7f53bf7fe700 1 -- 172.21.15.125:0/1468432191 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f53cc024030 con 0x7f53c0003a00 2023-11-28T11:09:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.286+0000 7f53bf7fe700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 0x7f53c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.286+0000 7f53d67fc700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 0x7f53c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.286+0000 7f53bf7fe700 1 -- 172.21.15.125:0/1468432191 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53cc086e40 con 0x7f53c0003a00 2023-11-28T11:09:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.286+0000 7f53d67fc700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 0x7f53c406a7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f53d80b0fe0 tx=0x7f53c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.290+0000 7f53bf7fe700 1 -- 172.21.15.125:0/1468432191 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f53cc0536a0 con 0x7f53c0003a00 2023-11-28T11:09:05.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.470+0000 7f53dd4fa700 1 -- 172.21.15.125:0/1468432191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f53d806ad90 con 0x7f53c0003a00 2023-11-28T11:09:05.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.471+0000 7f53bf7fe700 1 -- 172.21.15.125:0/1468432191 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f53cc056cc0 con 0x7f53c0003a00 2023-11-28T11:09:05.472 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:05.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 -- 172.21.15.125:0/1468432191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 msgr2=0x7f53c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 0x7f53c406a7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f53d80b0fe0 tx=0x7f53c8008040 comp rx=0 tx=0).stop 2023-11-28T11:09:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 -- 172.21.15.125:0/1468432191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 msgr2=0x7f53d80ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 0x7f53d80ca640 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f53cc000c00 tx=0x7f53cc001a00 comp rx=0 tx=0).stop 2023-11-28T11:09:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 -- 172.21.15.125:0/1468432191 shutdown_connections 2023-11-28T11:09:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 0x7f53c406a7a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53d81496c0 0x7f53d815e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53c0003a00 0x7f53d80ca640 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 --2- 172.21.15.125:0/1468432191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53d8149250 0x7f53d815dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 -- 172.21.15.125:0/1468432191 >> 172.21.15.125:0/1468432191 conn(0x7f53d806ea80 msgr2=0x7f53d80b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 -- 172.21.15.125:0/1468432191 shutdown_connections 2023-11-28T11:09:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.473+0000 7f53dd4fa700 1 -- 172.21.15.125:0/1468432191 wait complete. 2023-11-28T11:09:05.486 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:05.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.607+0000 7f0c91921700 1 Processor -- start 2023-11-28T11:09:05.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.608+0000 7f0c91921700 1 -- start start 2023-11-28T11:09:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.608+0000 7f0c91921700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c8c15c8c0 0x7f0c8c160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.608+0000 7f0c91921700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c8c06b220 0x7f0c8c0d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.608+0000 7f0c91921700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c0d2d30 con 0x7f0c8c0b5dc0 2023-11-28T11:09:05.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.608+0000 7f0c91921700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c0d0b40 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.608+0000 7f0c91921700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c1611f0 con 0x7f0c8c06b220 2023-11-28T11:09:05.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.608+0000 7f0c8affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c8c15c8c0 0x7f0c8c160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.608+0000 7f0c8affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c8c15c8c0 0x7f0c8c160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57654/0 (socket says 172.21.15.125:57654) 2023-11-28T11:09:05.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.608+0000 7f0c8affd700 1 -- 172.21.15.125:0/104801535 learned_addr learned my addr 172.21.15.125:0/104801535 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:05.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.609+0000 7f0c8b7fe700 1 --2- 172.21.15.125:0/104801535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c8c06b220 0x7f0c8c0d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.609+0000 7f0c8affd700 1 -- 172.21.15.125:0/104801535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c8c06b220 msgr2=0x7f0c8c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:05.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.609+0000 7f0c8affd700 1 --2- 172.21.15.125:0/104801535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c8c06b220 0x7f0c8c0d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.609+0000 7f0c8affd700 1 -- 172.21.15.125:0/104801535 >> v1:172.21.15.167:6789/0 conn(0x7f0c8c0b5dc0 legacy=0x7f0c8c06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.609+0000 7f0c8affd700 1 -- 172.21.15.125:0/104801535 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c0d2a50 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.609+0000 7f0c8affd700 1 --2- 172.21.15.125:0/104801535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8c15c8c0 0x7f0c8c160cb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0c800098f0 tx=0x7f0c80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853eacf516a1b20a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.609+0000 7f0c89ffb700 1 -- 172.21.15.125:0/104801535 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80011830 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.609+0000 7f0c89ffb700 1 -- 172.21.15.125:0/104801535 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c80011990 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.609+0000 7f0c89ffb700 1 -- 172.21.15.125:0/104801535 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80011d20 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.610+0000 7f0c91921700 1 -- 172.21.15.125:0/104801535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8c15c8c0 msgr2=0x7f0c8c160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.610+0000 7f0c91921700 1 --2- 172.21.15.125:0/104801535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8c15c8c0 0x7f0c8c160cb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0c800098f0 tx=0x7f0c80009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.610+0000 7f0c91921700 1 -- 172.21.15.125:0/104801535 shutdown_connections 2023-11-28T11:09:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.610+0000 7f0c91921700 1 --2- 172.21.15.125:0/104801535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8c15c8c0 0x7f0c8c160cb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.610+0000 7f0c91921700 1 --2- 172.21.15.125:0/104801535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c8c06b220 0x7f0c8c0d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.610+0000 7f0c91921700 1 -- 172.21.15.125:0/104801535 >> 172.21.15.125:0/104801535 conn(0x7f0c8c06c520 msgr2=0x7f0c8c06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.610+0000 7f0c91921700 1 -- 172.21.15.125:0/104801535 shutdown_connections 2023-11-28T11:09:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.610+0000 7f0c91921700 1 -- 172.21.15.125:0/104801535 wait complete. 2023-11-28T11:09:05.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.611+0000 7f0c91921700 1 Processor -- start 2023-11-28T11:09:05.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.611+0000 7f0c91921700 1 -- start start 2023-11-28T11:09:05.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c91921700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c8c06b220 0x7f0c8c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c91921700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c8c0b5dc0 0x7f0c8c15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c91921700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8c15c8c0 0x7f0c8c155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c91921700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c15e5f0 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c91921700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c15e8c0 con 0x7f0c8c0b5dc0 2023-11-28T11:09:05.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c91921700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c15eba0 con 0x7f0c8c06b220 2023-11-28T11:09:05.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8c15c8c0 0x7f0c8c155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8c15c8c0 0x7f0c8c155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57662/0 (socket says 172.21.15.125:57662) 2023-11-28T11:09:05.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8b7fe700 1 -- 172.21.15.125:0/3956056682 learned_addr learned my addr 172.21.15.125:0/3956056682 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:05.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8a7fc700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c8c0b5dc0 0x7f0c8c15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8affd700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c8c06b220 0x7f0c8c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8b7fe700 1 -- 172.21.15.125:0/3956056682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c8c06b220 msgr2=0x7f0c8c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8b7fe700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c8c06b220 0x7f0c8c15d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8b7fe700 1 -- 172.21.15.125:0/3956056682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c8c0b5dc0 msgr2=0x7f0c8c15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8b7fe700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c8c0b5dc0 0x7f0c8c15e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8b7fe700 1 -- 172.21.15.125:0/3956056682 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c80009550 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8a7fc700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c8c0b5dc0 0x7f0c8c15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c8b7fe700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8c15c8c0 0x7f0c8c155ba0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400ef90 tx=0x7f0c8400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c73fff700 1 -- 172.21.15.125:0/3956056682 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84009ca0 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c73fff700 1 -- 172.21.15.125:0/3956056682 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8400f040 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c91921700 1 -- 172.21.15.125:0/3956056682 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c0cda40 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c73fff700 1 -- 172.21.15.125:0/3956056682 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84014480 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.612+0000 7f0c91921700 1 -- 172.21.15.125:0/3956056682 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c0cd760 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.613+0000 7f0c91921700 1 -- 172.21.15.125:0/3956056682 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c0d2700 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.614+0000 7f0c73fff700 1 -- 172.21.15.125:0/3956056682 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0c840145e0 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.614+0000 7f0c73fff700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0c78068320 0x7f0c7806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.614+0000 7f0c73fff700 1 -- 172.21.15.125:0/3956056682 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c84086780 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.614+0000 7f0c8affd700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0c78068320 0x7f0c7806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.615+0000 7f0c8affd700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0c78068320 0x7f0c7806a7d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0b7630 tx=0x7f0c80008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:05.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.618+0000 7f0c73fff700 1 -- 172.21.15.125:0/3956056682 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0c84052fe0 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.798+0000 7f0c91921700 1 -- 172.21.15.125:0/3956056682 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c8c067d70 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.799+0000 7f0c73fff700 1 -- 172.21.15.125:0/3956056682 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c84056600 con 0x7f0c8c15c8c0 2023-11-28T11:09:05.800 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:05.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 -- 172.21.15.125:0/3956056682 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0c78068320 msgr2=0x7f0c7806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0c78068320 0x7f0c7806a7d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0b7630 tx=0x7f0c80008030 comp rx=0 tx=0).stop 2023-11-28T11:09:05.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 -- 172.21.15.125:0/3956056682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8c15c8c0 msgr2=0x7f0c8c155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8c15c8c0 0x7f0c8c155ba0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400ef90 tx=0x7f0c8400c3a0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 -- 172.21.15.125:0/3956056682 shutdown_connections 2023-11-28T11:09:05.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8c15c8c0 0x7f0c8c155ba0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0c78068320 0x7f0c7806a7d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c8c06b220 0x7f0c8c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 --2- 172.21.15.125:0/3956056682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c8c0b5dc0 0x7f0c8c15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 -- 172.21.15.125:0/3956056682 >> 172.21.15.125:0/3956056682 conn(0x7f0c8c06c520 msgr2=0x7f0c8c0b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:05.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 -- 172.21.15.125:0/3956056682 shutdown_connections 2023-11-28T11:09:05.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.801+0000 7f0c91921700 1 -- 172.21.15.125:0/3956056682 wait complete. 2023-11-28T11:09:05.814 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:05.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.936+0000 7fe144a6f700 1 Processor -- start 2023-11-28T11:09:05.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.936+0000 7fe144a6f700 1 -- start start 2023-11-28T11:09:05.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe144a6f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14015c810 0x7fe140160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe144a6f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe1400718e0 0x7fe14006c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe144a6f700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1401607a0 con 0x7fe14006cdc0 2023-11-28T11:09:05.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe144a6f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14015cbe0 con 0x7fe1400718e0 2023-11-28T11:09:05.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe144a6f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe140160a50 con 0x7fe14015c810 2023-11-28T11:09:05.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe1400718e0 0x7fe14006c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe1400718e0 0x7fe14006c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57666/0 (socket says 172.21.15.125:57666) 2023-11-28T11:09:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13dd9b700 1 -- 172.21.15.125:0/4072141588 learned_addr learned my addr 172.21.15.125:0/4072141588 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13e59c700 1 --2- 172.21.15.125:0/4072141588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14015c810 0x7fe140160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13dd9b700 1 -- 172.21.15.125:0/4072141588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14015c810 msgr2=0x7fe140160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13dd9b700 1 --2- 172.21.15.125:0/4072141588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14015c810 0x7fe140160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13dd9b700 1 -- 172.21.15.125:0/4072141588 >> v1:172.21.15.167:6789/0 conn(0x7fe14006cdc0 legacy=0x7fe14006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13dd9b700 1 -- 172.21.15.125:0/4072141588 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe140160d30 con 0x7fe1400718e0 2023-11-28T11:09:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13e59c700 1 --2- 172.21.15.125:0/4072141588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14015c810 0x7fe140160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13dd9b700 1 --2- 172.21.15.125:0/4072141588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1400718e0 0x7fe14006c880 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe1340098f0 tx=0x7fe134009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd207d304b76d0b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13d59a700 1 -- 172.21.15.125:0/4072141588 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134004230 con 0x7fe1400718e0 2023-11-28T11:09:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13d59a700 1 -- 172.21.15.125:0/4072141588 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134004390 con 0x7fe1400718e0 2023-11-28T11:09:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.937+0000 7fe13d59a700 1 -- 172.21.15.125:0/4072141588 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1340036a0 con 0x7fe1400718e0 2023-11-28T11:09:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.938+0000 7fe144a6f700 1 -- 172.21.15.125:0/4072141588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1400718e0 msgr2=0x7fe14006c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.938+0000 7fe144a6f700 1 --2- 172.21.15.125:0/4072141588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1400718e0 0x7fe14006c880 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe1340098f0 tx=0x7fe134009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.938+0000 7fe144a6f700 1 -- 172.21.15.125:0/4072141588 shutdown_connections 2023-11-28T11:09:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.938+0000 7fe144a6f700 1 --2- 172.21.15.125:0/4072141588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14015c810 0x7fe140160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.938+0000 7fe144a6f700 1 --2- 172.21.15.125:0/4072141588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1400718e0 0x7fe14006c880 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.938+0000 7fe144a6f700 1 -- 172.21.15.125:0/4072141588 >> 172.21.15.125:0/4072141588 conn(0x7fe14006c010 msgr2=0x7fe1400cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.938+0000 7fe144a6f700 1 -- 172.21.15.125:0/4072141588 shutdown_connections 2023-11-28T11:09:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.938+0000 7fe144a6f700 1 -- 172.21.15.125:0/4072141588 wait complete. 2023-11-28T11:09:05.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.939+0000 7fe144a6f700 1 Processor -- start 2023-11-28T11:09:05.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.939+0000 7fe144a6f700 1 -- start start 2023-11-28T11:09:05.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.940+0000 7fe144a6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe14006cdc0 0x7fe140155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.940+0000 7fe144a6f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1400718e0 0x7fe1400aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.940+0000 7fe144a6f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14015c810 0x7fe1400b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.940+0000 7fe144a6f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400b37a0 con 0x7fe14006cdc0 2023-11-28T11:09:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.940+0000 7fe144a6f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400c3f60 con 0x7fe14015c810 2023-11-28T11:09:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.940+0000 7fe144a6f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400af210 con 0x7fe1400718e0 2023-11-28T11:09:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.940+0000 7fe13e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe14006cdc0 0x7fe140155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.940+0000 7fe13e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe14006cdc0 0x7fe140155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57672/0 (socket says 172.21.15.125:57672) 2023-11-28T11:09:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.940+0000 7fe13e59c700 1 -- 172.21.15.125:0/3440511398 learned_addr learned my addr 172.21.15.125:0/3440511398 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.940+0000 7fe13ed9d700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14015c810 0x7fe1400b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.940+0000 7fe13dd9b700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1400718e0 0x7fe1400aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe13e59c700 1 -- 172.21.15.125:0/3440511398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1400718e0 msgr2=0x7fe1400aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe13e59c700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1400718e0 0x7fe1400aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe13e59c700 1 -- 172.21.15.125:0/3440511398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14015c810 msgr2=0x7fe1400b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe13e59c700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14015c810 0x7fe1400b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe13e59c700 1 -- 172.21.15.125:0/3440511398 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe134009550 con 0x7fe14006cdc0 2023-11-28T11:09:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe13dd9b700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1400718e0 0x7fe1400aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe13e59c700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe14006cdc0 0x7fe140155e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe13000c780 tx=0x7fe13000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe12effd700 1 -- 172.21.15.125:0/3440511398 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130011800 con 0x7fe14006cdc0 2023-11-28T11:09:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe12effd700 1 -- 172.21.15.125:0/3440511398 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe130011960 con 0x7fe14006cdc0 2023-11-28T11:09:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe144a6f700 1 -- 172.21.15.125:0/3440511398 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1400ceb20 con 0x7fe14006cdc0 2023-11-28T11:09:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe12effd700 1 -- 172.21.15.125:0/3440511398 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130011cd0 con 0x7fe14006cdc0 2023-11-28T11:09:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.941+0000 7fe144a6f700 1 -- 172.21.15.125:0/3440511398 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe140161010 con 0x7fe14006cdc0 2023-11-28T11:09:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.942+0000 7fe144a6f700 1 -- 172.21.15.125:0/3440511398 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1400ce740 con 0x7fe14006cdc0 2023-11-28T11:09:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.942+0000 7fe12effd700 1 -- 172.21.15.125:0/3440511398 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe130020070 con 0x7fe14006cdc0 2023-11-28T11:09:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.943+0000 7fe12effd700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1200682f0 0x7fe12006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:05.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.943+0000 7fe12effd700 1 -- 172.21.15.125:0/3440511398 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe130085c60 con 0x7fe14006cdc0 2023-11-28T11:09:05.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.943+0000 7fe13dd9b700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1200682f0 0x7fe12006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:05.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.943+0000 7fe13dd9b700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1200682f0 0x7fe12006a7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe134009c40 tx=0x7fe134008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:05.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:05.947+0000 7fe12effd700 1 -- 172.21.15.125:0/3440511398 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe130052440 con 0x7fe14006cdc0 2023-11-28T11:09:06.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.132+0000 7fe144a6f700 1 -- 172.21.15.125:0/3440511398 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1400743f0 con 0x7fe14006cdc0 2023-11-28T11:09:06.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.133+0000 7fe12effd700 1 -- 172.21.15.125:0/3440511398 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe130055a60 con 0x7fe14006cdc0 2023-11-28T11:09:06.135 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:06.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 -- 172.21.15.125:0/3440511398 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1200682f0 msgr2=0x7fe12006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1200682f0 0x7fe12006a7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe134009c40 tx=0x7fe134008030 comp rx=0 tx=0).stop 2023-11-28T11:09:06.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 -- 172.21.15.125:0/3440511398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe14006cdc0 msgr2=0x7fe140155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe14006cdc0 0x7fe140155e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe13000c780 tx=0x7fe13000cb40 comp rx=0 tx=0).stop 2023-11-28T11:09:06.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 -- 172.21.15.125:0/3440511398 shutdown_connections 2023-11-28T11:09:06.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14015c810 0x7fe1400b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe14006cdc0 0x7fe140155e10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1200682f0 0x7fe12006a7a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 --2- 172.21.15.125:0/3440511398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1400718e0 0x7fe1400aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 -- 172.21.15.125:0/3440511398 >> 172.21.15.125:0/3440511398 conn(0x7fe14006c010 msgr2=0x7fe1400ac9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:06.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 -- 172.21.15.125:0/3440511398 shutdown_connections 2023-11-28T11:09:06.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.135+0000 7fe144a6f700 1 -- 172.21.15.125:0/3440511398 wait complete. 2023-11-28T11:09:06.151 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.268+0000 7fb5738b6700 1 Processor -- start 2023-11-28T11:09:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.268+0000 7fb5738b6700 1 -- start start 2023-11-28T11:09:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.269+0000 7fb5738b6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c06ab10 0x7fb56c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.269+0000 7fb5738b6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb56c0d0450 0x7fb56c160a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.269+0000 7fb5738b6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56c0d1ee0 con 0x7fb56c0cd5a0 2023-11-28T11:09:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.269+0000 7fb5738b6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56c06b420 con 0x7fb56c0d0450 2023-11-28T11:09:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.269+0000 7fb5738b6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0cdb10 con 0x7fb56c06ab10 2023-11-28T11:09:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.269+0000 7fb571e53700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb56c0d0450 0x7fb56c160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.269+0000 7fb571e53700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb56c0d0450 0x7fb56c160a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57684/0 (socket says 172.21.15.125:57684) 2023-11-28T11:09:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.269+0000 7fb571e53700 1 -- 172.21.15.125:0/201902401 learned_addr learned my addr 172.21.15.125:0/201902401 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb571e53700 1 -- 172.21.15.125:0/201902401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c06ab10 msgr2=0x7fb56c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:06.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb571e53700 1 --2- 172.21.15.125:0/201902401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c06ab10 0x7fb56c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb571e53700 1 -- 172.21.15.125:0/201902401 >> v1:172.21.15.125:6789/0 conn(0x7fb56c0cd5a0 legacy=0x7fb56c160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb571e53700 1 -- 172.21.15.125:0/201902401 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c0d1890 con 0x7fb56c0d0450 2023-11-28T11:09:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb563fff700 1 -- 172.21.15.125:0/201902401 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609008976 0 0) 0x7fb56c0d1ee0 con 0x7fb56c0cd5a0 2023-11-28T11:09:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb571e53700 1 --2- 172.21.15.125:0/201902401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb56c0d0450 0x7fb56c160a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb564009e50 tx=0x7fb56400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff79df5d368dd24 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb563fff700 1 -- 172.21.15.125:0/201902401 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56400e070 con 0x7fb56c0d0450 2023-11-28T11:09:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb563fff700 1 -- 172.21.15.125:0/201902401 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56400b9c0 con 0x7fb56c0d0450 2023-11-28T11:09:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb563fff700 1 -- 172.21.15.125:0/201902401 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56400bd70 con 0x7fb56c0d0450 2023-11-28T11:09:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb5738b6700 1 -- 172.21.15.125:0/201902401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb56c0d0450 msgr2=0x7fb56c160a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb5738b6700 1 --2- 172.21.15.125:0/201902401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb56c0d0450 0x7fb56c160a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb564009e50 tx=0x7fb56400b330 comp rx=0 tx=0).stop 2023-11-28T11:09:06.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb5738b6700 1 -- 172.21.15.125:0/201902401 shutdown_connections 2023-11-28T11:09:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb5738b6700 1 --2- 172.21.15.125:0/201902401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb56c0d0450 0x7fb56c160a10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb5738b6700 1 --2- 172.21.15.125:0/201902401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c06ab10 0x7fb56c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.270+0000 7fb5738b6700 1 -- 172.21.15.125:0/201902401 >> 172.21.15.125:0/201902401 conn(0x7fb56c06c520 msgr2=0x7fb56c06c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.271+0000 7fb5738b6700 1 -- 172.21.15.125:0/201902401 shutdown_connections 2023-11-28T11:09:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.271+0000 7fb5738b6700 1 -- 172.21.15.125:0/201902401 wait complete. 2023-11-28T11:09:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.272+0000 7fb5738b6700 1 Processor -- start 2023-11-28T11:09:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.272+0000 7fb5738b6700 1 -- start start 2023-11-28T11:09:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.272+0000 7fb5738b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb56c06ab10 0x7fb56c1f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.272+0000 7fb5738b6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c0cd5a0 0x7fb56c159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.272+0000 7fb5738b6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb56c0d0450 0x7fb56c157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.272+0000 7fb5738b6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c156d60 con 0x7fb56c06ab10 2023-11-28T11:09:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.272+0000 7fb5738b6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0ca1a0 con 0x7fb56c0d0450 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.272+0000 7fb5738b6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0ca480 con 0x7fb56c0cd5a0 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.272+0000 7fb571652700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb56c06ab10 0x7fb56c1f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb571652700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb56c06ab10 0x7fb56c1f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57686/0 (socket says 172.21.15.125:57686) 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb571652700 1 -- 172.21.15.125:0/2600711302 learned_addr learned my addr 172.21.15.125:0/2600711302 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb571652700 1 -- 172.21.15.125:0/2600711302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c0cd5a0 msgr2=0x7fb56c159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb571652700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c0cd5a0 0x7fb56c159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb571652700 1 -- 172.21.15.125:0/2600711302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb56c0d0450 msgr2=0x7fb56c157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb571652700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb56c0d0450 0x7fb56c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb571652700 1 -- 172.21.15.125:0/2600711302 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564009b30 con 0x7fb56c06ab10 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb571652700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb56c06ab10 0x7fb56c1f38e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb56800b4a0 tx=0x7fb56800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb561ffb700 1 -- 172.21.15.125:0/2600711302 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568011830 con 0x7fb56c06ab10 2023-11-28T11:09:06.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb561ffb700 1 -- 172.21.15.125:0/2600711302 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb568011990 con 0x7fb56c06ab10 2023-11-28T11:09:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb5738b6700 1 -- 172.21.15.125:0/2600711302 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56c15cad0 con 0x7fb56c06ab10 2023-11-28T11:09:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb561ffb700 1 -- 172.21.15.125:0/2600711302 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568011d40 con 0x7fb56c06ab10 2023-11-28T11:09:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.273+0000 7fb5738b6700 1 -- 172.21.15.125:0/2600711302 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56c0d1b70 con 0x7fb56c06ab10 2023-11-28T11:09:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.274+0000 7fb5738b6700 1 -- 172.21.15.125:0/2600711302 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56c0b1ec0 con 0x7fb56c06ab10 2023-11-28T11:09:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.274+0000 7fb561ffb700 1 -- 172.21.15.125:0/2600711302 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb568021070 con 0x7fb56c06ab10 2023-11-28T11:09:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.275+0000 7fb561ffb700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb5500682f0 0x7fb55006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.275+0000 7fb561ffb700 1 -- 172.21.15.125:0/2600711302 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb568085bd0 con 0x7fb56c06ab10 2023-11-28T11:09:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.275+0000 7fb570e51700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb5500682f0 0x7fb55006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.275+0000 7fb570e51700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb5500682f0 0x7fb55006a7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb55c007fd0 tx=0x7fb55c0079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:06.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.279+0000 7fb561ffb700 1 -- 172.21.15.125:0/2600711302 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb5680523b0 con 0x7fb56c06ab10 2023-11-28T11:09:06.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.462+0000 7fb5738b6700 1 -- 172.21.15.125:0/2600711302 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb56c0743f0 con 0x7fb56c06ab10 2023-11-28T11:09:06.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.464+0000 7fb561ffb700 1 -- 172.21.15.125:0/2600711302 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7fb568015090 con 0x7fb56c06ab10 2023-11-28T11:09:06.465 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:06.466 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 -- 172.21.15.125:0/2600711302 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb5500682f0 msgr2=0x7fb55006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb5500682f0 0x7fb55006a7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb55c007fd0 tx=0x7fb55c0079a0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 -- 172.21.15.125:0/2600711302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb56c06ab10 msgr2=0x7fb56c1f38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb56c06ab10 0x7fb56c1f38e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb56800b4a0 tx=0x7fb56800b860 comp rx=0 tx=0).stop 2023-11-28T11:09:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 -- 172.21.15.125:0/2600711302 shutdown_connections 2023-11-28T11:09:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb56c0d0450 0x7fb56c157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb56c06ab10 0x7fb56c1f38e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb5500682f0 0x7fb55006a7a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 --2- 172.21.15.125:0/2600711302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb56c0cd5a0 0x7fb56c159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 -- 172.21.15.125:0/2600711302 >> 172.21.15.125:0/2600711302 conn(0x7fb56c06c520 msgr2=0x7fb56c0b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 -- 172.21.15.125:0/2600711302 shutdown_connections 2023-11-28T11:09:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.466+0000 7fb5738b6700 1 -- 172.21.15.125:0/2600711302 wait complete. 2023-11-28T11:09:06.479 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:06.480 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:06.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.600+0000 7fe8d7e1f700 1 Processor -- start 2023-11-28T11:09:06.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.600+0000 7fe8d7e1f700 1 -- start start 2023-11-28T11:09:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.601+0000 7fe8d7e1f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00b1650 0x7fe8d00b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.601+0000 7fe8d7e1f700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe8d00af0a0 0x7fe8d015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.601+0000 7fe8d7e1f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d0159ec0 con 0x7fe8d01599b0 2023-11-28T11:09:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.601+0000 7fe8d7e1f700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d00b1f60 con 0x7fe8d00af0a0 2023-11-28T11:09:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.601+0000 7fe8d7e1f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d015d8a0 con 0x7fe8d00b1650 2023-11-28T11:09:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.601+0000 7fe8d53ba700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe8d01599b0 0x7fe8d015d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41818/0 (socket says 172.21.15.125:41818) 2023-11-28T11:09:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.601+0000 7fe8d53ba700 1 -- 172.21.15.125:0/4286870987 learned_addr learned my addr 172.21.15.125:0/4286870987 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d63bc700 1 --2- 172.21.15.125:0/4286870987 >> v2:172.21.15.167:3300/0 conn(0x7fe8d00af0a0 0x7fe8d015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d5bbb700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00b1650 0x7fe8d00b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072985028 0 0) 0x7fe8d0159ec0 con 0x7fe8d01599b0 2023-11-28T11:09:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8bc0035b0 con 0x7fe8d01599b0 2023-11-28T11:09:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3495510267 0 0) 0x7fe8bc0035b0 con 0x7fe8d01599b0 2023-11-28T11:09:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00b1650 msgr2=0x7fe8d00b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:06.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00b1650 0x7fe8d00b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 >> v2:172.21.15.167:3300/0 conn(0x7fe8d00af0a0 msgr2=0x7fe8d015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 --2- 172.21.15.125:0/4286870987 >> v2:172.21.15.167:3300/0 conn(0x7fe8d00af0a0 0x7fe8d015a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d015db80 con 0x7fe8d01599b0 2023-11-28T11:09:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fe8cc001670 con 0x7fe8d01599b0 2023-11-28T11:09:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 >> v1:172.21.15.125:6789/0 conn(0x7fe8d01599b0 legacy=0x7fe8d015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc003a00 0x7fe8bc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00b1650 0x7fe8bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8bc004d90 0x7fe8bc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00b1f60 con 0x7fe8bc004d90 2023-11-28T11:09:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d015d8a0 con 0x7fe8bc003a00 2023-11-28T11:09:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc00dc20 con 0x7fe8d00b1650 2023-11-28T11:09:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d63bc700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8bc004d90 0x7fe8bc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d5bbb700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc003a00 0x7fe8bc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d53ba700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00b1650 0x7fe8bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d63bc700 1 -- 172.21.15.125:0/4286870987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00b1650 msgr2=0x7fe8bc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d63bc700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00b1650 0x7fe8bc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d63bc700 1 -- 172.21.15.125:0/4286870987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc003a00 msgr2=0x7fe8bc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d63bc700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc003a00 0x7fe8bc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.602+0000 7fe8d63bc700 1 -- 172.21.15.125:0/4286870987 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc0035b0 con 0x7fe8bc004d90 2023-11-28T11:09:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.603+0000 7fe8d63bc700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8bc004d90 0x7fe8bc005200 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009fc0 tx=0x7fe8bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614f02138ee84032 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.603+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c800ebd0 con 0x7fe8bc004d90 2023-11-28T11:09:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.603+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c800f040 con 0x7fe8bc004d90 2023-11-28T11:09:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.603+0000 7fe8d4bb9700 1 -- 172.21.15.125:0/4286870987 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8014480 con 0x7fe8bc004d90 2023-11-28T11:09:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.603+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/4286870987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8bc004d90 msgr2=0x7fe8bc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.603+0000 7fe8d7e1f700 1 --2- 172.21.15.125:0/4286870987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8bc004d90 0x7fe8bc005200 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009fc0 tx=0x7fe8bc005880 comp rx=0 tx=0).stop 2023-11-28T11:09:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.603+0000 7fe8d63bc700 1 -- 172.21.15.125:0/4286870987 reap_dead start 2023-11-28T11:09:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.603+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/4286870987 shutdown_connections 2023-11-28T11:09:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.603+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/4286870987 >> 172.21.15.125:0/4286870987 conn(0x7fe8d006c010 msgr2=0x7fe8d00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.603+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/4286870987 shutdown_connections 2023-11-28T11:09:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.603+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/4286870987 wait complete. 2023-11-28T11:09:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.604+0000 7fe8d7e1f700 1 Processor -- start 2023-11-28T11:09:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.604+0000 7fe8d7e1f700 1 -- start start 2023-11-28T11:09:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.605+0000 7fe8d7e1f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc004d90 0x7fe8d00b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.605+0000 7fe8d7e1f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00af6a0 0x7fe8d00afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.605+0000 7fe8d7e1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d00c4110 0x7fe8d00c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.605+0000 7fe8d7e1f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00b5a00 con 0x7fe8d00c4110 2023-11-28T11:09:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.605+0000 7fe8d7e1f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00b0050 con 0x7fe8bc004d90 2023-11-28T11:09:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.605+0000 7fe8d7e1f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0141de0 con 0x7fe8d00af6a0 2023-11-28T11:09:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.605+0000 7fe8d63bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d00c4110 0x7fe8d00c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.605+0000 7fe8d63bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d00c4110 0x7fe8d00c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57708/0 (socket says 172.21.15.125:57708) 2023-11-28T11:09:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.605+0000 7fe8d63bc700 1 -- 172.21.15.125:0/337151782 learned_addr learned my addr 172.21.15.125:0/337151782 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.605+0000 7fe8d5bbb700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc004d90 0x7fe8d00b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.605+0000 7fe8d53ba700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00af6a0 0x7fe8d00afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8d63bc700 1 -- 172.21.15.125:0/337151782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00af6a0 msgr2=0x7fe8d00afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8d63bc700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00af6a0 0x7fe8d00afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8d63bc700 1 -- 172.21.15.125:0/337151782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc004d90 msgr2=0x7fe8d00b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8d63bc700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc004d90 0x7fe8d00b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8d63bc700 1 -- 172.21.15.125:0/337151782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d015a890 con 0x7fe8d00c4110 2023-11-28T11:09:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8d5bbb700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc004d90 0x7fe8d00b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8d63bc700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d00c4110 0x7fe8d00c4580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8017040 tx=0x7fe8c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8c67fc700 1 -- 172.21.15.125:0/337151782 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8007000 con 0x7fe8d00c4110 2023-11-28T11:09:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8c67fc700 1 -- 172.21.15.125:0/337151782 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c8004470 con 0x7fe8d00c4110 2023-11-28T11:09:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/337151782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d015de60 con 0x7fe8d00c4110 2023-11-28T11:09:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8c67fc700 1 -- 172.21.15.125:0/337151782 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8004820 con 0x7fe8d00c4110 2023-11-28T11:09:06.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.606+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/337151782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d015aa20 con 0x7fe8d00c4110 2023-11-28T11:09:06.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.607+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/337151782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d00743f0 con 0x7fe8d00c4110 2023-11-28T11:09:06.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.607+0000 7fe8c67fc700 1 -- 172.21.15.125:0/337151782 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe8c8014480 con 0x7fe8d00c4110 2023-11-28T11:09:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.608+0000 7fe8c67fc700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe8b40682f0 0x7fe8b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.608+0000 7fe8d5bbb700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe8b40682f0 0x7fe8b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.608+0000 7fe8c67fc700 1 -- 172.21.15.125:0/337151782 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8c8087d20 con 0x7fe8d00c4110 2023-11-28T11:09:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.608+0000 7fe8d5bbb700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe8b40682f0 0x7fe8b406a7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009be0 tx=0x7fe8c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.612+0000 7fe8c67fc700 1 -- 172.21.15.125:0/337151782 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe8c80543b0 con 0x7fe8d00c4110 2023-11-28T11:09:06.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.797+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/337151782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8d006e620 con 0x7fe8d00c4110 2023-11-28T11:09:06.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.797+0000 7fe8c67fc700 1 -- 172.21.15.125:0/337151782 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8c80579d0 con 0x7fe8d00c4110 2023-11-28T11:09:06.799 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:06.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/337151782 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe8b40682f0 msgr2=0x7fe8b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe8b40682f0 0x7fe8b406a7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009be0 tx=0x7fe8c0008040 comp rx=0 tx=0).stop 2023-11-28T11:09:06.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/337151782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d00c4110 msgr2=0x7fe8d00c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d00c4110 0x7fe8d00c4580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8017040 tx=0x7fe8c8009750 comp rx=0 tx=0).stop 2023-11-28T11:09:06.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/337151782 shutdown_connections 2023-11-28T11:09:06.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d00c4110 0x7fe8d00c4580 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc004d90 0x7fe8d00b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe8b40682f0 0x7fe8b406a7a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 --2- 172.21.15.125:0/337151782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d00af6a0 0x7fe8d00afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/337151782 >> 172.21.15.125:0/337151782 conn(0x7fe8d006c010 msgr2=0x7fe8d0156c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:06.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/337151782 shutdown_connections 2023-11-28T11:09:06.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.799+0000 7fe8d7e1f700 1 -- 172.21.15.125:0/337151782 wait complete. 2023-11-28T11:09:06.813 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:06.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.935+0000 7fd7cad10700 1 Processor -- start 2023-11-28T11:09:06.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.936+0000 7fd7cad10700 1 -- start start 2023-11-28T11:09:06.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.936+0000 7fd7cad10700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7c40b1650 0x7fd7c40b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.936+0000 7fd7cad10700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd7c41599b0 0x7fd7c415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.936+0000 7fd7cad10700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd7c40af0a0 0x7fd7c415a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.936+0000 7fd7cad10700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c4159ec0 con 0x7fd7c41599b0 2023-11-28T11:09:06.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.936+0000 7fd7cad10700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c40b1f60 con 0x7fd7c40af0a0 2023-11-28T11:09:06.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.936+0000 7fd7cad10700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c415d8a0 con 0x7fd7c40b1650 2023-11-28T11:09:06.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.936+0000 7fd7c3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd7c41599b0 0x7fd7c415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.936+0000 7fd7c3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd7c41599b0 0x7fd7c415d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57712/0 (socket says 172.21.15.125:57712) 2023-11-28T11:09:06.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.936+0000 7fd7c3fff700 1 -- 172.21.15.125:0/2241816442 learned_addr learned my addr 172.21.15.125:0/2241816442 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:06.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c92ad700 1 --2- 172.21.15.125:0/2241816442 >> v2:172.21.15.167:3300/0 conn(0x7fd7c40af0a0 0x7fd7c415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c8aac700 1 --2- 172.21.15.125:0/2241816442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7c40b1650 0x7fd7c40b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c3fff700 1 -- 172.21.15.125:0/2241816442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7c40b1650 msgr2=0x7fd7c40b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:06.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c3fff700 1 --2- 172.21.15.125:0/2241816442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7c40b1650 0x7fd7c40b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c3fff700 1 -- 172.21.15.125:0/2241816442 >> v2:172.21.15.167:3300/0 conn(0x7fd7c40af0a0 msgr2=0x7fd7c415a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:06.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c3fff700 1 --2- 172.21.15.125:0/2241816442 >> v2:172.21.15.167:3300/0 conn(0x7fd7c40af0a0 0x7fd7c415a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c3fff700 1 -- 172.21.15.125:0/2241816442 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c415db80 con 0x7fd7c41599b0 2023-11-28T11:09:06.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c92ad700 1 --2- 172.21.15.125:0/2241816442 >> v2:172.21.15.167:3300/0 conn(0x7fd7c40af0a0 0x7fd7c415a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:06.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c3fff700 1 --2- 172.21.15.125:0/2241816442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7c41599b0 0x7fd7c415d050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd7c415cf90 tx=0x7fd7b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bbfd23f2e309d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:06.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c37fe700 1 -- 172.21.15.125:0/2241816442 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000b870 con 0x7fd7c41599b0 2023-11-28T11:09:06.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c37fe700 1 -- 172.21.15.125:0/2241816442 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b000b9d0 con 0x7fd7c41599b0 2023-11-28T11:09:06.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.937+0000 7fd7c37fe700 1 -- 172.21.15.125:0/2241816442 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000bd60 con 0x7fd7c41599b0 2023-11-28T11:09:06.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.938+0000 7fd7cad10700 1 -- 172.21.15.125:0/2241816442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7c41599b0 msgr2=0x7fd7c415d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.938+0000 7fd7cad10700 1 --2- 172.21.15.125:0/2241816442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7c41599b0 0x7fd7c415d050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd7c415cf90 tx=0x7fd7b0009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.938+0000 7fd7cad10700 1 -- 172.21.15.125:0/2241816442 shutdown_connections 2023-11-28T11:09:06.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.938+0000 7fd7cad10700 1 --2- 172.21.15.125:0/2241816442 >> v2:172.21.15.167:3300/0 conn(0x7fd7c40af0a0 0x7fd7c415a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.938+0000 7fd7cad10700 1 --2- 172.21.15.125:0/2241816442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7c40b1650 0x7fd7c40b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.938+0000 7fd7cad10700 1 --2- 172.21.15.125:0/2241816442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7c41599b0 0x7fd7c415d050 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.938+0000 7fd7cad10700 1 -- 172.21.15.125:0/2241816442 >> 172.21.15.125:0/2241816442 conn(0x7fd7c406c010 msgr2=0x7fd7c40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:06.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.938+0000 7fd7cad10700 1 -- 172.21.15.125:0/2241816442 shutdown_connections 2023-11-28T11:09:06.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.938+0000 7fd7cad10700 1 -- 172.21.15.125:0/2241816442 wait complete. 2023-11-28T11:09:06.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.939+0000 7fd7cad10700 1 Processor -- start 2023-11-28T11:09:06.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.939+0000 7fd7cad10700 1 -- start start 2023-11-28T11:09:06.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7cad10700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7c40af0a0 0x7fd7c4156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7cad10700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7c40b1650 0x7fd7c414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7cad10700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7c4158fd0 0x7fd7c41582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7cad10700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4157e30 con 0x7fd7c40af0a0 2023-11-28T11:09:06.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7cad10700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40c68f0 con 0x7fd7c40b1650 2023-11-28T11:09:06.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7cad10700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c414c670 con 0x7fd7c4158fd0 2023-11-28T11:09:06.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c8aac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7c40af0a0 0x7fd7c4156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c8aac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7c40af0a0 0x7fd7c4156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57716/0 (socket says 172.21.15.125:57716) 2023-11-28T11:09:06.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c8aac700 1 -- 172.21.15.125:0/866466278 learned_addr learned my addr 172.21.15.125:0/866466278 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c92ad700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7c4158fd0 0x7fd7c41582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c3fff700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7c40b1650 0x7fd7c414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c8aac700 1 -- 172.21.15.125:0/866466278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7c4158fd0 msgr2=0x7fd7c41582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c8aac700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7c4158fd0 0x7fd7c41582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c8aac700 1 -- 172.21.15.125:0/866466278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7c40b1650 msgr2=0x7fd7c414c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c8aac700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7c40b1650 0x7fd7c414c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c8aac700 1 -- 172.21.15.125:0/866466278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b0009550 con 0x7fd7c40af0a0 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c8aac700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7c40af0a0 0x7fd7c4156b90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800d800 tx=0x7fd7b800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c17fa700 1 -- 172.21.15.125:0/866466278 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b80125f0 con 0x7fd7c40af0a0 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c17fa700 1 -- 172.21.15.125:0/866466278 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b8012750 con 0x7fd7c40af0a0 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7cad10700 1 -- 172.21.15.125:0/866466278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c415d590 con 0x7fd7c40af0a0 2023-11-28T11:09:06.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.940+0000 7fd7c17fa700 1 -- 172.21.15.125:0/866466278 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8012b00 con 0x7fd7c40af0a0 2023-11-28T11:09:06.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.941+0000 7fd7cad10700 1 -- 172.21.15.125:0/866466278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c415de60 con 0x7fd7c40af0a0 2023-11-28T11:09:06.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.941+0000 7fd7cad10700 1 -- 172.21.15.125:0/866466278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c415a890 con 0x7fd7c40af0a0 2023-11-28T11:09:06.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.942+0000 7fd7c17fa700 1 -- 172.21.15.125:0/866466278 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd7b8012c60 con 0x7fd7c40af0a0 2023-11-28T11:09:06.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.942+0000 7fd7c17fa700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd7a80682f0 0x7fd7a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:06.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.942+0000 7fd7c17fa700 1 -- 172.21.15.125:0/866466278 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7b8085e70 con 0x7fd7c40af0a0 2023-11-28T11:09:06.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.942+0000 7fd7c3fff700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd7a80682f0 0x7fd7a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:06.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.943+0000 7fd7c3fff700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd7a80682f0 0x7fd7a806a7a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd7c415cf90 tx=0x7fd7b0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:06.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:06.947+0000 7fd7c17fa700 1 -- 172.21.15.125:0/866466278 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd7b80526d0 con 0x7fd7c40af0a0 2023-11-28T11:09:07.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.129+0000 7fd7cad10700 1 -- 172.21.15.125:0/866466278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd7c40743f0 con 0x7fd7c40af0a0 2023-11-28T11:09:07.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.129+0000 7fd7c17fa700 1 -- 172.21.15.125:0/866466278 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd7b8055cf0 con 0x7fd7c40af0a0 2023-11-28T11:09:07.131 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:07.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.131+0000 7fd7cad10700 1 -- 172.21.15.125:0/866466278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd7a80682f0 msgr2=0x7fd7a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.131+0000 7fd7cad10700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd7a80682f0 0x7fd7a806a7a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd7c415cf90 tx=0x7fd7b0008030 comp rx=0 tx=0).stop 2023-11-28T11:09:07.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.131+0000 7fd7cad10700 1 -- 172.21.15.125:0/866466278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7c40af0a0 msgr2=0x7fd7c4156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.131+0000 7fd7cad10700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7c40af0a0 0x7fd7c4156b90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800d800 tx=0x7fd7b800db10 comp rx=0 tx=0).stop 2023-11-28T11:09:07.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.131+0000 7fd7cad10700 1 -- 172.21.15.125:0/866466278 shutdown_connections 2023-11-28T11:09:07.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.132+0000 7fd7cad10700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd7a80682f0 0x7fd7a806a7a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.132+0000 7fd7cad10700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7c4158fd0 0x7fd7c41582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.132+0000 7fd7cad10700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7c40af0a0 0x7fd7c4156b90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.132+0000 7fd7cad10700 1 --2- 172.21.15.125:0/866466278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7c40b1650 0x7fd7c414c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.132+0000 7fd7cad10700 1 -- 172.21.15.125:0/866466278 >> 172.21.15.125:0/866466278 conn(0x7fd7c406c010 msgr2=0x7fd7c40cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:07.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.132+0000 7fd7cad10700 1 -- 172.21.15.125:0/866466278 shutdown_connections 2023-11-28T11:09:07.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.132+0000 7fd7cad10700 1 -- 172.21.15.125:0/866466278 wait complete. 2023-11-28T11:09:07.145 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.265+0000 7f3803eec700 1 Processor -- start 2023-11-28T11:09:07.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.266+0000 7f3803eec700 1 -- start start 2023-11-28T11:09:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.266+0000 7f3803eec700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 0x7f37fc0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.266+0000 7f3803eec700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f37fc0cc200 0x7f37fc0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.266+0000 7f3803eec700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc15a9c0 con 0x7f37fc0b2d10 2023-11-28T11:09:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.266+0000 7f3803eec700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc0b3190 con 0x7f37fc0cc200 2023-11-28T11:09:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.266+0000 7f3803eec700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc0c7b80 con 0x7f37fc15a5f0 2023-11-28T11:09:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3801c88700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 0x7f37fc0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3801487700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f37fc0cc200 0x7f37fc0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3802489700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f37fc0b2d10 0x7f37fc15e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:44652/0 (socket says 172.21.15.125:44652) 2023-11-28T11:09:07.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3801487700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f37fc0cc200 0x7f37fc0b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:54454/0 (socket says 172.21.15.125:54454) 2023-11-28T11:09:07.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3802489700 1 -- 172.21.15.125:0/3783035489 learned_addr learned my addr 172.21.15.125:0/3783035489 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:07.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3801c88700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 0x7f37fc0d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:52732/0 (socket says 172.21.15.125:52732) 2023-11-28T11:09:07.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3801487700 1 -- 172.21.15.125:0/3783035489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 msgr2=0x7f37fc0d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:07.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3801487700 1 --2- 172.21.15.125:0/3783035489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 0x7f37fc0d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3801487700 1 -- 172.21.15.125:0/3783035489 >> v1:172.21.15.167:6789/0 conn(0x7f37fc0b2d10 legacy=0x7f37fc15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3801487700 1 -- 172.21.15.125:0/3783035489 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc0cc990 con 0x7f37fc0cc200 2023-11-28T11:09:07.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3801487700 1 --2- 172.21.15.125:0/3783035489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc0cc200 0x7f37fc0b27d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009840 tx=0x7f37f8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cc56c9ab7a6d019 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:07.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3800c86700 1 -- 172.21.15.125:0/3783035489 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8011830 con 0x7f37fc0cc200 2023-11-28T11:09:07.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3800c86700 1 -- 172.21.15.125:0/3783035489 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f8011990 con 0x7f37fc0cc200 2023-11-28T11:09:07.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.267+0000 7f3800c86700 1 -- 172.21.15.125:0/3783035489 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8011d20 con 0x7f37fc0cc200 2023-11-28T11:09:07.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.268+0000 7f3803eec700 1 -- 172.21.15.125:0/3783035489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc0cc200 msgr2=0x7f37fc0b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.268+0000 7f3803eec700 1 --2- 172.21.15.125:0/3783035489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc0cc200 0x7f37fc0b27d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009840 tx=0x7f37f8009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:07.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.268+0000 7f3803eec700 1 -- 172.21.15.125:0/3783035489 shutdown_connections 2023-11-28T11:09:07.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.268+0000 7f3803eec700 1 --2- 172.21.15.125:0/3783035489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 0x7f37fc0d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.268+0000 7f3803eec700 1 --2- 172.21.15.125:0/3783035489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc0cc200 0x7f37fc0b27d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.268+0000 7f3803eec700 1 -- 172.21.15.125:0/3783035489 >> 172.21.15.125:0/3783035489 conn(0x7f37fc06ea80 msgr2=0x7f37fc06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.268+0000 7f3803eec700 1 -- 172.21.15.125:0/3783035489 shutdown_connections 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.268+0000 7f3803eec700 1 -- 172.21.15.125:0/3783035489 wait complete. 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.269+0000 7f3803eec700 1 Processor -- start 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.269+0000 7f3803eec700 1 -- start start 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3803eec700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc0b2d10 0x7f37fc1f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3803eec700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37fc0cc200 0x7f37fc0c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3803eec700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 0x7f37fc0ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3803eec700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc0c7410 con 0x7f37fc0cc200 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3803eec700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc0ca0c0 con 0x7f37fc0b2d10 2023-11-28T11:09:07.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3803eec700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc0c94b0 con 0x7f37fc15a5f0 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3801487700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37fc0cc200 0x7f37fc0c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3801487700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37fc0cc200 0x7f37fc0c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57730/0 (socket says 172.21.15.125:57730) 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3801487700 1 -- 172.21.15.125:0/2640184124 learned_addr learned my addr 172.21.15.125:0/2640184124 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3801c88700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc0b2d10 0x7f37fc1f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3802489700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 0x7f37fc0ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3801487700 1 -- 172.21.15.125:0/2640184124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 msgr2=0x7f37fc0ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3801487700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 0x7f37fc0ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3801487700 1 -- 172.21.15.125:0/2640184124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc0b2d10 msgr2=0x7f37fc1f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3801487700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc0b2d10 0x7f37fc1f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3801487700 1 -- 172.21.15.125:0/2640184124 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f80094a0 con 0x7f37fc0cc200 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.270+0000 7f3802489700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 0x7f37fc0ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:07.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.271+0000 7f3801487700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37fc0cc200 0x7f37fc0c4700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009fd0 tx=0x7f37f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.271+0000 7f37f27fc700 1 -- 172.21.15.125:0/2640184124 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f80036a0 con 0x7f37fc0cc200 2023-11-28T11:09:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.271+0000 7f37f27fc700 1 -- 172.21.15.125:0/2640184124 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f801f070 con 0x7f37fc0cc200 2023-11-28T11:09:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.271+0000 7f3803eec700 1 -- 172.21.15.125:0/2640184124 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc0ccf50 con 0x7f37fc0cc200 2023-11-28T11:09:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.271+0000 7f37f27fc700 1 -- 172.21.15.125:0/2640184124 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8003a60 con 0x7f37fc0cc200 2023-11-28T11:09:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.271+0000 7f3803eec700 1 -- 172.21.15.125:0/2640184124 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc0ccc70 con 0x7f37fc0cc200 2023-11-28T11:09:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.272+0000 7f3803eec700 1 -- 172.21.15.125:0/2640184124 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc0cd230 con 0x7f37fc0cc200 2023-11-28T11:09:07.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.272+0000 7f37f27fc700 1 -- 172.21.15.125:0/2640184124 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f37f800f050 con 0x7f37fc0cc200 2023-11-28T11:09:07.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.272+0000 7f37f27fc700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f37e00682f0 0x7f37e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.272+0000 7f37f27fc700 1 -- 172.21.15.125:0/2640184124 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f37f8021070 con 0x7f37fc0cc200 2023-11-28T11:09:07.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.273+0000 7f3801c88700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f37e00682f0 0x7f37e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.273+0000 7f3801c88700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f37e00682f0 0x7f37e006a7a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0c8f30 tx=0x7f37ec009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:07.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.277+0000 7f37f27fc700 1 -- 172.21.15.125:0/2640184124 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f37f8053cd0 con 0x7f37fc0cc200 2023-11-28T11:09:07.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.456+0000 7f3803eec700 1 -- 172.21.15.125:0/2640184124 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37fc0743f0 con 0x7f37fc0cc200 2023-11-28T11:09:07.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.457+0000 7f37f27fc700 1 -- 172.21.15.125:0/2640184124 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37f80572f0 con 0x7f37fc0cc200 2023-11-28T11:09:07.459 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:07.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 -- 172.21.15.125:0/2640184124 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f37e00682f0 msgr2=0x7f37e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f37e00682f0 0x7f37e006a7a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0c8f30 tx=0x7f37ec009210 comp rx=0 tx=0).stop 2023-11-28T11:09:07.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 -- 172.21.15.125:0/2640184124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37fc0cc200 msgr2=0x7f37fc0c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37fc0cc200 0x7f37fc0c4700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009fd0 tx=0x7f37f8004750 comp rx=0 tx=0).stop 2023-11-28T11:09:07.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 -- 172.21.15.125:0/2640184124 shutdown_connections 2023-11-28T11:09:07.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f37e00682f0 0x7f37e006a7a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37fc15a5f0 0x7f37fc0ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc0b2d10 0x7f37fc1f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 --2- 172.21.15.125:0/2640184124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37fc0cc200 0x7f37fc0c4700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 -- 172.21.15.125:0/2640184124 >> 172.21.15.125:0/2640184124 conn(0x7f37fc06ea80 msgr2=0x7f37fc158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:07.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 -- 172.21.15.125:0/2640184124 shutdown_connections 2023-11-28T11:09:07.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.459+0000 7f3803eec700 1 -- 172.21.15.125:0/2640184124 wait complete. 2023-11-28T11:09:07.472 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:07.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.593+0000 7eff58ef4700 1 Processor -- start 2023-11-28T11:09:07.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.593+0000 7eff58ef4700 1 -- start start 2023-11-28T11:09:07.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.594+0000 7eff58ef4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7eff540b2ee0 0x7eff540d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.594+0000 7eff58ef4700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff540cc200 0x7eff540ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.594+0000 7eff58ef4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5415a9c0 con 0x7eff5415a5f0 2023-11-28T11:09:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.594+0000 7eff58ef4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff540c7b80 con 0x7eff540b2ee0 2023-11-28T11:09:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.594+0000 7eff58ef4700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff540cc990 con 0x7eff540cc200 2023-11-28T11:09:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff5259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7eff5415a5f0 0x7eff540b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41860/0 (socket says 172.21.15.125:41860) 2023-11-28T11:09:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff51d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7eff540b2ee0 0x7eff540d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff5259c700 1 -- 172.21.15.125:0/319133888 learned_addr learned my addr 172.21.15.125:0/319133888 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff52d9d700 1 --2- 172.21.15.125:0/319133888 >> v2:172.21.15.167:3300/0 conn(0x7eff540cc200 0x7eff540ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff51d9b700 1 -- 172.21.15.125:0/319133888 >> v2:172.21.15.167:3300/0 conn(0x7eff540cc200 msgr2=0x7eff540ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff51d9b700 1 --2- 172.21.15.125:0/319133888 >> v2:172.21.15.167:3300/0 conn(0x7eff540cc200 0x7eff540ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff51d9b700 1 -- 172.21.15.125:0/319133888 >> v1:172.21.15.125:6789/0 conn(0x7eff5415a5f0 legacy=0x7eff540b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff51d9b700 1 -- 172.21.15.125:0/319133888 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff540ccc70 con 0x7eff540b2ee0 2023-11-28T11:09:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff5159a700 1 -- 172.21.15.125:0/319133888 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613317880 0 0) 0x7eff5415a9c0 con 0x7eff5415a5f0 2023-11-28T11:09:07.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff51d9b700 1 --2- 172.21.15.125:0/319133888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540b2ee0 0x7eff540d0ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7eff540cb410 tx=0x7eff44009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ea101173e2f42e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:07.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff5159a700 1 -- 172.21.15.125:0/319133888 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44011830 con 0x7eff540b2ee0 2023-11-28T11:09:07.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff5159a700 1 -- 172.21.15.125:0/319133888 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44011990 con 0x7eff540b2ee0 2023-11-28T11:09:07.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.595+0000 7eff5159a700 1 -- 172.21.15.125:0/319133888 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44011d20 con 0x7eff540b2ee0 2023-11-28T11:09:07.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.596+0000 7eff58ef4700 1 -- 172.21.15.125:0/319133888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540b2ee0 msgr2=0x7eff540d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.596+0000 7eff58ef4700 1 --2- 172.21.15.125:0/319133888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540b2ee0 0x7eff540d0ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7eff540cb410 tx=0x7eff44009b20 comp rx=0 tx=0).stop 2023-11-28T11:09:07.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.596+0000 7eff58ef4700 1 -- 172.21.15.125:0/319133888 shutdown_connections 2023-11-28T11:09:07.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.596+0000 7eff58ef4700 1 --2- 172.21.15.125:0/319133888 >> v2:172.21.15.167:3300/0 conn(0x7eff540cc200 0x7eff540ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.596+0000 7eff58ef4700 1 --2- 172.21.15.125:0/319133888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540b2ee0 0x7eff540d0ad0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.596+0000 7eff58ef4700 1 -- 172.21.15.125:0/319133888 >> 172.21.15.125:0/319133888 conn(0x7eff5406ea80 msgr2=0x7eff5406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:07.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.596+0000 7eff58ef4700 1 -- 172.21.15.125:0/319133888 shutdown_connections 2023-11-28T11:09:07.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.596+0000 7eff58ef4700 1 -- 172.21.15.125:0/319133888 wait complete. 2023-11-28T11:09:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.597+0000 7eff58ef4700 1 Processor -- start 2023-11-28T11:09:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.597+0000 7eff58ef4700 1 -- start start 2023-11-28T11:09:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff58ef4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff540b2ee0 0x7eff5414dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff58ef4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540cc200 0x7eff540c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff58ef4700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff5415a5f0 0x7eff540cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff58ef4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5414e420 con 0x7eff540cc200 2023-11-28T11:09:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff58ef4700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff54150030 con 0x7eff5415a5f0 2023-11-28T11:09:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff58ef4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5414ef90 con 0x7eff540b2ee0 2023-11-28T11:09:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff51d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540cc200 0x7eff540c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff51d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540cc200 0x7eff540c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57744/0 (socket says 172.21.15.125:57744) 2023-11-28T11:09:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff51d9b700 1 -- 172.21.15.125:0/1620025170 learned_addr learned my addr 172.21.15.125:0/1620025170 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff5259c700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff540b2ee0 0x7eff5414dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff52d9d700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff5415a5f0 0x7eff540cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff51d9b700 1 -- 172.21.15.125:0/1620025170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff540b2ee0 msgr2=0x7eff5414dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff51d9b700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff540b2ee0 0x7eff5414dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff51d9b700 1 -- 172.21.15.125:0/1620025170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff5415a5f0 msgr2=0x7eff540cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff51d9b700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff5415a5f0 0x7eff540cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff51d9b700 1 -- 172.21.15.125:0/1620025170 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff440094a0 con 0x7eff540cc200 2023-11-28T11:09:07.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.598+0000 7eff52d9d700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff5415a5f0 0x7eff540cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:07.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.599+0000 7eff51d9b700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540cc200 0x7eff540c5110 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7eff44009b60 tx=0x7eff44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:07.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.599+0000 7eff42ffd700 1 -- 172.21.15.125:0/1620025170 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440045d0 con 0x7eff540cc200 2023-11-28T11:09:07.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.599+0000 7eff42ffd700 1 -- 172.21.15.125:0/1620025170 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4401e070 con 0x7eff540cc200 2023-11-28T11:09:07.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.599+0000 7eff58ef4700 1 -- 172.21.15.125:0/1620025170 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff540cd230 con 0x7eff540cc200 2023-11-28T11:09:07.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.599+0000 7eff42ffd700 1 -- 172.21.15.125:0/1620025170 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440038e0 con 0x7eff540cc200 2023-11-28T11:09:07.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.599+0000 7eff58ef4700 1 -- 172.21.15.125:0/1620025170 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff540ccf50 con 0x7eff540cc200 2023-11-28T11:09:07.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.600+0000 7eff58ef4700 1 -- 172.21.15.125:0/1620025170 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff540cd510 con 0x7eff540cc200 2023-11-28T11:09:07.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.600+0000 7eff42ffd700 1 -- 172.21.15.125:0/1620025170 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7eff4400f050 con 0x7eff540cc200 2023-11-28T11:09:07.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.600+0000 7eff42ffd700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7eff340682f0 0x7eff3406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.600+0000 7eff42ffd700 1 -- 172.21.15.125:0/1620025170 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff44086be0 con 0x7eff540cc200 2023-11-28T11:09:07.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.600+0000 7eff5259c700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7eff340682f0 0x7eff3406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.601+0000 7eff5259c700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7eff340682f0 0x7eff3406a7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff48007fd0 tx=0x7eff48007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.604+0000 7eff42ffd700 1 -- 172.21.15.125:0/1620025170 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7eff44053440 con 0x7eff540cc200 2023-11-28T11:09:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.789+0000 7eff58ef4700 1 -- 172.21.15.125:0/1620025170 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff540743f0 con 0x7eff540cc200 2023-11-28T11:09:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.789+0000 7eff42ffd700 1 -- 172.21.15.125:0/1620025170 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff440150a0 con 0x7eff540cc200 2023-11-28T11:09:07.792 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:07.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 -- 172.21.15.125:0/1620025170 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7eff340682f0 msgr2=0x7eff3406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7eff340682f0 0x7eff3406a7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff48007fd0 tx=0x7eff48007de0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 -- 172.21.15.125:0/1620025170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540cc200 msgr2=0x7eff540c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540cc200 0x7eff540c5110 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7eff44009b60 tx=0x7eff44004750 comp rx=0 tx=0).stop 2023-11-28T11:09:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 -- 172.21.15.125:0/1620025170 shutdown_connections 2023-11-28T11:09:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff5415a5f0 0x7eff540cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7eff340682f0 0x7eff3406a7a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff540b2ee0 0x7eff5414dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 --2- 172.21.15.125:0/1620025170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540cc200 0x7eff540c5110 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 -- 172.21.15.125:0/1620025170 >> 172.21.15.125:0/1620025170 conn(0x7eff5406ea80 msgr2=0x7eff540b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 -- 172.21.15.125:0/1620025170 shutdown_connections 2023-11-28T11:09:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.791+0000 7eff58ef4700 1 -- 172.21.15.125:0/1620025170 wait complete. 2023-11-28T11:09:07.807 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:07.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.925+0000 7fe133b43700 1 Processor -- start 2023-11-28T11:09:07.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.926+0000 7fe133b43700 1 -- start start 2023-11-28T11:09:07.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.926+0000 7fe133b43700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe12c06a270 0x7fe12c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.926+0000 7fe133b43700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe12c15cc80 0x7fe12c06de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.926+0000 7fe133b43700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12c06ab80 con 0x7fe12c06e3a0 2023-11-28T11:09:07.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.926+0000 7fe133b43700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12c0b2490 con 0x7fe12c15cc80 2023-11-28T11:09:07.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.926+0000 7fe133b43700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12c0b1810 con 0x7fe12c06a270 2023-11-28T11:09:07.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.926+0000 7fe1310de700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe12c15cc80 0x7fe12c06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1320e0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe12c06e3a0 0x7fe12c06ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41876/0 (socket says 172.21.15.125:41876) 2023-11-28T11:09:07.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1310de700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe12c15cc80 0x7fe12c06de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57750/0 (socket says 172.21.15.125:57750) 2023-11-28T11:09:07.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1320e0700 1 -- 172.21.15.125:0/923913882 learned_addr learned my addr 172.21.15.125:0/923913882 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:07.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1318df700 1 --2- 172.21.15.125:0/923913882 >> v2:172.21.15.167:3300/0 conn(0x7fe12c06a270 0x7fe12c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1310de700 1 -- 172.21.15.125:0/923913882 >> v2:172.21.15.167:3300/0 conn(0x7fe12c06a270 msgr2=0x7fe12c06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:07.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1310de700 1 --2- 172.21.15.125:0/923913882 >> v2:172.21.15.167:3300/0 conn(0x7fe12c06a270 0x7fe12c06a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1310de700 1 -- 172.21.15.125:0/923913882 >> v1:172.21.15.125:6789/0 conn(0x7fe12c06e3a0 legacy=0x7fe12c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1308dd700 1 -- 172.21.15.125:0/923913882 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242536191 0 0) 0x7fe12c06ab80 con 0x7fe12c06e3a0 2023-11-28T11:09:07.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1310de700 1 -- 172.21.15.125:0/923913882 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c0b1af0 con 0x7fe12c15cc80 2023-11-28T11:09:07.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1310de700 1 --2- 172.21.15.125:0/923913882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12c15cc80 0x7fe12c06de60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe12c067380 tx=0x7fe11c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43db478ed301e6e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:07.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1308dd700 1 -- 172.21.15.125:0/923913882 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c011830 con 0x7fe12c15cc80 2023-11-28T11:09:07.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1308dd700 1 -- 172.21.15.125:0/923913882 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c011990 con 0x7fe12c15cc80 2023-11-28T11:09:07.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.927+0000 7fe1308dd700 1 -- 172.21.15.125:0/923913882 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c011d20 con 0x7fe12c15cc80 2023-11-28T11:09:07.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.928+0000 7fe133b43700 1 -- 172.21.15.125:0/923913882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12c15cc80 msgr2=0x7fe12c06de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.928+0000 7fe133b43700 1 --2- 172.21.15.125:0/923913882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12c15cc80 0x7fe12c06de60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe12c067380 tx=0x7fe11c009b20 comp rx=0 tx=0).stop 2023-11-28T11:09:07.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.928+0000 7fe133b43700 1 -- 172.21.15.125:0/923913882 shutdown_connections 2023-11-28T11:09:07.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.928+0000 7fe133b43700 1 --2- 172.21.15.125:0/923913882 >> v2:172.21.15.167:3300/0 conn(0x7fe12c06a270 0x7fe12c06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.928+0000 7fe133b43700 1 --2- 172.21.15.125:0/923913882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12c15cc80 0x7fe12c06de60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.928+0000 7fe133b43700 1 -- 172.21.15.125:0/923913882 >> 172.21.15.125:0/923913882 conn(0x7fe12c06c010 msgr2=0x7fe12c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:07.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.928+0000 7fe133b43700 1 -- 172.21.15.125:0/923913882 shutdown_connections 2023-11-28T11:09:07.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.928+0000 7fe133b43700 1 -- 172.21.15.125:0/923913882 wait complete. 2023-11-28T11:09:07.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.929+0000 7fe133b43700 1 Processor -- start 2023-11-28T11:09:07.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.929+0000 7fe133b43700 1 -- start start 2023-11-28T11:09:07.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe133b43700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe12c06a270 0x7fe12c152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe133b43700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe12c06e3a0 0x7fe12c152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe133b43700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12c15cc80 0x7fe12c152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe133b43700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0c60d0 con 0x7fe12c15cc80 2023-11-28T11:09:07.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe133b43700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0c63b0 con 0x7fe12c06e3a0 2023-11-28T11:09:07.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe133b43700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0c8020 con 0x7fe12c06a270 2023-11-28T11:09:07.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1320e0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12c15cc80 0x7fe12c152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1320e0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12c15cc80 0x7fe12c152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57758/0 (socket says 172.21.15.125:57758) 2023-11-28T11:09:07.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1320e0700 1 -- 172.21.15.125:0/429145953 learned_addr learned my addr 172.21.15.125:0/429145953 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:07.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1310de700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe12c06e3a0 0x7fe12c152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1320e0700 1 -- 172.21.15.125:0/429145953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe12c06a270 msgr2=0x7fe12c152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1320e0700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe12c06a270 0x7fe12c152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1320e0700 1 -- 172.21.15.125:0/429145953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe12c06e3a0 msgr2=0x7fe12c152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:07.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1320e0700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe12c06e3a0 0x7fe12c152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:07.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1320e0700 1 -- 172.21.15.125:0/429145953 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0094a0 con 0x7fe12c15cc80 2023-11-28T11:09:07.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1320e0700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12c15cc80 0x7fe12c152ff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe12800cba0 tx=0x7fe12800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:07.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1227fc700 1 -- 172.21.15.125:0/429145953 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12800ab80 con 0x7fe12c15cc80 2023-11-28T11:09:07.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1227fc700 1 -- 172.21.15.125:0/429145953 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12800ad00 con 0x7fe12c15cc80 2023-11-28T11:09:07.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe133b43700 1 -- 172.21.15.125:0/429145953 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12c0b20b0 con 0x7fe12c15cc80 2023-11-28T11:09:07.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe1227fc700 1 -- 172.21.15.125:0/429145953 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128007310 con 0x7fe12c15cc80 2023-11-28T11:09:07.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.930+0000 7fe133b43700 1 -- 172.21.15.125:0/429145953 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12c0b1dd0 con 0x7fe12c15cc80 2023-11-28T11:09:07.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.931+0000 7fe133b43700 1 -- 172.21.15.125:0/429145953 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12c06e7c0 con 0x7fe12c15cc80 2023-11-28T11:09:07.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.932+0000 7fe1227fc700 1 -- 172.21.15.125:0/429145953 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe12801a030 con 0x7fe12c15cc80 2023-11-28T11:09:07.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.932+0000 7fe1227fc700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1100682f0 0x7fe11006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:07.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.932+0000 7fe1227fc700 1 -- 172.21.15.125:0/429145953 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1280859e0 con 0x7fe12c15cc80 2023-11-28T11:09:07.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.932+0000 7fe1318df700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1100682f0 0x7fe11006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:07.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.932+0000 7fe1318df700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1100682f0 0x7fe11006a7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe12c1e92d0 tx=0x7fe124008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:07.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:07.936+0000 7fe1227fc700 1 -- 172.21.15.125:0/429145953 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe1280521e0 con 0x7fe12c15cc80 2023-11-28T11:09:08.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.122+0000 7fe133b43700 1 -- 172.21.15.125:0/429145953 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe12c0c6570 con 0x7fe12c15cc80 2023-11-28T11:09:08.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.124+0000 7fe1227fc700 1 -- 172.21.15.125:0/429145953 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7fe128018090 con 0x7fe12c15cc80 2023-11-28T11:09:08.125 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:08.125 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:08.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.125+0000 7fe133b43700 1 -- 172.21.15.125:0/429145953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1100682f0 msgr2=0x7fe11006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.126+0000 7fe133b43700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1100682f0 0x7fe11006a7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe12c1e92d0 tx=0x7fe124008040 comp rx=0 tx=0).stop 2023-11-28T11:09:08.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.126+0000 7fe133b43700 1 -- 172.21.15.125:0/429145953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12c15cc80 msgr2=0x7fe12c152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.126+0000 7fe133b43700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12c15cc80 0x7fe12c152ff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe12800cba0 tx=0x7fe12800cf60 comp rx=0 tx=0).stop 2023-11-28T11:09:08.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.126+0000 7fe133b43700 1 -- 172.21.15.125:0/429145953 shutdown_connections 2023-11-28T11:09:08.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.126+0000 7fe133b43700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12c15cc80 0x7fe12c152ff0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.126+0000 7fe133b43700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1100682f0 0x7fe11006a7a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.126+0000 7fe133b43700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe12c06a270 0x7fe12c152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.126+0000 7fe133b43700 1 --2- 172.21.15.125:0/429145953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe12c06e3a0 0x7fe12c152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.126+0000 7fe133b43700 1 -- 172.21.15.125:0/429145953 >> 172.21.15.125:0/429145953 conn(0x7fe12c06c010 msgr2=0x7fe12c0ad4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:08.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.126+0000 7fe133b43700 1 -- 172.21.15.125:0/429145953 shutdown_connections 2023-11-28T11:09:08.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.126+0000 7fe133b43700 1 -- 172.21.15.125:0/429145953 wait complete. 2023-11-28T11:09:08.141 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:08.141 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:08.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.262+0000 7fb0bf3cc700 1 Processor -- start 2023-11-28T11:09:08.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.262+0000 7fb0bf3cc700 1 -- start start 2023-11-28T11:09:08.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bf3cc700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0b80b1650 0x7fb0b80b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bf3cc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b81599b0 0x7fb0b815d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bf3cc700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b8159ec0 con 0x7fb0b80af0a0 2023-11-28T11:09:08.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bf3cc700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b815aa60 con 0x7fb0b80b1650 2023-11-28T11:09:08.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bf3cc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80b1f60 con 0x7fb0b81599b0 2023-11-28T11:09:08.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bc967700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b81599b0 0x7fb0b815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bd168700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0b80b1650 0x7fb0b80b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bd969700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb0b80af0a0 0x7fb0b815a350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:44692/0 (socket says 172.21.15.125:44692) 2023-11-28T11:09:08.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bc967700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b81599b0 0x7fb0b815d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:52772/0 (socket says 172.21.15.125:52772) 2023-11-28T11:09:08.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bd969700 1 -- 172.21.15.125:0/1391776278 learned_addr learned my addr 172.21.15.125:0/1391776278 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:08.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bd168700 1 -- 172.21.15.125:0/1391776278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b81599b0 msgr2=0x7fb0b815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:08.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.263+0000 7fb0bd168700 1 --2- 172.21.15.125:0/1391776278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b81599b0 0x7fb0b815d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0bd168700 1 -- 172.21.15.125:0/1391776278 >> v1:172.21.15.167:6789/0 conn(0x7fb0b80af0a0 legacy=0x7fb0b815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0affff700 1 -- 172.21.15.125:0/1391776278 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950316657 0 0) 0x7fb0b8159ec0 con 0x7fb0b80af0a0 2023-11-28T11:09:08.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0bd168700 1 -- 172.21.15.125:0/1391776278 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b815d8a0 con 0x7fb0b80b1650 2023-11-28T11:09:08.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0bc967700 1 --2- 172.21.15.125:0/1391776278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b81599b0 0x7fb0b815d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:08.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0bd168700 1 --2- 172.21.15.125:0/1391776278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b80b1650 0x7fb0b80b1a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009840 tx=0x7fb0a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b714ec8ea13057f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:08.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0affff700 1 -- 172.21.15.125:0/1391776278 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011830 con 0x7fb0b80b1650 2023-11-28T11:09:08.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0affff700 1 -- 172.21.15.125:0/1391776278 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a8011990 con 0x7fb0b80b1650 2023-11-28T11:09:08.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0affff700 1 -- 172.21.15.125:0/1391776278 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011d20 con 0x7fb0b80b1650 2023-11-28T11:09:08.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0bf3cc700 1 -- 172.21.15.125:0/1391776278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b80b1650 msgr2=0x7fb0b80b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0bf3cc700 1 --2- 172.21.15.125:0/1391776278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b80b1650 0x7fb0b80b1a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009840 tx=0x7fb0a8009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:08.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0bf3cc700 1 -- 172.21.15.125:0/1391776278 shutdown_connections 2023-11-28T11:09:08.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0bf3cc700 1 --2- 172.21.15.125:0/1391776278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b80b1650 0x7fb0b80b1a20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0bf3cc700 1 --2- 172.21.15.125:0/1391776278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b81599b0 0x7fb0b815d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.264+0000 7fb0bf3cc700 1 -- 172.21.15.125:0/1391776278 >> 172.21.15.125:0/1391776278 conn(0x7fb0b806c010 msgr2=0x7fb0b80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:08.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.265+0000 7fb0bf3cc700 1 -- 172.21.15.125:0/1391776278 shutdown_connections 2023-11-28T11:09:08.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.265+0000 7fb0bf3cc700 1 -- 172.21.15.125:0/1391776278 wait complete. 2023-11-28T11:09:08.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.266+0000 7fb0bf3cc700 1 Processor -- start 2023-11-28T11:09:08.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.266+0000 7fb0bf3cc700 1 -- start start 2023-11-28T11:09:08.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.266+0000 7fb0bf3cc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b80af0a0 0x7fb0b814f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.266+0000 7fb0bf3cc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b80b1650 0x7fb0b80cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.266+0000 7fb0bf3cc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b80cb5f0 0x7fb0b81f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.266+0000 7fb0bf3cc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b81f6df0 con 0x7fb0b80af0a0 2023-11-28T11:09:08.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.266+0000 7fb0bf3cc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b81503d0 con 0x7fb0b80b1650 2023-11-28T11:09:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.266+0000 7fb0bf3cc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80cba70 con 0x7fb0b80cb5f0 2023-11-28T11:09:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bd168700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b80af0a0 0x7fb0b814f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bd168700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b80af0a0 0x7fb0b814f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57770/0 (socket says 172.21.15.125:57770) 2023-11-28T11:09:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bd168700 1 -- 172.21.15.125:0/3495060364 learned_addr learned my addr 172.21.15.125:0/3495060364 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bc967700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b80b1650 0x7fb0b80cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bd969700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b80cb5f0 0x7fb0b81f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bd168700 1 -- 172.21.15.125:0/3495060364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b80cb5f0 msgr2=0x7fb0b81f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bd168700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b80cb5f0 0x7fb0b81f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bd168700 1 -- 172.21.15.125:0/3495060364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b80b1650 msgr2=0x7fb0b80cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bd168700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b80b1650 0x7fb0b80cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bd168700 1 -- 172.21.15.125:0/3495060364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b40094a0 con 0x7fb0b80af0a0 2023-11-28T11:09:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bd969700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b80cb5f0 0x7fb0b81f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bd168700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b80af0a0 0x7fb0b814f8d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009b90 tx=0x7fb0a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0adffb700 1 -- 172.21.15.125:0/3495060364 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80038a0 con 0x7fb0b80af0a0 2023-11-28T11:09:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0adffb700 1 -- 172.21.15.125:0/3495060364 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a801e070 con 0x7fb0b80af0a0 2023-11-28T11:09:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0bf3cc700 1 -- 172.21.15.125:0/3495060364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a80094a0 con 0x7fb0b80af0a0 2023-11-28T11:09:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.267+0000 7fb0adffb700 1 -- 172.21.15.125:0/3495060364 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8003c40 con 0x7fb0b80af0a0 2023-11-28T11:09:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.268+0000 7fb0bf3cc700 1 -- 172.21.15.125:0/3495060364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b815de60 con 0x7fb0b80af0a0 2023-11-28T11:09:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.268+0000 7fb0a37fe700 1 -- 172.21.15.125:0/3495060364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0900052f0 con 0x7fb0b80af0a0 2023-11-28T11:09:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.269+0000 7fb0adffb700 1 -- 172.21.15.125:0/3495060364 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb0a800f050 con 0x7fb0b80af0a0 2023-11-28T11:09:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.269+0000 7fb0adffb700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 0x7fb09c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.269+0000 7fb0adffb700 1 -- 172.21.15.125:0/3495060364 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0a8086d40 con 0x7fb0b80af0a0 2023-11-28T11:09:08.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.269+0000 7fb0bc967700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 0x7fb09c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.270+0000 7fb0bc967700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 0x7fb09c06a7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80b5900 tx=0x7fb0b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:08.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.273+0000 7fb0adffb700 1 -- 172.21.15.125:0/3495060364 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb0a80534b0 con 0x7fb0b80af0a0 2023-11-28T11:09:08.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.457+0000 7fb0a37fe700 1 -- 172.21.15.125:0/3495060364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb090005b20 con 0x7fb0b80af0a0 2023-11-28T11:09:08.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.458+0000 7fb0adffb700 1 -- 172.21.15.125:0/3495060364 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0a80150a0 con 0x7fb0b80af0a0 2023-11-28T11:09:08.459 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 -- 172.21.15.125:0/3495060364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 msgr2=0x7fb09c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 0x7fb09c06a7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80b5900 tx=0x7fb0b4008040 comp rx=0 tx=0).stop 2023-11-28T11:09:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 -- 172.21.15.125:0/3495060364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b80af0a0 msgr2=0x7fb0b814f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b80af0a0 0x7fb0b814f8d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009b90 tx=0x7fb0a8004750 comp rx=0 tx=0).stop 2023-11-28T11:09:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 -- 172.21.15.125:0/3495060364 shutdown_connections 2023-11-28T11:09:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 0x7fb09c06a7a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b80cb5f0 0x7fb0b81f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b80af0a0 0x7fb0b814f8d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 --2- 172.21.15.125:0/3495060364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b80b1650 0x7fb0b80cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 -- 172.21.15.125:0/3495060364 >> 172.21.15.125:0/3495060364 conn(0x7fb0b806c010 msgr2=0x7fb0b80b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:08.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 -- 172.21.15.125:0/3495060364 shutdown_connections 2023-11-28T11:09:08.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.460+0000 7fb0a37fe700 1 -- 172.21.15.125:0/3495060364 wait complete. 2023-11-28T11:09:08.473 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:08.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.594+0000 7fc0f8158700 1 Processor -- start 2023-11-28T11:09:08.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.595+0000 7fc0f8158700 1 -- start start 2023-11-28T11:09:08.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.595+0000 7fc0f8158700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00cf710 0x7fc0f00ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.595+0000 7fc0f8158700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0f006a980 0x7fc0f0071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.595+0000 7fc0f8158700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f015cc10 con 0x7fc0f0071890 2023-11-28T11:09:08.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.595+0000 7fc0f8158700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f006c9b0 con 0x7fc0f006a980 2023-11-28T11:09:08.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.595+0000 7fc0f8158700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f006cc90 con 0x7fc0f00cf710 2023-11-28T11:09:08.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.595+0000 7fc0f66f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0f006a980 0x7fc0f0071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.595+0000 7fc0f66f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0f006a980 0x7fc0f0071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57778/0 (socket says 172.21.15.125:57778) 2023-11-28T11:09:08.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.595+0000 7fc0f66f5700 1 -- 172.21.15.125:0/2954797461 learned_addr learned my addr 172.21.15.125:0/2954797461 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:08.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.596+0000 7fc0f5ef4700 1 --2- 172.21.15.125:0/2954797461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00cf710 0x7fc0f00ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.596+0000 7fc0f66f5700 1 -- 172.21.15.125:0/2954797461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00cf710 msgr2=0x7fc0f00ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:08.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.596+0000 7fc0f66f5700 1 --2- 172.21.15.125:0/2954797461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00cf710 0x7fc0f00ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.596+0000 7fc0f66f5700 1 -- 172.21.15.125:0/2954797461 >> v1:172.21.15.167:6789/0 conn(0x7fc0f0071890 legacy=0x7fc0f006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.596+0000 7fc0f66f5700 1 -- 172.21.15.125:0/2954797461 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f006cf70 con 0x7fc0f006a980 2023-11-28T11:09:08.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.596+0000 7fc0f66f5700 1 --2- 172.21.15.125:0/2954797461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0f006a980 0x7fc0f0071220 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009e50 tx=0x7fc0e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39bd8800ad9d09b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:08.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.596+0000 7fc0f4ef2700 1 -- 172.21.15.125:0/2954797461 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e800e070 con 0x7fc0f006a980 2023-11-28T11:09:08.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.596+0000 7fc0f4ef2700 1 -- 172.21.15.125:0/2954797461 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e800b9c0 con 0x7fc0f006a980 2023-11-28T11:09:08.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.596+0000 7fc0f4ef2700 1 -- 172.21.15.125:0/2954797461 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e800bd70 con 0x7fc0f006a980 2023-11-28T11:09:08.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.597+0000 7fc0f8158700 1 -- 172.21.15.125:0/2954797461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0f006a980 msgr2=0x7fc0f0071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.597+0000 7fc0f8158700 1 --2- 172.21.15.125:0/2954797461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0f006a980 0x7fc0f0071220 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009e50 tx=0x7fc0e800b330 comp rx=0 tx=0).stop 2023-11-28T11:09:08.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.597+0000 7fc0f8158700 1 -- 172.21.15.125:0/2954797461 shutdown_connections 2023-11-28T11:09:08.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.597+0000 7fc0f8158700 1 --2- 172.21.15.125:0/2954797461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0f006a980 0x7fc0f0071220 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.597+0000 7fc0f8158700 1 --2- 172.21.15.125:0/2954797461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00cf710 0x7fc0f00ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.597+0000 7fc0f8158700 1 -- 172.21.15.125:0/2954797461 >> 172.21.15.125:0/2954797461 conn(0x7fc0f006c010 msgr2=0x7fc0f00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:08.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.597+0000 7fc0f8158700 1 -- 172.21.15.125:0/2954797461 shutdown_connections 2023-11-28T11:09:08.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.597+0000 7fc0f8158700 1 -- 172.21.15.125:0/2954797461 wait complete. 2023-11-28T11:09:08.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.598+0000 7fc0f8158700 1 Processor -- start 2023-11-28T11:09:08.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.598+0000 7fc0f8158700 1 -- start start 2023-11-28T11:09:08.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f8158700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0f006a980 0x7fc0f01f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f8158700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f0071890 0x7fc0f01582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f8158700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f00cf710 0x7fc0f015e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f8158700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01587e0 con 0x7fc0f006a980 2023-11-28T11:09:08.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f8158700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01f3880 con 0x7fc0f00cf710 2023-11-28T11:09:08.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f8158700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01f2fe0 con 0x7fc0f0071890 2023-11-28T11:09:08.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f5ef4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0f006a980 0x7fc0f01f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f5ef4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0f006a980 0x7fc0f01f28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57780/0 (socket says 172.21.15.125:57780) 2023-11-28T11:09:08.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f5ef4700 1 -- 172.21.15.125:0/2209246315 learned_addr learned my addr 172.21.15.125:0/2209246315 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:08.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f66f5700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f00cf710 0x7fc0f015e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f56f3700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f0071890 0x7fc0f01582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f5ef4700 1 -- 172.21.15.125:0/2209246315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f0071890 msgr2=0x7fc0f01582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f5ef4700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f0071890 0x7fc0f01582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f5ef4700 1 -- 172.21.15.125:0/2209246315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f00cf710 msgr2=0x7fc0f015e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f5ef4700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f00cf710 0x7fc0f015e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f5ef4700 1 -- 172.21.15.125:0/2209246315 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8009b30 con 0x7fc0f006a980 2023-11-28T11:09:08.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f5ef4700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0f006a980 0x7fc0f01f28e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000d800 tx=0x7fc0e000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:08.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0e67fc700 1 -- 172.21.15.125:0/2209246315 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e00125f0 con 0x7fc0f006a980 2023-11-28T11:09:08.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0e67fc700 1 -- 172.21.15.125:0/2209246315 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e0012750 con 0x7fc0f006a980 2023-11-28T11:09:08.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f8158700 1 -- 172.21.15.125:0/2209246315 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f006d530 con 0x7fc0f006a980 2023-11-28T11:09:08.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0e67fc700 1 -- 172.21.15.125:0/2209246315 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0012b00 con 0x7fc0f006a980 2023-11-28T11:09:08.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.599+0000 7fc0f8158700 1 -- 172.21.15.125:0/2209246315 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f006d250 con 0x7fc0f006a980 2023-11-28T11:09:08.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.600+0000 7fc0f8158700 1 -- 172.21.15.125:0/2209246315 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f0160480 con 0x7fc0f006a980 2023-11-28T11:09:08.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.601+0000 7fc0e67fc700 1 -- 172.21.15.125:0/2209246315 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc0e0012c60 con 0x7fc0f006a980 2023-11-28T11:09:08.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.601+0000 7fc0e67fc700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc0d40682f0 0x7fc0d406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.601+0000 7fc0e67fc700 1 -- 172.21.15.125:0/2209246315 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0e0085e80 con 0x7fc0f006a980 2023-11-28T11:09:08.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.601+0000 7fc0f56f3700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc0d40682f0 0x7fc0d406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.602+0000 7fc0f56f3700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc0d40682f0 0x7fc0d406a7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0157710 tx=0x7fc0ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:08.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.605+0000 7fc0e67fc700 1 -- 172.21.15.125:0/2209246315 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc0e00526e0 con 0x7fc0f006a980 2023-11-28T11:09:08.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.787+0000 7fc0f8158700 1 -- 172.21.15.125:0/2209246315 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc0f015d2a0 con 0x7fc0f006a980 2023-11-28T11:09:08.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.787+0000 7fc0e67fc700 1 -- 172.21.15.125:0/2209246315 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc0e0055d00 con 0x7fc0f006a980 2023-11-28T11:09:08.789 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:08.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 -- 172.21.15.125:0/2209246315 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc0d40682f0 msgr2=0x7fc0d406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc0d40682f0 0x7fc0d406a7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0157710 tx=0x7fc0ec009040 comp rx=0 tx=0).stop 2023-11-28T11:09:08.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 -- 172.21.15.125:0/2209246315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0f006a980 msgr2=0x7fc0f01f28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0f006a980 0x7fc0f01f28e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000d800 tx=0x7fc0e000db10 comp rx=0 tx=0).stop 2023-11-28T11:09:08.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 -- 172.21.15.125:0/2209246315 shutdown_connections 2023-11-28T11:09:08.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f00cf710 0x7fc0f015e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0f006a980 0x7fc0f01f28e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc0d40682f0 0x7fc0d406a7a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 --2- 172.21.15.125:0/2209246315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f0071890 0x7fc0f01582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 -- 172.21.15.125:0/2209246315 >> 172.21.15.125:0/2209246315 conn(0x7fc0f006c010 msgr2=0x7fc0f006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:08.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 -- 172.21.15.125:0/2209246315 shutdown_connections 2023-11-28T11:09:08.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.789+0000 7fc0f8158700 1 -- 172.21.15.125:0/2209246315 wait complete. 2023-11-28T11:09:08.803 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:08.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.925+0000 7fdf458b1700 1 Processor -- start 2023-11-28T11:09:08.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.925+0000 7fdf458b1700 1 -- start start 2023-11-28T11:09:08.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf458b1700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf4015a5f0 0x7fdf400d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf458b1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdf400cc200 0x7fdf400b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf458b1700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4015a9c0 con 0x7fdf400b2d10 2023-11-28T11:09:08.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf458b1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf400b3190 con 0x7fdf400cc200 2023-11-28T11:09:08.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf458b1700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf400c7b80 con 0x7fdf4015a5f0 2023-11-28T11:09:08.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf3e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdf400cc200 0x7fdf400b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf3e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdf400cc200 0x7fdf400b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57790/0 (socket says 172.21.15.125:57790) 2023-11-28T11:09:08.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf3e7fc700 1 -- 172.21.15.125:0/2559021137 learned_addr learned my addr 172.21.15.125:0/2559021137 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:08.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf3e7fc700 1 -- 172.21.15.125:0/2559021137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf4015a5f0 msgr2=0x7fdf400d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:08.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf3e7fc700 1 --2- 172.21.15.125:0/2559021137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf4015a5f0 0x7fdf400d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf3e7fc700 1 -- 172.21.15.125:0/2559021137 >> v1:172.21.15.167:6789/0 conn(0x7fdf400b2d10 legacy=0x7fdf4015e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:08.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf3e7fc700 1 -- 172.21.15.125:0/2559021137 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf400cc990 con 0x7fdf400cc200 2023-11-28T11:09:08.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf3e7fc700 1 --2- 172.21.15.125:0/2559021137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf400cc200 0x7fdf400b27d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdf340098f0 tx=0x7fdf34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592ec516b6611fba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:08.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf3dffb700 1 -- 172.21.15.125:0/2559021137 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34004230 con 0x7fdf400cc200 2023-11-28T11:09:08.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf3dffb700 1 -- 172.21.15.125:0/2559021137 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf34004390 con 0x7fdf400cc200 2023-11-28T11:09:08.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.926+0000 7fdf3dffb700 1 -- 172.21.15.125:0/2559021137 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340036a0 con 0x7fdf400cc200 2023-11-28T11:09:08.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.927+0000 7fdf458b1700 1 -- 172.21.15.125:0/2559021137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf400cc200 msgr2=0x7fdf400b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.927+0000 7fdf458b1700 1 --2- 172.21.15.125:0/2559021137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf400cc200 0x7fdf400b27d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdf340098f0 tx=0x7fdf34009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:08.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.927+0000 7fdf458b1700 1 -- 172.21.15.125:0/2559021137 shutdown_connections 2023-11-28T11:09:08.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.927+0000 7fdf458b1700 1 --2- 172.21.15.125:0/2559021137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf4015a5f0 0x7fdf400d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.927+0000 7fdf458b1700 1 --2- 172.21.15.125:0/2559021137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf400cc200 0x7fdf400b27d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.927+0000 7fdf458b1700 1 -- 172.21.15.125:0/2559021137 >> 172.21.15.125:0/2559021137 conn(0x7fdf4006ea80 msgr2=0x7fdf4006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:08.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.927+0000 7fdf458b1700 1 -- 172.21.15.125:0/2559021137 shutdown_connections 2023-11-28T11:09:08.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.927+0000 7fdf458b1700 1 -- 172.21.15.125:0/2559021137 wait complete. 2023-11-28T11:09:08.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.928+0000 7fdf458b1700 1 Processor -- start 2023-11-28T11:09:08.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.929+0000 7fdf458b1700 1 -- start start 2023-11-28T11:09:08.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf458b1700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf400b2d10 0x7fdf401f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf458b1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf400cc200 0x7fdf400c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf458b1700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf4015a5f0 0x7fdf400c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf458b1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf401f2340 con 0x7fdf400cc200 2023-11-28T11:09:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf458b1700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4006cf80 con 0x7fdf4015a5f0 2023-11-28T11:09:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf458b1700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf40145fc0 con 0x7fdf400b2d10 2023-11-28T11:09:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf3e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf400cc200 0x7fdf400c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf3e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf400cc200 0x7fdf400c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57796/0 (socket says 172.21.15.125:57796) 2023-11-28T11:09:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf3e7fc700 1 -- 172.21.15.125:0/3038961505 learned_addr learned my addr 172.21.15.125:0/3038961505 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf3e7fc700 1 -- 172.21.15.125:0/3038961505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf400b2d10 msgr2=0x7fdf401f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf3e7fc700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf400b2d10 0x7fdf401f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf3e7fc700 1 -- 172.21.15.125:0/3038961505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf4015a5f0 msgr2=0x7fdf400c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf3f7fe700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf4015a5f0 0x7fdf400c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf3e7fc700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf4015a5f0 0x7fdf400c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf3e7fc700 1 -- 172.21.15.125:0/3038961505 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34009550 con 0x7fdf400cc200 2023-11-28T11:09:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf3f7fe700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf4015a5f0 0x7fdf400c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf3e7fc700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf400cc200 0x7fdf400c4700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdf4006d5f0 tx=0x7fdf34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf27fff700 1 -- 172.21.15.125:0/3038961505 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34003e70 con 0x7fdf400cc200 2023-11-28T11:09:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf27fff700 1 -- 172.21.15.125:0/3038961505 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3401f070 con 0x7fdf400cc200 2023-11-28T11:09:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf458b1700 1 -- 172.21.15.125:0/3038961505 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf400ccf50 con 0x7fdf400cc200 2023-11-28T11:09:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf27fff700 1 -- 172.21.15.125:0/3038961505 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400b8a0 con 0x7fdf400cc200 2023-11-28T11:09:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.930+0000 7fdf458b1700 1 -- 172.21.15.125:0/3038961505 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf400ccc70 con 0x7fdf400cc200 2023-11-28T11:09:08.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.931+0000 7fdf458b1700 1 -- 172.21.15.125:0/3038961505 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf400cd230 con 0x7fdf400cc200 2023-11-28T11:09:08.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.932+0000 7fdf27fff700 1 -- 172.21.15.125:0/3038961505 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdf3402a020 con 0x7fdf400cc200 2023-11-28T11:09:08.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.932+0000 7fdf27fff700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdf2c0682f0 0x7fdf2c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:08.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.932+0000 7fdf27fff700 1 -- 172.21.15.125:0/3038961505 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf34087780 con 0x7fdf400cc200 2023-11-28T11:09:08.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.932+0000 7fdf3effd700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdf2c0682f0 0x7fdf2c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:08.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.933+0000 7fdf3effd700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdf2c0682f0 0x7fdf2c06a7a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdf300097b0 tx=0x7fdf30006d20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:08.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:08.937+0000 7fdf27fff700 1 -- 172.21.15.125:0/3038961505 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdf34053ef0 con 0x7fdf400cc200 2023-11-28T11:09:09.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.120+0000 7fdf458b1700 1 -- 172.21.15.125:0/3038961505 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf400cd230 con 0x7fdf400cc200 2023-11-28T11:09:09.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.120+0000 7fdf27fff700 1 -- 172.21.15.125:0/3038961505 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf34057510 con 0x7fdf400cc200 2023-11-28T11:09:09.122 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:09.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.122+0000 7fdf458b1700 1 -- 172.21.15.125:0/3038961505 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdf2c0682f0 msgr2=0x7fdf2c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.122+0000 7fdf458b1700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdf2c0682f0 0x7fdf2c06a7a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdf300097b0 tx=0x7fdf30006d20 comp rx=0 tx=0).stop 2023-11-28T11:09:09.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.122+0000 7fdf458b1700 1 -- 172.21.15.125:0/3038961505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf400cc200 msgr2=0x7fdf400c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.122+0000 7fdf458b1700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf400cc200 0x7fdf400c4700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdf4006d5f0 tx=0x7fdf34004750 comp rx=0 tx=0).stop 2023-11-28T11:09:09.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.123+0000 7fdf458b1700 1 -- 172.21.15.125:0/3038961505 shutdown_connections 2023-11-28T11:09:09.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.123+0000 7fdf458b1700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf4015a5f0 0x7fdf400c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.123+0000 7fdf458b1700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdf2c0682f0 0x7fdf2c06a7a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.123+0000 7fdf458b1700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf400b2d10 0x7fdf401f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.123+0000 7fdf458b1700 1 --2- 172.21.15.125:0/3038961505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf400cc200 0x7fdf400c4700 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.123+0000 7fdf458b1700 1 -- 172.21.15.125:0/3038961505 >> 172.21.15.125:0/3038961505 conn(0x7fdf4006ea80 msgr2=0x7fdf401560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:09.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.123+0000 7fdf458b1700 1 -- 172.21.15.125:0/3038961505 shutdown_connections 2023-11-28T11:09:09.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.123+0000 7fdf458b1700 1 -- 172.21.15.125:0/3038961505 wait complete. 2023-11-28T11:09:09.136 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:09.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.257+0000 7f283eca6700 1 Processor -- start 2023-11-28T11:09:09.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.257+0000 7f283eca6700 1 -- start start 2023-11-28T11:09:09.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.258+0000 7f283eca6700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f28381599b0 0x7f283815d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.258+0000 7f283eca6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2838159ec0 con 0x7f28380af0a0 2023-11-28T11:09:09.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.258+0000 7f283eca6700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283815aa60 con 0x7f28380b1650 2023-11-28T11:09:09.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.258+0000 7f283eca6700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283815d8a0 con 0x7f28381599b0 2023-11-28T11:09:09.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.258+0000 7f283d243700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f28380af0a0 0x7f283815a350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41930/0 (socket says 172.21.15.125:41930) 2023-11-28T11:09:09.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.258+0000 7f283d243700 1 -- 172.21.15.125:0/610830237 learned_addr learned my addr 172.21.15.125:0/610830237 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:09.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.258+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196288981 0 0) 0x7f2838159ec0 con 0x7f28380af0a0 2023-11-28T11:09:09.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.258+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28280035b0 con 0x7f28380af0a0 2023-11-28T11:09:09.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.258+0000 7f2837fff700 1 --2- 172.21.15.125:0/610830237 >> v2:172.21.15.167:3300/0 conn(0x7f28381599b0 0x7f283815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2326172371 0 0) 0x7f28280035b0 con 0x7f28380af0a0 2023-11-28T11:09:09.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 >> v2:172.21.15.167:3300/0 conn(0x7f28381599b0 msgr2=0x7f283815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:09.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 --2- 172.21.15.125:0/610830237 >> v2:172.21.15.167:3300/0 conn(0x7f28381599b0 0x7f283815d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 >> v1:172.21.15.167:6789/0 conn(0x7f28380b1650 legacy=0x7f28380b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283815db80 con 0x7f28380af0a0 2023-11-28T11:09:09.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f28300019f0 con 0x7f28380af0a0 2023-11-28T11:09:09.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 >> v1:172.21.15.125:6789/0 conn(0x7f28380af0a0 legacy=0x7f283815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 --2- 172.21.15.125:0/610830237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2828003a00 0x7f2828003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 --2- 172.21.15.125:0/610830237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2828004850 0x7f2828004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 --2- 172.21.15.125:0/610830237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2828005200 0x7f282800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283815d8a0 con 0x7f2828003a00 2023-11-28T11:09:09.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282800c190 con 0x7f2828004850 2023-11-28T11:09:09.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282800c350 con 0x7f2828005200 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f283ca42700 1 --2- 172.21.15.125:0/610830237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2828003a00 0x7f2828003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f2837fff700 1 --2- 172.21.15.125:0/610830237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2828004850 0x7f2828004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f283d243700 1 --2- 172.21.15.125:0/610830237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2828005200 0x7f282800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f283ca42700 1 -- 172.21.15.125:0/610830237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2828005200 msgr2=0x7f282800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f283ca42700 1 --2- 172.21.15.125:0/610830237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2828005200 0x7f282800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f283ca42700 1 -- 172.21.15.125:0/610830237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2828004850 msgr2=0x7f2828004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f283ca42700 1 --2- 172.21.15.125:0/610830237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2828004850 0x7f2828004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f283d243700 1 -- 172.21.15.125:0/610830237 reap_dead start 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f283ca42700 1 -- 172.21.15.125:0/610830237 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28280035b0 con 0x7f2828003a00 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f283ca42700 1 --2- 172.21.15.125:0/610830237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2828003a00 0x7f2828003e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f282c007fd0 tx=0x7f2828005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be24b881410a6a2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0052d0 con 0x7f2828003a00 2023-11-28T11:09:09.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c005430 con 0x7f2828003a00 2023-11-28T11:09:09.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.259+0000 7f28377fe700 1 -- 172.21.15.125:0/610830237 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0038c0 con 0x7f2828003a00 2023-11-28T11:09:09.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.260+0000 7f283eca6700 1 -- 172.21.15.125:0/610830237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2828003a00 msgr2=0x7f2828003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.260+0000 7f283eca6700 1 --2- 172.21.15.125:0/610830237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2828003a00 0x7f2828003e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f282c007fd0 tx=0x7f2828005880 comp rx=0 tx=0).stop 2023-11-28T11:09:09.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.260+0000 7f283eca6700 1 -- 172.21.15.125:0/610830237 shutdown_connections 2023-11-28T11:09:09.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.260+0000 7f283eca6700 1 --2- 172.21.15.125:0/610830237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2828003a00 0x7f2828003e10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.260+0000 7f283eca6700 1 -- 172.21.15.125:0/610830237 >> 172.21.15.125:0/610830237 conn(0x7f283806c010 msgr2=0x7f28380cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:09.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.260+0000 7f283eca6700 1 -- 172.21.15.125:0/610830237 shutdown_connections 2023-11-28T11:09:09.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.260+0000 7f283eca6700 1 -- 172.21.15.125:0/610830237 wait complete. 2023-11-28T11:09:09.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.261+0000 7f283eca6700 1 Processor -- start 2023-11-28T11:09:09.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.261+0000 7f283eca6700 1 -- start start 2023-11-28T11:09:09.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.262+0000 7f283eca6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2828003a00 0x7f2838151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.262+0000 7f283eca6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2838151e00 0x7f28381575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.262+0000 7f283eca6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28380b33a0 0x7f28380af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.262+0000 7f283eca6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2838158200 con 0x7f28380b33a0 2023-11-28T11:09:09.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.262+0000 7f283eca6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2838157c40 con 0x7f2828003a00 2023-11-28T11:09:09.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.262+0000 7f283eca6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2838157f20 con 0x7f2838151e00 2023-11-28T11:09:09.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.262+0000 7f283d243700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28380b33a0 0x7f28380af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.262+0000 7f283d243700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28380b33a0 0x7f28380af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57818/0 (socket says 172.21.15.125:57818) 2023-11-28T11:09:09.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.262+0000 7f283d243700 1 -- 172.21.15.125:0/3127550080 learned_addr learned my addr 172.21.15.125:0/3127550080 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:09.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.262+0000 7f283ca42700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2828003a00 0x7f2838151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f2837fff700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2838151e00 0x7f28381575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f283d243700 1 -- 172.21.15.125:0/3127550080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2838151e00 msgr2=0x7f28381575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f283d243700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2838151e00 0x7f28381575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f283d243700 1 -- 172.21.15.125:0/3127550080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2828003a00 msgr2=0x7f2838151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f283d243700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2828003a00 0x7f2838151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f283d243700 1 -- 172.21.15.125:0/3127550080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283815a350 con 0x7f28380b33a0 2023-11-28T11:09:09.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f283ca42700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2828003a00 0x7f2838151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:09.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f2837fff700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2838151e00 0x7f28381575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f283d243700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28380b33a0 0x7f28380af6c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f283806e2a0 tx=0x7f283000a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f28357fa700 1 -- 172.21.15.125:0/3127550080 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283000adc0 con 0x7f28380b33a0 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f28357fa700 1 -- 172.21.15.125:0/3127550080 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28300133f0 con 0x7f28380b33a0 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f283eca6700 1 -- 172.21.15.125:0/3127550080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283815de60 con 0x7f28380b33a0 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f28357fa700 1 -- 172.21.15.125:0/3127550080 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28300137a0 con 0x7f28380b33a0 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.263+0000 7f283eca6700 1 -- 172.21.15.125:0/3127550080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283815a4e0 con 0x7f28380b33a0 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.264+0000 7f283eca6700 1 -- 172.21.15.125:0/3127550080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28380b2a00 con 0x7f28380b33a0 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.264+0000 7f28357fa700 1 -- 172.21.15.125:0/3127550080 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2830013900 con 0x7f28380b33a0 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.264+0000 7f28357fa700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f281c0682f0 0x7f281c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.265+0000 7f28357fa700 1 -- 172.21.15.125:0/3127550080 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2830086760 con 0x7f28380b33a0 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.265+0000 7f283ca42700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f281c0682f0 0x7f281c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.265+0000 7f283ca42700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f281c0682f0 0x7f281c06a7a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f282c001eb0 tx=0x7f282c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:09.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.269+0000 7f28357fa700 1 -- 172.21.15.125:0/3127550080 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f28380b2a00 con 0x7f28380b33a0 2023-11-28T11:09:09.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.449+0000 7f283eca6700 1 -- 172.21.15.125:0/3127550080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28380b2a00 con 0x7f28380b33a0 2023-11-28T11:09:09.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.449+0000 7f28357fa700 1 -- 172.21.15.125:0/3127550080 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28380b2a00 con 0x7f28380b33a0 2023-11-28T11:09:09.451 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:09.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 -- 172.21.15.125:0/3127550080 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f281c0682f0 msgr2=0x7f281c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f281c0682f0 0x7f281c06a7a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f282c001eb0 tx=0x7f282c009030 comp rx=0 tx=0).stop 2023-11-28T11:09:09.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 -- 172.21.15.125:0/3127550080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28380b33a0 msgr2=0x7f28380af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28380b33a0 0x7f28380af6c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f283806e2a0 tx=0x7f283000a5f0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 -- 172.21.15.125:0/3127550080 shutdown_connections 2023-11-28T11:09:09.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28380b33a0 0x7f28380af6c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2828003a00 0x7f2838151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f281c0682f0 0x7f281c06a7a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 --2- 172.21.15.125:0/3127550080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2838151e00 0x7f28381575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 -- 172.21.15.125:0/3127550080 >> 172.21.15.125:0/3127550080 conn(0x7f283806c010 msgr2=0x7f28380715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:09.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 -- 172.21.15.125:0/3127550080 shutdown_connections 2023-11-28T11:09:09.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.451+0000 7f283eca6700 1 -- 172.21.15.125:0/3127550080 wait complete. 2023-11-28T11:09:09.472 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:09:09.473 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-28T11:09:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.594+0000 7fc77d6e5700 1 Processor -- start 2023-11-28T11:09:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.594+0000 7fc77d6e5700 1 -- start start 2023-11-28T11:09:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.595+0000 7fc77d6e5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc778071f70 0x7fc7780cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.595+0000 7fc77d6e5700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc7780b4a30 0x7fc7780b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.595+0000 7fc77d6e5700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7780cfb00 con 0x7fc7780b4660 2023-11-28T11:09:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.595+0000 7fc77d6e5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77815aa20 con 0x7fc778071f70 2023-11-28T11:09:09.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.595+0000 7fc77d6e5700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7780cf4d0 con 0x7fc7780b4a30 2023-11-28T11:09:09.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.596+0000 7fc7767fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc778071f70 0x7fc7780cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.596+0000 7fc7767fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc778071f70 0x7fc7780cff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57822/0 (socket says 172.21.15.125:57822) 2023-11-28T11:09:09.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.596+0000 7fc7767fc700 1 -- 172.21.15.125:0/1500190001 learned_addr learned my addr 172.21.15.125:0/1500190001 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:09.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.596+0000 7fc7767fc700 1 -- 172.21.15.125:0/1500190001 >> v2:172.21.15.167:3300/0 conn(0x7fc7780b4a30 msgr2=0x7fc7780b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:09.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.596+0000 7fc7767fc700 1 --2- 172.21.15.125:0/1500190001 >> v2:172.21.15.167:3300/0 conn(0x7fc7780b4a30 0x7fc7780b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.596+0000 7fc7767fc700 1 -- 172.21.15.125:0/1500190001 >> v1:172.21.15.167:6789/0 conn(0x7fc7780b4660 legacy=0x7fc77806b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.596+0000 7fc7767fc700 1 -- 172.21.15.125:0/1500190001 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778072550 con 0x7fc778071f70 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.596+0000 7fc7767fc700 1 --2- 172.21.15.125:0/1500190001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc778071f70 0x7fc7780cff90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc778073cf0 tx=0x7fc768009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e87e6839e666f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.596+0000 7fc775ffb700 1 -- 172.21.15.125:0/1500190001 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768004230 con 0x7fc778071f70 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.596+0000 7fc775ffb700 1 -- 172.21.15.125:0/1500190001 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc768004390 con 0x7fc778071f70 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.596+0000 7fc775ffb700 1 -- 172.21.15.125:0/1500190001 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7680036a0 con 0x7fc778071f70 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.597+0000 7fc77d6e5700 1 -- 172.21.15.125:0/1500190001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc778071f70 msgr2=0x7fc7780cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.597+0000 7fc77d6e5700 1 --2- 172.21.15.125:0/1500190001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc778071f70 0x7fc7780cff90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc778073cf0 tx=0x7fc768009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.597+0000 7fc77d6e5700 1 -- 172.21.15.125:0/1500190001 shutdown_connections 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.597+0000 7fc77d6e5700 1 --2- 172.21.15.125:0/1500190001 >> v2:172.21.15.167:3300/0 conn(0x7fc7780b4a30 0x7fc7780b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.597+0000 7fc77d6e5700 1 --2- 172.21.15.125:0/1500190001 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc778071f70 0x7fc7780cff90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.597+0000 7fc77d6e5700 1 -- 172.21.15.125:0/1500190001 >> 172.21.15.125:0/1500190001 conn(0x7fc7780b2fc0 msgr2=0x7fc778071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:09.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.597+0000 7fc77d6e5700 1 -- 172.21.15.125:0/1500190001 shutdown_connections 2023-11-28T11:09:09.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.597+0000 7fc77d6e5700 1 -- 172.21.15.125:0/1500190001 wait complete. 2023-11-28T11:09:09.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.598+0000 7fc77d6e5700 1 Processor -- start 2023-11-28T11:09:09.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.598+0000 7fc77d6e5700 1 -- start start 2023-11-28T11:09:09.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.599+0000 7fc77d6e5700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc778071f70 0x7fc778156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.599+0000 7fc77d6e5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7780b4660 0x7fc7780ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.599+0000 7fc77d6e5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7780b4a30 0x7fc7780ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.599+0000 7fc77d6e5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7781f1470 con 0x7fc7780b4a30 2023-11-28T11:09:09.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.599+0000 7fc77d6e5700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7781f4960 con 0x7fc778071f70 2023-11-28T11:09:09.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.599+0000 7fc77d6e5700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780c6520 con 0x7fc7780b4660 2023-11-28T11:09:09.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.599+0000 7fc7777fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7780b4a30 0x7fc7780ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.599+0000 7fc7777fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7780b4a30 0x7fc7780ac720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57830/0 (socket says 172.21.15.125:57830) 2023-11-28T11:09:09.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.599+0000 7fc7777fe700 1 -- 172.21.15.125:0/3753186547 learned_addr learned my addr 172.21.15.125:0/3753186547 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:09.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.599+0000 7fc7767fc700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7780b4660 0x7fc7780ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.599+0000 7fc776ffd700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc778071f70 0x7fc778156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.600+0000 7fc7777fe700 1 -- 172.21.15.125:0/3753186547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7780b4660 msgr2=0x7fc7780ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.600+0000 7fc7777fe700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7780b4660 0x7fc7780ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.600+0000 7fc7777fe700 1 -- 172.21.15.125:0/3753186547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc778071f70 msgr2=0x7fc778156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:09.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.600+0000 7fc7777fe700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc778071f70 0x7fc778156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:09.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.600+0000 7fc7777fe700 1 -- 172.21.15.125:0/3753186547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768009550 con 0x7fc7780b4a30 2023-11-28T11:09:09.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.600+0000 7fc7777fe700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7780b4a30 0x7fc7780ac720 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc77000ba10 tx=0x7fc77000bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:09.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.600+0000 7fc75f7fe700 1 -- 172.21.15.125:0/3753186547 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000d8e0 con 0x7fc7780b4a30 2023-11-28T11:09:09.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.600+0000 7fc75f7fe700 1 -- 172.21.15.125:0/3753186547 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77000da80 con 0x7fc7780b4a30 2023-11-28T11:09:09.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.600+0000 7fc77d6e5700 1 -- 172.21.15.125:0/3753186547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77815f170 con 0x7fc7780b4a30 2023-11-28T11:09:09.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.600+0000 7fc75f7fe700 1 -- 172.21.15.125:0/3753186547 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000de30 con 0x7fc7780b4a30 2023-11-28T11:09:09.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.600+0000 7fc77d6e5700 1 -- 172.21.15.125:0/3753186547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7780cf790 con 0x7fc7780b4a30 2023-11-28T11:09:09.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.601+0000 7fc77d6e5700 1 -- 172.21.15.125:0/3753186547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77815f300 con 0x7fc7780b4a30 2023-11-28T11:09:09.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.601+0000 7fc75f7fe700 1 -- 172.21.15.125:0/3753186547 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc770015420 con 0x7fc7780b4a30 2023-11-28T11:09:09.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.601+0000 7fc75f7fe700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7640682f0 0x7fc76406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:09.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.602+0000 7fc75f7fe700 1 -- 172.21.15.125:0/3753186547 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc770011070 con 0x7fc7780b4a30 2023-11-28T11:09:09.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.602+0000 7fc776ffd700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7640682f0 0x7fc76406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:09.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.602+0000 7fc776ffd700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7640682f0 0x7fc76406a7a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc76c007fd0 tx=0x7fc76c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:09.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.606+0000 7fc75f7fe700 1 -- 172.21.15.125:0/3753186547 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc77004d5e0 con 0x7fc7780b4a30 2023-11-28T11:09:09.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:09.860+0000 7fc77d6e5700 1 -- 172.21.15.125:0/3753186547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7fc7780743f0 con 0x7fc7780b4a30 2023-11-28T11:09:10.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.018+0000 7fc75f7fe700 1 -- 172.21.15.125:0/3753186547 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v50) v1 ==== 145+0+0 (secure 0 0 0) 0x7fc770052560 con 0x7fc7780b4a30 2023-11-28T11:09:10.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 -- 172.21.15.125:0/3753186547 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7640682f0 msgr2=0x7fc76406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7640682f0 0x7fc76406a7a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc76c007fd0 tx=0x7fc76c009040 comp rx=0 tx=0).stop 2023-11-28T11:09:10.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 -- 172.21.15.125:0/3753186547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7780b4a30 msgr2=0x7fc7780ac720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7780b4a30 0x7fc7780ac720 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc77000ba10 tx=0x7fc77000bd20 comp rx=0 tx=0).stop 2023-11-28T11:09:10.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 -- 172.21.15.125:0/3753186547 shutdown_connections 2023-11-28T11:09:10.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7780b4a30 0x7fc7780ac720 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc778071f70 0x7fc778156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7640682f0 0x7fc76406a7a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 --2- 172.21.15.125:0/3753186547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7780b4660 0x7fc7780ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 -- 172.21.15.125:0/3753186547 >> 172.21.15.125:0/3753186547 conn(0x7fc7780b2fc0 msgr2=0x7fc7780afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:10.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 -- 172.21.15.125:0/3753186547 shutdown_connections 2023-11-28T11:09:10.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.020+0000 7fc77d6e5700 1 -- 172.21.15.125:0/3753186547 wait complete. 2023-11-28T11:09:10.034 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T11:09:10.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.156+0000 7f394105b700 1 Processor -- start 2023-11-28T11:09:10.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.156+0000 7f394105b700 1 -- start start 2023-11-28T11:09:10.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f394105b700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f393c0b1650 0x7f393c0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f394105b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f393c1599b0 0x7f393c15d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f394105b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393c159ec0 con 0x7f393c0af0a0 2023-11-28T11:09:10.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f394105b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393c15aa60 con 0x7f393c1599b0 2023-11-28T11:09:10.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f394105b700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393c0b1f60 con 0x7f393c0b1650 2023-11-28T11:09:10.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f393a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f393c1599b0 0x7f393c15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:10.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f393b59e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f393c0af0a0 0x7f393c15a350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:41960/0 (socket says 172.21.15.125:41960) 2023-11-28T11:09:10.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f393b59e700 1 -- 172.21.15.125:0/1631681323 learned_addr learned my addr 172.21.15.125:0/1631681323 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:10.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f393a59c700 1 -- 172.21.15.125:0/1631681323 >> v2:172.21.15.167:3300/0 conn(0x7f393c0b1650 msgr2=0x7f393c0b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:10.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f393ad9d700 1 --2- 172.21.15.125:0/1631681323 >> v2:172.21.15.167:3300/0 conn(0x7f393c0b1650 0x7f393c0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:10.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f393a59c700 1 --2- 172.21.15.125:0/1631681323 >> v2:172.21.15.167:3300/0 conn(0x7f393c0b1650 0x7f393c0b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f393a59c700 1 -- 172.21.15.125:0/1631681323 >> v1:172.21.15.125:6789/0 conn(0x7f393c0af0a0 legacy=0x7f393c15a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f3939d9b700 1 -- 172.21.15.125:0/1631681323 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187500257 0 0) 0x7f393c159ec0 con 0x7f393c0af0a0 2023-11-28T11:09:10.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f393a59c700 1 -- 172.21.15.125:0/1631681323 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c15d8a0 con 0x7f393c1599b0 2023-11-28T11:09:10.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.157+0000 7f393ad9d700 1 --2- 172.21.15.125:0/1631681323 >> v2:172.21.15.167:3300/0 conn(0x7f393c0b1650 0x7f393c0b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:10.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f393a59c700 1 --2- 172.21.15.125:0/1631681323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393c1599b0 0x7f393c15d050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f393c067310 tx=0x7f392c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6afa722b182c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:10.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f3939d9b700 1 -- 172.21.15.125:0/1631681323 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c011830 con 0x7f393c1599b0 2023-11-28T11:09:10.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f3939d9b700 1 -- 172.21.15.125:0/1631681323 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c011990 con 0x7f393c1599b0 2023-11-28T11:09:10.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f3939d9b700 1 -- 172.21.15.125:0/1631681323 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c011d20 con 0x7f393c1599b0 2023-11-28T11:09:10.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f394105b700 1 -- 172.21.15.125:0/1631681323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393c1599b0 msgr2=0x7f393c15d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f394105b700 1 --2- 172.21.15.125:0/1631681323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393c1599b0 0x7f393c15d050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f393c067310 tx=0x7f392c009b20 comp rx=0 tx=0).stop 2023-11-28T11:09:10.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f394105b700 1 -- 172.21.15.125:0/1631681323 shutdown_connections 2023-11-28T11:09:10.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f394105b700 1 --2- 172.21.15.125:0/1631681323 >> v2:172.21.15.167:3300/0 conn(0x7f393c0b1650 0x7f393c0b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f394105b700 1 --2- 172.21.15.125:0/1631681323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393c1599b0 0x7f393c15d050 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f394105b700 1 -- 172.21.15.125:0/1631681323 >> 172.21.15.125:0/1631681323 conn(0x7f393c06c010 msgr2=0x7f393c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:10.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f394105b700 1 -- 172.21.15.125:0/1631681323 shutdown_connections 2023-11-28T11:09:10.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.158+0000 7f394105b700 1 -- 172.21.15.125:0/1631681323 wait complete. 2023-11-28T11:09:10.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.160+0000 7f394105b700 1 Processor -- start 2023-11-28T11:09:10.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.160+0000 7f394105b700 1 -- start start 2023-11-28T11:09:10.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.161+0000 7f394105b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f393c0af0a0 0x7f393c14f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.161+0000 7f394105b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f393c0b1650 0x7f393c1e2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.161+0000 7f394105b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393c1e3390 0x7f393c0b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.161+0000 7f394105b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c1e3810 con 0x7f393c1e3390 2023-11-28T11:09:10.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.161+0000 7f394105b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c13d3d0 con 0x7f393c0af0a0 2023-11-28T11:09:10.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.161+0000 7f394105b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0b52b0 con 0x7f393c0b1650 2023-11-28T11:09:10.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.161+0000 7f393b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393c1e3390 0x7f393c0b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:10.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.161+0000 7f393b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393c1e3390 0x7f393c0b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57842/0 (socket says 172.21.15.125:57842) 2023-11-28T11:09:10.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.161+0000 7f393b59e700 1 -- 172.21.15.125:0/539879854 learned_addr learned my addr 172.21.15.125:0/539879854 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:10.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.161+0000 7f393ad9d700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f393c0af0a0 0x7f393c14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:10.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f393a59c700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f393c0b1650 0x7f393c1e2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:10.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f393b59e700 1 -- 172.21.15.125:0/539879854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f393c0b1650 msgr2=0x7f393c1e2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f393b59e700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f393c0b1650 0x7f393c1e2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f393b59e700 1 -- 172.21.15.125:0/539879854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f393c0af0a0 msgr2=0x7f393c14f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f393b59e700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f393c0af0a0 0x7f393c14f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f393b59e700 1 -- 172.21.15.125:0/539879854 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c0094a0 con 0x7f393c1e3390 2023-11-28T11:09:10.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f393a59c700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f393c0b1650 0x7f393c1e2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:10.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f393ad9d700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f393c0af0a0 0x7f393c14f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:10.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f393b59e700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393c1e3390 0x7f393c0b4460 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f393400cca0 tx=0x7f393400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:10.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f39237fe700 1 -- 172.21.15.125:0/539879854 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400cea0 con 0x7f393c1e3390 2023-11-28T11:09:10.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f39237fe700 1 -- 172.21.15.125:0/539879854 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393400ade0 con 0x7f393c1e3390 2023-11-28T11:09:10.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f394105b700 1 -- 172.21.15.125:0/539879854 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c15de60 con 0x7f393c1e3390 2023-11-28T11:09:10.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f39237fe700 1 -- 172.21.15.125:0/539879854 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934007310 con 0x7f393c1e3390 2023-11-28T11:09:10.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.162+0000 7f394105b700 1 -- 172.21.15.125:0/539879854 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c15db80 con 0x7f393c1e3390 2023-11-28T11:09:10.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.163+0000 7f394105b700 1 -- 172.21.15.125:0/539879854 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c15d590 con 0x7f393c1e3390 2023-11-28T11:09:10.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.163+0000 7f39237fe700 1 -- 172.21.15.125:0/539879854 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f393401a030 con 0x7f393c1e3390 2023-11-28T11:09:10.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.164+0000 7f39237fe700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39280682f0 0x7f392806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.164+0000 7f39237fe700 1 -- 172.21.15.125:0/539879854 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3934085ae0 con 0x7f393c1e3390 2023-11-28T11:09:10.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.164+0000 7f393ad9d700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39280682f0 0x7f392806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:10.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.164+0000 7f393ad9d700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39280682f0 0x7f392806a7a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3930006fd0 tx=0x7f3930008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:10.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.168+0000 7f39237fe700 1 -- 172.21.15.125:0/539879854 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3934052340 con 0x7f393c1e3390 2023-11-28T11:09:10.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.352+0000 7f394105b700 1 -- 172.21.15.125:0/539879854 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f393c0743f0 con 0x7f393c1e3390 2023-11-28T11:09:10.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.356+0000 7f39237fe700 1 -- 172.21.15.125:0/539879854 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f39340180c0 con 0x7f393c1e3390 2023-11-28T11:09:10.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 -- 172.21.15.125:0/539879854 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39280682f0 msgr2=0x7f392806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39280682f0 0x7f392806a7a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3930006fd0 tx=0x7f3930008040 comp rx=0 tx=0).stop 2023-11-28T11:09:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 -- 172.21.15.125:0/539879854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393c1e3390 msgr2=0x7f393c0b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393c1e3390 0x7f393c0b4460 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f393400cca0 tx=0x7f393400a340 comp rx=0 tx=0).stop 2023-11-28T11:09:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 -- 172.21.15.125:0/539879854 shutdown_connections 2023-11-28T11:09:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393c1e3390 0x7f393c0b4460 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f393c0af0a0 0x7f393c14f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39280682f0 0x7f392806a7a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 --2- 172.21.15.125:0/539879854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f393c0b1650 0x7f393c1e2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 -- 172.21.15.125:0/539879854 >> 172.21.15.125:0/539879854 conn(0x7f393c06c010 msgr2=0x7f393c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 -- 172.21.15.125:0/539879854 shutdown_connections 2023-11-28T11:09:10.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.358+0000 7f394105b700 1 -- 172.21.15.125:0/539879854 wait complete. 2023-11-28T11:09:10.373 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:09:10.373 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:09:10.413 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:09:10.458 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:09:10.459 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:09:10.459 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:10.476 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:09:10.476 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:10.534 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:10.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.692+0000 7f22b0cff700 1 Processor -- start 2023-11-28T11:09:10.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.692+0000 7f22b0cff700 1 -- start start 2023-11-28T11:09:10.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22b0cff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22ac0b4660 0x7f22ac071f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22b0cff700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22ac0cff90 0x7f22ac06b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22b0cff700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac0cfb00 con 0x7f22ac0b4a30 2023-11-28T11:09:10.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22b0cff700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac15aa20 con 0x7f22ac0b4660 2023-11-28T11:09:10.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22b0cff700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0cf4d0 con 0x7f22ac0cff90 2023-11-28T11:09:10.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22aa59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22ac0b4660 0x7f22ac071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:10.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22aa59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22ac0b4660 0x7f22ac071f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57846/0 (socket says 172.21.15.125:57846) 2023-11-28T11:09:10.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22aa59c700 1 -- 172.21.15.125:0/199276842 learned_addr learned my addr 172.21.15.125:0/199276842 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:10.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22aa59c700 1 -- 172.21.15.125:0/199276842 >> v2:172.21.15.167:3300/0 conn(0x7f22ac0cff90 msgr2=0x7f22ac06b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:10.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22aa59c700 1 --2- 172.21.15.125:0/199276842 >> v2:172.21.15.167:3300/0 conn(0x7f22ac0cff90 0x7f22ac06b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22aa59c700 1 -- 172.21.15.125:0/199276842 >> v1:172.21.15.167:6789/0 conn(0x7f22ac0b4a30 legacy=0x7f22ac0ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:10.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22aa59c700 1 -- 172.21.15.125:0/199276842 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac072550 con 0x7f22ac0b4660 2023-11-28T11:09:10.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22aa59c700 1 --2- 172.21.15.125:0/199276842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22ac0b4660 0x7f22ac071f70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0c9870 tx=0x7f229c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66611ee34ae2c7e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:10.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22a959a700 1 -- 172.21.15.125:0/199276842 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c004230 con 0x7f22ac0b4660 2023-11-28T11:09:10.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22a959a700 1 -- 172.21.15.125:0/199276842 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c004390 con 0x7f22ac0b4660 2023-11-28T11:09:10.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.693+0000 7f22a959a700 1 -- 172.21.15.125:0/199276842 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c0036a0 con 0x7f22ac0b4660 2023-11-28T11:09:10.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.694+0000 7f22b0cff700 1 -- 172.21.15.125:0/199276842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22ac0b4660 msgr2=0x7f22ac071f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.694+0000 7f22b0cff700 1 --2- 172.21.15.125:0/199276842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22ac0b4660 0x7f22ac071f70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0c9870 tx=0x7f229c009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.694+0000 7f22b0cff700 1 -- 172.21.15.125:0/199276842 shutdown_connections 2023-11-28T11:09:10.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.694+0000 7f22b0cff700 1 --2- 172.21.15.125:0/199276842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22ac0b4660 0x7f22ac071f70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.694+0000 7f22b0cff700 1 --2- 172.21.15.125:0/199276842 >> v2:172.21.15.167:3300/0 conn(0x7f22ac0cff90 0x7f22ac06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.694+0000 7f22b0cff700 1 -- 172.21.15.125:0/199276842 >> 172.21.15.125:0/199276842 conn(0x7f22ac0b2fc0 msgr2=0x7f22ac071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:10.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.694+0000 7f22b0cff700 1 -- 172.21.15.125:0/199276842 shutdown_connections 2023-11-28T11:09:10.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.694+0000 7f22b0cff700 1 -- 172.21.15.125:0/199276842 wait complete. 2023-11-28T11:09:10.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.695+0000 7f22b0cff700 1 Processor -- start 2023-11-28T11:09:10.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.695+0000 7f22b0cff700 1 -- start start 2023-11-28T11:09:10.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.696+0000 7f22b0cff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22ac0b4660 0x7f22ac1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.696+0000 7f22b0cff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22ac0b4a30 0x7f22ac15cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.696+0000 7f22b0cff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22ac0cff90 0x7f22ac098ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.696+0000 7f22b0cff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac15df20 con 0x7f22ac0cff90 2023-11-28T11:09:10.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.696+0000 7f22b0cff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac15d310 con 0x7f22ac0b4660 2023-11-28T11:09:10.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.696+0000 7f22b0cff700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac15d5f0 con 0x7f22ac0b4a30 2023-11-28T11:09:10.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.696+0000 7f22aad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22ac0cff90 0x7f22ac098ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:10.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.696+0000 7f22aad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22ac0cff90 0x7f22ac098ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57856/0 (socket says 172.21.15.125:57856) 2023-11-28T11:09:10.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.696+0000 7f22aad9d700 1 -- 172.21.15.125:0/2997796791 learned_addr learned my addr 172.21.15.125:0/2997796791 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:10.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.696+0000 7f22aa59c700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22ac0b4660 0x7f22ac1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:10.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.696+0000 7f22a9d9b700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22ac0b4a30 0x7f22ac15cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:10.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f22aad9d700 1 -- 172.21.15.125:0/2997796791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22ac0b4a30 msgr2=0x7f22ac15cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f22aad9d700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22ac0b4a30 0x7f22ac15cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f22aad9d700 1 -- 172.21.15.125:0/2997796791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22ac0b4660 msgr2=0x7f22ac1561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f22aad9d700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22ac0b4660 0x7f22ac1561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f22aad9d700 1 -- 172.21.15.125:0/2997796791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c009550 con 0x7f22ac0cff90 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f22aa59c700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22ac0b4660 0x7f22ac1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f22a9d9b700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22ac0b4a30 0x7f22ac15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f22aad9d700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22ac0cff90 0x7f22ac098ac0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f22a400c7a0 tx=0x7f22a400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f229affd700 1 -- 172.21.15.125:0/2997796791 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4003e10 con 0x7f22ac0cff90 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f229affd700 1 -- 172.21.15.125:0/2997796791 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a4005070 con 0x7f22ac0cff90 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f22b0cff700 1 -- 172.21.15.125:0/2997796791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac06bad0 con 0x7f22ac0cff90 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f229affd700 1 -- 172.21.15.125:0/2997796791 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4005420 con 0x7f22ac0cff90 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.697+0000 7f22b0cff700 1 -- 172.21.15.125:0/2997796791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac0cf790 con 0x7f22ac0cff90 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.698+0000 7f22b0cff700 1 -- 172.21.15.125:0/2997796791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac0b4e90 con 0x7f22ac0cff90 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.698+0000 7f229affd700 1 -- 172.21.15.125:0/2997796791 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f22a4019030 con 0x7f22ac0cff90 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.699+0000 7f229affd700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f228c0682f0 0x7f228c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:10.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.699+0000 7f229affd700 1 -- 172.21.15.125:0/2997796791 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22a40852e0 con 0x7f22ac0cff90 2023-11-28T11:09:10.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.699+0000 7f22aa59c700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f228c0682f0 0x7f228c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:10.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.699+0000 7f22aa59c700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f228c0682f0 0x7f228c06a7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f229c009130 tx=0x7f229c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:10.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.703+0000 7f229affd700 1 -- 172.21.15.125:0/2997796791 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f22a4051b40 con 0x7f22ac0cff90 2023-11-28T11:09:10.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.885+0000 7f22b0cff700 1 -- 172.21.15.125:0/2997796791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22ac156bb0 con 0x7f22ac0cff90 2023-11-28T11:09:10.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.886+0000 7f229affd700 1 -- 172.21.15.125:0/2997796791 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f22ac156bb0 con 0x7f22ac0cff90 2023-11-28T11:09:10.888 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:10.888 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:10.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 -- 172.21.15.125:0/2997796791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f228c0682f0 msgr2=0x7f228c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f228c0682f0 0x7f228c06a7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f229c009130 tx=0x7f229c008030 comp rx=0 tx=0).stop 2023-11-28T11:09:10.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 -- 172.21.15.125:0/2997796791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22ac0cff90 msgr2=0x7f22ac098ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:10.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22ac0cff90 0x7f22ac098ac0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f22a400c7a0 tx=0x7f22a400cb60 comp rx=0 tx=0).stop 2023-11-28T11:09:10.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 -- 172.21.15.125:0/2997796791 shutdown_connections 2023-11-28T11:09:10.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22ac0cff90 0x7f22ac098ac0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22ac0b4660 0x7f22ac1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f228c0682f0 0x7f228c06a7a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 --2- 172.21.15.125:0/2997796791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22ac0b4a30 0x7f22ac15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:10.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 -- 172.21.15.125:0/2997796791 >> 172.21.15.125:0/2997796791 conn(0x7f22ac0b2fc0 msgr2=0x7f22ac0ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:10.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 -- 172.21.15.125:0/2997796791 shutdown_connections 2023-11-28T11:09:10.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:10.888+0000 7f22b0cff700 1 -- 172.21.15.125:0/2997796791 wait complete. 2023-11-28T11:09:10.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:10.903 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:11.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.025+0000 7fec6ef52700 1 Processor -- start 2023-11-28T11:09:11.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.025+0000 7fec6ef52700 1 -- start start 2023-11-28T11:09:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.025+0000 7fec6ef52700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fec6815c810 0x7fec68160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.025+0000 7fec6ef52700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fec6806a270 0x7fec6806a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.025+0000 7fec6ef52700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6806abb0 con 0x7fec680718e0 2023-11-28T11:09:11.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.025+0000 7fec6ef52700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6815cbe0 con 0x7fec6815c810 2023-11-28T11:09:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.025+0000 7fec6ef52700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec681607a0 con 0x7fec6806a270 2023-11-28T11:09:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec6ccee700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fec6815c810 0x7fec68160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec6ccee700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fec6815c810 0x7fec68160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57860/0 (socket says 172.21.15.125:57860) 2023-11-28T11:09:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec6ccee700 1 -- 172.21.15.125:0/3057763181 learned_addr learned my addr 172.21.15.125:0/3057763181 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec6d4ef700 1 --2- 172.21.15.125:0/3057763181 >> v2:172.21.15.167:3300/0 conn(0x7fec6806a270 0x7fec6806a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec6ccee700 1 -- 172.21.15.125:0/3057763181 >> v2:172.21.15.167:3300/0 conn(0x7fec6806a270 msgr2=0x7fec6806a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec6ccee700 1 --2- 172.21.15.125:0/3057763181 >> v2:172.21.15.167:3300/0 conn(0x7fec6806a270 0x7fec6806a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec6ccee700 1 -- 172.21.15.125:0/3057763181 >> v1:172.21.15.167:6789/0 conn(0x7fec680718e0 legacy=0x7fec6806c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec6ccee700 1 -- 172.21.15.125:0/3057763181 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68160a50 con 0x7fec6815c810 2023-11-28T11:09:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec6ccee700 1 --2- 172.21.15.125:0/3057763181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6815c810 0x7fec68160260 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fec68071870 tx=0x7fec5c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36664e7c93bd2096 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:11.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec677fe700 1 -- 172.21.15.125:0/3057763181 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c004230 con 0x7fec6815c810 2023-11-28T11:09:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec677fe700 1 -- 172.21.15.125:0/3057763181 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c004390 con 0x7fec6815c810 2023-11-28T11:09:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.026+0000 7fec677fe700 1 -- 172.21.15.125:0/3057763181 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0036a0 con 0x7fec6815c810 2023-11-28T11:09:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.027+0000 7fec6ef52700 1 -- 172.21.15.125:0/3057763181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6815c810 msgr2=0x7fec68160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.027+0000 7fec6ef52700 1 --2- 172.21.15.125:0/3057763181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6815c810 0x7fec68160260 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fec68071870 tx=0x7fec5c009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.027+0000 7fec6ef52700 1 -- 172.21.15.125:0/3057763181 shutdown_connections 2023-11-28T11:09:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.027+0000 7fec6ef52700 1 --2- 172.21.15.125:0/3057763181 >> v2:172.21.15.167:3300/0 conn(0x7fec6806a270 0x7fec6806a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.027+0000 7fec6ef52700 1 --2- 172.21.15.125:0/3057763181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6815c810 0x7fec68160260 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.027+0000 7fec6ef52700 1 -- 172.21.15.125:0/3057763181 >> 172.21.15.125:0/3057763181 conn(0x7fec6806c010 msgr2=0x7fec680cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.027+0000 7fec6ef52700 1 -- 172.21.15.125:0/3057763181 shutdown_connections 2023-11-28T11:09:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.027+0000 7fec6ef52700 1 -- 172.21.15.125:0/3057763181 wait complete. 2023-11-28T11:09:11.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.028+0000 7fec6ef52700 1 Processor -- start 2023-11-28T11:09:11.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.028+0000 7fec6ef52700 1 -- start start 2023-11-28T11:09:11.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ef52700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6806a270 0x7fec680c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ef52700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec680718e0 0x7fec68147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ef52700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec6815c810 0x7fec680b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ef52700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec680b21c0 con 0x7fec6806a270 2023-11-28T11:09:11.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ef52700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6815de50 con 0x7fec6815c810 2023-11-28T11:09:11.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ef52700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6815e130 con 0x7fec680718e0 2023-11-28T11:09:11.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ccee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6806a270 0x7fec680c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ccee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6806a270 0x7fec680c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57866/0 (socket says 172.21.15.125:57866) 2023-11-28T11:09:11.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ccee700 1 -- 172.21.15.125:0/1139824473 learned_addr learned my addr 172.21.15.125:0/1139824473 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:11.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6d4ef700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec6815c810 0x7fec680b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec67fff700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec680718e0 0x7fec68147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ccee700 1 -- 172.21.15.125:0/1139824473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec680718e0 msgr2=0x7fec68147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ccee700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec680718e0 0x7fec68147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ccee700 1 -- 172.21.15.125:0/1139824473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec6815c810 msgr2=0x7fec680b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ccee700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec6815c810 0x7fec680b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ccee700 1 -- 172.21.15.125:0/1139824473 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c009550 con 0x7fec6806a270 2023-11-28T11:09:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec67fff700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec680718e0 0x7fec68147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ccee700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6806a270 0x7fec680c96c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009130 tx=0x7fec5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec657fa700 1 -- 172.21.15.125:0/1139824473 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c003e20 con 0x7fec6806a270 2023-11-28T11:09:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec657fa700 1 -- 172.21.15.125:0/1139824473 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c011630 con 0x7fec6806a270 2023-11-28T11:09:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec6ef52700 1 -- 172.21.15.125:0/1139824473 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec68161010 con 0x7fec6806a270 2023-11-28T11:09:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.029+0000 7fec657fa700 1 -- 172.21.15.125:0/1139824473 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0119e0 con 0x7fec6806a270 2023-11-28T11:09:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.030+0000 7fec6ef52700 1 -- 172.21.15.125:0/1139824473 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec68160d30 con 0x7fec6806a270 2023-11-28T11:09:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.030+0000 7fec6ef52700 1 -- 172.21.15.125:0/1139824473 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec680ceb20 con 0x7fec6806a270 2023-11-28T11:09:11.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.031+0000 7fec657fa700 1 -- 172.21.15.125:0/1139824473 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fec5c017020 con 0x7fec6806a270 2023-11-28T11:09:11.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.031+0000 7fec657fa700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fec4c0682f0 0x7fec4c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.031+0000 7fec657fa700 1 -- 172.21.15.125:0/1139824473 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec5c0870d0 con 0x7fec6806a270 2023-11-28T11:09:11.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.031+0000 7fec67fff700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fec4c0682f0 0x7fec4c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.032+0000 7fec67fff700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fec4c0682f0 0x7fec4c06a7a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec680b4e90 tx=0x7fec54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:11.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.035+0000 7fec657fa700 1 -- 172.21.15.125:0/1139824473 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fec5c0538b0 con 0x7fec6806a270 2023-11-28T11:09:11.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.218+0000 7fec6ef52700 1 -- 172.21.15.125:0/1139824473 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec680743f0 con 0x7fec6806a270 2023-11-28T11:09:11.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.218+0000 7fec657fa700 1 -- 172.21.15.125:0/1139824473 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec5c056ed0 con 0x7fec6806a270 2023-11-28T11:09:11.220 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:11.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 -- 172.21.15.125:0/1139824473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fec4c0682f0 msgr2=0x7fec4c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fec4c0682f0 0x7fec4c06a7a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec680b4e90 tx=0x7fec54009040 comp rx=0 tx=0).stop 2023-11-28T11:09:11.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 -- 172.21.15.125:0/1139824473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6806a270 msgr2=0x7fec680c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6806a270 0x7fec680c96c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009130 tx=0x7fec5c004750 comp rx=0 tx=0).stop 2023-11-28T11:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 -- 172.21.15.125:0/1139824473 shutdown_connections 2023-11-28T11:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec6815c810 0x7fec680b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6806a270 0x7fec680c96c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fec4c0682f0 0x7fec4c06a7a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 --2- 172.21.15.125:0/1139824473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec680718e0 0x7fec68147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 -- 172.21.15.125:0/1139824473 >> 172.21.15.125:0/1139824473 conn(0x7fec6806c010 msgr2=0x7fec680d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 -- 172.21.15.125:0/1139824473 shutdown_connections 2023-11-28T11:09:11.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.220+0000 7fec6ef52700 1 -- 172.21.15.125:0/1139824473 wait complete. 2023-11-28T11:09:11.234 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:11.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.355+0000 7ff235bf6700 1 Processor -- start 2023-11-28T11:09:11.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.355+0000 7ff235bf6700 1 -- start start 2023-11-28T11:09:11.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff235bf6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff23006a980 0x7ff2300ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff235bf6700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff230071890 0x7ff230071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff235bf6700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23015cc10 con 0x7ff2300cf710 2023-11-28T11:09:11.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff235bf6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23006c9b0 con 0x7ff23006a980 2023-11-28T11:09:11.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff235bf6700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23006cc90 con 0x7ff230071890 2023-11-28T11:09:11.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff23006a980 0x7ff2300ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff23006a980 0x7ff2300ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57876/0 (socket says 172.21.15.125:57876) 2023-11-28T11:09:11.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22effd700 1 -- 172.21.15.125:0/3382285009 learned_addr learned my addr 172.21.15.125:0/3382285009 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:11.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22effd700 1 -- 172.21.15.125:0/3382285009 >> v2:172.21.15.167:3300/0 conn(0x7ff230071890 msgr2=0x7ff230071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:11.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22ffff700 1 --2- 172.21.15.125:0/3382285009 >> v2:172.21.15.167:3300/0 conn(0x7ff230071890 0x7ff230071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22effd700 1 --2- 172.21.15.125:0/3382285009 >> v2:172.21.15.167:3300/0 conn(0x7ff230071890 0x7ff230071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22effd700 1 -- 172.21.15.125:0/3382285009 >> v1:172.21.15.167:6789/0 conn(0x7ff2300cf710 legacy=0x7ff23006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:11.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22effd700 1 -- 172.21.15.125:0/3382285009 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23006cf70 con 0x7ff23006a980 2023-11-28T11:09:11.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22ffff700 1 --2- 172.21.15.125:0/3382285009 >> v2:172.21.15.167:3300/0 conn(0x7ff230071890 0x7ff230071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:11.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22effd700 1 --2- 172.21.15.125:0/3382285009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23006a980 0x7ff2300ce740 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff23006ad50 tx=0x7ff224009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7798560b06124319 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:11.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22e7fc700 1 -- 172.21.15.125:0/3382285009 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224004230 con 0x7ff23006a980 2023-11-28T11:09:11.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22e7fc700 1 -- 172.21.15.125:0/3382285009 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224004390 con 0x7ff23006a980 2023-11-28T11:09:11.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.356+0000 7ff22e7fc700 1 -- 172.21.15.125:0/3382285009 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2240036a0 con 0x7ff23006a980 2023-11-28T11:09:11.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.357+0000 7ff235bf6700 1 -- 172.21.15.125:0/3382285009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23006a980 msgr2=0x7ff2300ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.357+0000 7ff235bf6700 1 --2- 172.21.15.125:0/3382285009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23006a980 0x7ff2300ce740 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff23006ad50 tx=0x7ff224009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.357+0000 7ff235bf6700 1 -- 172.21.15.125:0/3382285009 shutdown_connections 2023-11-28T11:09:11.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.357+0000 7ff235bf6700 1 --2- 172.21.15.125:0/3382285009 >> v2:172.21.15.167:3300/0 conn(0x7ff230071890 0x7ff230071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.357+0000 7ff235bf6700 1 --2- 172.21.15.125:0/3382285009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23006a980 0x7ff2300ce740 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.357+0000 7ff235bf6700 1 -- 172.21.15.125:0/3382285009 >> 172.21.15.125:0/3382285009 conn(0x7ff23006c010 msgr2=0x7ff2300cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:11.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.357+0000 7ff235bf6700 1 -- 172.21.15.125:0/3382285009 shutdown_connections 2023-11-28T11:09:11.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.357+0000 7ff235bf6700 1 -- 172.21.15.125:0/3382285009 wait complete. 2023-11-28T11:09:11.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.358+0000 7ff235bf6700 1 Processor -- start 2023-11-28T11:09:11.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.358+0000 7ff235bf6700 1 -- start start 2023-11-28T11:09:11.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.359+0000 7ff235bf6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff23006a980 0x7ff23015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.359+0000 7ff235bf6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff230071890 0x7ff23015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.359+0000 7ff235bf6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2300cf710 0x7ff2300b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.359+0000 7ff235bf6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23015a900 con 0x7ff230071890 2023-11-28T11:09:11.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.359+0000 7ff235bf6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23015d3e0 con 0x7ff2300cf710 2023-11-28T11:09:11.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.359+0000 7ff235bf6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23015d6c0 con 0x7ff23006a980 2023-11-28T11:09:11.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.359+0000 7ff22effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff230071890 0x7ff23015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.359+0000 7ff22effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff230071890 0x7ff23015a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57882/0 (socket says 172.21.15.125:57882) 2023-11-28T11:09:11.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.359+0000 7ff22effd700 1 -- 172.21.15.125:0/3059783326 learned_addr learned my addr 172.21.15.125:0/3059783326 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:11.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.359+0000 7ff22ffff700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2300cf710 0x7ff2300b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.359+0000 7ff22f7fe700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff23006a980 0x7ff23015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.360+0000 7ff22effd700 1 -- 172.21.15.125:0/3059783326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff23006a980 msgr2=0x7ff23015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.360+0000 7ff22effd700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff23006a980 0x7ff23015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.360+0000 7ff22effd700 1 -- 172.21.15.125:0/3059783326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2300cf710 msgr2=0x7ff2300b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.360+0000 7ff22effd700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2300cf710 0x7ff2300b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.360+0000 7ff22effd700 1 -- 172.21.15.125:0/3059783326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224009550 con 0x7ff230071890 2023-11-28T11:09:11.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.360+0000 7ff22effd700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff230071890 0x7ff23015a3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff230067450 tx=0x7ff224004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:11.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.360+0000 7ff217fff700 1 -- 172.21.15.125:0/3059783326 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224003c90 con 0x7ff230071890 2023-11-28T11:09:11.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.360+0000 7ff217fff700 1 -- 172.21.15.125:0/3059783326 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22401f070 con 0x7ff230071890 2023-11-28T11:09:11.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.360+0000 7ff217fff700 1 -- 172.21.15.125:0/3059783326 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224011870 con 0x7ff230071890 2023-11-28T11:09:11.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.360+0000 7ff235bf6700 1 -- 172.21.15.125:0/3059783326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23006d530 con 0x7ff230071890 2023-11-28T11:09:11.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.360+0000 7ff235bf6700 1 -- 172.21.15.125:0/3059783326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23006d250 con 0x7ff230071890 2023-11-28T11:09:11.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.361+0000 7ff235bf6700 1 -- 172.21.15.125:0/3059783326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff230160480 con 0x7ff230071890 2023-11-28T11:09:11.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.361+0000 7ff217fff700 1 -- 172.21.15.125:0/3059783326 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff224017020 con 0x7ff230071890 2023-11-28T11:09:11.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.362+0000 7ff217fff700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff21c0682f0 0x7ff21c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.362+0000 7ff217fff700 1 -- 172.21.15.125:0/3059783326 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff224087380 con 0x7ff230071890 2023-11-28T11:09:11.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.362+0000 7ff22f7fe700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff21c0682f0 0x7ff21c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.362+0000 7ff22f7fe700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff21c0682f0 0x7ff21c06a7a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff2301e6d40 tx=0x7ff2200090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:11.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.366+0000 7ff217fff700 1 -- 172.21.15.125:0/3059783326 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff224053be0 con 0x7ff230071890 2023-11-28T11:09:11.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.550+0000 7ff235bf6700 1 -- 172.21.15.125:0/3059783326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2300743f0 con 0x7ff230071890 2023-11-28T11:09:11.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.551+0000 7ff217fff700 1 -- 172.21.15.125:0/3059783326 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff224057200 con 0x7ff230071890 2023-11-28T11:09:11.553 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:11.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 -- 172.21.15.125:0/3059783326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff21c0682f0 msgr2=0x7ff21c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff21c0682f0 0x7ff21c06a7a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff2301e6d40 tx=0x7ff2200090e0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 -- 172.21.15.125:0/3059783326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff230071890 msgr2=0x7ff23015a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff230071890 0x7ff23015a3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff230067450 tx=0x7ff224004750 comp rx=0 tx=0).stop 2023-11-28T11:09:11.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 -- 172.21.15.125:0/3059783326 shutdown_connections 2023-11-28T11:09:11.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2300cf710 0x7ff2300b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff21c0682f0 0x7ff21c06a7a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff23006a980 0x7ff23015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 --2- 172.21.15.125:0/3059783326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff230071890 0x7ff23015a3c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 -- 172.21.15.125:0/3059783326 >> 172.21.15.125:0/3059783326 conn(0x7ff23006c010 msgr2=0x7ff23006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:11.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 -- 172.21.15.125:0/3059783326 shutdown_connections 2023-11-28T11:09:11.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.553+0000 7ff235bf6700 1 -- 172.21.15.125:0/3059783326 wait complete. 2023-11-28T11:09:11.567 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:11.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.689+0000 7fafe82da700 1 Processor -- start 2023-11-28T11:09:11.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.689+0000 7fafe82da700 1 -- start start 2023-11-28T11:09:11.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.690+0000 7fafe82da700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe0159710 0x7fafe0070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.690+0000 7fafe82da700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe006a310 con 0x7fafe00cee40 2023-11-28T11:09:11.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.690+0000 7fafe82da700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe00ce7e0 con 0x7fafe00c9a50 2023-11-28T11:09:11.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.690+0000 7fafe82da700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00cf2b0 con 0x7fafe0159710 2023-11-28T11:09:11.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.690+0000 7fafe5875700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fafe00cee40 0x7fafe00cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42012/0 (socket says 172.21.15.125:42012) 2023-11-28T11:09:11.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.690+0000 7fafe5875700 1 -- 172.21.15.125:0/1566257282 learned_addr learned my addr 172.21.15.125:0/1566257282 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:11.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.690+0000 7fafe6076700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe0159710 0x7fafe0070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.690+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681181647 0 0) 0x7fafe006a310 con 0x7fafe00cee40 2023-11-28T11:09:11.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.690+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafcc0035b0 con 0x7fafe00cee40 2023-11-28T11:09:11.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 891239329 0 0) 0x7fafcc0035b0 con 0x7fafe00cee40 2023-11-28T11:09:11.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe0159710 msgr2=0x7fafe0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:11.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe0159710 0x7fafe0070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 >> v1:172.21.15.167:6789/0 conn(0x7fafe00c9a50 legacy=0x7fafe006adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe006a5b0 con 0x7fafe00cee40 2023-11-28T11:09:11.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fafdc001670 con 0x7fafe00cee40 2023-11-28T11:09:11.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 >> v1:172.21.15.125:6789/0 conn(0x7fafe00cee40 legacy=0x7fafe00cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe0159710 0x7fafcc003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc003f70 0x7fafcc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafcc004d90 0x7fafcc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc00ba10 con 0x7fafcc004d90 2023-11-28T11:09:11.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc00bb80 con 0x7fafcc003f70 2023-11-28T11:09:11.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc00df50 con 0x7fafe0159710 2023-11-28T11:09:11.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe6877700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafcc004d90 0x7fafcc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe6076700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe0159710 0x7fafcc003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5875700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc003f70 0x7fafcc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe6877700 1 -- 172.21.15.125:0/1566257282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe0159710 msgr2=0x7fafcc003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:11.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe6877700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe0159710 0x7fafcc003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe6877700 1 -- 172.21.15.125:0/1566257282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc003f70 msgr2=0x7fafcc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:11.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe6877700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc003f70 0x7fafcc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe6877700 1 -- 172.21.15.125:0/1566257282 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc0035b0 con 0x7fafcc004d90 2023-11-28T11:09:11.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe6877700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafcc004d90 0x7fafcc005200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c290 tx=0x7fafcc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab0cbec4f787916 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:11.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8001e70 con 0x7fafcc004d90 2023-11-28T11:09:11.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd800ce50 con 0x7fafcc004d90 2023-11-28T11:09:11.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.691+0000 7fafe5074700 1 -- 172.21.15.125:0/1566257282 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8012660 con 0x7fafcc004d90 2023-11-28T11:09:11.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.692+0000 7fafe82da700 1 -- 172.21.15.125:0/1566257282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafcc004d90 msgr2=0x7fafcc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.692+0000 7fafe82da700 1 --2- 172.21.15.125:0/1566257282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafcc004d90 0x7fafcc005200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c290 tx=0x7fafcc005880 comp rx=0 tx=0).stop 2023-11-28T11:09:11.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.692+0000 7fafe6877700 1 -- 172.21.15.125:0/1566257282 reap_dead start 2023-11-28T11:09:11.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.692+0000 7fafe82da700 1 -- 172.21.15.125:0/1566257282 shutdown_connections 2023-11-28T11:09:11.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.692+0000 7fafe82da700 1 -- 172.21.15.125:0/1566257282 >> 172.21.15.125:0/1566257282 conn(0x7fafe00cf400 msgr2=0x7fafe00cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:11.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.692+0000 7fafe82da700 1 -- 172.21.15.125:0/1566257282 shutdown_connections 2023-11-28T11:09:11.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.692+0000 7fafe82da700 1 -- 172.21.15.125:0/1566257282 wait complete. 2023-11-28T11:09:11.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.693+0000 7fafe82da700 1 Processor -- start 2023-11-28T11:09:11.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.693+0000 7fafe82da700 1 -- start start 2023-11-28T11:09:11.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe82da700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc004d90 0x7fafe014da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe82da700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe00c6560 0x7fafe00c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe82da700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe00c42f0 0x7fafe00c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe82da700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe014df50 con 0x7fafe00c6560 2023-11-28T11:09:11.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe82da700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00c4ca0 con 0x7fafcc004d90 2023-11-28T11:09:11.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe82da700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00c6ab0 con 0x7fafe00c42f0 2023-11-28T11:09:11.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe5875700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe00c6560 0x7fafe00c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe5875700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe00c6560 0x7fafe00c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57900/0 (socket says 172.21.15.125:57900) 2023-11-28T11:09:11.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe5875700 1 -- 172.21.15.125:0/1872277576 learned_addr learned my addr 172.21.15.125:0/1872277576 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:11.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe6076700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc004d90 0x7fafe014da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe6877700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe00c42f0 0x7fafe00c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe5875700 1 -- 172.21.15.125:0/1872277576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe00c42f0 msgr2=0x7fafe00c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe5875700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe00c42f0 0x7fafe00c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe5875700 1 -- 172.21.15.125:0/1872277576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc004d90 msgr2=0x7fafe014da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe5875700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc004d90 0x7fafe014da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.694+0000 7fafe5875700 1 -- 172.21.15.125:0/1872277576 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe00ceac0 con 0x7fafe00c6560 2023-11-28T11:09:11.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.695+0000 7fafe5875700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe00c6560 0x7fafe00c4f90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007290 tx=0x7fafdc007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:11.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.695+0000 7fafd6ffd700 1 -- 172.21.15.125:0/1872277576 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc00f870 con 0x7fafe00c6560 2023-11-28T11:09:11.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.695+0000 7fafd6ffd700 1 -- 172.21.15.125:0/1872277576 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc00f9f0 con 0x7fafe00c6560 2023-11-28T11:09:11.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.695+0000 7fafe82da700 1 -- 172.21.15.125:0/1872277576 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe006a890 con 0x7fafe00c6560 2023-11-28T11:09:11.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.695+0000 7fafd6ffd700 1 -- 172.21.15.125:0/1872277576 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc00fda0 con 0x7fafe00c6560 2023-11-28T11:09:11.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.695+0000 7fafe82da700 1 -- 172.21.15.125:0/1872277576 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe0070370 con 0x7fafe00c6560 2023-11-28T11:09:11.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.696+0000 7fafe82da700 1 -- 172.21.15.125:0/1872277576 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe00743f0 con 0x7fafe00c6560 2023-11-28T11:09:11.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.696+0000 7fafd6ffd700 1 -- 172.21.15.125:0/1872277576 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fafdc01d460 con 0x7fafe00c6560 2023-11-28T11:09:11.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.696+0000 7fafd6ffd700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafc40682f0 0x7fafc406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:11.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.696+0000 7fafd6ffd700 1 -- 172.21.15.125:0/1872277576 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fafdc085e30 con 0x7fafe00c6560 2023-11-28T11:09:11.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.696+0000 7fafe6076700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafc40682f0 0x7fafc406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:11.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.697+0000 7fafe6076700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafc40682f0 0x7fafc406a7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009ba0 tx=0x7fafd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:11.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.700+0000 7fafd6ffd700 1 -- 172.21.15.125:0/1872277576 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fafdc052630 con 0x7fafe00c6560 2023-11-28T11:09:11.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.883+0000 7fafe82da700 1 -- 172.21.15.125:0/1872277576 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafe00663f0 con 0x7fafe00c6560 2023-11-28T11:09:11.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.883+0000 7fafd6ffd700 1 -- 172.21.15.125:0/1872277576 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafdc055c50 con 0x7fafe00c6560 2023-11-28T11:09:11.885 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:11.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 -- 172.21.15.125:0/1872277576 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafc40682f0 msgr2=0x7fafc406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafc40682f0 0x7fafc406a7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009ba0 tx=0x7fafd0008040 comp rx=0 tx=0).stop 2023-11-28T11:09:11.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 -- 172.21.15.125:0/1872277576 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe00c6560 msgr2=0x7fafe00c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:11.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe00c6560 0x7fafe00c4f90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007290 tx=0x7fafdc007650 comp rx=0 tx=0).stop 2023-11-28T11:09:11.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 -- 172.21.15.125:0/1872277576 shutdown_connections 2023-11-28T11:09:11.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafc40682f0 0x7fafc406a7a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafe00c42f0 0x7fafe00c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc004d90 0x7fafe014da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 --2- 172.21.15.125:0/1872277576 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe00c6560 0x7fafe00c4f90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:11.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 -- 172.21.15.125:0/1872277576 >> 172.21.15.125:0/1872277576 conn(0x7fafe00cf400 msgr2=0x7fafe00aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:11.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 -- 172.21.15.125:0/1872277576 shutdown_connections 2023-11-28T11:09:11.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:11.885+0000 7fafe82da700 1 -- 172.21.15.125:0/1872277576 wait complete. 2023-11-28T11:09:11.899 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:12.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.021+0000 7f344e8b4700 1 Processor -- start 2023-11-28T11:09:12.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.021+0000 7f344e8b4700 1 -- start start 2023-11-28T11:09:12.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f344e8b4700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f34480cec00 0x7f3448065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f344e8b4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3448160300 0x7f344815d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f344e8b4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344815ceb0 con 0x7f344815d880 2023-11-28T11:09:12.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f344e8b4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34481608c0 con 0x7f3448160300 2023-11-28T11:09:12.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f344e8b4700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3448160ba0 con 0x7f34480cec00 2023-11-28T11:09:12.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f34477fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3448160300 0x7f344815d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f344ce51700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f344815d880 0x7f34480cac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42032/0 (socket says 172.21.15.125:42032) 2023-11-28T11:09:12.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f344ce51700 1 -- 172.21.15.125:0/2602659898 learned_addr learned my addr 172.21.15.125:0/2602659898 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:12.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f3447fff700 1 --2- 172.21.15.125:0/2602659898 >> v2:172.21.15.167:3300/0 conn(0x7f34480cec00 0x7f3448065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f34477fe700 1 -- 172.21.15.125:0/2602659898 >> v2:172.21.15.167:3300/0 conn(0x7f34480cec00 msgr2=0x7f3448065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:12.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f34477fe700 1 --2- 172.21.15.125:0/2602659898 >> v2:172.21.15.167:3300/0 conn(0x7f34480cec00 0x7f3448065fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f34477fe700 1 -- 172.21.15.125:0/2602659898 >> v1:172.21.15.125:6789/0 conn(0x7f344815d880 legacy=0x7f34480cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f34477fe700 1 -- 172.21.15.125:0/2602659898 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3448160e80 con 0x7f3448160300 2023-11-28T11:09:12.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.022+0000 7f34477fe700 1 --2- 172.21.15.125:0/2602659898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3448160300 0x7f344815d340 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f34480cceb0 tx=0x7f343c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd65470792bc14a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:12.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.026+0000 7f3446ffd700 1 -- 172.21.15.125:0/2602659898 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c011830 con 0x7f3448160300 2023-11-28T11:09:12.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.026+0000 7f3446ffd700 1 -- 172.21.15.125:0/2602659898 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c011990 con 0x7f3448160300 2023-11-28T11:09:12.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.026+0000 7f3446ffd700 1 -- 172.21.15.125:0/2602659898 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c011d20 con 0x7f3448160300 2023-11-28T11:09:12.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.026+0000 7f344e8b4700 1 -- 172.21.15.125:0/2602659898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3448160300 msgr2=0x7f344815d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.026+0000 7f344e8b4700 1 --2- 172.21.15.125:0/2602659898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3448160300 0x7f344815d340 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f34480cceb0 tx=0x7f343c009b20 comp rx=0 tx=0).stop 2023-11-28T11:09:12.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.027+0000 7f344e8b4700 1 -- 172.21.15.125:0/2602659898 shutdown_connections 2023-11-28T11:09:12.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.027+0000 7f344e8b4700 1 --2- 172.21.15.125:0/2602659898 >> v2:172.21.15.167:3300/0 conn(0x7f34480cec00 0x7f3448065fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.027+0000 7f344e8b4700 1 --2- 172.21.15.125:0/2602659898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3448160300 0x7f344815d340 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.027+0000 7f344e8b4700 1 -- 172.21.15.125:0/2602659898 >> 172.21.15.125:0/2602659898 conn(0x7f34480cf400 msgr2=0x7f34480cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:12.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.027+0000 7f344e8b4700 1 -- 172.21.15.125:0/2602659898 shutdown_connections 2023-11-28T11:09:12.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.027+0000 7f344e8b4700 1 -- 172.21.15.125:0/2602659898 wait complete. 2023-11-28T11:09:12.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.028+0000 7f344e8b4700 1 Processor -- start 2023-11-28T11:09:12.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.028+0000 7f344e8b4700 1 -- start start 2023-11-28T11:09:12.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.029+0000 7f344e8b4700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34480cec00 0x7f3448156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.029+0000 7f344e8b4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f344815d880 0x7f34480c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.029+0000 7f344e8b4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3448160300 0x7f3448071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.029+0000 7f344e8b4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34480b2730 con 0x7f3448160300 2023-11-28T11:09:12.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.029+0000 7f344e8b4700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34480b2a10 con 0x7f34480cec00 2023-11-28T11:09:12.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.029+0000 7f344e8b4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34480b2cf0 con 0x7f344815d880 2023-11-28T11:09:12.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.029+0000 7f344ce51700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3448160300 0x7f3448071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.029+0000 7f344ce51700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3448160300 0x7f3448071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57914/0 (socket says 172.21.15.125:57914) 2023-11-28T11:09:12.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.029+0000 7f344ce51700 1 -- 172.21.15.125:0/459363514 learned_addr learned my addr 172.21.15.125:0/459363514 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f3447fff700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34480cec00 0x7f3448156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f34477fe700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f344815d880 0x7f34480c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f344ce51700 1 -- 172.21.15.125:0/459363514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f344815d880 msgr2=0x7f34480c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f344ce51700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f344815d880 0x7f34480c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f344ce51700 1 -- 172.21.15.125:0/459363514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34480cec00 msgr2=0x7f3448156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f344ce51700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34480cec00 0x7f3448156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f344ce51700 1 -- 172.21.15.125:0/459363514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0094a0 con 0x7f3448160300 2023-11-28T11:09:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f3447fff700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34480cec00 0x7f3448156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f34477fe700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f344815d880 0x7f34480c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f344ce51700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3448160300 0x7f3448071860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f344000cbc0 tx=0x7f344000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:12.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f3444ff9700 1 -- 172.21.15.125:0/459363514 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344000ab50 con 0x7f3448160300 2023-11-28T11:09:12.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f3444ff9700 1 -- 172.21.15.125:0/459363514 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344000acb0 con 0x7f3448160300 2023-11-28T11:09:12.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f344e8b4700 1 -- 172.21.15.125:0/459363514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3448066510 con 0x7f3448160300 2023-11-28T11:09:12.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f3444ff9700 1 -- 172.21.15.125:0/459363514 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440012600 con 0x7f3448160300 2023-11-28T11:09:12.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.030+0000 7f344e8b4700 1 -- 172.21.15.125:0/459363514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3448161160 con 0x7f3448160300 2023-11-28T11:09:12.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.031+0000 7f344e8b4700 1 -- 172.21.15.125:0/459363514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34480cefd0 con 0x7f3448160300 2023-11-28T11:09:12.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.031+0000 7f3444ff9700 1 -- 172.21.15.125:0/459363514 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3440019030 con 0x7f3448160300 2023-11-28T11:09:12.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.032+0000 7f3444ff9700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34340682f0 0x7f343406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.032+0000 7f3444ff9700 1 -- 172.21.15.125:0/459363514 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3440085810 con 0x7f3448160300 2023-11-28T11:09:12.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.032+0000 7f3447fff700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34340682f0 0x7f343406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.032+0000 7f3447fff700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34340682f0 0x7f343406a7a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3438009a00 tx=0x7f3438008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.036+0000 7f3444ff9700 1 -- 172.21.15.125:0/459363514 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f344004b5e0 con 0x7f3448160300 2023-11-28T11:09:12.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.220+0000 7f344e8b4700 1 -- 172.21.15.125:0/459363514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34480b31e0 con 0x7f3448160300 2023-11-28T11:09:12.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.220+0000 7f3444ff9700 1 -- 172.21.15.125:0/459363514 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3440052040 con 0x7f3448160300 2023-11-28T11:09:12.222 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:12.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 -- 172.21.15.125:0/459363514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34340682f0 msgr2=0x7f343406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34340682f0 0x7f343406a7a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3438009a00 tx=0x7f3438008040 comp rx=0 tx=0).stop 2023-11-28T11:09:12.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 -- 172.21.15.125:0/459363514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3448160300 msgr2=0x7f3448071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3448160300 0x7f3448071860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f344000cbc0 tx=0x7f344000cf80 comp rx=0 tx=0).stop 2023-11-28T11:09:12.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 -- 172.21.15.125:0/459363514 shutdown_connections 2023-11-28T11:09:12.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3448160300 0x7f3448071860 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34480cec00 0x7f3448156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34340682f0 0x7f343406a7a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 --2- 172.21.15.125:0/459363514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f344815d880 0x7f34480c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 -- 172.21.15.125:0/459363514 >> 172.21.15.125:0/459363514 conn(0x7f34480cf400 msgr2=0x7f34480af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 -- 172.21.15.125:0/459363514 shutdown_connections 2023-11-28T11:09:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.222+0000 7f344e8b4700 1 -- 172.21.15.125:0/459363514 wait complete. 2023-11-28T11:09:12.236 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:09:12.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.354+0000 7fa63b32a700 1 Processor -- start 2023-11-28T11:09:12.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.354+0000 7fa63b32a700 1 -- start start 2023-11-28T11:09:12.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.355+0000 7fa63b32a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6340af0a0 0x7fa63415a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.355+0000 7fa63b32a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa634159ec0 con 0x7fa6340b1650 2023-11-28T11:09:12.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.355+0000 7fa63b32a700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63415d8a0 con 0x7fa6341599b0 2023-11-28T11:09:12.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.355+0000 7fa63b32a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63415db80 con 0x7fa6340af0a0 2023-11-28T11:09:12.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.355+0000 7fa6390c6700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa6340b1650 0x7fa6340b1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42042/0 (socket says 172.21.15.125:42042) 2023-11-28T11:09:12.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.355+0000 7fa6390c6700 1 -- 172.21.15.125:0/2569354733 learned_addr learned my addr 172.21.15.125:0/2569354733 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:12.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa6398c7700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6340af0a0 0x7fa63415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852873358 0 0) 0x7fa634159ec0 con 0x7fa6340b1650 2023-11-28T11:09:12.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6200035b0 con 0x7fa6340b1650 2023-11-28T11:09:12.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3391797548 0 0) 0x7fa6200035b0 con 0x7fa6340b1650 2023-11-28T11:09:12.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6340af0a0 msgr2=0x7fa63415a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:12.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6340af0a0 0x7fa63415a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 >> v1:172.21.15.167:6789/0 conn(0x7fa6341599b0 legacy=0x7fa63415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63415de60 con 0x7fa6340b1650 2023-11-28T11:09:12.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fa624001670 con 0x7fa6340b1650 2023-11-28T11:09:12.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 >> v1:172.21.15.125:6789/0 conn(0x7fa6340b1650 legacy=0x7fa6340b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 0x7fa620003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6340af0a0 0x7fa620004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa620004d90 0x7fa620005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63415db80 con 0x7fa620003a30 2023-11-28T11:09:12.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62000bac0 con 0x7fa620004d90 2023-11-28T11:09:12.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62000de60 con 0x7fa6340af0a0 2023-11-28T11:09:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa6390c6700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 0x7fa620003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa6398c7700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa620004d90 0x7fa620005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa6388c5700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6340af0a0 0x7fa620004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa6390c6700 1 -- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6340af0a0 msgr2=0x7fa620004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa6390c6700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6340af0a0 0x7fa620004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa6390c6700 1 -- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa620004d90 msgr2=0x7fa620005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa6390c6700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa620004d90 0x7fa620005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa6390c6700 1 -- 172.21.15.125:0/2569354733 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6200035b0 con 0x7fa620003a30 2023-11-28T11:09:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.356+0000 7fa6388c5700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6340af0a0 0x7fa620004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.357+0000 7fa6390c6700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 0x7fa620003e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa62400c240 tx=0x7fa620005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60622687961824c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:12.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.357+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624007c10 con 0x7fa620003a30 2023-11-28T11:09:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.357+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62400ce00 con 0x7fa620003a30 2023-11-28T11:09:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.357+0000 7fa62bfff700 1 -- 172.21.15.125:0/2569354733 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624005ba0 con 0x7fa620003a30 2023-11-28T11:09:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.357+0000 7fa63b32a700 1 -- 172.21.15.125:0/2569354733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 msgr2=0x7fa620003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.357+0000 7fa63b32a700 1 --2- 172.21.15.125:0/2569354733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 0x7fa620003e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa62400c240 tx=0x7fa620005880 comp rx=0 tx=0).stop 2023-11-28T11:09:12.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.357+0000 7fa6398c7700 1 -- 172.21.15.125:0/2569354733 reap_dead start 2023-11-28T11:09:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.357+0000 7fa63b32a700 1 -- 172.21.15.125:0/2569354733 shutdown_connections 2023-11-28T11:09:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.357+0000 7fa63b32a700 1 -- 172.21.15.125:0/2569354733 >> 172.21.15.125:0/2569354733 conn(0x7fa63406c010 msgr2=0x7fa6340cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.357+0000 7fa63b32a700 1 -- 172.21.15.125:0/2569354733 shutdown_connections 2023-11-28T11:09:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.357+0000 7fa63b32a700 1 -- 172.21.15.125:0/2569354733 wait complete. 2023-11-28T11:09:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.358+0000 7fa63b32a700 1 Processor -- start 2023-11-28T11:09:12.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.359+0000 7fa63b32a700 1 -- start start 2023-11-28T11:09:12.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.359+0000 7fa63b32a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 0x7fa634157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.359+0000 7fa63b32a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6341f2400 0x7fa6340c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.359+0000 7fa63b32a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6341f2870 0x7fa6340cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.359+0000 7fa63b32a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340b3760 con 0x7fa620003a30 2023-11-28T11:09:12.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.359+0000 7fa63b32a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6341584e0 con 0x7fa6341f2400 2023-11-28T11:09:12.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.359+0000 7fa63b32a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340c5fb0 con 0x7fa6341f2870 2023-11-28T11:09:12.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.359+0000 7fa6390c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 0x7fa634157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.359+0000 7fa6390c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 0x7fa634157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57930/0 (socket says 172.21.15.125:57930) 2023-11-28T11:09:12.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.359+0000 7fa6390c6700 1 -- 172.21.15.125:0/704732490 learned_addr learned my addr 172.21.15.125:0/704732490 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:12.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa6398c7700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6341f2870 0x7fa6340cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa6388c5700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6341f2400 0x7fa6340c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa6390c6700 1 -- 172.21.15.125:0/704732490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6341f2870 msgr2=0x7fa6340cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa6390c6700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6341f2870 0x7fa6340cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa6390c6700 1 -- 172.21.15.125:0/704732490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6341f2400 msgr2=0x7fa6340c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa6390c6700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6341f2400 0x7fa6340c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa6390c6700 1 -- 172.21.15.125:0/704732490 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63415a4e0 con 0x7fa620003a30 2023-11-28T11:09:12.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa6388c5700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6341f2400 0x7fa6340c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:12.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa6390c6700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 0x7fa634157fa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa62400c830 tx=0x7fa624001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:12.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa629ffb700 1 -- 172.21.15.125:0/704732490 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624001630 con 0x7fa620003a30 2023-11-28T11:09:12.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa629ffb700 1 -- 172.21.15.125:0/704732490 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6240070d0 con 0x7fa620003a30 2023-11-28T11:09:12.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa629ffb700 1 -- 172.21.15.125:0/704732490 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624007440 con 0x7fa620003a30 2023-11-28T11:09:12.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa63b32a700 1 -- 172.21.15.125:0/704732490 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63415a350 con 0x7fa620003a30 2023-11-28T11:09:12.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.360+0000 7fa63b32a700 1 -- 172.21.15.125:0/704732490 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63415a670 con 0x7fa620003a30 2023-11-28T11:09:12.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.361+0000 7fa63b32a700 1 -- 172.21.15.125:0/704732490 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6340b3a40 con 0x7fa620003a30 2023-11-28T11:09:12.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.361+0000 7fa629ffb700 1 -- 172.21.15.125:0/704732490 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa624010070 con 0x7fa620003a30 2023-11-28T11:09:12.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.362+0000 7fa629ffb700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6180682f0 0x7fa61806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.362+0000 7fa629ffb700 1 -- 172.21.15.125:0/704732490 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa624086f60 con 0x7fa620003a30 2023-11-28T11:09:12.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.362+0000 7fa6388c5700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6180682f0 0x7fa61806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.362+0000 7fa6388c5700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6180682f0 0x7fa61806a7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa630000c00 tx=0x7fa630009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:12.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.366+0000 7fa629ffb700 1 -- 172.21.15.125:0/704732490 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa6240536d0 con 0x7fa620003a30 2023-11-28T11:09:12.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.565+0000 7fa63b32a700 1 -- 172.21.15.125:0/704732490 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa6340743f0 con 0x7fa620003a30 2023-11-28T11:09:12.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.565+0000 7fa629ffb700 1 -- 172.21.15.125:0/704732490 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa62402b080 con 0x7fa620003a30 2023-11-28T11:09:12.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 -- 172.21.15.125:0/704732490 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6180682f0 msgr2=0x7fa61806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6180682f0 0x7fa61806a7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa630000c00 tx=0x7fa630009040 comp rx=0 tx=0).stop 2023-11-28T11:09:12.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 -- 172.21.15.125:0/704732490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 msgr2=0x7fa634157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 0x7fa634157fa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa62400c830 tx=0x7fa624001a00 comp rx=0 tx=0).stop 2023-11-28T11:09:12.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 -- 172.21.15.125:0/704732490 shutdown_connections 2023-11-28T11:09:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6180682f0 0x7fa61806a7a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6341f2870 0x7fa6340cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa620003a30 0x7fa634157fa0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 --2- 172.21.15.125:0/704732490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6341f2400 0x7fa6340c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 -- 172.21.15.125:0/704732490 >> 172.21.15.125:0/704732490 conn(0x7fa63406c010 msgr2=0x7fa6340d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 -- 172.21.15.125:0/704732490 shutdown_connections 2023-11-28T11:09:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.567+0000 7fa63b32a700 1 -- 172.21.15.125:0/704732490 wait complete. 2023-11-28T11:09:12.570 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:09:12.581 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:09:12.581 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:12.599 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:12.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.758+0000 7f0eae913700 1 Processor -- start 2023-11-28T11:09:12.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.758+0000 7f0eae913700 1 -- start start 2023-11-28T11:09:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.759+0000 7f0eae913700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea80cd5a0 0x7f0ea80cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.759+0000 7f0eae913700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea80d1ee0 con 0x7f0ea80b22a0 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.759+0000 7f0eae913700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea80cdb10 con 0x7f0ea806ab10 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.759+0000 7f0eae913700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80d1890 con 0x7f0ea80cd5a0 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.759+0000 7f0eaceb0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0ea80b22a0 0x7f0ea80cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42066/0 (socket says 172.21.15.125:42066) 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.759+0000 7f0eaceb0700 1 -- 172.21.15.125:0/1049946287 learned_addr learned my addr 172.21.15.125:0/1049946287 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153024880 0 0) 0x7f0ea80d1ee0 con 0x7f0ea80b22a0 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea77fe700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea80cd5a0 0x7f0ea80cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e900035b0 con 0x7f0ea80b22a0 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1244159951 0 0) 0x7f0e900035b0 con 0x7f0ea80b22a0 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea80cd5a0 msgr2=0x7f0ea80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea80cd5a0 0x7f0ea80cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 >> v1:172.21.15.167:6789/0 conn(0x7f0ea806ab10 legacy=0x7f0ea806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea80d1b70 con 0x7f0ea80b22a0 2023-11-28T11:09:12.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f0ea00019f0 con 0x7f0ea80b22a0 2023-11-28T11:09:12.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 >> v1:172.21.15.125:6789/0 conn(0x7f0ea80b22a0 legacy=0x7f0ea80cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e90003a30 0x7f0e90003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea80cd5a0 0x7f0e90004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e90004d90 0x7f0e90005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80d1890 con 0x7f0e90004d90 2023-11-28T11:09:12.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9000bac0 con 0x7f0e90003a30 2023-11-28T11:09:12.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9000bc50 con 0x7f0ea80cd5a0 2023-11-28T11:09:12.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0eaceb0700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e90004d90 0x7f0e90005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea7fff700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e90003a30 0x7f0e90003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea77fe700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea80cd5a0 0x7f0e90004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0eaceb0700 1 -- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea80cd5a0 msgr2=0x7f0e90004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0eaceb0700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea80cd5a0 0x7f0e90004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0eaceb0700 1 -- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e90003a30 msgr2=0x7f0e90003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0eaceb0700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e90003a30 0x7f0e90003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0eaceb0700 1 -- 172.21.15.125:0/1049946287 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e900035b0 con 0x7f0e90004d90 2023-11-28T11:09:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0ea77fe700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea80cd5a0 0x7f0e90004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.760+0000 7f0eaceb0700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e90004d90 0x7f0e90005200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00013d0 tx=0x7f0e90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66de218d6762cd2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.761+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0012600 con 0x7f0e90004d90 2023-11-28T11:09:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.761+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0012760 con 0x7f0e90004d90 2023-11-28T11:09:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.761+0000 7f0ea6ffd700 1 -- 172.21.15.125:0/1049946287 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0012b10 con 0x7f0e90004d90 2023-11-28T11:09:12.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.761+0000 7f0eae913700 1 -- 172.21.15.125:0/1049946287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e90004d90 msgr2=0x7f0e90005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.761+0000 7f0eae913700 1 --2- 172.21.15.125:0/1049946287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e90004d90 0x7f0e90005200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00013d0 tx=0x7f0e90005880 comp rx=0 tx=0).stop 2023-11-28T11:09:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.761+0000 7f0eaceb0700 1 -- 172.21.15.125:0/1049946287 reap_dead start 2023-11-28T11:09:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.761+0000 7f0eae913700 1 -- 172.21.15.125:0/1049946287 shutdown_connections 2023-11-28T11:09:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.761+0000 7f0eae913700 1 -- 172.21.15.125:0/1049946287 >> 172.21.15.125:0/1049946287 conn(0x7f0ea806c520 msgr2=0x7f0ea806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.761+0000 7f0eae913700 1 -- 172.21.15.125:0/1049946287 shutdown_connections 2023-11-28T11:09:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.761+0000 7f0eae913700 1 -- 172.21.15.125:0/1049946287 wait complete. 2023-11-28T11:09:12.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.762+0000 7f0eae913700 1 Processor -- start 2023-11-28T11:09:12.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.763+0000 7f0eae913700 1 -- start start 2023-11-28T11:09:12.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.763+0000 7f0eae913700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea815d5c0 0x7f0ea81f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.763+0000 7f0eae913700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea815d990 0x7f0ea81f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.763+0000 7f0eae913700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea81f5610 0x7f0ea815f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.763+0000 7f0eae913700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80cbc80 con 0x7f0ea815d990 2023-11-28T11:09:12.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.763+0000 7f0eae913700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea81f5a80 con 0x7f0ea815d5c0 2023-11-28T11:09:12.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.763+0000 7f0eae913700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80cb040 con 0x7f0ea81f5610 2023-11-28T11:09:12.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.763+0000 7f0ea77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea815d990 0x7f0ea81f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.763+0000 7f0ea77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea815d990 0x7f0ea81f50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57952/0 (socket says 172.21.15.125:57952) 2023-11-28T11:09:12.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.763+0000 7f0ea77fe700 1 -- 172.21.15.125:0/2023964465 learned_addr learned my addr 172.21.15.125:0/2023964465 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:12.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0ea7fff700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea815d5c0 0x7f0ea81f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0eaceb0700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea81f5610 0x7f0ea815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0ea77fe700 1 -- 172.21.15.125:0/2023964465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea81f5610 msgr2=0x7f0ea815f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0ea77fe700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea81f5610 0x7f0ea815f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0ea77fe700 1 -- 172.21.15.125:0/2023964465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea815d5c0 msgr2=0x7f0ea81f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0ea77fe700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea815d5c0 0x7f0ea81f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0ea77fe700 1 -- 172.21.15.125:0/2023964465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea80b1ec0 con 0x7f0ea815d990 2023-11-28T11:09:12.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0ea7fff700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea815d5c0 0x7f0ea81f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:12.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0ea77fe700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea815d990 0x7f0ea81f50d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0118d0 tx=0x7f0e9c011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:12.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0ea4ff9700 1 -- 172.21.15.125:0/2023964465 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c004220 con 0x7f0ea815d990 2023-11-28T11:09:12.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0ea4ff9700 1 -- 172.21.15.125:0/2023964465 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c004380 con 0x7f0ea815d990 2023-11-28T11:09:12.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0eae913700 1 -- 172.21.15.125:0/2023964465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea815cad0 con 0x7f0ea815d990 2023-11-28T11:09:12.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0ea4ff9700 1 -- 172.21.15.125:0/2023964465 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c0036a0 con 0x7f0ea815d990 2023-11-28T11:09:12.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.764+0000 7f0eae913700 1 -- 172.21.15.125:0/2023964465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea80b2050 con 0x7f0ea815d990 2023-11-28T11:09:12.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.765+0000 7f0eae913700 1 -- 172.21.15.125:0/2023964465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea80cbdc0 con 0x7f0ea815d990 2023-11-28T11:09:12.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.765+0000 7f0ea4ff9700 1 -- 172.21.15.125:0/2023964465 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0e9c024070 con 0x7f0ea815d990 2023-11-28T11:09:12.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.766+0000 7f0ea4ff9700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e940682f0 0x7f0e9406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:12.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.766+0000 7f0ea4ff9700 1 -- 172.21.15.125:0/2023964465 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e9c086000 con 0x7f0ea815d990 2023-11-28T11:09:12.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.766+0000 7f0ea7fff700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e940682f0 0x7f0e9406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:12.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.766+0000 7f0ea7fff700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e940682f0 0x7f0e9406a7a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ea815c230 tx=0x7f0e98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:12.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.770+0000 7f0ea4ff9700 1 -- 172.21.15.125:0/2023964465 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0ea80cbdc0 con 0x7f0ea815d990 2023-11-28T11:09:12.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.953+0000 7f0eae913700 1 -- 172.21.15.125:0/2023964465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ea80cbdc0 con 0x7f0ea815d990 2023-11-28T11:09:12.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.954+0000 7f0ea4ff9700 1 -- 172.21.15.125:0/2023964465 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f0ea80cbdc0 con 0x7f0ea815d990 2023-11-28T11:09:12.956 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:12.956 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:12.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 -- 172.21.15.125:0/2023964465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e940682f0 msgr2=0x7f0e9406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e940682f0 0x7f0e9406a7a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ea815c230 tx=0x7f0e98009040 comp rx=0 tx=0).stop 2023-11-28T11:09:12.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 -- 172.21.15.125:0/2023964465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea815d990 msgr2=0x7f0ea81f50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:12.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea815d990 0x7f0ea81f50d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0118d0 tx=0x7f0e9c011c90 comp rx=0 tx=0).stop 2023-11-28T11:09:12.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 -- 172.21.15.125:0/2023964465 shutdown_connections 2023-11-28T11:09:12.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e940682f0 0x7f0e9406a7a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea81f5610 0x7f0ea815f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea815d5c0 0x7f0ea81f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 --2- 172.21.15.125:0/2023964465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea815d990 0x7f0ea81f50d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:12.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 -- 172.21.15.125:0/2023964465 >> 172.21.15.125:0/2023964465 conn(0x7f0ea806c520 msgr2=0x7f0ea80b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:12.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 -- 172.21.15.125:0/2023964465 shutdown_connections 2023-11-28T11:09:12.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:12.956+0000 7f0eae913700 1 -- 172.21.15.125:0/2023964465 wait complete. 2023-11-28T11:09:12.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:12.970 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:13.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.092+0000 7f8cdb1b3700 1 Processor -- start 2023-11-28T11:09:13.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.092+0000 7f8cdb1b3700 1 -- start start 2023-11-28T11:09:13.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cdb1b3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8cd415c810 0x7f8cd4160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cdb1b3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd41607a0 con 0x7f8cd40718e0 2023-11-28T11:09:13.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cdb1b3700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd4160a50 con 0x7f8cd406a270 2023-11-28T11:09:13.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cdb1b3700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd415cbe0 con 0x7f8cd415c810 2023-11-28T11:09:13.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8cd40718e0 0x7f8cd406c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42084/0 (socket says 172.21.15.125:42084) 2023-11-28T11:09:13.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd3fff700 1 -- 172.21.15.125:0/2093074293 learned_addr learned my addr 172.21.15.125:0/2093074293 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:13.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694752538 0 0) 0x7f8cd41607a0 con 0x7f8cd40718e0 2023-11-28T11:09:13.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc40035b0 con 0x7f8cd40718e0 2023-11-28T11:09:13.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd8f4f700 1 --2- 172.21.15.125:0/2093074293 >> v2:172.21.15.167:3300/0 conn(0x7f8cd415c810 0x7f8cd4160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4127167754 0 0) 0x7f8cc40035b0 con 0x7f8cd40718e0 2023-11-28T11:09:13.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 >> v2:172.21.15.167:3300/0 conn(0x7f8cd415c810 msgr2=0x7f8cd4160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 --2- 172.21.15.125:0/2093074293 >> v2:172.21.15.167:3300/0 conn(0x7f8cd415c810 0x7f8cd4160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 >> v1:172.21.15.167:6789/0 conn(0x7f8cd406a270 legacy=0x7f8cd406a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd4160d30 con 0x7f8cd40718e0 2023-11-28T11:09:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f8cc0001670 con 0x7f8cd40718e0 2023-11-28T11:09:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 >> v1:172.21.15.125:6789/0 conn(0x7f8cd40718e0 legacy=0x7f8cd406c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 --2- 172.21.15.125:0/2093074293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cc4003a00 0x7f8cc4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 --2- 172.21.15.125:0/2093074293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cc4004850 0x7f8cc4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 --2- 172.21.15.125:0/2093074293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 0x7f8cc400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd415cbe0 con 0x7f8cc4005200 2023-11-28T11:09:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc400c080 con 0x7f8cc4004850 2023-11-28T11:09:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.093+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc400c240 con 0x7f8cc4003a00 2023-11-28T11:09:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd9750700 1 --2- 172.21.15.125:0/2093074293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 0x7f8cc400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd3fff700 1 --2- 172.21.15.125:0/2093074293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cc4004850 0x7f8cc4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd8f4f700 1 --2- 172.21.15.125:0/2093074293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cc4003a00 0x7f8cc4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd9750700 1 -- 172.21.15.125:0/2093074293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cc4003a00 msgr2=0x7f8cc4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd9750700 1 --2- 172.21.15.125:0/2093074293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cc4003a00 0x7f8cc4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd9750700 1 -- 172.21.15.125:0/2093074293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cc4004850 msgr2=0x7f8cc4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd9750700 1 --2- 172.21.15.125:0/2093074293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cc4004850 0x7f8cc4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd9750700 1 -- 172.21.15.125:0/2093074293 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc40035b0 con 0x7f8cc4005200 2023-11-28T11:09:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd9750700 1 -- 172.21.15.125:0/2093074293 reap_dead start 2023-11-28T11:09:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd9750700 1 --2- 172.21.15.125:0/2093074293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 0x7f8cc400ba10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c190 tx=0x7f8cc4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a43feaee3064d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc001db0 con 0x7f8cc4005200 2023-11-28T11:09:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00ccf0 con 0x7f8cc4005200 2023-11-28T11:09:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.094+0000 7f8cd37fe700 1 -- 172.21.15.125:0/2093074293 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc003c40 con 0x7f8cc4005200 2023-11-28T11:09:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.095+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/2093074293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 msgr2=0x7f8cc400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.095+0000 7f8cdb1b3700 1 --2- 172.21.15.125:0/2093074293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 0x7f8cc400ba10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c190 tx=0x7f8cc4005880 comp rx=0 tx=0).stop 2023-11-28T11:09:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.095+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/2093074293 shutdown_connections 2023-11-28T11:09:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.095+0000 7f8cdb1b3700 1 --2- 172.21.15.125:0/2093074293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 0x7f8cc400ba10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.095+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/2093074293 >> 172.21.15.125:0/2093074293 conn(0x7f8cd406c010 msgr2=0x7f8cd40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.095+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/2093074293 shutdown_connections 2023-11-28T11:09:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.095+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/2093074293 wait complete. 2023-11-28T11:09:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.096+0000 7f8cdb1b3700 1 Processor -- start 2023-11-28T11:09:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.096+0000 7f8cdb1b3700 1 -- start start 2023-11-28T11:09:13.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cdb1b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 0x7f8cd414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cdb1b3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40af6a0 0x7f8cd414e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cdb1b3700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cd40afb10 0x7f8cd415def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cdb1b3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd414d5f0 con 0x7f8cc4005200 2023-11-28T11:09:13.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cdb1b3700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd415ce50 con 0x7f8cd40afb10 2023-11-28T11:09:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cdb1b3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd415d130 con 0x7f8cd40af6a0 2023-11-28T11:09:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd8f4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 0x7f8cd414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd8f4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 0x7f8cd414d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57970/0 (socket says 172.21.15.125:57970) 2023-11-28T11:09:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd8f4f700 1 -- 172.21.15.125:0/62697375 learned_addr learned my addr 172.21.15.125:0/62697375 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd9750700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cd40afb10 0x7f8cd415def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd3fff700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40af6a0 0x7f8cd414e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd8f4f700 1 -- 172.21.15.125:0/62697375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40af6a0 msgr2=0x7f8cd414e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd8f4f700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40af6a0 0x7f8cd414e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd8f4f700 1 -- 172.21.15.125:0/62697375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cd40afb10 msgr2=0x7f8cd415def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd8f4f700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cd40afb10 0x7f8cd415def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd8f4f700 1 -- 172.21.15.125:0/62697375 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd40ceb20 con 0x7f8cc4005200 2023-11-28T11:09:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd3fff700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40af6a0 0x7f8cd414e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd8f4f700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 0x7f8cd414d0b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80119a0 tx=0x7f8cc8011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd17fa700 1 -- 172.21.15.125:0/62697375 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800f940 con 0x7f8cc4005200 2023-11-28T11:09:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd17fa700 1 -- 172.21.15.125:0/62697375 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc800faa0 con 0x7f8cc4005200 2023-11-28T11:09:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cd17fa700 1 -- 172.21.15.125:0/62697375 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800fe30 con 0x7f8cc4005200 2023-11-28T11:09:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.097+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/62697375 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd4161010 con 0x7f8cc4005200 2023-11-28T11:09:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.098+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/62697375 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd40ce740 con 0x7f8cc4005200 2023-11-28T11:09:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.098+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/62697375 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd40743f0 con 0x7f8cc4005200 2023-11-28T11:09:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.099+0000 7f8cd17fa700 1 -- 172.21.15.125:0/62697375 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8cc8014440 con 0x7f8cc4005200 2023-11-28T11:09:13.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.099+0000 7f8cd17fa700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8cb80682f0 0x7f8cb806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.099+0000 7f8cd17fa700 1 -- 172.21.15.125:0/62697375 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8cc8086470 con 0x7f8cc4005200 2023-11-28T11:09:13.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.099+0000 7f8cd3fff700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8cb80682f0 0x7f8cb806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.100+0000 7f8cd3fff700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8cb80682f0 0x7f8cb806a7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0007d10 tx=0x7f8cc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:13.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.103+0000 7f8cd17fa700 1 -- 172.21.15.125:0/62697375 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8cc8052d20 con 0x7f8cc4005200 2023-11-28T11:09:13.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.283+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/62697375 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8cd40b58a0 con 0x7f8cc4005200 2023-11-28T11:09:13.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.283+0000 7f8cd17fa700 1 -- 172.21.15.125:0/62697375 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8cc8022020 con 0x7f8cc4005200 2023-11-28T11:09:13.285 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:13.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/62697375 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8cb80682f0 msgr2=0x7f8cb806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8cb80682f0 0x7f8cb806a7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0007d10 tx=0x7f8cc0009040 comp rx=0 tx=0).stop 2023-11-28T11:09:13.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/62697375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 msgr2=0x7f8cd414d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 0x7f8cd414d0b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80119a0 tx=0x7f8cc8011cb0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/62697375 shutdown_connections 2023-11-28T11:09:13.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cd40afb10 0x7f8cd415def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc4005200 0x7f8cd414d0b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8cb80682f0 0x7f8cb806a7a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 --2- 172.21.15.125:0/62697375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cd40af6a0 0x7f8cd414e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/62697375 >> 172.21.15.125:0/62697375 conn(0x7f8cd406c010 msgr2=0x7f8cd40b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:13.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/62697375 shutdown_connections 2023-11-28T11:09:13.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.286+0000 7f8cdb1b3700 1 -- 172.21.15.125:0/62697375 wait complete. 2023-11-28T11:09:13.299 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:13.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.421+0000 7f5c50fc4700 1 Processor -- start 2023-11-28T11:09:13.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.421+0000 7f5c50fc4700 1 -- start start 2023-11-28T11:09:13.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c50fc4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5c4c15a5f0 0x7f5c4c0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c50fc4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c4c0b2ee0 0x7f5c4c0ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c50fc4700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c15a9c0 con 0x7f5c4c0cc200 2023-11-28T11:09:13.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c50fc4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c7b80 con 0x7f5c4c15a5f0 2023-11-28T11:09:13.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c50fc4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0cc990 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c4a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5c4c15a5f0 0x7f5c4c0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c4a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5c4c15a5f0 0x7f5c4c0d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57978/0 (socket says 172.21.15.125:57978) 2023-11-28T11:09:13.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c4a59c700 1 -- 172.21.15.125:0/1783612014 learned_addr learned my addr 172.21.15.125:0/1783612014 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:13.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c4ad9d700 1 --2- 172.21.15.125:0/1783612014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c4c0b2ee0 0x7f5c4c0ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c4a59c700 1 -- 172.21.15.125:0/1783612014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c4c0b2ee0 msgr2=0x7f5c4c0ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:13.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c4a59c700 1 --2- 172.21.15.125:0/1783612014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c4c0b2ee0 0x7f5c4c0ced30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c4a59c700 1 -- 172.21.15.125:0/1783612014 >> v1:172.21.15.167:6789/0 conn(0x7f5c4c0cc200 legacy=0x7f5c4c0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:13.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.422+0000 7f5c4a59c700 1 -- 172.21.15.125:0/1783612014 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c0ccc70 con 0x7f5c4c15a5f0 2023-11-28T11:09:13.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c4a59c700 1 --2- 172.21.15.125:0/1783612014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c4c15a5f0 0x7f5c4c0d0ad0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5c400098f0 tx=0x7f5c40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ca89e6db208eff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:13.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c4959a700 1 -- 172.21.15.125:0/1783612014 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40004230 con 0x7f5c4c15a5f0 2023-11-28T11:09:13.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c4959a700 1 -- 172.21.15.125:0/1783612014 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c40004390 con 0x7f5c4c15a5f0 2023-11-28T11:09:13.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c4959a700 1 -- 172.21.15.125:0/1783612014 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c400036a0 con 0x7f5c4c15a5f0 2023-11-28T11:09:13.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c50fc4700 1 -- 172.21.15.125:0/1783612014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c4c15a5f0 msgr2=0x7f5c4c0d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c50fc4700 1 --2- 172.21.15.125:0/1783612014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c4c15a5f0 0x7f5c4c0d0ad0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5c400098f0 tx=0x7f5c40009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:13.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c50fc4700 1 -- 172.21.15.125:0/1783612014 shutdown_connections 2023-11-28T11:09:13.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c50fc4700 1 --2- 172.21.15.125:0/1783612014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c4c15a5f0 0x7f5c4c0d0ad0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c50fc4700 1 --2- 172.21.15.125:0/1783612014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c4c0b2ee0 0x7f5c4c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c50fc4700 1 -- 172.21.15.125:0/1783612014 >> 172.21.15.125:0/1783612014 conn(0x7f5c4c06ea80 msgr2=0x7f5c4c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:13.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c50fc4700 1 -- 172.21.15.125:0/1783612014 shutdown_connections 2023-11-28T11:09:13.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.423+0000 7f5c50fc4700 1 -- 172.21.15.125:0/1783612014 wait complete. 2023-11-28T11:09:13.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.425+0000 7f5c50fc4700 1 Processor -- start 2023-11-28T11:09:13.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.425+0000 7f5c50fc4700 1 -- start start 2023-11-28T11:09:13.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.425+0000 7f5c50fc4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c4c0b2ee0 0x7f5c4c149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.425+0000 7f5c50fc4700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c4c0cc200 0x7f5c4c15db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.425+0000 7f5c50fc4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c4c15a5f0 0x7f5c4c0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.425+0000 7f5c50fc4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c15c880 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.425+0000 7f5c50fc4700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c1f0570 con 0x7f5c4c0cc200 2023-11-28T11:09:13.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.425+0000 7f5c50fc4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c15e5c0 con 0x7f5c4c15a5f0 2023-11-28T11:09:13.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c4a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c4c0b2ee0 0x7f5c4c149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c4a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c4c0b2ee0 0x7f5c4c149fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57984/0 (socket says 172.21.15.125:57984) 2023-11-28T11:09:13.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c4a59c700 1 -- 172.21.15.125:0/2047301164 learned_addr learned my addr 172.21.15.125:0/2047301164 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:13.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c4ad9d700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c4c15a5f0 0x7f5c4c0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c49d9b700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c4c0cc200 0x7f5c4c15db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c4a59c700 1 -- 172.21.15.125:0/2047301164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c4c15a5f0 msgr2=0x7f5c4c0b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c4a59c700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c4c15a5f0 0x7f5c4c0b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c4a59c700 1 -- 172.21.15.125:0/2047301164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c4c0cc200 msgr2=0x7f5c4c15db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c4a59c700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c4c0cc200 0x7f5c4c15db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c4a59c700 1 -- 172.21.15.125:0/2047301164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c40009550 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c4ad9d700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c4c15a5f0 0x7f5c4c0b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:13.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c4a59c700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c4c0b2ee0 0x7f5c4c149fc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c06d5f0 tx=0x7f5c40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:13.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c3affd700 1 -- 172.21.15.125:0/2047301164 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40003dc0 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c3affd700 1 -- 172.21.15.125:0/2047301164 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4001f070 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c50fc4700 1 -- 172.21.15.125:0/2047301164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c0cd230 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c3affd700 1 -- 172.21.15.125:0/2047301164 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000b8a0 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.426+0000 7f5c50fc4700 1 -- 172.21.15.125:0/2047301164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c0ccf50 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.427+0000 7f5c50fc4700 1 -- 172.21.15.125:0/2047301164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c0cd510 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.428+0000 7f5c3affd700 1 -- 172.21.15.125:0/2047301164 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5c4002a020 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.428+0000 7f5c3affd700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5c2c0682f0 0x7f5c2c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.428+0000 7f5c3affd700 1 -- 172.21.15.125:0/2047301164 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c40087450 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.428+0000 7f5c49d9b700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5c2c0682f0 0x7f5c2c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.428+0000 7f5c49d9b700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5c2c0682f0 0x7f5c2c06a7a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0b2e80 tx=0x7f5c3c007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:13.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.432+0000 7f5c3affd700 1 -- 172.21.15.125:0/2047301164 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5c40053cb0 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.614+0000 7f5c50fc4700 1 -- 172.21.15.125:0/2047301164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5c4c0cd510 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.614+0000 7f5c3affd700 1 -- 172.21.15.125:0/2047301164 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5c400572d0 con 0x7f5c4c0b2ee0 2023-11-28T11:09:13.616 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:13.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 -- 172.21.15.125:0/2047301164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5c2c0682f0 msgr2=0x7f5c2c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5c2c0682f0 0x7f5c2c06a7a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0b2e80 tx=0x7f5c3c007ec0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 -- 172.21.15.125:0/2047301164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c4c0b2ee0 msgr2=0x7f5c4c149fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c4c0b2ee0 0x7f5c4c149fc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c06d5f0 tx=0x7f5c40004750 comp rx=0 tx=0).stop 2023-11-28T11:09:13.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 -- 172.21.15.125:0/2047301164 shutdown_connections 2023-11-28T11:09:13.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5c2c0682f0 0x7f5c2c06a7a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c4c15a5f0 0x7f5c4c0b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c4c0b2ee0 0x7f5c4c149fc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 --2- 172.21.15.125:0/2047301164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c4c0cc200 0x7f5c4c15db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 -- 172.21.15.125:0/2047301164 >> 172.21.15.125:0/2047301164 conn(0x7f5c4c06ea80 msgr2=0x7f5c4c0c73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:13.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 -- 172.21.15.125:0/2047301164 shutdown_connections 2023-11-28T11:09:13.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.616+0000 7f5c50fc4700 1 -- 172.21.15.125:0/2047301164 wait complete. 2023-11-28T11:09:13.630 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.750+0000 7f7575217700 1 Processor -- start 2023-11-28T11:09:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.750+0000 7f7575217700 1 -- start start 2023-11-28T11:09:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.751+0000 7f7575217700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75700c9b00 0x7f75701598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.751+0000 7f7575217700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f75700adf30 0x7f757015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.751+0000 7f7575217700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757015cf40 con 0x7f75700b0540 2023-11-28T11:09:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.751+0000 7f7575217700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757015a1c0 con 0x7f75700adf30 2023-11-28T11:09:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.751+0000 7f7575217700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757015a4a0 con 0x7f75700c9b00 2023-11-28T11:09:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.751+0000 7f756f59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f75700adf30 0x7f757015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.751+0000 7f756ed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f75700b0540 0x7f75700b0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42116/0 (socket says 172.21.15.125:42116) 2023-11-28T11:09:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.751+0000 7f756ed9d700 1 -- 172.21.15.125:0/2069723423 learned_addr learned my addr 172.21.15.125:0/2069723423 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:13.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f756e59c700 1 --2- 172.21.15.125:0/2069723423 >> v2:172.21.15.167:3300/0 conn(0x7f75700c9b00 0x7f75701598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f756f59e700 1 -- 172.21.15.125:0/2069723423 >> v2:172.21.15.167:3300/0 conn(0x7f75700c9b00 msgr2=0x7f75701598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:13.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f756f59e700 1 --2- 172.21.15.125:0/2069723423 >> v2:172.21.15.167:3300/0 conn(0x7f75700c9b00 0x7f75701598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f756f59e700 1 -- 172.21.15.125:0/2069723423 >> v1:172.21.15.125:6789/0 conn(0x7f75700b0540 legacy=0x7f75700b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f756dd9b700 1 -- 172.21.15.125:0/2069723423 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825317982 0 0) 0x7f757015cf40 con 0x7f75700b0540 2023-11-28T11:09:13.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f756f59e700 1 -- 172.21.15.125:0/2069723423 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757015a780 con 0x7f75700adf30 2023-11-28T11:09:13.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f756e59c700 1 --2- 172.21.15.125:0/2069723423 >> v2:172.21.15.167:3300/0 conn(0x7f75700c9b00 0x7f75701598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:13.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f756f59e700 1 --2- 172.21.15.125:0/2069723423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75700adf30 0x7f757015d6b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7570071f40 tx=0x7f756800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f444496d8da07b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:13.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f756dd9b700 1 -- 172.21.15.125:0/2069723423 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756800e070 con 0x7f75700adf30 2023-11-28T11:09:13.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f756dd9b700 1 -- 172.21.15.125:0/2069723423 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756800bbd0 con 0x7f75700adf30 2023-11-28T11:09:13.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f756dd9b700 1 -- 172.21.15.125:0/2069723423 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568012430 con 0x7f75700adf30 2023-11-28T11:09:13.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f7575217700 1 -- 172.21.15.125:0/2069723423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75700adf30 msgr2=0x7f757015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f7575217700 1 --2- 172.21.15.125:0/2069723423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75700adf30 0x7f757015d6b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7570071f40 tx=0x7f756800b330 comp rx=0 tx=0).stop 2023-11-28T11:09:13.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f7575217700 1 -- 172.21.15.125:0/2069723423 shutdown_connections 2023-11-28T11:09:13.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f7575217700 1 --2- 172.21.15.125:0/2069723423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75700adf30 0x7f757015d6b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.752+0000 7f7575217700 1 --2- 172.21.15.125:0/2069723423 >> v2:172.21.15.167:3300/0 conn(0x7f75700c9b00 0x7f75701598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.753+0000 7f7575217700 1 -- 172.21.15.125:0/2069723423 >> 172.21.15.125:0/2069723423 conn(0x7f75700cb540 msgr2=0x7f75700cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:13.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.753+0000 7f7575217700 1 -- 172.21.15.125:0/2069723423 shutdown_connections 2023-11-28T11:09:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.753+0000 7f7575217700 1 -- 172.21.15.125:0/2069723423 wait complete. 2023-11-28T11:09:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.754+0000 7f7575217700 1 Processor -- start 2023-11-28T11:09:13.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.754+0000 7f7575217700 1 -- start start 2023-11-28T11:09:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f7575217700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75700adf30 0x7f7570144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f7575217700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75700b0540 0x7f7570145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f7575217700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75700c9b00 0x7f757006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f7575217700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75700af080 con 0x7f75700adf30 2023-11-28T11:09:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f7575217700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75700af360 con 0x7f75700c9b00 2023-11-28T11:09:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f7575217700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75700c7aa0 con 0x7f75700b0540 2023-11-28T11:09:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75700adf30 0x7f7570144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75700adf30 0x7f7570144dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57998/0 (socket says 172.21.15.125:57998) 2023-11-28T11:09:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756ed9d700 1 -- 172.21.15.125:0/898784038 learned_addr learned my addr 172.21.15.125:0/898784038 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756e59c700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75700b0540 0x7f7570145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756f59e700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75700c9b00 0x7f757006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756ed9d700 1 -- 172.21.15.125:0/898784038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75700b0540 msgr2=0x7f7570145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756ed9d700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75700b0540 0x7f7570145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756ed9d700 1 -- 172.21.15.125:0/898784038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75700c9b00 msgr2=0x7f757006bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756ed9d700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75700c9b00 0x7f757006bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756ed9d700 1 -- 172.21.15.125:0/898784038 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7568009a70 con 0x7f75700adf30 2023-11-28T11:09:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756f59e700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75700c9b00 0x7f757006bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756e59c700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75700b0540 0x7f7570145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f756ed9d700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75700adf30 0x7f7570144dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f75600011e0 tx=0x7f756000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f75577fe700 1 -- 172.21.15.125:0/898784038 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560004c80 con 0x7f75700adf30 2023-11-28T11:09:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f75577fe700 1 -- 172.21.15.125:0/898784038 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7560004e00 con 0x7f75700adf30 2023-11-28T11:09:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f7575217700 1 -- 172.21.15.125:0/898784038 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7570159df0 con 0x7f75700adf30 2023-11-28T11:09:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.755+0000 7f75577fe700 1 -- 172.21.15.125:0/898784038 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560007310 con 0x7f75700adf30 2023-11-28T11:09:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.756+0000 7f7575217700 1 -- 172.21.15.125:0/898784038 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757015d190 con 0x7f75700adf30 2023-11-28T11:09:13.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.756+0000 7f7575217700 1 -- 172.21.15.125:0/898784038 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7570159f80 con 0x7f75700adf30 2023-11-28T11:09:13.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.757+0000 7f75577fe700 1 -- 172.21.15.125:0/898784038 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f756001a020 con 0x7f75700adf30 2023-11-28T11:09:13.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.757+0000 7f75577fe700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f755c0682f0 0x7f755c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:13.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.757+0000 7f75577fe700 1 -- 172.21.15.125:0/898784038 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7560085970 con 0x7f75700adf30 2023-11-28T11:09:13.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.757+0000 7f756e59c700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f755c0682f0 0x7f755c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:13.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.758+0000 7f756e59c700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f755c0682f0 0x7f755c06a7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f75701487c0 tx=0x7f7564008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:13.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.762+0000 7f75577fe700 1 -- 172.21.15.125:0/898784038 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7570159f80 con 0x7f75700adf30 2023-11-28T11:09:13.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.946+0000 7f7575217700 1 -- 172.21.15.125:0/898784038 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7570159f80 con 0x7f75700adf30 2023-11-28T11:09:13.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.946+0000 7f75577fe700 1 -- 172.21.15.125:0/898784038 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7570159f80 con 0x7f75700adf30 2023-11-28T11:09:13.948 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 -- 172.21.15.125:0/898784038 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f755c0682f0 msgr2=0x7f755c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f755c0682f0 0x7f755c06a7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f75701487c0 tx=0x7f7564008040 comp rx=0 tx=0).stop 2023-11-28T11:09:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 -- 172.21.15.125:0/898784038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75700adf30 msgr2=0x7f7570144dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75700adf30 0x7f7570144dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f75600011e0 tx=0x7f756000cae0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 -- 172.21.15.125:0/898784038 shutdown_connections 2023-11-28T11:09:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75700c9b00 0x7f757006bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75700adf30 0x7f7570144dc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f755c0682f0 0x7f755c06a7a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 --2- 172.21.15.125:0/898784038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75700b0540 0x7f7570145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 -- 172.21.15.125:0/898784038 >> 172.21.15.125:0/898784038 conn(0x7f75700cb540 msgr2=0x7f75700ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 -- 172.21.15.125:0/898784038 shutdown_connections 2023-11-28T11:09:13.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:13.948+0000 7f7575217700 1 -- 172.21.15.125:0/898784038 wait complete. 2023-11-28T11:09:13.962 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:14.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.084+0000 7f0b8cf05700 1 Processor -- start 2023-11-28T11:09:14.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.084+0000 7f0b8cf05700 1 -- start start 2023-11-28T11:09:14.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b8cf05700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8806a980 0x7f0b88160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b8cf05700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0b880ce740 0x7f0b881608c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b8cf05700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8815cc70 con 0x7f0b8815c8a0 2023-11-28T11:09:14.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b8cf05700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8806c880 con 0x7f0b880ce740 2023-11-28T11:09:14.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b8cf05700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8806cad0 con 0x7f0b8806a980 2023-11-28T11:09:14.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b85d9b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8806a980 0x7f0b88160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b86d9d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0b880ce740 0x7f0b881608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b85d9b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8806a980 0x7f0b88160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:53016/0 (socket says 172.21.15.125:53016) 2023-11-28T11:09:14.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b85d9b700 1 -- 172.21.15.125:0/2930507991 learned_addr learned my addr 172.21.15.125:0/2930507991 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:14.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b8659c700 1 --1- 172.21.15.125:0/2930507991 >> v1:172.21.15.167:6789/0 conn(0x7f0b8815c8a0 0x7f0b8806a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:44932/0 (socket says 172.21.15.125:44932) 2023-11-28T11:09:14.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b86d9d700 1 -- 172.21.15.125:0/2930507991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8806a980 msgr2=0x7f0b88160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:14.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b86d9d700 1 --2- 172.21.15.125:0/2930507991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8806a980 0x7f0b88160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b86d9d700 1 -- 172.21.15.125:0/2930507991 >> v1:172.21.15.167:6789/0 conn(0x7f0b8815c8a0 legacy=0x7f0b8806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b86d9d700 1 -- 172.21.15.125:0/2930507991 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8806cdb0 con 0x7f0b880ce740 2023-11-28T11:09:14.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.085+0000 7f0b85d9b700 1 --2- 172.21.15.125:0/2930507991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8806a980 0x7f0b88160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:14.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b86d9d700 1 --2- 172.21.15.125:0/2930507991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b880ce740 0x7f0b881608c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009d90 tx=0x7f0b8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=446cfe1d0d8b982b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:14.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b8559a700 1 -- 172.21.15.125:0/2930507991 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000e070 con 0x7f0b880ce740 2023-11-28T11:09:14.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b8559a700 1 -- 172.21.15.125:0/2930507991 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8000bb20 con 0x7f0b880ce740 2023-11-28T11:09:14.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b8559a700 1 -- 172.21.15.125:0/2930507991 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80012430 con 0x7f0b880ce740 2023-11-28T11:09:14.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b8cf05700 1 -- 172.21.15.125:0/2930507991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b880ce740 msgr2=0x7f0b881608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b8cf05700 1 --2- 172.21.15.125:0/2930507991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b880ce740 0x7f0b881608c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009d90 tx=0x7f0b8000b330 comp rx=0 tx=0).stop 2023-11-28T11:09:14.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b8cf05700 1 -- 172.21.15.125:0/2930507991 shutdown_connections 2023-11-28T11:09:14.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b8cf05700 1 --2- 172.21.15.125:0/2930507991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b880ce740 0x7f0b881608c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b8cf05700 1 --2- 172.21.15.125:0/2930507991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8806a980 0x7f0b88160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b8cf05700 1 -- 172.21.15.125:0/2930507991 >> 172.21.15.125:0/2930507991 conn(0x7f0b8806c010 msgr2=0x7f0b880cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:14.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b8cf05700 1 -- 172.21.15.125:0/2930507991 shutdown_connections 2023-11-28T11:09:14.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.086+0000 7f0b8cf05700 1 -- 172.21.15.125:0/2930507991 wait complete. 2023-11-28T11:09:14.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.088+0000 7f0b8cf05700 1 Processor -- start 2023-11-28T11:09:14.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.088+0000 7f0b8cf05700 1 -- start start 2023-11-28T11:09:14.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.088+0000 7f0b8cf05700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b8806a980 0x7f0b880b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.088+0000 7f0b8cf05700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b880ce740 0x7f0b880b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.088+0000 7f0b8cf05700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8815c8a0 0x7f0b880b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.088+0000 7f0b8cf05700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880b2aa0 con 0x7f0b8806a980 2023-11-28T11:09:14.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.088+0000 7f0b8cf05700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880b2d80 con 0x7f0b880ce740 2023-11-28T11:09:14.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.088+0000 7f0b8cf05700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880b3060 con 0x7f0b8815c8a0 2023-11-28T11:09:14.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b8659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b8806a980 0x7f0b880b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b8659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b8806a980 0x7f0b880b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58012/0 (socket says 172.21.15.125:58012) 2023-11-28T11:09:14.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b8659c700 1 -- 172.21.15.125:0/1529552207 learned_addr learned my addr 172.21.15.125:0/1529552207 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:14.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b85d9b700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b880ce740 0x7f0b880b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b86d9d700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8815c8a0 0x7f0b880b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b8659c700 1 -- 172.21.15.125:0/1529552207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8815c8a0 msgr2=0x7f0b880b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b8659c700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8815c8a0 0x7f0b880b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b8659c700 1 -- 172.21.15.125:0/1529552207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b880ce740 msgr2=0x7f0b880b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b8659c700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b880ce740 0x7f0b880b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b8659c700 1 -- 172.21.15.125:0/1529552207 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c009550 con 0x7f0b8806a980 2023-11-28T11:09:14.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b86d9d700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8815c8a0 0x7f0b880b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:14.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b85d9b700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b880ce740 0x7f0b880b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:14.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b8659c700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b8806a980 0x7f0b880b42e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c500 tx=0x7f0b7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:14.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b76ffd700 1 -- 172.21.15.125:0/1529552207 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78005cb0 con 0x7f0b8806a980 2023-11-28T11:09:14.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b76ffd700 1 -- 172.21.15.125:0/1529552207 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b78005e10 con 0x7f0b8806a980 2023-11-28T11:09:14.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b8cf05700 1 -- 172.21.15.125:0/1529552207 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b80009a70 con 0x7f0b8806a980 2023-11-28T11:09:14.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b76ffd700 1 -- 172.21.15.125:0/1529552207 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b780072d0 con 0x7f0b8806a980 2023-11-28T11:09:14.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.089+0000 7f0b8cf05700 1 -- 172.21.15.125:0/1529552207 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8806d370 con 0x7f0b8806a980 2023-11-28T11:09:14.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.090+0000 7f0b8cf05700 1 -- 172.21.15.125:0/1529552207 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8806d090 con 0x7f0b8806a980 2023-11-28T11:09:14.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.091+0000 7f0b76ffd700 1 -- 172.21.15.125:0/1529552207 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0b78019030 con 0x7f0b8806a980 2023-11-28T11:09:14.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.091+0000 7f0b76ffd700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b680682f0 0x7f0b6806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.091+0000 7f0b76ffd700 1 -- 172.21.15.125:0/1529552207 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b78084e70 con 0x7f0b8806a980 2023-11-28T11:09:14.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.091+0000 7f0b85d9b700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b680682f0 0x7f0b6806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.091+0000 7f0b85d9b700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b680682f0 0x7f0b6806a7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b880c6c50 tx=0x7f0b7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:14.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.095+0000 7f0b76ffd700 1 -- 172.21.15.125:0/1529552207 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0b7804b5e0 con 0x7f0b8806a980 2023-11-28T11:09:14.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.277+0000 7f0b8cf05700 1 -- 172.21.15.125:0/1529552207 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b880cd430 con 0x7f0b8806a980 2023-11-28T11:09:14.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.278+0000 7f0b76ffd700 1 -- 172.21.15.125:0/1529552207 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b78017020 con 0x7f0b8806a980 2023-11-28T11:09:14.280 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:14.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.279+0000 7f0b8cf05700 1 -- 172.21.15.125:0/1529552207 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b680682f0 msgr2=0x7f0b6806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.279+0000 7f0b8cf05700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b680682f0 0x7f0b6806a7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b880c6c50 tx=0x7f0b7c008040 comp rx=0 tx=0).stop 2023-11-28T11:09:14.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.279+0000 7f0b8cf05700 1 -- 172.21.15.125:0/1529552207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b8806a980 msgr2=0x7f0b880b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.280+0000 7f0b8cf05700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b8806a980 0x7f0b880b42e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c500 tx=0x7f0b7800c8c0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.280+0000 7f0b8cf05700 1 -- 172.21.15.125:0/1529552207 shutdown_connections 2023-11-28T11:09:14.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.280+0000 7f0b8cf05700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b680682f0 0x7f0b6806a7a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.280+0000 7f0b8cf05700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b8815c8a0 0x7f0b880b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.280+0000 7f0b8cf05700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b8806a980 0x7f0b880b42e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.280+0000 7f0b8cf05700 1 --2- 172.21.15.125:0/1529552207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b880ce740 0x7f0b880b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.280+0000 7f0b8cf05700 1 -- 172.21.15.125:0/1529552207 >> 172.21.15.125:0/1529552207 conn(0x7f0b8806c010 msgr2=0x7f0b88156a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:14.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.280+0000 7f0b8cf05700 1 -- 172.21.15.125:0/1529552207 shutdown_connections 2023-11-28T11:09:14.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.280+0000 7f0b8cf05700 1 -- 172.21.15.125:0/1529552207 wait complete. 2023-11-28T11:09:14.293 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:09:14.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.412+0000 7f4b2901b700 1 Processor -- start 2023-11-28T11:09:14.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.412+0000 7f4b2901b700 1 -- start start 2023-11-28T11:09:14.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.413+0000 7f4b2901b700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4b2406a980 0x7f4b240ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.413+0000 7f4b2901b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2415cc10 con 0x7f4b24071890 2023-11-28T11:09:14.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.413+0000 7f4b2901b700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2406c9b0 con 0x7f4b240cf710 2023-11-28T11:09:14.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.413+0000 7f4b2901b700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2406cc90 con 0x7f4b2406a980 2023-11-28T11:09:14.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.413+0000 7f4b2359e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4b24071890 0x7f4b24160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42148/0 (socket says 172.21.15.125:42148) 2023-11-28T11:09:14.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.413+0000 7f4b2359e700 1 -- 172.21.15.125:0/2495129767 learned_addr learned my addr 172.21.15.125:0/2495129767 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:14.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.413+0000 7f4b2259c700 1 --2- 172.21.15.125:0/2495129767 >> v2:172.21.15.167:3300/0 conn(0x7f4b2406a980 0x7f4b240ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.413+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566998989 0 0) 0x7f4b2415cc10 con 0x7f4b24071890 2023-11-28T11:09:14.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.413+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b0c0035b0 con 0x7f4b24071890 2023-11-28T11:09:14.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2499012223 0 0) 0x7f4b0c0035b0 con 0x7f4b24071890 2023-11-28T11:09:14.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 >> v2:172.21.15.167:3300/0 conn(0x7f4b2406a980 msgr2=0x7f4b240ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:14.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 --2- 172.21.15.125:0/2495129767 >> v2:172.21.15.167:3300/0 conn(0x7f4b2406a980 0x7f4b240ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 >> v1:172.21.15.167:6789/0 conn(0x7f4b240cf710 legacy=0x7f4b2406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2406cf70 con 0x7f4b24071890 2023-11-28T11:09:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f4b1c0019f0 con 0x7f4b24071890 2023-11-28T11:09:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 >> v1:172.21.15.125:6789/0 conn(0x7f4b24071890 legacy=0x7f4b24160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 --2- 172.21.15.125:0/2495129767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b0c003a00 0x7f4b0c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 --2- 172.21.15.125:0/2495129767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 0x7f4b0c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 --2- 172.21.15.125:0/2495129767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b0c005200 0x7f4b0c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2406cc90 con 0x7f4b0c004850 2023-11-28T11:09:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c00c110 con 0x7f4b0c005200 2023-11-28T11:09:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c00c2d0 con 0x7f4b0c003a00 2023-11-28T11:09:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b2259c700 1 --2- 172.21.15.125:0/2495129767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 0x7f4b0c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b22d9d700 1 --2- 172.21.15.125:0/2495129767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b0c003a00 0x7f4b0c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b2359e700 1 --2- 172.21.15.125:0/2495129767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b0c005200 0x7f4b0c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b2259c700 1 -- 172.21.15.125:0/2495129767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b0c003a00 msgr2=0x7f4b0c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b2259c700 1 --2- 172.21.15.125:0/2495129767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b0c003a00 0x7f4b0c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b2259c700 1 -- 172.21.15.125:0/2495129767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b0c005200 msgr2=0x7f4b0c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b2259c700 1 --2- 172.21.15.125:0/2495129767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b0c005200 0x7f4b0c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b2359e700 1 -- 172.21.15.125:0/2495129767 reap_dead start 2023-11-28T11:09:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b2259c700 1 -- 172.21.15.125:0/2495129767 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c0035b0 con 0x7f4b0c004850 2023-11-28T11:09:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b2259c700 1 --2- 172.21.15.125:0/2495129767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 0x7f4b0c004cc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009b60 tx=0x7f4b0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7842346ca3f8b21c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.414+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400e6c0 con 0x7f4b0c004850 2023-11-28T11:09:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.415+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1400e820 con 0x7f4b0c004850 2023-11-28T11:09:14.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.415+0000 7f4b21d9b700 1 -- 172.21.15.125:0/2495129767 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400eb90 con 0x7f4b0c004850 2023-11-28T11:09:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.415+0000 7f4b2901b700 1 -- 172.21.15.125:0/2495129767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 msgr2=0x7f4b0c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.415+0000 7f4b2901b700 1 --2- 172.21.15.125:0/2495129767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 0x7f4b0c004cc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009b60 tx=0x7f4b0c005880 comp rx=0 tx=0).stop 2023-11-28T11:09:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.415+0000 7f4b2901b700 1 -- 172.21.15.125:0/2495129767 shutdown_connections 2023-11-28T11:09:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.415+0000 7f4b2901b700 1 --2- 172.21.15.125:0/2495129767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 0x7f4b0c004cc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.415+0000 7f4b2901b700 1 -- 172.21.15.125:0/2495129767 >> 172.21.15.125:0/2495129767 conn(0x7f4b2406c010 msgr2=0x7f4b240cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.415+0000 7f4b2901b700 1 -- 172.21.15.125:0/2495129767 shutdown_connections 2023-11-28T11:09:14.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.415+0000 7f4b2901b700 1 -- 172.21.15.125:0/2495129767 wait complete. 2023-11-28T11:09:14.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.417+0000 7f4b2901b700 1 Processor -- start 2023-11-28T11:09:14.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.417+0000 7f4b2901b700 1 -- start start 2023-11-28T11:09:14.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b2901b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 0x7f4b240adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b2901b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b24158850 0x7f4b2414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b2901b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b2414d050 0x7f4b24156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b2901b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240c6d10 con 0x7f4b0c004850 2023-11-28T11:09:14.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b2901b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2414d4d0 con 0x7f4b2414d050 2023-11-28T11:09:14.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b2901b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b241577b0 con 0x7f4b24158850 2023-11-28T11:09:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b22d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 0x7f4b240adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b22d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 0x7f4b240adce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58032/0 (socket says 172.21.15.125:58032) 2023-11-28T11:09:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b22d9d700 1 -- 172.21.15.125:0/4249486285 learned_addr learned my addr 172.21.15.125:0/4249486285 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b2259c700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b24158850 0x7f4b2414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b2359e700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b2414d050 0x7f4b24156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b22d9d700 1 -- 172.21.15.125:0/4249486285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b24158850 msgr2=0x7f4b2414cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b22d9d700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b24158850 0x7f4b2414cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b22d9d700 1 -- 172.21.15.125:0/4249486285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b2414d050 msgr2=0x7f4b24156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b22d9d700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b2414d050 0x7f4b24156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b22d9d700 1 -- 172.21.15.125:0/4249486285 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2406d530 con 0x7f4b0c004850 2023-11-28T11:09:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b2359e700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b2414d050 0x7f4b24156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:14.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.418+0000 7f4b22d9d700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 0x7f4b240adce0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800f820 tx=0x7f4b1800fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:14.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.419+0000 7f4b0b7fe700 1 -- 172.21.15.125:0/4249486285 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b180052e0 con 0x7f4b0c004850 2023-11-28T11:09:14.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.419+0000 7f4b0b7fe700 1 -- 172.21.15.125:0/4249486285 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18005440 con 0x7f4b0c004850 2023-11-28T11:09:14.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.419+0000 7f4b0b7fe700 1 -- 172.21.15.125:0/4249486285 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b180038c0 con 0x7f4b0c004850 2023-11-28T11:09:14.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.419+0000 7f4b2901b700 1 -- 172.21.15.125:0/4249486285 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2406d250 con 0x7f4b0c004850 2023-11-28T11:09:14.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.419+0000 7f4b2901b700 1 -- 172.21.15.125:0/4249486285 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b240ce740 con 0x7f4b0c004850 2023-11-28T11:09:14.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.420+0000 7f4b2901b700 1 -- 172.21.15.125:0/4249486285 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b240743f0 con 0x7f4b0c004850 2023-11-28T11:09:14.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.420+0000 7f4b0b7fe700 1 -- 172.21.15.125:0/4249486285 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4b18003a20 con 0x7f4b0c004850 2023-11-28T11:09:14.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.421+0000 7f4b0b7fe700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4b100682f0 0x7f4b1006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.421+0000 7f4b2259c700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4b100682f0 0x7f4b1006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.421+0000 7f4b0b7fe700 1 -- 172.21.15.125:0/4249486285 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b18085b40 con 0x7f4b0c004850 2023-11-28T11:09:14.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.421+0000 7f4b2259c700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4b100682f0 0x7f4b1006a7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b140090b0 tx=0x7f4b1401e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:14.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.425+0000 7f4b0b7fe700 1 -- 172.21.15.125:0/4249486285 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4b18052310 con 0x7f4b0c004850 2023-11-28T11:09:14.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.621+0000 7f4b2901b700 1 -- 172.21.15.125:0/4249486285 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4b240b5b50 con 0x7f4b0c004850 2023-11-28T11:09:14.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.622+0000 7f4b0b7fe700 1 -- 172.21.15.125:0/4249486285 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4b18003cb0 con 0x7f4b0c004850 2023-11-28T11:09:14.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 -- 172.21.15.125:0/4249486285 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4b100682f0 msgr2=0x7f4b1006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4b100682f0 0x7f4b1006a7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b140090b0 tx=0x7f4b1401e040 comp rx=0 tx=0).stop 2023-11-28T11:09:14.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 -- 172.21.15.125:0/4249486285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 msgr2=0x7f4b240adce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 0x7f4b240adce0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800f820 tx=0x7f4b1800fb30 comp rx=0 tx=0).stop 2023-11-28T11:09:14.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 -- 172.21.15.125:0/4249486285 shutdown_connections 2023-11-28T11:09:14.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b2414d050 0x7f4b24156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b0c004850 0x7f4b240adce0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4b100682f0 0x7f4b1006a7a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 --2- 172.21.15.125:0/4249486285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b24158850 0x7f4b2414cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 -- 172.21.15.125:0/4249486285 >> 172.21.15.125:0/4249486285 conn(0x7f4b2406c010 msgr2=0x7f4b240affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:14.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 -- 172.21.15.125:0/4249486285 shutdown_connections 2023-11-28T11:09:14.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.624+0000 7f4b2901b700 1 -- 172.21.15.125:0/4249486285 wait complete. 2023-11-28T11:09:14.627 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:09:14.638 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-11-28T11:09:14.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:14.638 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T11:09:14.676 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:09:14.676 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:09:14.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:14.676 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:09:14.737 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:09:14.737 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:14.759 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:09:14.759 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:14.818 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:14.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.937+0000 7f560f4a0700 1 Processor -- start 2023-11-28T11:09:14.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.937+0000 7f560f4a0700 1 -- start start 2023-11-28T11:09:14.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560f4a0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f560806b220 0x7f5608164f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560f4a0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56080d1570 0x7f56080d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560f4a0700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5608160ee0 con 0x7f5608160b10 2023-11-28T11:09:14.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560f4a0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56081654d0 con 0x7f560806b220 2023-11-28T11:09:14.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560f4a0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080d0b20 con 0x7f56080d1570 2023-11-28T11:09:14.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560ca3b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f560806b220 0x7f5608164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560ca3b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f560806b220 0x7f5608164f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58042/0 (socket says 172.21.15.125:58042) 2023-11-28T11:09:14.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560ca3b700 1 -- 172.21.15.125:0/4029750484 learned_addr learned my addr 172.21.15.125:0/4029750484 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:14.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560da3d700 1 --2- 172.21.15.125:0/4029750484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56080d1570 0x7f56080d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560ca3b700 1 -- 172.21.15.125:0/4029750484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56080d1570 msgr2=0x7f56080d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:14.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560ca3b700 1 --2- 172.21.15.125:0/4029750484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56080d1570 0x7f56080d19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560ca3b700 1 -- 172.21.15.125:0/4029750484 >> v1:172.21.15.167:6789/0 conn(0x7f5608160b10 legacy=0x7f560806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560ca3b700 1 -- 172.21.15.125:0/4029750484 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080cf2e0 con 0x7f560806b220 2023-11-28T11:09:14.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f560ca3b700 1 --2- 172.21.15.125:0/4029750484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560806b220 0x7f5608164f90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f55f80098f0 tx=0x7f55f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70333339a204f674 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:14.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f55fffff700 1 -- 172.21.15.125:0/4029750484 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f800b8a0 con 0x7f560806b220 2023-11-28T11:09:14.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f55fffff700 1 -- 172.21.15.125:0/4029750484 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f800ba00 con 0x7f560806b220 2023-11-28T11:09:14.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.939+0000 7f55fffff700 1 -- 172.21.15.125:0/4029750484 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f800bd90 con 0x7f560806b220 2023-11-28T11:09:14.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.940+0000 7f560f4a0700 1 -- 172.21.15.125:0/4029750484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560806b220 msgr2=0x7f5608164f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.940+0000 7f560f4a0700 1 --2- 172.21.15.125:0/4029750484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560806b220 0x7f5608164f90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f55f80098f0 tx=0x7f55f8009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:14.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.940+0000 7f560f4a0700 1 -- 172.21.15.125:0/4029750484 shutdown_connections 2023-11-28T11:09:14.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.940+0000 7f560f4a0700 1 --2- 172.21.15.125:0/4029750484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56080d1570 0x7f56080d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.940+0000 7f560f4a0700 1 --2- 172.21.15.125:0/4029750484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560806b220 0x7f5608164f90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.940+0000 7f560f4a0700 1 -- 172.21.15.125:0/4029750484 >> 172.21.15.125:0/4029750484 conn(0x7f560806c520 msgr2=0x7f560806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:14.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.940+0000 7f560f4a0700 1 -- 172.21.15.125:0/4029750484 shutdown_connections 2023-11-28T11:09:14.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.940+0000 7f560f4a0700 1 -- 172.21.15.125:0/4029750484 wait complete. 2023-11-28T11:09:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.941+0000 7f560f4a0700 1 Processor -- start 2023-11-28T11:09:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.941+0000 7f560f4a0700 1 -- start start 2023-11-28T11:09:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560f4a0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560806b220 0x7f5608161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560f4a0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56080d1570 0x7f560814bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560f4a0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5608160b10 0x7f560814c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560f4a0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c84e0 con 0x7f560806b220 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560f4a0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c9340 con 0x7f56080d1570 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560f4a0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560815d840 con 0x7f5608160b10 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560d23c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560806b220 0x7f5608161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560d23c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560806b220 0x7f5608161080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58046/0 (socket says 172.21.15.125:58046) 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560d23c700 1 -- 172.21.15.125:0/3257201295 learned_addr learned my addr 172.21.15.125:0/3257201295 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560ca3b700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56080d1570 0x7f560814bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560da3d700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5608160b10 0x7f560814c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560d23c700 1 -- 172.21.15.125:0/3257201295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5608160b10 msgr2=0x7f560814c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560d23c700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5608160b10 0x7f560814c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560d23c700 1 -- 172.21.15.125:0/3257201295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56080d1570 msgr2=0x7f560814bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560d23c700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56080d1570 0x7f560814bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560d23c700 1 -- 172.21.15.125:0/3257201295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8009550 con 0x7f560806b220 2023-11-28T11:09:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.942+0000 7f560d23c700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560806b220 0x7f5608161080 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f560400c510 tx=0x7f560400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.943+0000 7f55fdffb700 1 -- 172.21.15.125:0/3257201295 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56040052d0 con 0x7f560806b220 2023-11-28T11:09:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.943+0000 7f55fdffb700 1 -- 172.21.15.125:0/3257201295 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604005430 con 0x7f560806b220 2023-11-28T11:09:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.943+0000 7f560f4a0700 1 -- 172.21.15.125:0/3257201295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56080d0d70 con 0x7f560806b220 2023-11-28T11:09:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.943+0000 7f55fdffb700 1 -- 172.21.15.125:0/3257201295 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56040038c0 con 0x7f560806b220 2023-11-28T11:09:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.943+0000 7f560f4a0700 1 -- 172.21.15.125:0/3257201295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56080cf5c0 con 0x7f560806b220 2023-11-28T11:09:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.944+0000 7f560f4a0700 1 -- 172.21.15.125:0/3257201295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56080d1050 con 0x7f560806b220 2023-11-28T11:09:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.944+0000 7f55fdffb700 1 -- 172.21.15.125:0/3257201295 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5604019030 con 0x7f560806b220 2023-11-28T11:09:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.945+0000 7f55fdffb700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f55ec0682f0 0x7f55ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:14.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.945+0000 7f55fdffb700 1 -- 172.21.15.125:0/3257201295 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5604084d30 con 0x7f560806b220 2023-11-28T11:09:14.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.945+0000 7f560ca3b700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f55ec0682f0 0x7f55ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:14.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.945+0000 7f560ca3b700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f55ec0682f0 0x7f55ec06a7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55f8014040 tx=0x7f55f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:14.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:14.949+0000 7f55fdffb700 1 -- 172.21.15.125:0/3257201295 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5604051590 con 0x7f560806b220 2023-11-28T11:09:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.134+0000 7f560f4a0700 1 -- 172.21.15.125:0/3257201295 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5608160ee0 con 0x7f560806b220 2023-11-28T11:09:15.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.135+0000 7f55fdffb700 1 -- 172.21.15.125:0/3257201295 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f5608160ee0 con 0x7f560806b220 2023-11-28T11:09:15.139 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:15.139 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.137+0000 7f560f4a0700 1 -- 172.21.15.125:0/3257201295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f55ec0682f0 msgr2=0x7f55ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.137+0000 7f560f4a0700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f55ec0682f0 0x7f55ec06a7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55f8014040 tx=0x7f55f8008030 comp rx=0 tx=0).stop 2023-11-28T11:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.137+0000 7f560f4a0700 1 -- 172.21.15.125:0/3257201295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560806b220 msgr2=0x7f5608161080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.137+0000 7f560f4a0700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560806b220 0x7f5608161080 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f560400c510 tx=0x7f560400c820 comp rx=0 tx=0).stop 2023-11-28T11:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.137+0000 7f560f4a0700 1 -- 172.21.15.125:0/3257201295 shutdown_connections 2023-11-28T11:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.137+0000 7f560f4a0700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f55ec0682f0 0x7f55ec06a7a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.137+0000 7f560f4a0700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5608160b10 0x7f560814c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.137+0000 7f560f4a0700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f560806b220 0x7f5608161080 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.137+0000 7f560f4a0700 1 --2- 172.21.15.125:0/3257201295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56080d1570 0x7f560814bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.137+0000 7f560f4a0700 1 -- 172.21.15.125:0/3257201295 >> 172.21.15.125:0/3257201295 conn(0x7f560806c520 msgr2=0x7f56080b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.138+0000 7f560f4a0700 1 -- 172.21.15.125:0/3257201295 shutdown_connections 2023-11-28T11:09:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.138+0000 7f560f4a0700 1 -- 172.21.15.125:0/3257201295 wait complete. 2023-11-28T11:09:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:15.152 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:15.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.273+0000 7f42fcce0700 1 Processor -- start 2023-11-28T11:09:15.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.273+0000 7f42fcce0700 1 -- start start 2023-11-28T11:09:15.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.274+0000 7f42fcce0700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f42f80718e0 0x7f42f806c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.274+0000 7f42fcce0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42f806cdc0 0x7f42f806a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.274+0000 7f42fcce0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f8160a50 con 0x7f42f815c810 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.274+0000 7f42fcce0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f815cbe0 con 0x7f42f806cdc0 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.274+0000 7f42fcce0700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f8160d30 con 0x7f42f80718e0 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.274+0000 7f42f6d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42f806cdc0 0x7f42f806a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.274+0000 7f42f659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f42f815c810 0x7f42f8160260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42178/0 (socket says 172.21.15.125:42178) 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.274+0000 7f42f659c700 1 -- 172.21.15.125:0/1009733225 learned_addr learned my addr 172.21.15.125:0/1009733225 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.275+0000 7f42f6d9d700 1 -- 172.21.15.125:0/1009733225 >> v2:172.21.15.167:3300/0 conn(0x7f42f80718e0 msgr2=0x7f42f806c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.275+0000 7f42f5d9b700 1 --2- 172.21.15.125:0/1009733225 >> v2:172.21.15.167:3300/0 conn(0x7f42f80718e0 0x7f42f806c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.275+0000 7f42f6d9d700 1 --2- 172.21.15.125:0/1009733225 >> v2:172.21.15.167:3300/0 conn(0x7f42f80718e0 0x7f42f806c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.275+0000 7f42f6d9d700 1 -- 172.21.15.125:0/1009733225 >> v1:172.21.15.125:6789/0 conn(0x7f42f815c810 legacy=0x7f42f8160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.275+0000 7f42f559a700 1 -- 172.21.15.125:0/1009733225 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818921380 0 0) 0x7f42f8160a50 con 0x7f42f815c810 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.275+0000 7f42f6d9d700 1 -- 172.21.15.125:0/1009733225 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8161010 con 0x7f42f806cdc0 2023-11-28T11:09:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.275+0000 7f42f6d9d700 1 --2- 172.21.15.125:0/1009733225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42f806cdc0 0x7f42f806a270 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009d90 tx=0x7f42f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d33597ab7dc646 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.275+0000 7f42f559a700 1 -- 172.21.15.125:0/1009733225 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f000e070 con 0x7f42f806cdc0 2023-11-28T11:09:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.275+0000 7f42f559a700 1 -- 172.21.15.125:0/1009733225 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f000bb90 con 0x7f42f806cdc0 2023-11-28T11:09:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.275+0000 7f42f559a700 1 -- 172.21.15.125:0/1009733225 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0012430 con 0x7f42f806cdc0 2023-11-28T11:09:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.276+0000 7f42fcce0700 1 -- 172.21.15.125:0/1009733225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42f806cdc0 msgr2=0x7f42f806a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.276+0000 7f42fcce0700 1 --2- 172.21.15.125:0/1009733225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42f806cdc0 0x7f42f806a270 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009d90 tx=0x7f42f000b330 comp rx=0 tx=0).stop 2023-11-28T11:09:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.276+0000 7f42fcce0700 1 -- 172.21.15.125:0/1009733225 shutdown_connections 2023-11-28T11:09:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.276+0000 7f42fcce0700 1 --2- 172.21.15.125:0/1009733225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42f806cdc0 0x7f42f806a270 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.276+0000 7f42fcce0700 1 --2- 172.21.15.125:0/1009733225 >> v2:172.21.15.167:3300/0 conn(0x7f42f80718e0 0x7f42f806c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.276+0000 7f42fcce0700 1 -- 172.21.15.125:0/1009733225 >> 172.21.15.125:0/1009733225 conn(0x7f42f806c010 msgr2=0x7f42f80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:15.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.276+0000 7f42fcce0700 1 -- 172.21.15.125:0/1009733225 shutdown_connections 2023-11-28T11:09:15.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.276+0000 7f42fcce0700 1 -- 172.21.15.125:0/1009733225 wait complete. 2023-11-28T11:09:15.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.277+0000 7f42fcce0700 1 Processor -- start 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.277+0000 7f42fcce0700 1 -- start start 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42fcce0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42f806cdc0 0x7f42f81f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42fcce0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f80718e0 0x7f42f815e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42fcce0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f815c810 0x7f42f80ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42fcce0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80b1940 con 0x7f42f806cdc0 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42fcce0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f815ddb0 con 0x7f42f80718e0 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42fcce0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81f28a0 con 0x7f42f815c810 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42f806cdc0 0x7f42f81f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42f806cdc0 0x7f42f81f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58060/0 (socket says 172.21.15.125:58060) 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f659c700 1 -- 172.21.15.125:0/1160369199 learned_addr learned my addr 172.21.15.125:0/1160369199 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f5d9b700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f80718e0 0x7f42f815e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f6d9d700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f815c810 0x7f42f80ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f659c700 1 -- 172.21.15.125:0/1160369199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f815c810 msgr2=0x7f42f80ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f659c700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f815c810 0x7f42f80ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f659c700 1 -- 172.21.15.125:0/1160369199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f80718e0 msgr2=0x7f42f815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f659c700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f80718e0 0x7f42f815e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f659c700 1 -- 172.21.15.125:0/1160369199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0009a70 con 0x7f42f806cdc0 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f5d9b700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f80718e0 0x7f42f815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f6d9d700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f815c810 0x7f42f80ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.278+0000 7f42f659c700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42f806cdc0 0x7f42f81f2360 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c550 tx=0x7f42ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.279+0000 7f42e6ffd700 1 -- 172.21.15.125:0/1160369199 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec004c80 con 0x7f42f806cdc0 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.279+0000 7f42e6ffd700 1 -- 172.21.15.125:0/1160369199 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec004e00 con 0x7f42f806cdc0 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.279+0000 7f42fcce0700 1 -- 172.21.15.125:0/1160369199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f80ce740 con 0x7f42f806cdc0 2023-11-28T11:09:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.279+0000 7f42e6ffd700 1 -- 172.21.15.125:0/1160369199 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec007310 con 0x7f42f806cdc0 2023-11-28T11:09:15.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.279+0000 7f42fcce0700 1 -- 172.21.15.125:0/1160369199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f80ceb20 con 0x7f42f806cdc0 2023-11-28T11:09:15.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.280+0000 7f42fcce0700 1 -- 172.21.15.125:0/1160369199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f80ce8d0 con 0x7f42f806cdc0 2023-11-28T11:09:15.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.280+0000 7f42e6ffd700 1 -- 172.21.15.125:0/1160369199 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f42ec01a020 con 0x7f42f806cdc0 2023-11-28T11:09:15.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.280+0000 7f42e6ffd700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42d80682f0 0x7f42d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.281+0000 7f42e6ffd700 1 -- 172.21.15.125:0/1160369199 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f42ec085940 con 0x7f42f806cdc0 2023-11-28T11:09:15.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.281+0000 7f42f5d9b700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42d80682f0 0x7f42d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.281+0000 7f42f5d9b700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42d80682f0 0x7f42d806a7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f42e8006fd0 tx=0x7f42e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:15.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.285+0000 7f42e6ffd700 1 -- 172.21.15.125:0/1160369199 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f42ec0521f0 con 0x7f42f806cdc0 2023-11-28T11:09:15.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.466+0000 7f42fcce0700 1 -- 172.21.15.125:0/1160369199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42f80714f0 con 0x7f42f806cdc0 2023-11-28T11:09:15.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.466+0000 7f42e6ffd700 1 -- 172.21.15.125:0/1160369199 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42ec055810 con 0x7f42f806cdc0 2023-11-28T11:09:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 -- 172.21.15.125:0/1160369199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42d80682f0 msgr2=0x7f42d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42d80682f0 0x7f42d806a7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f42e8006fd0 tx=0x7f42e8008040 comp rx=0 tx=0).stop 2023-11-28T11:09:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 -- 172.21.15.125:0/1160369199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42f806cdc0 msgr2=0x7f42f81f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42f806cdc0 0x7f42f81f2360 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c550 tx=0x7f42ec00c910 comp rx=0 tx=0).stop 2023-11-28T11:09:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 -- 172.21.15.125:0/1160369199 shutdown_connections 2023-11-28T11:09:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42d80682f0 0x7f42d806a7a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f815c810 0x7f42f80ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42f806cdc0 0x7f42f81f2360 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 --2- 172.21.15.125:0/1160369199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f80718e0 0x7f42f815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 -- 172.21.15.125:0/1160369199 >> 172.21.15.125:0/1160369199 conn(0x7f42f806c010 msgr2=0x7f42f80cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 -- 172.21.15.125:0/1160369199 shutdown_connections 2023-11-28T11:09:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.468+0000 7f42fcce0700 1 -- 172.21.15.125:0/1160369199 wait complete. 2023-11-28T11:09:15.482 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:15.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.603+0000 7f093c662700 1 Processor -- start 2023-11-28T11:09:15.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.603+0000 7f093c662700 1 -- start start 2023-11-28T11:09:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093c662700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f093415fe50 0x7f093406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093c662700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09340b27d0 0x7f09340b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093c662700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0934161370 con 0x7f09340b3b80 2023-11-28T11:09:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093c662700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0934160220 con 0x7f09340b27d0 2023-11-28T11:09:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093c662700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09340cf700 con 0x7f093415fe50 2023-11-28T11:09:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f0939bfd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f09340b3b80 0x7f0934160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42192/0 (socket says 172.21.15.125:42192) 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f0939bfd700 1 -- 172.21.15.125:0/2202483439 learned_addr learned my addr 172.21.15.125:0/2202483439 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093abff700 1 --2- 172.21.15.125:0/2202483439 >> v2:172.21.15.125:3300/0 conn(0x7f09340b27d0 0x7f09340b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f09393fc700 1 -- 172.21.15.125:0/2202483439 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265975071 0 0) 0x7f0934161370 con 0x7f09340b3b80 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f09393fc700 1 -- 172.21.15.125:0/2202483439 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09200035b0 con 0x7f09340b3b80 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093a3fe700 1 --2- 172.21.15.125:0/2202483439 >> v2:172.21.15.167:3300/0 conn(0x7f093415fe50 0x7f093406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093abff700 1 -- 172.21.15.125:0/2202483439 >> v2:172.21.15.167:3300/0 conn(0x7f093415fe50 msgr2=0x7f093406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093abff700 1 --2- 172.21.15.125:0/2202483439 >> v2:172.21.15.167:3300/0 conn(0x7f093415fe50 0x7f093406d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093abff700 1 -- 172.21.15.125:0/2202483439 >> v1:172.21.15.125:6789/0 conn(0x7f09340b3b80 legacy=0x7f0934160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093abff700 1 -- 172.21.15.125:0/2202483439 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09340b3170 con 0x7f09340b27d0 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.604+0000 7f093abff700 1 --2- 172.21.15.125:0/2202483439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09340b27d0 0x7f09340b2c30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f09340d1e30 tx=0x7f092c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34d872ba097ade5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.605+0000 7f09393fc700 1 -- 172.21.15.125:0/2202483439 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c00e070 con 0x7f09340b27d0 2023-11-28T11:09:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.605+0000 7f09393fc700 1 -- 172.21.15.125:0/2202483439 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c00bb20 con 0x7f09340b27d0 2023-11-28T11:09:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.605+0000 7f09393fc700 1 -- 172.21.15.125:0/2202483439 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c00be90 con 0x7f09340b27d0 2023-11-28T11:09:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.605+0000 7f093c662700 1 -- 172.21.15.125:0/2202483439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09340b27d0 msgr2=0x7f09340b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.605+0000 7f093c662700 1 --2- 172.21.15.125:0/2202483439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09340b27d0 0x7f09340b2c30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f09340d1e30 tx=0x7f092c00b330 comp rx=0 tx=0).stop 2023-11-28T11:09:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.605+0000 7f093c662700 1 -- 172.21.15.125:0/2202483439 shutdown_connections 2023-11-28T11:09:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.605+0000 7f093c662700 1 --2- 172.21.15.125:0/2202483439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09340b27d0 0x7f09340b2c30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.605+0000 7f093c662700 1 --2- 172.21.15.125:0/2202483439 >> v2:172.21.15.167:3300/0 conn(0x7f093415fe50 0x7f093406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.605+0000 7f093c662700 1 -- 172.21.15.125:0/2202483439 >> 172.21.15.125:0/2202483439 conn(0x7f093406ea80 msgr2=0x7f093406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.605+0000 7f093c662700 1 -- 172.21.15.125:0/2202483439 shutdown_connections 2023-11-28T11:09:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.605+0000 7f093c662700 1 -- 172.21.15.125:0/2202483439 wait complete. 2023-11-28T11:09:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.606+0000 7f093c662700 1 Processor -- start 2023-11-28T11:09:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.606+0000 7f093c662700 1 -- start start 2023-11-28T11:09:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.607+0000 7f093c662700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340b27d0 0x7f09341f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.607+0000 7f093c662700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09340b3b80 0x7f09340c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.607+0000 7f093c662700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f093415fe50 0x7f093415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.607+0000 7f093c662700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09341f1dc0 con 0x7f09340b3b80 2023-11-28T11:09:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.607+0000 7f093c662700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340c4c90 con 0x7f093415fe50 2023-11-28T11:09:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.607+0000 7f093c662700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09340c4f70 con 0x7f09340b27d0 2023-11-28T11:09:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.607+0000 7f0939bfd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09340b3b80 0x7f09340c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.607+0000 7f0939bfd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09340b3b80 0x7f09340c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58076/0 (socket says 172.21.15.125:58076) 2023-11-28T11:09:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.607+0000 7f0939bfd700 1 -- 172.21.15.125:0/93649974 learned_addr learned my addr 172.21.15.125:0/93649974 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.607+0000 7f093a3fe700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340b27d0 0x7f09341f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.607+0000 7f093abff700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f093415fe50 0x7f093415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f0939bfd700 1 -- 172.21.15.125:0/93649974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340b27d0 msgr2=0x7f09341f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f0939bfd700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340b27d0 0x7f09341f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f0939bfd700 1 -- 172.21.15.125:0/93649974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f093415fe50 msgr2=0x7f093415cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f0939bfd700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f093415fe50 0x7f093415cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f0939bfd700 1 -- 172.21.15.125:0/93649974 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c009a70 con 0x7f09340b3b80 2023-11-28T11:09:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f093a3fe700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340b27d0 0x7f09341f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f0939bfd700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09340b3b80 0x7f09340c9e70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f092400c420 tx=0x7f092400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f092affd700 1 -- 172.21.15.125:0/93649974 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924005d70 con 0x7f09340b3b80 2023-11-28T11:09:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f092affd700 1 -- 172.21.15.125:0/93649974 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09240070d0 con 0x7f09340b3b80 2023-11-28T11:09:15.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f092affd700 1 -- 172.21.15.125:0/93649974 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924007440 con 0x7f09340b3b80 2023-11-28T11:09:15.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f093c662700 1 -- 172.21.15.125:0/93649974 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09340cedd0 con 0x7f09340b3b80 2023-11-28T11:09:15.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.608+0000 7f093c662700 1 -- 172.21.15.125:0/93649974 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09340b3fd0 con 0x7f09340b3b80 2023-11-28T11:09:15.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.609+0000 7f093c662700 1 -- 172.21.15.125:0/93649974 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09340cf0b0 con 0x7f09340b3b80 2023-11-28T11:09:15.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.609+0000 7f092affd700 1 -- 172.21.15.125:0/93649974 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0924019030 con 0x7f09340b3b80 2023-11-28T11:09:15.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.610+0000 7f092affd700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f09180682f0 0x7f091806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.610+0000 7f092affd700 1 -- 172.21.15.125:0/93649974 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0924084ea0 con 0x7f09340b3b80 2023-11-28T11:09:15.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.610+0000 7f093a3fe700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f09180682f0 0x7f091806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.610+0000 7f093a3fe700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f09180682f0 0x7f091806a7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0930006fd0 tx=0x7f0930008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:15.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.614+0000 7f092affd700 1 -- 172.21.15.125:0/93649974 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f092404b5e0 con 0x7f09340b3b80 2023-11-28T11:09:15.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.794+0000 7f093c662700 1 -- 172.21.15.125:0/93649974 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09340cb8e0 con 0x7f09340b3b80 2023-11-28T11:09:15.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.795+0000 7f092affd700 1 -- 172.21.15.125:0/93649974 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0924017020 con 0x7f09340b3b80 2023-11-28T11:09:15.797 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:15.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 -- 172.21.15.125:0/93649974 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f09180682f0 msgr2=0x7f091806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f09180682f0 0x7f091806a7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0930006fd0 tx=0x7f0930008040 comp rx=0 tx=0).stop 2023-11-28T11:09:15.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 -- 172.21.15.125:0/93649974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09340b3b80 msgr2=0x7f09340c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09340b3b80 0x7f09340c9e70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f092400c420 tx=0x7f092400c7e0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 -- 172.21.15.125:0/93649974 shutdown_connections 2023-11-28T11:09:15.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f093415fe50 0x7f093415cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f09180682f0 0x7f091806a7a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340b27d0 0x7f09341f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 --2- 172.21.15.125:0/93649974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09340b3b80 0x7f09340c9e70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 -- 172.21.15.125:0/93649974 >> 172.21.15.125:0/93649974 conn(0x7f093406ea80 msgr2=0x7f09340b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:15.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 -- 172.21.15.125:0/93649974 shutdown_connections 2023-11-28T11:09:15.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.797+0000 7f093c662700 1 -- 172.21.15.125:0/93649974 wait complete. 2023-11-28T11:09:15.811 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:15.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.932+0000 7f0ee6bf7700 1 Processor -- start 2023-11-28T11:09:15.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.932+0000 7f0ee6bf7700 1 -- start start 2023-11-28T11:09:15.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee6bf7700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0ee01599b0 0x7f0ee015d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee6bf7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ee00af0a0 0x7f0ee015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee6bf7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee0159ec0 con 0x7f0ee00b1650 2023-11-28T11:09:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee6bf7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee015d8a0 con 0x7f0ee00af0a0 2023-11-28T11:09:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee6bf7700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee015db80 con 0x7f0ee01599b0 2023-11-28T11:09:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee5194700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ee00af0a0 0x7f0ee015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee4993700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0ee00b1650 0x7f0ee00b1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42206/0 (socket says 172.21.15.125:42206) 2023-11-28T11:09:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee5194700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ee00af0a0 0x7f0ee015a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58086/0 (socket says 172.21.15.125:58086) 2023-11-28T11:09:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee4993700 1 -- 172.21.15.125:0/56005644 learned_addr learned my addr 172.21.15.125:0/56005644 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0edffff700 1 --2- 172.21.15.125:0/56005644 >> v2:172.21.15.167:3300/0 conn(0x7f0ee01599b0 0x7f0ee015d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee5194700 1 -- 172.21.15.125:0/56005644 >> v2:172.21.15.167:3300/0 conn(0x7f0ee01599b0 msgr2=0x7f0ee015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee5194700 1 --2- 172.21.15.125:0/56005644 >> v2:172.21.15.167:3300/0 conn(0x7f0ee01599b0 0x7f0ee015d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee5194700 1 -- 172.21.15.125:0/56005644 >> v1:172.21.15.125:6789/0 conn(0x7f0ee00b1650 legacy=0x7f0ee00b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0ee5194700 1 -- 172.21.15.125:0/56005644 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee015de60 con 0x7f0ee00af0a0 2023-11-28T11:09:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0edf7fe700 1 -- 172.21.15.125:0/56005644 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971225084 0 0) 0x7f0ee0159ec0 con 0x7f0ee00b1650 2023-11-28T11:09:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.933+0000 7f0edffff700 1 --2- 172.21.15.125:0/56005644 >> v2:172.21.15.167:3300/0 conn(0x7f0ee01599b0 0x7f0ee015d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0ee5194700 1 --2- 172.21.15.125:0/56005644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee00af0a0 0x7f0ee015a350 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0ee006c730 tx=0x7f0ed800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4aabfb7d979fdd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0edf7fe700 1 -- 172.21.15.125:0/56005644 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed800e070 con 0x7f0ee00af0a0 2023-11-28T11:09:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0edf7fe700 1 -- 172.21.15.125:0/56005644 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed800bbd0 con 0x7f0ee00af0a0 2023-11-28T11:09:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0edf7fe700 1 -- 172.21.15.125:0/56005644 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8012430 con 0x7f0ee00af0a0 2023-11-28T11:09:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/56005644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee00af0a0 msgr2=0x7f0ee015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0ee6bf7700 1 --2- 172.21.15.125:0/56005644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee00af0a0 0x7f0ee015a350 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0ee006c730 tx=0x7f0ed800b330 comp rx=0 tx=0).stop 2023-11-28T11:09:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/56005644 shutdown_connections 2023-11-28T11:09:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0ee6bf7700 1 --2- 172.21.15.125:0/56005644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee00af0a0 0x7f0ee015a350 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0ee6bf7700 1 --2- 172.21.15.125:0/56005644 >> v2:172.21.15.167:3300/0 conn(0x7f0ee01599b0 0x7f0ee015d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/56005644 >> 172.21.15.125:0/56005644 conn(0x7f0ee006c010 msgr2=0x7f0ee00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:15.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/56005644 shutdown_connections 2023-11-28T11:09:15.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.934+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/56005644 wait complete. 2023-11-28T11:09:15.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.935+0000 7f0ee6bf7700 1 Processor -- start 2023-11-28T11:09:15.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.936+0000 7f0ee6bf7700 1 -- start start 2023-11-28T11:09:15.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.936+0000 7f0ee6bf7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee00af0a0 0x7f0ee006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.936+0000 7f0ee6bf7700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee00b1650 0x7f0ee01f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.936+0000 7f0ee6bf7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee01f2290 0x7f0ee00b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.936+0000 7f0ee6bf7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00b4700 con 0x7f0ee01f2290 2023-11-28T11:09:15.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.936+0000 7f0ee6bf7700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0153d30 con 0x7f0ee00af0a0 2023-11-28T11:09:15.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.936+0000 7f0ee6bf7700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0154010 con 0x7f0ee00b1650 2023-11-28T11:09:15.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee5194700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee01f2290 0x7f0ee00b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee5194700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee01f2290 0x7f0ee00b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58092/0 (socket says 172.21.15.125:58092) 2023-11-28T11:09:15.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee5194700 1 -- 172.21.15.125:0/2507906480 learned_addr learned my addr 172.21.15.125:0/2507906480 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:15.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0edffff700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee00b1650 0x7f0ee01f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee4993700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee00af0a0 0x7f0ee006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee5194700 1 -- 172.21.15.125:0/2507906480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee00b1650 msgr2=0x7f0ee01f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee5194700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee00b1650 0x7f0ee01f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee5194700 1 -- 172.21.15.125:0/2507906480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee00af0a0 msgr2=0x7f0ee006a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee5194700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee00af0a0 0x7f0ee006a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee5194700 1 -- 172.21.15.125:0/2507906480 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8009a70 con 0x7f0ee01f2290 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee5194700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee01f2290 0x7f0ee00b3960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00708b0 tx=0x7f0ed8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0edd7fa700 1 -- 172.21.15.125:0/2507906480 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8012430 con 0x7f0ee01f2290 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0edd7fa700 1 -- 172.21.15.125:0/2507906480 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed8020070 con 0x7f0ee01f2290 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/2507906480 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee015a890 con 0x7f0ee01f2290 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0edd7fa700 1 -- 172.21.15.125:0/2507906480 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8004280 con 0x7f0ee01f2290 2023-11-28T11:09:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.937+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/2507906480 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee015d590 con 0x7f0ee01f2290 2023-11-28T11:09:15.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.938+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/2507906480 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee015aa20 con 0x7f0ee01f2290 2023-11-28T11:09:15.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.938+0000 7f0edd7fa700 1 -- 172.21.15.125:0/2507906480 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0ed80043e0 con 0x7f0ee01f2290 2023-11-28T11:09:15.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.939+0000 7f0edd7fa700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ec40682f0 0x7f0ec406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:15.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.939+0000 7f0edd7fa700 1 -- 172.21.15.125:0/2507906480 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ed8022070 con 0x7f0ee01f2290 2023-11-28T11:09:15.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.939+0000 7f0ee4993700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ec40682f0 0x7f0ec406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:15.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.939+0000 7f0ee4993700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ec40682f0 0x7f0ec406a7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4000f60 tx=0x7f0ed4007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:15.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:15.943+0000 7f0edd7fa700 1 -- 172.21.15.125:0/2507906480 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0ed8054ab0 con 0x7f0ee01f2290 2023-11-28T11:09:16.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.129+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/2507906480 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ee00cd340 con 0x7f0ee01f2290 2023-11-28T11:09:16.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.129+0000 7f0edd7fa700 1 -- 172.21.15.125:0/2507906480 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ed80580d0 con 0x7f0ee01f2290 2023-11-28T11:09:16.131 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:16.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/2507906480 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ec40682f0 msgr2=0x7f0ec406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ec40682f0 0x7f0ec406a7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4000f60 tx=0x7f0ed4007be0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/2507906480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee01f2290 msgr2=0x7f0ee00b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee01f2290 0x7f0ee00b3960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00708b0 tx=0x7f0ed8004ad0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/2507906480 shutdown_connections 2023-11-28T11:09:16.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ee01f2290 0x7f0ee00b3960 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee00af0a0 0x7f0ee006a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ec40682f0 0x7f0ec406a7a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 --2- 172.21.15.125:0/2507906480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee00b1650 0x7f0ee01f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/2507906480 >> 172.21.15.125:0/2507906480 conn(0x7f0ee006c010 msgr2=0x7f0ee0070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:16.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/2507906480 shutdown_connections 2023-11-28T11:09:16.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.131+0000 7f0ee6bf7700 1 -- 172.21.15.125:0/2507906480 wait complete. 2023-11-28T11:09:16.145 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:16.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.266+0000 7fd99db6a700 1 Processor -- start 2023-11-28T11:09:16.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.266+0000 7fd99db6a700 1 -- start start 2023-11-28T11:09:16.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.267+0000 7fd99db6a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd99815c8c0 0x7fd998160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.267+0000 7fd99db6a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9980d2d30 con 0x7fd99806b220 2023-11-28T11:09:16.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.267+0000 7fd99db6a700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9980d0b40 con 0x7fd9980b5dc0 2023-11-28T11:09:16.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.267+0000 7fd99db6a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9981611f0 con 0x7fd99815c8c0 2023-11-28T11:09:16.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.267+0000 7fd9977fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd99815c8c0 0x7fd998160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.267+0000 7fd997fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd99806b220 0x7fd9980d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42224/0 (socket says 172.21.15.125:42224) 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.267+0000 7fd9977fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd99815c8c0 0x7fd998160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58096/0 (socket says 172.21.15.125:58096) 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.267+0000 7fd997fff700 1 -- 172.21.15.125:0/3940164079 learned_addr learned my addr 172.21.15.125:0/3940164079 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd9977fe700 1 -- 172.21.15.125:0/3940164079 >> v1:172.21.15.167:6789/0 conn(0x7fd9980b5dc0 legacy=0x7fd99806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd9977fe700 1 -- 172.21.15.125:0/3940164079 >> v1:172.21.15.125:6789/0 conn(0x7fd99806b220 legacy=0x7fd9980d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd9967fc700 1 -- 172.21.15.125:0/3940164079 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609817612 0 0) 0x7fd990001490 con 0x7fd99806b220 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd9977fe700 1 -- 172.21.15.125:0/3940164079 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9980d2a50 con 0x7fd99815c8c0 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd9977fe700 1 --2- 172.21.15.125:0/3940164079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd99815c8c0 0x7fd998160cb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009840 tx=0x7fd98c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b732e1a4001f66 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd9967fc700 1 -- 172.21.15.125:0/3940164079 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c011830 con 0x7fd99815c8c0 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd9967fc700 1 -- 172.21.15.125:0/3940164079 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c011990 con 0x7fd99815c8c0 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd9967fc700 1 -- 172.21.15.125:0/3940164079 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c011d20 con 0x7fd99815c8c0 2023-11-28T11:09:16.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd99db6a700 1 -- 172.21.15.125:0/3940164079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd99815c8c0 msgr2=0x7fd998160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd99db6a700 1 --2- 172.21.15.125:0/3940164079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd99815c8c0 0x7fd998160cb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009840 tx=0x7fd98c009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:16.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd99db6a700 1 -- 172.21.15.125:0/3940164079 shutdown_connections 2023-11-28T11:09:16.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd99db6a700 1 --2- 172.21.15.125:0/3940164079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd99815c8c0 0x7fd998160cb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.268+0000 7fd99db6a700 1 -- 172.21.15.125:0/3940164079 >> 172.21.15.125:0/3940164079 conn(0x7fd99806c520 msgr2=0x7fd99806c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:16.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.269+0000 7fd99db6a700 1 -- 172.21.15.125:0/3940164079 shutdown_connections 2023-11-28T11:09:16.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.269+0000 7fd99db6a700 1 -- 172.21.15.125:0/3940164079 wait complete. 2023-11-28T11:09:16.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.270+0000 7fd99db6a700 1 Processor -- start 2023-11-28T11:09:16.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.270+0000 7fd99db6a700 1 -- start start 2023-11-28T11:09:16.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.271+0000 7fd99db6a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd99806b220 0x7fd99814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.271+0000 7fd99db6a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9980b5dc0 0x7fd9981f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.271+0000 7fd99db6a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd99815c8c0 0x7fd9980b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.271+0000 7fd99db6a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981f31e0 con 0x7fd99806b220 2023-11-28T11:09:16.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.271+0000 7fd99db6a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981f2c20 con 0x7fd9980b5dc0 2023-11-28T11:09:16.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.271+0000 7fd99db6a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981f2f00 con 0x7fd99815c8c0 2023-11-28T11:09:16.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.271+0000 7fd9977fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd99806b220 0x7fd99814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.271+0000 7fd9977fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd99806b220 0x7fd99814c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58102/0 (socket says 172.21.15.125:58102) 2023-11-28T11:09:16.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.271+0000 7fd9977fe700 1 -- 172.21.15.125:0/2319307082 learned_addr learned my addr 172.21.15.125:0/2319307082 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:16.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.272+0000 7fd9977fe700 1 -- 172.21.15.125:0/2319307082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd99815c8c0 msgr2=0x7fd9980b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.272+0000 7fd9977fe700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd99815c8c0 0x7fd9980b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.272+0000 7fd9977fe700 1 -- 172.21.15.125:0/2319307082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9980b5dc0 msgr2=0x7fd9981f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.272+0000 7fd9977fe700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9980b5dc0 0x7fd9981f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.272+0000 7fd9977fe700 1 -- 172.21.15.125:0/2319307082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c0094a0 con 0x7fd99806b220 2023-11-28T11:09:16.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.272+0000 7fd9977fe700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd99806b220 0x7fd99814c330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd98c014040 tx=0x7fd98c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:16.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.272+0000 7fd97ffff700 1 -- 172.21.15.125:0/2319307082 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c01a900 con 0x7fd99806b220 2023-11-28T11:09:16.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.272+0000 7fd97ffff700 1 -- 172.21.15.125:0/2319307082 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c01aa60 con 0x7fd99806b220 2023-11-28T11:09:16.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.272+0000 7fd97ffff700 1 -- 172.21.15.125:0/2319307082 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c01add0 con 0x7fd99806b220 2023-11-28T11:09:16.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.272+0000 7fd99db6a700 1 -- 172.21.15.125:0/2319307082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9980cda40 con 0x7fd99806b220 2023-11-28T11:09:16.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.272+0000 7fd99db6a700 1 -- 172.21.15.125:0/2319307082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9980cd760 con 0x7fd99806b220 2023-11-28T11:09:16.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.273+0000 7fd99db6a700 1 -- 172.21.15.125:0/2319307082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9980d2700 con 0x7fd99806b220 2023-11-28T11:09:16.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.273+0000 7fd97ffff700 1 -- 172.21.15.125:0/2319307082 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd98c00f050 con 0x7fd99806b220 2023-11-28T11:09:16.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.274+0000 7fd97ffff700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9840682f0 0x7fd98406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.274+0000 7fd97ffff700 1 -- 172.21.15.125:0/2319307082 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd98c086c80 con 0x7fd99806b220 2023-11-28T11:09:16.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.274+0000 7fd996ffd700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9840682f0 0x7fd98406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.274+0000 7fd996ffd700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9840682f0 0x7fd98406a7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd988000f60 tx=0x7fd988007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:16.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.278+0000 7fd97ffff700 1 -- 172.21.15.125:0/2319307082 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd98c053590 con 0x7fd99806b220 2023-11-28T11:09:16.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.465+0000 7fd99db6a700 1 -- 172.21.15.125:0/2319307082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd998067d70 con 0x7fd99806b220 2023-11-28T11:09:16.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.465+0000 7fd97ffff700 1 -- 172.21.15.125:0/2319307082 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd98c0290a0 con 0x7fd99806b220 2023-11-28T11:09:16.467 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:16.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 -- 172.21.15.125:0/2319307082 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9840682f0 msgr2=0x7fd98406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9840682f0 0x7fd98406a7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd988000f60 tx=0x7fd988007a40 comp rx=0 tx=0).stop 2023-11-28T11:09:16.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 -- 172.21.15.125:0/2319307082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd99806b220 msgr2=0x7fd99814c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd99806b220 0x7fd99814c330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd98c014040 tx=0x7fd98c004750 comp rx=0 tx=0).stop 2023-11-28T11:09:16.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 -- 172.21.15.125:0/2319307082 shutdown_connections 2023-11-28T11:09:16.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9840682f0 0x7fd98406a7a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd99815c8c0 0x7fd9980b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd99806b220 0x7fd99814c330 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 --2- 172.21.15.125:0/2319307082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9980b5dc0 0x7fd9981f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 -- 172.21.15.125:0/2319307082 >> 172.21.15.125:0/2319307082 conn(0x7fd99806c520 msgr2=0x7fd9980cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:16.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 -- 172.21.15.125:0/2319307082 shutdown_connections 2023-11-28T11:09:16.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.467+0000 7fd99db6a700 1 -- 172.21.15.125:0/2319307082 wait complete. 2023-11-28T11:09:16.481 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:09:16.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.601+0000 7f7812254700 1 Processor -- start 2023-11-28T11:09:16.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.601+0000 7f7812254700 1 -- start start 2023-11-28T11:09:16.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.601+0000 7f7812254700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f780c15a590 0x7f780c06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.601+0000 7f7812254700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f780c06cb50 0x7f780c06a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.601+0000 7f7812254700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0cd480 con 0x7f780c0b50d0 2023-11-28T11:09:16.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.601+0000 7f7812254700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c0cd760 con 0x7f780c15a590 2023-11-28T11:09:16.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.601+0000 7f7812254700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0cda40 con 0x7f780c06cb50 2023-11-28T11:09:16.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f780c15a590 0x7f780c06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f780c0b50d0 0x7f780c06c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42234/0 (socket says 172.21.15.125:42234) 2023-11-28T11:09:16.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780affd700 1 -- 172.21.15.125:0/876835670 learned_addr learned my addr 172.21.15.125:0/876835670 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:16.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780bfff700 1 --2- 172.21.15.125:0/876835670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f780c06cb50 0x7f780c06a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780b7fe700 1 -- 172.21.15.125:0/876835670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f780c06cb50 msgr2=0x7f780c06a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:16.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780b7fe700 1 --2- 172.21.15.125:0/876835670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f780c06cb50 0x7f780c06a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780b7fe700 1 -- 172.21.15.125:0/876835670 >> v1:172.21.15.125:6789/0 conn(0x7f780c0b50d0 legacy=0x7f780c06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780a7fc700 1 -- 172.21.15.125:0/876835670 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857585508 0 0) 0x7f780c0cd480 con 0x7f780c0b50d0 2023-11-28T11:09:16.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780b7fe700 1 -- 172.21.15.125:0/876835670 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0cdd20 con 0x7f780c15a590 2023-11-28T11:09:16.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780b7fe700 1 --2- 172.21.15.125:0/876835670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f780c15a590 0x7f780c06b5b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009840 tx=0x7f77fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2980cb3d673be626 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:16.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780a7fc700 1 -- 172.21.15.125:0/876835670 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc011830 con 0x7f780c15a590 2023-11-28T11:09:16.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780a7fc700 1 -- 172.21.15.125:0/876835670 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc011990 con 0x7f780c15a590 2023-11-28T11:09:16.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.602+0000 7f780a7fc700 1 -- 172.21.15.125:0/876835670 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc011d20 con 0x7f780c15a590 2023-11-28T11:09:16.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.603+0000 7f7812254700 1 -- 172.21.15.125:0/876835670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f780c15a590 msgr2=0x7f780c06b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.603+0000 7f7812254700 1 --2- 172.21.15.125:0/876835670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f780c15a590 0x7f780c06b5b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009840 tx=0x7f77fc009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:16.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.603+0000 7f7812254700 1 -- 172.21.15.125:0/876835670 shutdown_connections 2023-11-28T11:09:16.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.603+0000 7f7812254700 1 --2- 172.21.15.125:0/876835670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f780c06cb50 0x7f780c06a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.603+0000 7f7812254700 1 --2- 172.21.15.125:0/876835670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f780c15a590 0x7f780c06b5b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.603+0000 7f7812254700 1 -- 172.21.15.125:0/876835670 >> 172.21.15.125:0/876835670 conn(0x7f780c0cf400 msgr2=0x7f780c0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:16.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.603+0000 7f7812254700 1 -- 172.21.15.125:0/876835670 shutdown_connections 2023-11-28T11:09:16.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.603+0000 7f7812254700 1 -- 172.21.15.125:0/876835670 wait complete. 2023-11-28T11:09:16.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.604+0000 7f7812254700 1 Processor -- start 2023-11-28T11:09:16.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.604+0000 7f7812254700 1 -- start start 2023-11-28T11:09:16.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f7812254700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f780c06cb50 0x7f780c1ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f7812254700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f780c0b50d0 0x7f780c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f7812254700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f780c15a590 0x7f780c15c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f7812254700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c1f34f0 con 0x7f780c0b50d0 2023-11-28T11:09:16.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f7812254700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0b26d0 con 0x7f780c15a590 2023-11-28T11:09:16.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f7812254700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0b29b0 con 0x7f780c06cb50 2023-11-28T11:09:16.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f780affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f780c0b50d0 0x7f780c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f780affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f780c0b50d0 0x7f780c1550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58114/0 (socket says 172.21.15.125:58114) 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f780affd700 1 -- 172.21.15.125:0/1402759039 learned_addr learned my addr 172.21.15.125:0/1402759039 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f780b7fe700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f780c06cb50 0x7f780c1ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f780bfff700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f780c15a590 0x7f780c15c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f780affd700 1 -- 172.21.15.125:0/1402759039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f780c06cb50 msgr2=0x7f780c1ef6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f780affd700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f780c06cb50 0x7f780c1ef6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f780affd700 1 -- 172.21.15.125:0/1402759039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f780c15a590 msgr2=0x7f780c15c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f780affd700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f780c15a590 0x7f780c15c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f780affd700 1 -- 172.21.15.125:0/1402759039 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0094a0 con 0x7f780c0b50d0 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.605+0000 7f780affd700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f780c0b50d0 0x7f780c1550a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f780000c520 tx=0x7f780000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.606+0000 7f77f3fff700 1 -- 172.21.15.125:0/1402759039 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800004c80 con 0x7f780c0b50d0 2023-11-28T11:09:16.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.606+0000 7f77f3fff700 1 -- 172.21.15.125:0/1402759039 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7800004e00 con 0x7f780c0b50d0 2023-11-28T11:09:16.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.606+0000 7f77f3fff700 1 -- 172.21.15.125:0/1402759039 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800007310 con 0x7f780c0b50d0 2023-11-28T11:09:16.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.606+0000 7f7812254700 1 -- 172.21.15.125:0/1402759039 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c06baf0 con 0x7f780c0b50d0 2023-11-28T11:09:16.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.606+0000 7f7812254700 1 -- 172.21.15.125:0/1402759039 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c0ce000 con 0x7f780c0b50d0 2023-11-28T11:09:16.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.607+0000 7f7812254700 1 -- 172.21.15.125:0/1402759039 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c15a960 con 0x7f780c0b50d0 2023-11-28T11:09:16.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.607+0000 7f77f3fff700 1 -- 172.21.15.125:0/1402759039 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f780001a020 con 0x7f780c0b50d0 2023-11-28T11:09:16.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.608+0000 7f77f3fff700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77f80682f0 0x7f77f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.608+0000 7f780b7fe700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77f80682f0 0x7f77f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.608+0000 7f77f3fff700 1 -- 172.21.15.125:0/1402759039 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78000858e0 con 0x7f780c0b50d0 2023-11-28T11:09:16.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.608+0000 7f780b7fe700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77f80682f0 0x7f77f806a7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0090b0 tx=0x7f77fc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:16.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.612+0000 7f77f3fff700 1 -- 172.21.15.125:0/1402759039 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7800052140 con 0x7f780c0b50d0 2023-11-28T11:09:16.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.811+0000 7f7812254700 1 -- 172.21.15.125:0/1402759039 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f780c1f3630 con 0x7f780c0b50d0 2023-11-28T11:09:16.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.811+0000 7f77f3fff700 1 -- 172.21.15.125:0/1402759039 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7800055760 con 0x7f780c0b50d0 2023-11-28T11:09:16.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 -- 172.21.15.125:0/1402759039 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77f80682f0 msgr2=0x7f77f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77f80682f0 0x7f77f806a7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0090b0 tx=0x7f77fc01c040 comp rx=0 tx=0).stop 2023-11-28T11:09:16.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 -- 172.21.15.125:0/1402759039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f780c0b50d0 msgr2=0x7f780c1550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f780c0b50d0 0x7f780c1550a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f780000c520 tx=0x7f780000c8e0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 -- 172.21.15.125:0/1402759039 shutdown_connections 2023-11-28T11:09:16.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f780c15a590 0x7f780c15c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f77f80682f0 0x7f77f806a7a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f780c06cb50 0x7f780c1ef6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 --2- 172.21.15.125:0/1402759039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f780c0b50d0 0x7f780c1550a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 -- 172.21.15.125:0/1402759039 >> 172.21.15.125:0/1402759039 conn(0x7f780c0cf400 msgr2=0x7f780c0b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:16.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 -- 172.21.15.125:0/1402759039 shutdown_connections 2023-11-28T11:09:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.813+0000 7f7812254700 1 -- 172.21.15.125:0/1402759039 wait complete. 2023-11-28T11:09:16.820 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:09:16.827 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:09:16.828 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:16.851 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:16.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.970+0000 7ff3b4e02700 1 Processor -- start 2023-11-28T11:09:16.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.970+0000 7ff3b4e02700 1 -- start start 2023-11-28T11:09:16.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.971+0000 7ff3b4e02700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3b00cd5a0 0x7ff3b00cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.971+0000 7ff3b4e02700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b00d1ee0 con 0x7ff3b006ab10 2023-11-28T11:09:16.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.971+0000 7ff3b4e02700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b00cdb10 con 0x7ff3b00b22a0 2023-11-28T11:09:16.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.971+0000 7ff3b4e02700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b00d1890 con 0x7ff3b00cd5a0 2023-11-28T11:09:16.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.971+0000 7ff3add9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3b00cd5a0 0x7ff3b00cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.971+0000 7ff3ae59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff3b006ab10 0x7ff3b006aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42244/0 (socket says 172.21.15.125:42244) 2023-11-28T11:09:16.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.971+0000 7ff3ae59c700 1 -- 172.21.15.125:0/2791118587 learned_addr learned my addr 172.21.15.125:0/2791118587 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:16.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.971+0000 7ff3add9b700 1 -- 172.21.15.125:0/2791118587 >> v1:172.21.15.167:6789/0 conn(0x7ff3b00b22a0 legacy=0x7ff3b00cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:16.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.971+0000 7ff3add9b700 1 -- 172.21.15.125:0/2791118587 >> v1:172.21.15.125:6789/0 conn(0x7ff3b006ab10 legacy=0x7ff3b006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.971+0000 7ff3add9b700 1 -- 172.21.15.125:0/2791118587 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b00d1b70 con 0x7ff3b00cd5a0 2023-11-28T11:09:16.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.971+0000 7ff3add9b700 1 --2- 172.21.15.125:0/2791118587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3b00cd5a0 0x7ff3b00cf440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009840 tx=0x7ff3a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d089110e6d1408 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:16.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.972+0000 7ff3ad59a700 1 -- 172.21.15.125:0/2791118587 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0004230 con 0x7ff3b00cd5a0 2023-11-28T11:09:16.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.972+0000 7ff3ad59a700 1 -- 172.21.15.125:0/2791118587 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0004390 con 0x7ff3b00cd5a0 2023-11-28T11:09:16.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.972+0000 7ff3ad59a700 1 -- 172.21.15.125:0/2791118587 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00036a0 con 0x7ff3b00cd5a0 2023-11-28T11:09:16.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.972+0000 7ff3b4e02700 1 -- 172.21.15.125:0/2791118587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3b00cd5a0 msgr2=0x7ff3b00cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.972+0000 7ff3b4e02700 1 --2- 172.21.15.125:0/2791118587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3b00cd5a0 0x7ff3b00cf440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009840 tx=0x7ff3a0009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:16.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.972+0000 7ff3b4e02700 1 -- 172.21.15.125:0/2791118587 shutdown_connections 2023-11-28T11:09:16.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.972+0000 7ff3b4e02700 1 --2- 172.21.15.125:0/2791118587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3b00cd5a0 0x7ff3b00cf440 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.972+0000 7ff3b4e02700 1 -- 172.21.15.125:0/2791118587 >> 172.21.15.125:0/2791118587 conn(0x7ff3b006c520 msgr2=0x7ff3b006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:16.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.972+0000 7ff3b4e02700 1 -- 172.21.15.125:0/2791118587 shutdown_connections 2023-11-28T11:09:16.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.972+0000 7ff3b4e02700 1 -- 172.21.15.125:0/2791118587 wait complete. 2023-11-28T11:09:16.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.974+0000 7ff3b4e02700 1 Processor -- start 2023-11-28T11:09:16.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.974+0000 7ff3b4e02700 1 -- start start 2023-11-28T11:09:16.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.974+0000 7ff3b4e02700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3b006ab10 0x7ff3b0154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.974+0000 7ff3b4e02700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3b00b22a0 0x7ff3b01f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.974+0000 7ff3b4e02700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3b00cd5a0 0x7ff3b0159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.974+0000 7ff3b4e02700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00cb240 con 0x7ff3b006ab10 2023-11-28T11:09:16.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.974+0000 7ff3b4e02700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0154940 con 0x7ff3b00cd5a0 2023-11-28T11:09:16.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.974+0000 7ff3b4e02700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01f6db0 con 0x7ff3b00b22a0 2023-11-28T11:09:16.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.974+0000 7ff3ae59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3b006ab10 0x7ff3b0154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.974+0000 7ff3ae59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3b006ab10 0x7ff3b0154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58126/0 (socket says 172.21.15.125:58126) 2023-11-28T11:09:16.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.974+0000 7ff3ae59c700 1 -- 172.21.15.125:0/1414392131 learned_addr learned my addr 172.21.15.125:0/1414392131 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:16.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff3aed9d700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3b00cd5a0 0x7ff3b0159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff3add9b700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3b00b22a0 0x7ff3b01f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff3ae59c700 1 -- 172.21.15.125:0/1414392131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3b00b22a0 msgr2=0x7ff3b01f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff3ae59c700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3b00b22a0 0x7ff3b01f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff3ae59c700 1 -- 172.21.15.125:0/1414392131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3b00cd5a0 msgr2=0x7ff3b0159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:16.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff3ae59c700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3b00cd5a0 0x7ff3b0159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:16.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff3ae59c700 1 -- 172.21.15.125:0/1414392131 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a00094a0 con 0x7ff3b006ab10 2023-11-28T11:09:16.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff3add9b700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3b00b22a0 0x7ff3b01f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:16.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff3ae59c700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3b006ab10 0x7ff3b0154400 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400c490 tx=0x7ff3a400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:16.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff39effd700 1 -- 172.21.15.125:0/1414392131 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4005d70 con 0x7ff3b006ab10 2023-11-28T11:09:16.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff39effd700 1 -- 172.21.15.125:0/1414392131 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a40070d0 con 0x7ff3b006ab10 2023-11-28T11:09:16.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff3b4e02700 1 -- 172.21.15.125:0/1414392131 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b00b1ec0 con 0x7ff3b006ab10 2023-11-28T11:09:16.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff39effd700 1 -- 172.21.15.125:0/1414392131 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4007460 con 0x7ff3b006ab10 2023-11-28T11:09:16.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.975+0000 7ff3b4e02700 1 -- 172.21.15.125:0/1414392131 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b015cad0 con 0x7ff3b006ab10 2023-11-28T11:09:16.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.976+0000 7ff3b4e02700 1 -- 172.21.15.125:0/1414392131 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b00b2050 con 0x7ff3b006ab10 2023-11-28T11:09:16.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.976+0000 7ff39effd700 1 -- 172.21.15.125:0/1414392131 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff3a4019030 con 0x7ff3b006ab10 2023-11-28T11:09:16.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.977+0000 7ff39effd700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3900682f0 0x7ff39006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:16.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.977+0000 7ff39effd700 1 -- 172.21.15.125:0/1414392131 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff3a4085070 con 0x7ff3b006ab10 2023-11-28T11:09:16.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.977+0000 7ff3add9b700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3900682f0 0x7ff39006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:16.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.977+0000 7ff3add9b700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3900682f0 0x7ff39006a7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009840 tx=0x7ff3a0013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:16.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:16.981+0000 7ff39effd700 1 -- 172.21.15.125:0/1414392131 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff3a40518d0 con 0x7ff3b006ab10 2023-11-28T11:09:17.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.167+0000 7ff3b4e02700 1 -- 172.21.15.125:0/1414392131 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3b00743f0 con 0x7ff3b006ab10 2023-11-28T11:09:17.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.168+0000 7ff39effd700 1 -- 172.21.15.125:0/1414392131 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7ff3a4017090 con 0x7ff3b006ab10 2023-11-28T11:09:17.169 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:17.170 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":24,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:08:37.384579+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 -- 172.21.15.125:0/1414392131 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3900682f0 msgr2=0x7ff39006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3900682f0 0x7ff39006a7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009840 tx=0x7ff3a0013040 comp rx=0 tx=0).stop 2023-11-28T11:09:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 -- 172.21.15.125:0/1414392131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3b006ab10 msgr2=0x7ff3b0154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3b006ab10 0x7ff3b0154400 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400c490 tx=0x7ff3a400c850 comp rx=0 tx=0).stop 2023-11-28T11:09:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 -- 172.21.15.125:0/1414392131 shutdown_connections 2023-11-28T11:09:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3b00cd5a0 0x7ff3b0159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3b006ab10 0x7ff3b0154400 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3900682f0 0x7ff39006a7a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 --2- 172.21.15.125:0/1414392131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3b00b22a0 0x7ff3b01f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 -- 172.21.15.125:0/1414392131 >> 172.21.15.125:0/1414392131 conn(0x7ff3b006c520 msgr2=0x7ff3b00b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 -- 172.21.15.125:0/1414392131 shutdown_connections 2023-11-28T11:09:17.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.170+0000 7ff3b4e02700 1 -- 172.21.15.125:0/1414392131 wait complete. 2023-11-28T11:09:17.184 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:17.184 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:17.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.305+0000 7f2689d2b700 1 Processor -- start 2023-11-28T11:09:17.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.305+0000 7f2689d2b700 1 -- start start 2023-11-28T11:09:17.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.306+0000 7f2689d2b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2684070370 0x7f26840cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.306+0000 7f2689d2b700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26840c9a50 0x7f26840c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.306+0000 7f2689d2b700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26840ca3f0 con 0x7f2684159710 2023-11-28T11:09:17.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.306+0000 7f2689d2b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26840707f0 con 0x7f2684070370 2023-11-28T11:09:17.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.306+0000 7f2689d2b700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268406a310 con 0x7f26840c9a50 2023-11-28T11:09:17.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.306+0000 7f2682ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2684070370 0x7f26840cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.306+0000 7f2682ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2684070370 0x7f26840cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58136/0 (socket says 172.21.15.125:58136) 2023-11-28T11:09:17.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.306+0000 7f2682ffd700 1 -- 172.21.15.125:0/3147774736 learned_addr learned my addr 172.21.15.125:0/3147774736 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:17.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2683fff700 1 --2- 172.21.15.125:0/3147774736 >> v2:172.21.15.167:3300/0 conn(0x7f26840c9a50 0x7f26840c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2682ffd700 1 -- 172.21.15.125:0/3147774736 >> v2:172.21.15.167:3300/0 conn(0x7f26840c9a50 msgr2=0x7f26840c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:17.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2682ffd700 1 --2- 172.21.15.125:0/3147774736 >> v2:172.21.15.167:3300/0 conn(0x7f26840c9a50 0x7f26840c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2682ffd700 1 -- 172.21.15.125:0/3147774736 >> v1:172.21.15.167:6789/0 conn(0x7f2684159710 legacy=0x7f26840cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2682ffd700 1 -- 172.21.15.125:0/3147774736 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26840ce7e0 con 0x7f2684070370 2023-11-28T11:09:17.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2682ffd700 1 --2- 172.21.15.125:0/3147774736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2684070370 0x7f26840cee40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f26740098f0 tx=0x7f2674009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438baa877ea3ed8d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:17.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f26827fc700 1 -- 172.21.15.125:0/3147774736 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267400b860 con 0x7f2684070370 2023-11-28T11:09:17.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f26827fc700 1 -- 172.21.15.125:0/3147774736 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267400b9c0 con 0x7f2684070370 2023-11-28T11:09:17.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f26827fc700 1 -- 172.21.15.125:0/3147774736 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267400bd50 con 0x7f2684070370 2023-11-28T11:09:17.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2689d2b700 1 -- 172.21.15.125:0/3147774736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2684070370 msgr2=0x7f26840cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2689d2b700 1 --2- 172.21.15.125:0/3147774736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2684070370 0x7f26840cee40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f26740098f0 tx=0x7f2674009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:17.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2689d2b700 1 -- 172.21.15.125:0/3147774736 shutdown_connections 2023-11-28T11:09:17.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2689d2b700 1 --2- 172.21.15.125:0/3147774736 >> v2:172.21.15.167:3300/0 conn(0x7f26840c9a50 0x7f26840c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2689d2b700 1 --2- 172.21.15.125:0/3147774736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2684070370 0x7f26840cee40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.307+0000 7f2689d2b700 1 -- 172.21.15.125:0/3147774736 >> 172.21.15.125:0/3147774736 conn(0x7f26840cf400 msgr2=0x7f26840cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:17.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.308+0000 7f2689d2b700 1 -- 172.21.15.125:0/3147774736 shutdown_connections 2023-11-28T11:09:17.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.308+0000 7f2689d2b700 1 -- 172.21.15.125:0/3147774736 wait complete. 2023-11-28T11:09:17.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.309+0000 7f2689d2b700 1 Processor -- start 2023-11-28T11:09:17.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.309+0000 7f2689d2b700 1 -- start start 2023-11-28T11:09:17.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2689d2b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2684070370 0x7f2684070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2689d2b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26840c9a50 0x7f26841512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2689d2b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2684159710 0x7f26840b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2689d2b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26840c84a0 con 0x7f26840c9a50 2023-11-28T11:09:17.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2689d2b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26840c7890 con 0x7f2684159710 2023-11-28T11:09:17.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2689d2b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26840c7b70 con 0x7f2684070370 2023-11-28T11:09:17.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2682ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26840c9a50 0x7f26841512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2682ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26840c9a50 0x7f26841512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58142/0 (socket says 172.21.15.125:58142) 2023-11-28T11:09:17.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2682ffd700 1 -- 172.21.15.125:0/2322406957 learned_addr learned my addr 172.21.15.125:0/2322406957 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:17.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2683fff700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2684159710 0x7f26840b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f26837fe700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2684070370 0x7f2684070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2682ffd700 1 -- 172.21.15.125:0/2322406957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2684070370 msgr2=0x7f2684070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2682ffd700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2684070370 0x7f2684070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2682ffd700 1 -- 172.21.15.125:0/2322406957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2684159710 msgr2=0x7f26840b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2682ffd700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2684159710 0x7f26840b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2682ffd700 1 -- 172.21.15.125:0/2322406957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674009550 con 0x7f26840c9a50 2023-11-28T11:09:17.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2683fff700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2684159710 0x7f26840b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2682ffd700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26840c9a50 0x7f26841512f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2674009c40 tx=0x7f2674004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f266bfff700 1 -- 172.21.15.125:0/2322406957 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740045d0 con 0x7f26840c9a50 2023-11-28T11:09:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f266bfff700 1 -- 172.21.15.125:0/2322406957 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267401e070 con 0x7f26840c9a50 2023-11-28T11:09:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2689d2b700 1 -- 172.21.15.125:0/2322406957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268406a890 con 0x7f26840c9a50 2023-11-28T11:09:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f266bfff700 1 -- 172.21.15.125:0/2322406957 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740038c0 con 0x7f26840c9a50 2023-11-28T11:09:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.310+0000 7f2689d2b700 1 -- 172.21.15.125:0/2322406957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268406a5b0 con 0x7f26840c9a50 2023-11-28T11:09:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.311+0000 7f2689d2b700 1 -- 172.21.15.125:0/2322406957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26840ceac0 con 0x7f26840c9a50 2023-11-28T11:09:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.312+0000 7f266bfff700 1 -- 172.21.15.125:0/2322406957 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f267400f050 con 0x7f26840c9a50 2023-11-28T11:09:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.312+0000 7f266bfff700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f26700682f0 0x7f267006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.312+0000 7f266bfff700 1 -- 172.21.15.125:0/2322406957 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2674020070 con 0x7f26840c9a50 2023-11-28T11:09:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.312+0000 7f26837fe700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f26700682f0 0x7f267006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.312+0000 7f26837fe700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f26700682f0 0x7f267006a7a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2678000f60 tx=0x7f2678009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:17.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.316+0000 7f266bfff700 1 -- 172.21.15.125:0/2322406957 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f26740539f0 con 0x7f26840c9a50 2023-11-28T11:09:17.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.499+0000 7f2689d2b700 1 -- 172.21.15.125:0/2322406957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26840743f0 con 0x7f26840c9a50 2023-11-28T11:09:17.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.499+0000 7f266bfff700 1 -- 172.21.15.125:0/2322406957 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2674057010 con 0x7f26840c9a50 2023-11-28T11:09:17.501 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:17.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 -- 172.21.15.125:0/2322406957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f26700682f0 msgr2=0x7f267006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f26700682f0 0x7f267006a7a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2678000f60 tx=0x7f2678009040 comp rx=0 tx=0).stop 2023-11-28T11:09:17.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 -- 172.21.15.125:0/2322406957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26840c9a50 msgr2=0x7f26841512f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26840c9a50 0x7f26841512f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2674009c40 tx=0x7f2674004750 comp rx=0 tx=0).stop 2023-11-28T11:09:17.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 -- 172.21.15.125:0/2322406957 shutdown_connections 2023-11-28T11:09:17.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2684159710 0x7f26840b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f26700682f0 0x7f267006a7a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2684070370 0x7f2684070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 --2- 172.21.15.125:0/2322406957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26840c9a50 0x7f26841512f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 -- 172.21.15.125:0/2322406957 >> 172.21.15.125:0/2322406957 conn(0x7f26840cf400 msgr2=0x7f26840cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:17.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 -- 172.21.15.125:0/2322406957 shutdown_connections 2023-11-28T11:09:17.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.501+0000 7f2689d2b700 1 -- 172.21.15.125:0/2322406957 wait complete. 2023-11-28T11:09:17.515 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:17.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.636+0000 7f22a4956700 1 Processor -- start 2023-11-28T11:09:17.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.636+0000 7f22a4956700 1 -- start start 2023-11-28T11:09:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.636+0000 7f22a4956700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22a006a980 0x7f22a00cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.636+0000 7f22a4956700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a015e0d0 con 0x7f22a00cdd50 2023-11-28T11:09:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f22a4956700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a00ce560 con 0x7f22a015a4d0 2023-11-28T11:09:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f22a4956700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a015e320 con 0x7f22a006a980 2023-11-28T11:09:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f229dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22a006a980 0x7f22a00cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f229ed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f22a00cdd50 0x7f22a00cb010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42276/0 (socket says 172.21.15.125:42276) 2023-11-28T11:09:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f229ed9d700 1 -- 172.21.15.125:0/1089390783 learned_addr learned my addr 172.21.15.125:0/1089390783 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f229dd9b700 1 -- 172.21.15.125:0/1089390783 >> v1:172.21.15.167:6789/0 conn(0x7f22a015a4d0 legacy=0x7f22a006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f229dd9b700 1 -- 172.21.15.125:0/1089390783 >> v1:172.21.15.125:6789/0 conn(0x7f22a00cdd50 legacy=0x7f22a00cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f229dd9b700 1 -- 172.21.15.125:0/1089390783 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a015e600 con 0x7f22a006a980 2023-11-28T11:09:17.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f229d59a700 1 -- 172.21.15.125:0/1089390783 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475651608 0 0) 0x7f22a015e0d0 con 0x7f22a00cdd50 2023-11-28T11:09:17.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f229dd9b700 1 --2- 172.21.15.125:0/1089390783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a006a980 0x7f22a00cd810 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2290009840 tx=0x7f2290009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c638dcd8e575fbe5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:17.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f229d59a700 1 -- 172.21.15.125:0/1089390783 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290011830 con 0x7f22a006a980 2023-11-28T11:09:17.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f229d59a700 1 -- 172.21.15.125:0/1089390783 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2290011990 con 0x7f22a006a980 2023-11-28T11:09:17.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.637+0000 7f229d59a700 1 -- 172.21.15.125:0/1089390783 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290011d20 con 0x7f22a006a980 2023-11-28T11:09:17.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.638+0000 7f22a4956700 1 -- 172.21.15.125:0/1089390783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a006a980 msgr2=0x7f22a00cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.638+0000 7f22a4956700 1 --2- 172.21.15.125:0/1089390783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a006a980 0x7f22a00cd810 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2290009840 tx=0x7f2290009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:17.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.638+0000 7f22a4956700 1 -- 172.21.15.125:0/1089390783 shutdown_connections 2023-11-28T11:09:17.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.638+0000 7f22a4956700 1 --2- 172.21.15.125:0/1089390783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a006a980 0x7f22a00cd810 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.638+0000 7f22a4956700 1 -- 172.21.15.125:0/1089390783 >> 172.21.15.125:0/1089390783 conn(0x7f22a006c010 msgr2=0x7f22a00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:17.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.638+0000 7f22a4956700 1 -- 172.21.15.125:0/1089390783 shutdown_connections 2023-11-28T11:09:17.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.638+0000 7f22a4956700 1 -- 172.21.15.125:0/1089390783 wait complete. 2023-11-28T11:09:17.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.639+0000 7f22a4956700 1 Processor -- start 2023-11-28T11:09:17.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.639+0000 7f22a4956700 1 -- start start 2023-11-28T11:09:17.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f22a4956700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22a006a980 0x7f22a015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f22a4956700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22a00cdd50 0x7f22a00c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f22a4956700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a015a4d0 0x7f22a01516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f22a4956700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00c9b60 con 0x7f22a015a4d0 2023-11-28T11:09:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f22a4956700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a015be60 con 0x7f22a006a980 2023-11-28T11:09:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f22a4956700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a015b250 con 0x7f22a00cdd50 2023-11-28T11:09:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f229ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a015a4d0 0x7f22a01516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f229ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a015a4d0 0x7f22a01516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58158/0 (socket says 172.21.15.125:58158) 2023-11-28T11:09:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f229ed9d700 1 -- 172.21.15.125:0/62193930 learned_addr learned my addr 172.21.15.125:0/62193930 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f229e59c700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22a006a980 0x7f22a015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f229dd9b700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22a00cdd50 0x7f22a00c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f229ed9d700 1 -- 172.21.15.125:0/62193930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22a00cdd50 msgr2=0x7f22a00c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f229ed9d700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22a00cdd50 0x7f22a00c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f229ed9d700 1 -- 172.21.15.125:0/62193930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22a006a980 msgr2=0x7f22a015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f229ed9d700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22a006a980 0x7f22a015ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.640+0000 7f229ed9d700 1 -- 172.21.15.125:0/62193930 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22900094a0 con 0x7f22a015a4d0 2023-11-28T11:09:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.641+0000 7f229ed9d700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a015a4d0 0x7f22a01516d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2298002230 tx=0x7f229800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.641+0000 7f228effd700 1 -- 172.21.15.125:0/62193930 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229800aac0 con 0x7f22a015a4d0 2023-11-28T11:09:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.641+0000 7f228effd700 1 -- 172.21.15.125:0/62193930 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229800ac40 con 0x7f22a015a4d0 2023-11-28T11:09:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.641+0000 7f22a4956700 1 -- 172.21.15.125:0/62193930 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a00ce1b0 con 0x7f22a015a4d0 2023-11-28T11:09:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.641+0000 7f228effd700 1 -- 172.21.15.125:0/62193930 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22980070d0 con 0x7f22a015a4d0 2023-11-28T11:09:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.641+0000 7f22a4956700 1 -- 172.21.15.125:0/62193930 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a015e8e0 con 0x7f22a015a4d0 2023-11-28T11:09:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.642+0000 7f22a4956700 1 -- 172.21.15.125:0/62193930 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a015a8a0 con 0x7f22a015a4d0 2023-11-28T11:09:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.642+0000 7f228effd700 1 -- 172.21.15.125:0/62193930 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f229801a030 con 0x7f22a015a4d0 2023-11-28T11:09:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.643+0000 7f228effd700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22800682f0 0x7f228006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.643+0000 7f228effd700 1 -- 172.21.15.125:0/62193930 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22980858f0 con 0x7f22a015a4d0 2023-11-28T11:09:17.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.643+0000 7f229e59c700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22800682f0 0x7f228006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.643+0000 7f229e59c700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22800682f0 0x7f228006a7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2294000f60 tx=0x7f2294009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:17.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.647+0000 7f228effd700 1 -- 172.21.15.125:0/62193930 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2298052150 con 0x7f22a015a4d0 2023-11-28T11:09:17.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.827+0000 7f22a4956700 1 -- 172.21.15.125:0/62193930 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f22a015bfd0 con 0x7f22a015a4d0 2023-11-28T11:09:17.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.827+0000 7f228effd700 1 -- 172.21.15.125:0/62193930 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f22980180a0 con 0x7f22a015a4d0 2023-11-28T11:09:17.829 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:17.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.829+0000 7f22a4956700 1 -- 172.21.15.125:0/62193930 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22800682f0 msgr2=0x7f228006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.829+0000 7f22a4956700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22800682f0 0x7f228006a7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2294000f60 tx=0x7f2294009040 comp rx=0 tx=0).stop 2023-11-28T11:09:17.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.829+0000 7f22a4956700 1 -- 172.21.15.125:0/62193930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a015a4d0 msgr2=0x7f22a01516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.829+0000 7f22a4956700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a015a4d0 0x7f22a01516d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2298002230 tx=0x7f229800cf50 comp rx=0 tx=0).stop 2023-11-28T11:09:17.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.829+0000 7f22a4956700 1 -- 172.21.15.125:0/62193930 shutdown_connections 2023-11-28T11:09:17.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.829+0000 7f22a4956700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22a015a4d0 0x7f22a01516d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.829+0000 7f22a4956700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22a006a980 0x7f22a015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.829+0000 7f22a4956700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22800682f0 0x7f228006a7a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.829+0000 7f22a4956700 1 --2- 172.21.15.125:0/62193930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22a00cdd50 0x7f22a00c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.830+0000 7f22a4956700 1 -- 172.21.15.125:0/62193930 >> 172.21.15.125:0/62193930 conn(0x7f22a006c010 msgr2=0x7f22a0154440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:17.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.830+0000 7f22a4956700 1 -- 172.21.15.125:0/62193930 shutdown_connections 2023-11-28T11:09:17.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.830+0000 7f22a4956700 1 -- 172.21.15.125:0/62193930 wait complete. 2023-11-28T11:09:17.843 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:17.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.965+0000 7f95c151e700 1 Processor -- start 2023-11-28T11:09:17.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.965+0000 7f95c151e700 1 -- start start 2023-11-28T11:09:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95c151e700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f95bc0cf710 0x7f95bc0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95c151e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f95bc071890 0x7f95bc071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95c151e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95bc06a270 0x7f95bc06a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95c151e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc06ac30 con 0x7f95bc071890 2023-11-28T11:09:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95c151e700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc15cc10 con 0x7f95bc0cf710 2023-11-28T11:09:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95c151e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc06c9b0 con 0x7f95bc06a270 2023-11-28T11:09:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95ba7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f95bc071890 0x7f95bc071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95ba7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f95bc071890 0x7f95bc071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58166/0 (socket says 172.21.15.125:58166) 2023-11-28T11:09:17.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95ba7fc700 1 -- 172.21.15.125:0/4286350618 learned_addr learned my addr 172.21.15.125:0/4286350618 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95ba7fc700 1 -- 172.21.15.125:0/4286350618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95bc06a270 msgr2=0x7f95bc06a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95ba7fc700 1 --2- 172.21.15.125:0/4286350618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95bc06a270 0x7f95bc06a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95ba7fc700 1 -- 172.21.15.125:0/4286350618 >> v2:172.21.15.167:3300/0 conn(0x7f95bc0cf710 msgr2=0x7f95bc0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95ba7fc700 1 --2- 172.21.15.125:0/4286350618 >> v2:172.21.15.167:3300/0 conn(0x7f95bc0cf710 0x7f95bc0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95ba7fc700 1 -- 172.21.15.125:0/4286350618 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc06cc90 con 0x7f95bc071890 2023-11-28T11:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95ba7fc700 1 --2- 172.21.15.125:0/4286350618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95bc071890 0x7f95bc071220 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0098f0 tx=0x7f95ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2035f618ec8850eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95b9ffb700 1 -- 172.21.15.125:0/4286350618 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac00b860 con 0x7f95bc071890 2023-11-28T11:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95b9ffb700 1 -- 172.21.15.125:0/4286350618 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac00b9c0 con 0x7f95bc071890 2023-11-28T11:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.966+0000 7f95b9ffb700 1 -- 172.21.15.125:0/4286350618 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac00bd50 con 0x7f95bc071890 2023-11-28T11:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.967+0000 7f95c151e700 1 -- 172.21.15.125:0/4286350618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95bc071890 msgr2=0x7f95bc071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.967+0000 7f95c151e700 1 --2- 172.21.15.125:0/4286350618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95bc071890 0x7f95bc071220 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0098f0 tx=0x7f95ac009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.967+0000 7f95c151e700 1 -- 172.21.15.125:0/4286350618 shutdown_connections 2023-11-28T11:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.967+0000 7f95c151e700 1 --2- 172.21.15.125:0/4286350618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95bc06a270 0x7f95bc06a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.967+0000 7f95c151e700 1 --2- 172.21.15.125:0/4286350618 >> v2:172.21.15.167:3300/0 conn(0x7f95bc0cf710 0x7f95bc0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.967+0000 7f95c151e700 1 --2- 172.21.15.125:0/4286350618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95bc071890 0x7f95bc071220 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.967+0000 7f95c151e700 1 -- 172.21.15.125:0/4286350618 >> 172.21.15.125:0/4286350618 conn(0x7f95bc06c010 msgr2=0x7f95bc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.967+0000 7f95c151e700 1 -- 172.21.15.125:0/4286350618 shutdown_connections 2023-11-28T11:09:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.967+0000 7f95c151e700 1 -- 172.21.15.125:0/4286350618 wait complete. 2023-11-28T11:09:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.968+0000 7f95c151e700 1 Processor -- start 2023-11-28T11:09:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.968+0000 7f95c151e700 1 -- start start 2023-11-28T11:09:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95c151e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95bc06a270 0x7f95bc14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95c151e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95bc071890 0x7f95bc15f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95c151e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95bc0cf710 0x7f95bc0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95c151e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc15de30 con 0x7f95bc0cf710 2023-11-28T11:09:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95c151e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc15e080 con 0x7f95bc071890 2023-11-28T11:09:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95c151e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc15e360 con 0x7f95bc06a270 2023-11-28T11:09:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95bb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95bc0cf710 0x7f95bc0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95bb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95bc0cf710 0x7f95bc0b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58174/0 (socket says 172.21.15.125:58174) 2023-11-28T11:09:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95bb7fe700 1 -- 172.21.15.125:0/3195356518 learned_addr learned my addr 172.21.15.125:0/3195356518 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95ba7fc700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95bc071890 0x7f95bc15f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95baffd700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95bc06a270 0x7f95bc14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95bb7fe700 1 -- 172.21.15.125:0/3195356518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95bc06a270 msgr2=0x7f95bc14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95bb7fe700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95bc06a270 0x7f95bc14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95bb7fe700 1 -- 172.21.15.125:0/3195356518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95bc071890 msgr2=0x7f95bc15f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95bb7fe700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95bc071890 0x7f95bc15f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95bb7fe700 1 -- 172.21.15.125:0/3195356518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac009550 con 0x7f95bc0cf710 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.969+0000 7f95bb7fe700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95bc0cf710 0x7f95bc0b1640 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f95b400b970 tx=0x7f95b400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.970+0000 7f95a37fe700 1 -- 172.21.15.125:0/3195356518 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b400c9b0 con 0x7f95bc0cf710 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.970+0000 7f95a37fe700 1 -- 172.21.15.125:0/3195356518 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b400cb30 con 0x7f95bc0cf710 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.970+0000 7f95c151e700 1 -- 172.21.15.125:0/3195356518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc06d250 con 0x7f95bc0cf710 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.970+0000 7f95a37fe700 1 -- 172.21.15.125:0/3195356518 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4014440 con 0x7f95bc0cf710 2023-11-28T11:09:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.970+0000 7f95c151e700 1 -- 172.21.15.125:0/3195356518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc06cf70 con 0x7f95bc0cf710 2023-11-28T11:09:17.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.970+0000 7f95c151e700 1 -- 172.21.15.125:0/3195356518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc06d530 con 0x7f95bc0cf710 2023-11-28T11:09:17.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.971+0000 7f95a37fe700 1 -- 172.21.15.125:0/3195356518 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f95b401b030 con 0x7f95bc0cf710 2023-11-28T11:09:17.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.971+0000 7f95a37fe700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f95a80682f0 0x7f95a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:17.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.971+0000 7f95a37fe700 1 -- 172.21.15.125:0/3195356518 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95b4085920 con 0x7f95bc0cf710 2023-11-28T11:09:17.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.971+0000 7f95baffd700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f95a80682f0 0x7f95a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:17.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.972+0000 7f95baffd700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f95a80682f0 0x7f95a806a7a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f95b0006fd0 tx=0x7f95b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:17.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:17.975+0000 7f95a37fe700 1 -- 172.21.15.125:0/3195356518 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f95b4052180 con 0x7f95bc0cf710 2023-11-28T11:09:18.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.163+0000 7f95c151e700 1 -- 172.21.15.125:0/3195356518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95bc0743f0 con 0x7f95bc0cf710 2023-11-28T11:09:18.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.163+0000 7f95a37fe700 1 -- 172.21.15.125:0/3195356518 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95b40190a0 con 0x7f95bc0cf710 2023-11-28T11:09:18.165 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 -- 172.21.15.125:0/3195356518 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f95a80682f0 msgr2=0x7f95a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f95a80682f0 0x7f95a806a7a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f95b0006fd0 tx=0x7f95b0008040 comp rx=0 tx=0).stop 2023-11-28T11:09:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 -- 172.21.15.125:0/3195356518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95bc0cf710 msgr2=0x7f95bc0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95bc0cf710 0x7f95bc0b1640 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f95b400b970 tx=0x7f95b400bd30 comp rx=0 tx=0).stop 2023-11-28T11:09:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 -- 172.21.15.125:0/3195356518 shutdown_connections 2023-11-28T11:09:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95bc0cf710 0x7f95bc0b1640 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f95a80682f0 0x7f95a806a7a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95bc06a270 0x7f95bc14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 --2- 172.21.15.125:0/3195356518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95bc071890 0x7f95bc15f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 -- 172.21.15.125:0/3195356518 >> 172.21.15.125:0/3195356518 conn(0x7f95bc06c010 msgr2=0x7f95bc15c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:18.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 -- 172.21.15.125:0/3195356518 shutdown_connections 2023-11-28T11:09:18.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.165+0000 7f95c151e700 1 -- 172.21.15.125:0/3195356518 wait complete. 2023-11-28T11:09:18.179 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:18.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.301+0000 7fbdaf440700 1 Processor -- start 2023-11-28T11:09:18.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.301+0000 7fbdaf440700 1 -- start start 2023-11-28T11:09:18.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdaf440700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbda80b1650 0x7fbda80b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdaf440700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbda80af0a0 0x7fbda815a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdaf440700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda8159ec0 con 0x7fbda81599b0 2023-11-28T11:09:18.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdaf440700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda80b1f60 con 0x7fbda80b1650 2023-11-28T11:09:18.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdaf440700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda815d8a0 con 0x7fbda80af0a0 2023-11-28T11:09:18.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdad1dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbda80b1650 0x7fbda80b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:18.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdad1dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbda80b1650 0x7fbda80b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58180/0 (socket says 172.21.15.125:58180) 2023-11-28T11:09:18.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdad1dc700 1 -- 172.21.15.125:0/1595246346 learned_addr learned my addr 172.21.15.125:0/1595246346 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:18.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdad1dc700 1 -- 172.21.15.125:0/1595246346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbda80af0a0 msgr2=0x7fbda815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:18.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdad1dc700 1 --2- 172.21.15.125:0/1595246346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbda80af0a0 0x7fbda815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdad1dc700 1 -- 172.21.15.125:0/1595246346 >> v1:172.21.15.167:6789/0 conn(0x7fbda81599b0 legacy=0x7fbda815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdad1dc700 1 -- 172.21.15.125:0/1595246346 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda815db80 con 0x7fbda80b1650 2023-11-28T11:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbdad1dc700 1 --2- 172.21.15.125:0/1595246346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbda80b1650 0x7fbda80b1a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbda40098f0 tx=0x7fbda4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e245995705b1ef0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.302+0000 7fbd9ffff700 1 -- 172.21.15.125:0/1595246346 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4004230 con 0x7fbda80b1650 2023-11-28T11:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.303+0000 7fbd9ffff700 1 -- 172.21.15.125:0/1595246346 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4004390 con 0x7fbda80b1650 2023-11-28T11:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.303+0000 7fbd9ffff700 1 -- 172.21.15.125:0/1595246346 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda40036a0 con 0x7fbda80b1650 2023-11-28T11:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.303+0000 7fbdaf440700 1 -- 172.21.15.125:0/1595246346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbda80b1650 msgr2=0x7fbda80b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.303+0000 7fbdaf440700 1 --2- 172.21.15.125:0/1595246346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbda80b1650 0x7fbda80b1a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbda40098f0 tx=0x7fbda4009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.303+0000 7fbdaf440700 1 -- 172.21.15.125:0/1595246346 shutdown_connections 2023-11-28T11:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.303+0000 7fbdaf440700 1 --2- 172.21.15.125:0/1595246346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbda80b1650 0x7fbda80b1a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.303+0000 7fbdaf440700 1 --2- 172.21.15.125:0/1595246346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbda80af0a0 0x7fbda815a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.303+0000 7fbdaf440700 1 -- 172.21.15.125:0/1595246346 >> 172.21.15.125:0/1595246346 conn(0x7fbda806c010 msgr2=0x7fbda80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:18.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.303+0000 7fbdaf440700 1 -- 172.21.15.125:0/1595246346 shutdown_connections 2023-11-28T11:09:18.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.303+0000 7fbdaf440700 1 -- 172.21.15.125:0/1595246346 wait complete. 2023-11-28T11:09:18.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.304+0000 7fbdaf440700 1 Processor -- start 2023-11-28T11:09:18.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.304+0000 7fbdaf440700 1 -- start start 2023-11-28T11:09:18.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.305+0000 7fbdaf440700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbda80af0a0 0x7fbda8149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.305+0000 7fbdaf440700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbda80b1650 0x7fbda80c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.305+0000 7fbdaf440700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbda8070bd0 0x7fbda8071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.305+0000 7fbdaf440700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8071590 con 0x7fbda80b1650 2023-11-28T11:09:18.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.305+0000 7fbdaf440700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8149590 con 0x7fbda80af0a0 2023-11-28T11:09:18.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.305+0000 7fbdaf440700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80c78d0 con 0x7fbda8070bd0 2023-11-28T11:09:18.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.305+0000 7fbdac9db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbda80b1650 0x7fbda80c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:18.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.305+0000 7fbdac9db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbda80b1650 0x7fbda80c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58188/0 (socket says 172.21.15.125:58188) 2023-11-28T11:09:18.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.305+0000 7fbdac9db700 1 -- 172.21.15.125:0/1586064449 learned_addr learned my addr 172.21.15.125:0/1586064449 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:18.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.305+0000 7fbdad1dc700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbda80af0a0 0x7fbda8149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.305+0000 7fbdad9dd700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbda8070bd0 0x7fbda8071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbdac9db700 1 -- 172.21.15.125:0/1586064449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbda8070bd0 msgr2=0x7fbda8071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbdac9db700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbda8070bd0 0x7fbda8071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbdac9db700 1 -- 172.21.15.125:0/1586064449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbda80af0a0 msgr2=0x7fbda8149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbdac9db700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbda80af0a0 0x7fbda8149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbdac9db700 1 -- 172.21.15.125:0/1586064449 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda4009550 con 0x7fbda80b1650 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbdad9dd700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbda8070bd0 0x7fbda8071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbdac9db700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbda80b1650 0x7fbda80c7390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbd98006fd0 tx=0x7fbd9800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbd9dffb700 1 -- 172.21.15.125:0/1586064449 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98011830 con 0x7fbda80b1650 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbd9dffb700 1 -- 172.21.15.125:0/1586064449 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd98011990 con 0x7fbda80b1650 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbdaf440700 1 -- 172.21.15.125:0/1586064449 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda815a890 con 0x7fbda80b1650 2023-11-28T11:09:18.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbd9dffb700 1 -- 172.21.15.125:0/1586064449 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98011d00 con 0x7fbda80b1650 2023-11-28T11:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.306+0000 7fbdaf440700 1 -- 172.21.15.125:0/1586064449 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda815de60 con 0x7fbda80b1650 2023-11-28T11:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.307+0000 7fbdaf440700 1 -- 172.21.15.125:0/1586064449 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda815aa20 con 0x7fbda80b1650 2023-11-28T11:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.307+0000 7fbd9dffb700 1 -- 172.21.15.125:0/1586064449 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbd98021070 con 0x7fbda80b1650 2023-11-28T11:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.308+0000 7fbd9dffb700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd8c0682f0 0x7fbd8c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.308+0000 7fbd9dffb700 1 -- 172.21.15.125:0/1586064449 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbd98085c40 con 0x7fbda80b1650 2023-11-28T11:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.308+0000 7fbdad1dc700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd8c0682f0 0x7fbd8c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:18.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.308+0000 7fbdad1dc700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd8c0682f0 0x7fbd8c06a7a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009130 tx=0x7fbda4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:18.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.312+0000 7fbd9dffb700 1 -- 172.21.15.125:0/1586064449 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbd980522e0 con 0x7fbda80b1650 2023-11-28T11:09:18.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.494+0000 7fbdaf440700 1 -- 172.21.15.125:0/1586064449 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbda80743f0 con 0x7fbda80b1650 2023-11-28T11:09:18.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.494+0000 7fbd9dffb700 1 -- 172.21.15.125:0/1586064449 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd98011e60 con 0x7fbda80b1650 2023-11-28T11:09:18.496 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:18.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.496+0000 7fbdaf440700 1 -- 172.21.15.125:0/1586064449 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd8c0682f0 msgr2=0x7fbd8c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.496+0000 7fbdaf440700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd8c0682f0 0x7fbd8c06a7a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009130 tx=0x7fbda4008030 comp rx=0 tx=0).stop 2023-11-28T11:09:18.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.496+0000 7fbdaf440700 1 -- 172.21.15.125:0/1586064449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbda80b1650 msgr2=0x7fbda80c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.496+0000 7fbdaf440700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbda80b1650 0x7fbda80c7390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbd98006fd0 tx=0x7fbd9800b730 comp rx=0 tx=0).stop 2023-11-28T11:09:18.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.496+0000 7fbdaf440700 1 -- 172.21.15.125:0/1586064449 shutdown_connections 2023-11-28T11:09:18.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.496+0000 7fbdaf440700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbd8c0682f0 0x7fbd8c06a7a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.496+0000 7fbdaf440700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbda8070bd0 0x7fbda8071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.496+0000 7fbdaf440700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbda80af0a0 0x7fbda8149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.496+0000 7fbdaf440700 1 --2- 172.21.15.125:0/1586064449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbda80b1650 0x7fbda80c7390 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.496+0000 7fbdaf440700 1 -- 172.21.15.125:0/1586064449 >> 172.21.15.125:0/1586064449 conn(0x7fbda806c010 msgr2=0x7fbda80cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:18.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.496+0000 7fbdaf440700 1 -- 172.21.15.125:0/1586064449 shutdown_connections 2023-11-28T11:09:18.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.497+0000 7fbdaf440700 1 -- 172.21.15.125:0/1586064449 wait complete. 2023-11-28T11:09:18.510 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:09:18.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.629+0000 7f93af89d700 1 Processor -- start 2023-11-28T11:09:18.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.629+0000 7f93af89d700 1 -- start start 2023-11-28T11:09:18.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.630+0000 7f93af89d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f93a80b1650 0x7f93a80b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.630+0000 7f93af89d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f93a81599b0 0x7f93a815d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.630+0000 7f93af89d700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a8159ec0 con 0x7f93a80af0a0 2023-11-28T11:09:18.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.630+0000 7f93af89d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a815aa60 con 0x7f93a81599b0 2023-11-28T11:09:18.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.630+0000 7f93af89d700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a80b1f60 con 0x7f93a80b1650 2023-11-28T11:09:18.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.630+0000 7f93ace38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f93a81599b0 0x7f93a815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:18.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.630+0000 7f93ace38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f93a81599b0 0x7f93a815d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58198/0 (socket says 172.21.15.125:58198) 2023-11-28T11:09:18.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.630+0000 7f93ace38700 1 -- 172.21.15.125:0/2902258575 learned_addr learned my addr 172.21.15.125:0/2902258575 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:18.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.631+0000 7f93ad639700 1 --2- 172.21.15.125:0/2902258575 >> v2:172.21.15.167:3300/0 conn(0x7f93a80b1650 0x7f93a80b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:18.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.631+0000 7f93ace38700 1 -- 172.21.15.125:0/2902258575 >> v2:172.21.15.167:3300/0 conn(0x7f93a80b1650 msgr2=0x7f93a80b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:18.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.631+0000 7f93ace38700 1 --2- 172.21.15.125:0/2902258575 >> v2:172.21.15.167:3300/0 conn(0x7f93a80b1650 0x7f93a80b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.631+0000 7f93ace38700 1 -- 172.21.15.125:0/2902258575 >> v1:172.21.15.167:6789/0 conn(0x7f93a80af0a0 legacy=0x7f93a815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:18.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.631+0000 7f93ace38700 1 -- 172.21.15.125:0/2902258575 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a815d8a0 con 0x7f93a81599b0 2023-11-28T11:09:18.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.631+0000 7f93ace38700 1 --2- 172.21.15.125:0/2902258575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93a81599b0 0x7f93a815d050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f93a8067310 tx=0x7f93a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f267f99546d2289 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:18.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.631+0000 7f939ffff700 1 -- 172.21.15.125:0/2902258575 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4004230 con 0x7f93a81599b0 2023-11-28T11:09:18.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.631+0000 7f939ffff700 1 -- 172.21.15.125:0/2902258575 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4004390 con 0x7f93a81599b0 2023-11-28T11:09:18.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.631+0000 7f939ffff700 1 -- 172.21.15.125:0/2902258575 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a40036a0 con 0x7f93a81599b0 2023-11-28T11:09:18.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.632+0000 7f93af89d700 1 -- 172.21.15.125:0/2902258575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93a81599b0 msgr2=0x7f93a815d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.632+0000 7f93af89d700 1 --2- 172.21.15.125:0/2902258575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93a81599b0 0x7f93a815d050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f93a8067310 tx=0x7f93a4009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.632+0000 7f93af89d700 1 -- 172.21.15.125:0/2902258575 shutdown_connections 2023-11-28T11:09:18.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.632+0000 7f93af89d700 1 --2- 172.21.15.125:0/2902258575 >> v2:172.21.15.167:3300/0 conn(0x7f93a80b1650 0x7f93a80b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.632+0000 7f93af89d700 1 --2- 172.21.15.125:0/2902258575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93a81599b0 0x7f93a815d050 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.632+0000 7f93af89d700 1 -- 172.21.15.125:0/2902258575 >> 172.21.15.125:0/2902258575 conn(0x7f93a806c010 msgr2=0x7f93a80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:18.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.632+0000 7f93af89d700 1 -- 172.21.15.125:0/2902258575 shutdown_connections 2023-11-28T11:09:18.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.632+0000 7f93af89d700 1 -- 172.21.15.125:0/2902258575 wait complete. 2023-11-28T11:09:18.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.633+0000 7f93af89d700 1 Processor -- start 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.633+0000 7f93af89d700 1 -- start start 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93af89d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93a80af0a0 0x7f93a80c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93af89d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93a80b1650 0x7f93a8071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93af89d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93a80c66f0 0x7f93a8071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93af89d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a814db90 con 0x7f93a80b1650 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93af89d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a814de70 con 0x7f93a80c66f0 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93af89d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a814e150 con 0x7f93a80af0a0 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93ace38700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93a80b1650 0x7f93a8071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93ace38700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93a80b1650 0x7f93a8071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58202/0 (socket says 172.21.15.125:58202) 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93ace38700 1 -- 172.21.15.125:0/3364007047 learned_addr learned my addr 172.21.15.125:0/3364007047 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93ad639700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93a80af0a0 0x7f93a80c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:18.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93ade3a700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93a80c66f0 0x7f93a8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:18.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93ace38700 1 -- 172.21.15.125:0/3364007047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93a80af0a0 msgr2=0x7f93a80c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93ace38700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93a80af0a0 0x7f93a80c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93ace38700 1 -- 172.21.15.125:0/3364007047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93a80c66f0 msgr2=0x7f93a8071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93ace38700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93a80c66f0 0x7f93a8071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93ace38700 1 -- 172.21.15.125:0/3364007047 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4009550 con 0x7f93a80b1650 2023-11-28T11:09:18.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93ace38700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93a80b1650 0x7f93a8071440 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009130 tx=0x7f93a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:18.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f939dffb700 1 -- 172.21.15.125:0/3364007047 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4011630 con 0x7f93a80b1650 2023-11-28T11:09:18.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f939dffb700 1 -- 172.21.15.125:0/3364007047 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4011790 con 0x7f93a80b1650 2023-11-28T11:09:18.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f93af89d700 1 -- 172.21.15.125:0/3364007047 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a815de60 con 0x7f93a80b1650 2023-11-28T11:09:18.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.634+0000 7f939dffb700 1 -- 172.21.15.125:0/3364007047 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4011b40 con 0x7f93a80b1650 2023-11-28T11:09:18.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.635+0000 7f93af89d700 1 -- 172.21.15.125:0/3364007047 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a815db80 con 0x7f93a80b1650 2023-11-28T11:09:18.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.636+0000 7f93af89d700 1 -- 172.21.15.125:0/3364007047 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a815d590 con 0x7f93a80b1650 2023-11-28T11:09:18.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.636+0000 7f939dffb700 1 -- 172.21.15.125:0/3364007047 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f93a4017020 con 0x7f93a80b1650 2023-11-28T11:09:18.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.636+0000 7f939dffb700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f938c0682f0 0x7f938c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:18.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.636+0000 7f939dffb700 1 -- 172.21.15.125:0/3364007047 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f93a4087150 con 0x7f93a80b1650 2023-11-28T11:09:18.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.636+0000 7f93ad639700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f938c0682f0 0x7f938c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:18.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.637+0000 7f93ad639700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f938c0682f0 0x7f938c06a7a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9398009930 tx=0x7f9398008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:18.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.640+0000 7f939dffb700 1 -- 172.21.15.125:0/3364007047 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f93a4053970 con 0x7f93a80b1650 2023-11-28T11:09:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.837+0000 7f93af89d700 1 -- 172.21.15.125:0/3364007047 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f93a80743f0 con 0x7f93a80b1650 2023-11-28T11:09:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.837+0000 7f939dffb700 1 -- 172.21.15.125:0/3364007047 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f93a4056f90 con 0x7f93a80b1650 2023-11-28T11:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 -- 172.21.15.125:0/3364007047 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f938c0682f0 msgr2=0x7f938c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f938c0682f0 0x7f938c06a7a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9398009930 tx=0x7f9398008040 comp rx=0 tx=0).stop 2023-11-28T11:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 -- 172.21.15.125:0/3364007047 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93a80b1650 msgr2=0x7f93a8071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93a80b1650 0x7f93a8071440 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009130 tx=0x7f93a4004750 comp rx=0 tx=0).stop 2023-11-28T11:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 -- 172.21.15.125:0/3364007047 shutdown_connections 2023-11-28T11:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93a80c66f0 0x7f93a8071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f938c0682f0 0x7f938c06a7a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93a80af0a0 0x7f93a80c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 --2- 172.21.15.125:0/3364007047 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93a80b1650 0x7f93a8071440 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 -- 172.21.15.125:0/3364007047 >> 172.21.15.125:0/3364007047 conn(0x7f93a806c010 msgr2=0x7f93a80ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 -- 172.21.15.125:0/3364007047 shutdown_connections 2023-11-28T11:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:18.839+0000 7f93af89d700 1 -- 172.21.15.125:0/3364007047 wait complete. 2023-11-28T11:09:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:09:18.853 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi167.front.sepia.ceph.com... 2023-11-28T11:09:18.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:18.853 DEBUG:teuthology.orchestra.run.smithi167:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-28T11:09:18.893 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:09:18.894 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:09:18.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:18.894 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T11:09:18.969 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:09:18.970 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:18.988 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:09:18.988 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:19.049 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:19.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.204+0000 7feaf2cbc700 1 Processor -- start 2023-11-28T11:09:19.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.204+0000 7feaf2cbc700 1 -- start start 2023-11-28T11:09:19.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.205+0000 7feaf2cbc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaec06a270 0x7feaec06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.205+0000 7feaf2cbc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feaec06e570 0x7feaec070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.205+0000 7feaf2cbc700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaec06ab80 con 0x7feaec15cc80 2023-11-28T11:09:19.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.205+0000 7feaf2cbc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaec0b2490 con 0x7feaec06e570 2023-11-28T11:09:19.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.205+0000 7feaf2cbc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec06e9b0 con 0x7feaec06a270 2023-11-28T11:09:19.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.205+0000 7feaf1259700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feaec06e570 0x7feaec070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.205+0000 7feaf1259700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feaec06e570 0x7feaec070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58212/0 (socket says 172.21.15.125:58212) 2023-11-28T11:09:19.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.205+0000 7feaf1259700 1 -- 172.21.15.125:0/2328202656 learned_addr learned my addr 172.21.15.125:0/2328202656 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:19.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.206+0000 7feaf0a58700 1 --2- 172.21.15.125:0/2328202656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaec06a270 0x7feaec06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.206+0000 7feaf1259700 1 -- 172.21.15.125:0/2328202656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaec06a270 msgr2=0x7feaec06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:19.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.206+0000 7feaf1259700 1 --2- 172.21.15.125:0/2328202656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaec06a270 0x7feaec06a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.206+0000 7feaf1259700 1 -- 172.21.15.125:0/2328202656 >> v1:172.21.15.167:6789/0 conn(0x7feaec15cc80 legacy=0x7feaec06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:19.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.206+0000 7feaf1259700 1 -- 172.21.15.125:0/2328202656 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec0b1810 con 0x7feaec06e570 2023-11-28T11:09:19.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.206+0000 7feaf1259700 1 --2- 172.21.15.125:0/2328202656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaec06e570 0x7feaec070d20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feae4009e50 tx=0x7feae400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a566a83b5b613b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:19.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.206+0000 7feaeb7fe700 1 -- 172.21.15.125:0/2328202656 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae400e070 con 0x7feaec06e570 2023-11-28T11:09:19.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.206+0000 7feaeb7fe700 1 -- 172.21.15.125:0/2328202656 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae4003a20 con 0x7feaec06e570 2023-11-28T11:09:19.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.206+0000 7feaeb7fe700 1 -- 172.21.15.125:0/2328202656 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4003dd0 con 0x7feaec06e570 2023-11-28T11:09:19.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.207+0000 7feaf2cbc700 1 -- 172.21.15.125:0/2328202656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaec06e570 msgr2=0x7feaec070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.207+0000 7feaf2cbc700 1 --2- 172.21.15.125:0/2328202656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaec06e570 0x7feaec070d20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feae4009e50 tx=0x7feae400b330 comp rx=0 tx=0).stop 2023-11-28T11:09:19.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.207+0000 7feaf2cbc700 1 -- 172.21.15.125:0/2328202656 shutdown_connections 2023-11-28T11:09:19.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.207+0000 7feaf2cbc700 1 --2- 172.21.15.125:0/2328202656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaec06e570 0x7feaec070d20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.207+0000 7feaf2cbc700 1 --2- 172.21.15.125:0/2328202656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaec06a270 0x7feaec06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.207+0000 7feaf2cbc700 1 -- 172.21.15.125:0/2328202656 >> 172.21.15.125:0/2328202656 conn(0x7feaec06c010 msgr2=0x7feaec0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:19.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.207+0000 7feaf2cbc700 1 -- 172.21.15.125:0/2328202656 shutdown_connections 2023-11-28T11:09:19.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.207+0000 7feaf2cbc700 1 -- 172.21.15.125:0/2328202656 wait complete. 2023-11-28T11:09:19.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.208+0000 7feaf2cbc700 1 Processor -- start 2023-11-28T11:09:19.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.208+0000 7feaf2cbc700 1 -- start start 2023-11-28T11:09:19.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaf2cbc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec06a270 0x7feaec153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaf2cbc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaec06e570 0x7feaec0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaf2cbc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaec15cc80 0x7feaec0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaf2cbc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec0c8340 con 0x7feaec06e570 2023-11-28T11:09:19.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaf2cbc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec1535b0 con 0x7feaec06a270 2023-11-28T11:09:19.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaf2cbc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec0c7730 con 0x7feaec15cc80 2023-11-28T11:09:19.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaec06e570 0x7feaec0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaec06e570 0x7feaec0c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58216/0 (socket says 172.21.15.125:58216) 2023-11-28T11:09:19.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaebfff700 1 -- 172.21.15.125:0/1637333097 learned_addr learned my addr 172.21.15.125:0/1637333097 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:19.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaf1259700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaec15cc80 0x7feaec0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaf0a58700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec06a270 0x7feaec153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaebfff700 1 -- 172.21.15.125:0/1637333097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaec15cc80 msgr2=0x7feaec0c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaebfff700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaec15cc80 0x7feaec0c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaebfff700 1 -- 172.21.15.125:0/1637333097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec06a270 msgr2=0x7feaec153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaebfff700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec06a270 0x7feaec153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaebfff700 1 -- 172.21.15.125:0/1637333097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae4009b30 con 0x7feaec06e570 2023-11-28T11:09:19.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaebfff700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaec06e570 0x7feaec0c87d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fead800c4d0 tx=0x7fead800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:19.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feae97fa700 1 -- 172.21.15.125:0/1637333097 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8011790 con 0x7feaec06e570 2023-11-28T11:09:19.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feae97fa700 1 -- 172.21.15.125:0/1637333097 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead80118f0 con 0x7feaec06e570 2023-11-28T11:09:19.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feae97fa700 1 -- 172.21.15.125:0/1637333097 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8011ca0 con 0x7feaec06e570 2023-11-28T11:09:19.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaf2cbc700 1 -- 172.21.15.125:0/1637333097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaec0b1dd0 con 0x7feaec06e570 2023-11-28T11:09:19.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.209+0000 7feaf2cbc700 1 -- 172.21.15.125:0/1637333097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaec0b1af0 con 0x7feaec06e570 2023-11-28T11:09:19.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.210+0000 7feaf2cbc700 1 -- 172.21.15.125:0/1637333097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaec0b20b0 con 0x7feaec06e570 2023-11-28T11:09:19.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.211+0000 7feae97fa700 1 -- 172.21.15.125:0/1637333097 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fead8010050 con 0x7feaec06e570 2023-11-28T11:09:19.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.211+0000 7feae97fa700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fead00682f0 0x7fead006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.211+0000 7feae97fa700 1 -- 172.21.15.125:0/1637333097 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fead8085860 con 0x7feaec06e570 2023-11-28T11:09:19.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.211+0000 7feaf0a58700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fead00682f0 0x7fead006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.212+0000 7feaf0a58700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fead00682f0 0x7fead006a7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feae0006fd0 tx=0x7feae0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:19.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.215+0000 7feae97fa700 1 -- 172.21.15.125:0/1637333097 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fead8052080 con 0x7feaec06e570 2023-11-28T11:09:19.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.400+0000 7feaf2cbc700 1 -- 172.21.15.125:0/1637333097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaec074450 con 0x7feaec06e570 2023-11-28T11:09:19.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.401+0000 7feae97fa700 1 -- 172.21.15.125:0/1637333097 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7fead80556a0 con 0x7feaec06e570 2023-11-28T11:09:19.403 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:19.404 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":26,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:19.047682+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 -- 172.21.15.125:0/1637333097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fead00682f0 msgr2=0x7fead006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fead00682f0 0x7fead006a7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feae0006fd0 tx=0x7feae0008040 comp rx=0 tx=0).stop 2023-11-28T11:09:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 -- 172.21.15.125:0/1637333097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaec06e570 msgr2=0x7feaec0c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaec06e570 0x7feaec0c87d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fead800c4d0 tx=0x7fead800c7e0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 -- 172.21.15.125:0/1637333097 shutdown_connections 2023-11-28T11:09:19.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fead00682f0 0x7fead006a7a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaec15cc80 0x7feaec0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaec06a270 0x7feaec153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 --2- 172.21.15.125:0/1637333097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaec06e570 0x7feaec0c87d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 -- 172.21.15.125:0/1637333097 >> 172.21.15.125:0/1637333097 conn(0x7feaec06c010 msgr2=0x7feaec0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:19.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 -- 172.21.15.125:0/1637333097 shutdown_connections 2023-11-28T11:09:19.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.403+0000 7feaf2cbc700 1 -- 172.21.15.125:0/1637333097 wait complete. 2023-11-28T11:09:19.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:19.419 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:19.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.541+0000 7f459bb97700 1 Processor -- start 2023-11-28T11:09:19.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.541+0000 7f459bb97700 1 -- start start 2023-11-28T11:09:19.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f459bb97700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 0x7f45940d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f459bb97700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459415a9c0 con 0x7f45940cc200 2023-11-28T11:09:19.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f459bb97700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45940c7b80 con 0x7f459415a5f0 2023-11-28T11:09:19.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f459bb97700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45940cc990 con 0x7f45940b2ee0 2023-11-28T11:09:19.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f459a134700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f45940cc200 0x7f45940ced30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42350/0 (socket says 172.21.15.125:42350) 2023-11-28T11:09:19.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f459a134700 1 -- 172.21.15.125:0/2501498132 learned_addr learned my addr 172.21.15.125:0/2501498132 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f4599132700 1 --2- 172.21.15.125:0/2501498132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 0x7f45940d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f4598931700 1 -- 172.21.15.125:0/2501498132 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436772733 0 0) 0x7f459415a9c0 con 0x7f45940cc200 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f4598931700 1 -- 172.21.15.125:0/2501498132 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45800035b0 con 0x7f45940cc200 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f4598931700 1 -- 172.21.15.125:0/2501498132 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204364727 0 0) 0x7f45940c7b80 con 0x7f459415a5f0 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f4598931700 1 -- 172.21.15.125:0/2501498132 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f459415a9c0 con 0x7f459415a5f0 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f4598931700 1 -- 172.21.15.125:0/2501498132 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 238046599 0 0) 0x7f45800035b0 con 0x7f45940cc200 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f4599132700 1 -- 172.21.15.125:0/2501498132 >> v1:172.21.15.167:6789/0 conn(0x7f459415a5f0 legacy=0x7f45940b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f4599132700 1 -- 172.21.15.125:0/2501498132 >> v1:172.21.15.125:6789/0 conn(0x7f45940cc200 legacy=0x7f45940ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.542+0000 7f4599132700 1 -- 172.21.15.125:0/2501498132 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45940ccc70 con 0x7f45940b2ee0 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.543+0000 7f4599132700 1 --2- 172.21.15.125:0/2501498132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 0x7f45940d0ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4584009870 tx=0x7f4584009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5508d029171284ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.543+0000 7f4598931700 1 -- 172.21.15.125:0/2501498132 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0019f0 con 0x7f45940b2ee0 2023-11-28T11:09:19.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.543+0000 7f4598931700 1 -- 172.21.15.125:0/2501498132 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4584004030 con 0x7f45940b2ee0 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.543+0000 7f4598931700 1 -- 172.21.15.125:0/2501498132 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840043c0 con 0x7f45940b2ee0 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.543+0000 7f459bb97700 1 -- 172.21.15.125:0/2501498132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 msgr2=0x7f45940d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.543+0000 7f459bb97700 1 --2- 172.21.15.125:0/2501498132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 0x7f45940d0ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4584009870 tx=0x7f4584009b80 comp rx=0 tx=0).stop 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.543+0000 7f459bb97700 1 -- 172.21.15.125:0/2501498132 shutdown_connections 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.543+0000 7f459bb97700 1 --2- 172.21.15.125:0/2501498132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 0x7f45940d0ad0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.543+0000 7f459bb97700 1 -- 172.21.15.125:0/2501498132 >> 172.21.15.125:0/2501498132 conn(0x7f459406ea80 msgr2=0x7f459406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.543+0000 7f459bb97700 1 -- 172.21.15.125:0/2501498132 shutdown_connections 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.543+0000 7f459bb97700 1 -- 172.21.15.125:0/2501498132 wait complete. 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.545+0000 7f459bb97700 1 Processor -- start 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.545+0000 7f459bb97700 1 -- start start 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.545+0000 7f459bb97700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 0x7f459414aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.545+0000 7f459bb97700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45940cc200 0x7f45941f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.545+0000 7f459bb97700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459415a5f0 0x7f45940b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.545+0000 7f459bb97700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4594150030 con 0x7f45940cc200 2023-11-28T11:09:19.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.545+0000 7f459bb97700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940ca1d0 con 0x7f459415a5f0 2023-11-28T11:09:19.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.545+0000 7f459bb97700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459414f970 con 0x7f45940b2ee0 2023-11-28T11:09:19.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.545+0000 7f4599132700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45940cc200 0x7f45941f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.545+0000 7f4599132700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45940cc200 0x7f45941f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58230/0 (socket says 172.21.15.125:58230) 2023-11-28T11:09:19.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.545+0000 7f4599132700 1 -- 172.21.15.125:0/945021897 learned_addr learned my addr 172.21.15.125:0/945021897 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:19.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f4599933700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 0x7f459414aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f459a134700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459415a5f0 0x7f45940b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f4599132700 1 -- 172.21.15.125:0/945021897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 msgr2=0x7f459414aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f4599132700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 0x7f459414aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f4599132700 1 -- 172.21.15.125:0/945021897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459415a5f0 msgr2=0x7f45940b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f4599132700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459415a5f0 0x7f45940b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f4599132700 1 -- 172.21.15.125:0/945021897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45840094a0 con 0x7f45940cc200 2023-11-28T11:09:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f4599933700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 0x7f459414aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f4599132700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45940cc200 0x7f45941f4410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f45840097c0 tx=0x7f4584004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f458a7fc700 1 -- 172.21.15.125:0/945021897 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584003db0 con 0x7f45940cc200 2023-11-28T11:09:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f458a7fc700 1 -- 172.21.15.125:0/945021897 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458401f070 con 0x7f45940cc200 2023-11-28T11:09:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f459bb97700 1 -- 172.21.15.125:0/945021897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45940cd230 con 0x7f45940cc200 2023-11-28T11:09:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f458a7fc700 1 -- 172.21.15.125:0/945021897 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584011870 con 0x7f45940cc200 2023-11-28T11:09:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.546+0000 7f459bb97700 1 -- 172.21.15.125:0/945021897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45940ccf50 con 0x7f45940cc200 2023-11-28T11:09:19.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.547+0000 7f459bb97700 1 -- 172.21.15.125:0/945021897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45940cd510 con 0x7f45940cc200 2023-11-28T11:09:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.547+0000 7f458a7fc700 1 -- 172.21.15.125:0/945021897 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f458402a020 con 0x7f45940cc200 2023-11-28T11:09:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.548+0000 7f458a7fc700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45780682f0 0x7f457806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.548+0000 7f458a7fc700 1 -- 172.21.15.125:0/945021897 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4584087220 con 0x7f45940cc200 2023-11-28T11:09:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.548+0000 7f4599933700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45780682f0 0x7f457806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.548+0000 7f4599933700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45780682f0 0x7f457806a7a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4590007fd0 tx=0x7f4590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:19.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.552+0000 7f458a7fc700 1 -- 172.21.15.125:0/945021897 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4584053a40 con 0x7f45940cc200 2023-11-28T11:09:19.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.735+0000 7f459bb97700 1 -- 172.21.15.125:0/945021897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f459414f7d0 con 0x7f45940cc200 2023-11-28T11:09:19.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.735+0000 7f458a7fc700 1 -- 172.21.15.125:0/945021897 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f459414f7d0 con 0x7f45940cc200 2023-11-28T11:09:19.738 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 -- 172.21.15.125:0/945021897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45780682f0 msgr2=0x7f457806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45780682f0 0x7f457806a7a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4590007fd0 tx=0x7f4590009040 comp rx=0 tx=0).stop 2023-11-28T11:09:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 -- 172.21.15.125:0/945021897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45940cc200 msgr2=0x7f45941f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45940cc200 0x7f45941f4410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f45840097c0 tx=0x7f4584004750 comp rx=0 tx=0).stop 2023-11-28T11:09:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 -- 172.21.15.125:0/945021897 shutdown_connections 2023-11-28T11:09:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459415a5f0 0x7f45940b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45780682f0 0x7f457806a7a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b2ee0 0x7f459414aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 --2- 172.21.15.125:0/945021897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45940cc200 0x7f45941f4410 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 -- 172.21.15.125:0/945021897 >> 172.21.15.125:0/945021897 conn(0x7f459406ea80 msgr2=0x7f4594157be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:19.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 -- 172.21.15.125:0/945021897 shutdown_connections 2023-11-28T11:09:19.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.737+0000 7f459bb97700 1 -- 172.21.15.125:0/945021897 wait complete. 2023-11-28T11:09:19.751 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:19.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.872+0000 7f0ea8a1f700 1 Processor -- start 2023-11-28T11:09:19.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.872+0000 7f0ea8a1f700 1 -- start start 2023-11-28T11:09:19.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.873+0000 7f0ea8a1f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ea406a980 0x7f0ea40ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.873+0000 7f0ea8a1f700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0ea4071890 0x7f0ea4071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.873+0000 7f0ea8a1f700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea415cc10 con 0x7f0ea40cf710 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.873+0000 7f0ea8a1f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea406c9b0 con 0x7f0ea406a980 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.873+0000 7f0ea8a1f700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea406cc90 con 0x7f0ea4071890 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ea406a980 0x7f0ea40ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ea406a980 0x7f0ea40ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58238/0 (socket says 172.21.15.125:58238) 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea1d9b700 1 -- 172.21.15.125:0/966843076 learned_addr learned my addr 172.21.15.125:0/966843076 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea2d9d700 1 --2- 172.21.15.125:0/966843076 >> v2:172.21.15.167:3300/0 conn(0x7f0ea4071890 0x7f0ea4071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea1d9b700 1 -- 172.21.15.125:0/966843076 >> v2:172.21.15.167:3300/0 conn(0x7f0ea4071890 msgr2=0x7f0ea4071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea1d9b700 1 --2- 172.21.15.125:0/966843076 >> v2:172.21.15.167:3300/0 conn(0x7f0ea4071890 0x7f0ea4071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea1d9b700 1 -- 172.21.15.125:0/966843076 >> v1:172.21.15.167:6789/0 conn(0x7f0ea40cf710 legacy=0x7f0ea406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea1d9b700 1 -- 172.21.15.125:0/966843076 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea406cf70 con 0x7f0ea406a980 2023-11-28T11:09:19.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea1d9b700 1 --2- 172.21.15.125:0/966843076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea406a980 0x7f0ea40ce740 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0ea406ad50 tx=0x7f0e94009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e979bdbcca7275 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:19.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea159a700 1 -- 172.21.15.125:0/966843076 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94004230 con 0x7f0ea406a980 2023-11-28T11:09:19.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea159a700 1 -- 172.21.15.125:0/966843076 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e94004390 con 0x7f0ea406a980 2023-11-28T11:09:19.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.874+0000 7f0ea159a700 1 -- 172.21.15.125:0/966843076 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940036a0 con 0x7f0ea406a980 2023-11-28T11:09:19.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.875+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/966843076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea406a980 msgr2=0x7f0ea40ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.875+0000 7f0ea8a1f700 1 --2- 172.21.15.125:0/966843076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea406a980 0x7f0ea40ce740 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0ea406ad50 tx=0x7f0e94009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.875+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/966843076 shutdown_connections 2023-11-28T11:09:19.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.875+0000 7f0ea8a1f700 1 --2- 172.21.15.125:0/966843076 >> v2:172.21.15.167:3300/0 conn(0x7f0ea4071890 0x7f0ea4071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.875+0000 7f0ea8a1f700 1 --2- 172.21.15.125:0/966843076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea406a980 0x7f0ea40ce740 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.875+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/966843076 >> 172.21.15.125:0/966843076 conn(0x7f0ea406c010 msgr2=0x7f0ea40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:19.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.875+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/966843076 shutdown_connections 2023-11-28T11:09:19.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.875+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/966843076 wait complete. 2023-11-28T11:09:19.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.876+0000 7f0ea8a1f700 1 Processor -- start 2023-11-28T11:09:19.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.876+0000 7f0ea8a1f700 1 -- start start 2023-11-28T11:09:19.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea8a1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea406a980 0x7f0ea4149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea8a1f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea4071890 0x7f0ea415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea8a1f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea40cf710 0x7f0ea415e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea8a1f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea4158b30 con 0x7f0ea406a980 2023-11-28T11:09:19.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea8a1f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea415e890 con 0x7f0ea4071890 2023-11-28T11:09:19.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea8a1f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea4158d80 con 0x7f0ea40cf710 2023-11-28T11:09:19.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea406a980 0x7f0ea4149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea406a980 0x7f0ea4149090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58242/0 (socket says 172.21.15.125:58242) 2023-11-28T11:09:19.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea259c700 1 -- 172.21.15.125:0/2475123292 learned_addr learned my addr 172.21.15.125:0/2475123292 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:19.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea1d9b700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea4071890 0x7f0ea415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea2d9d700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea40cf710 0x7f0ea415e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea259c700 1 -- 172.21.15.125:0/2475123292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea40cf710 msgr2=0x7f0ea415e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea259c700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea40cf710 0x7f0ea415e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea259c700 1 -- 172.21.15.125:0/2475123292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea4071890 msgr2=0x7f0ea415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:19.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea259c700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea4071890 0x7f0ea415dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:19.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea259c700 1 -- 172.21.15.125:0/2475123292 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94009550 con 0x7f0ea406a980 2023-11-28T11:09:19.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea1d9b700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea4071890 0x7f0ea415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:19.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.877+0000 7f0ea259c700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea406a980 0x7f0ea4149090 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800b4a0 tx=0x7f0e9800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:19.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.878+0000 7f0e92ffd700 1 -- 172.21.15.125:0/2475123292 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98011830 con 0x7f0ea406a980 2023-11-28T11:09:19.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.878+0000 7f0e92ffd700 1 -- 172.21.15.125:0/2475123292 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98011990 con 0x7f0ea406a980 2023-11-28T11:09:19.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.878+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/2475123292 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea406d530 con 0x7f0ea406a980 2023-11-28T11:09:19.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.878+0000 7f0e92ffd700 1 -- 172.21.15.125:0/2475123292 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98011d40 con 0x7f0ea406a980 2023-11-28T11:09:19.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.878+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/2475123292 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea406d250 con 0x7f0ea406a980 2023-11-28T11:09:19.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.879+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/2475123292 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea4160480 con 0x7f0ea406a980 2023-11-28T11:09:19.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.879+0000 7f0e92ffd700 1 -- 172.21.15.125:0/2475123292 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0e9800f050 con 0x7f0ea406a980 2023-11-28T11:09:19.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.879+0000 7f0e92ffd700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e840682f0 0x7f0e8406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:19.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.879+0000 7f0e92ffd700 1 -- 172.21.15.125:0/2475123292 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0e980858a0 con 0x7f0ea406a980 2023-11-28T11:09:19.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.879+0000 7f0ea1d9b700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e840682f0 0x7f0e8406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:19.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.880+0000 7f0ea1d9b700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e840682f0 0x7f0e8406a7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40ae370 tx=0x7f0e94008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:19.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:19.884+0000 7f0e92ffd700 1 -- 172.21.15.125:0/2475123292 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0e98052060 con 0x7f0ea406a980 2023-11-28T11:09:20.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.072+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/2475123292 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0ea40743f0 con 0x7f0ea406a980 2023-11-28T11:09:20.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.073+0000 7f0e92ffd700 1 -- 172.21.15.125:0/2475123292 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0e98055680 con 0x7f0ea406a980 2023-11-28T11:09:20.075 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:20.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/2475123292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e840682f0 msgr2=0x7f0e8406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e840682f0 0x7f0e8406a7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40ae370 tx=0x7f0e94008030 comp rx=0 tx=0).stop 2023-11-28T11:09:20.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/2475123292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea406a980 msgr2=0x7f0ea4149090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea406a980 0x7f0ea4149090 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800b4a0 tx=0x7f0e9800b860 comp rx=0 tx=0).stop 2023-11-28T11:09:20.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/2475123292 shutdown_connections 2023-11-28T11:09:20.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0e840682f0 0x7f0e8406a7a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ea40cf710 0x7f0ea415e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ea406a980 0x7f0ea4149090 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 --2- 172.21.15.125:0/2475123292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea4071890 0x7f0ea415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/2475123292 >> 172.21.15.125:0/2475123292 conn(0x7f0ea406c010 msgr2=0x7f0ea406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:20.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/2475123292 shutdown_connections 2023-11-28T11:09:20.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.075+0000 7f0ea8a1f700 1 -- 172.21.15.125:0/2475123292 wait complete. 2023-11-28T11:09:20.089 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:20.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.211+0000 7fd38ee67700 1 Processor -- start 2023-11-28T11:09:20.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.211+0000 7fd38ee67700 1 -- start start 2023-11-28T11:09:20.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.212+0000 7fd38ee67700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd38806cb50 0x7fd388163b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.212+0000 7fd38ee67700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3880cbcc0 con 0x7fd388158e10 2023-11-28T11:09:20.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.212+0000 7fd38ee67700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3880ca140 con 0x7fd3880ae850 2023-11-28T11:09:20.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.212+0000 7fd38ee67700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38806ac30 con 0x7fd38806cb50 2023-11-28T11:09:20.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.212+0000 7fd38cc03700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd388158e10 0x7fd3880cb5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42374/0 (socket says 172.21.15.125:42374) 2023-11-28T11:09:20.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.212+0000 7fd38cc03700 1 -- 172.21.15.125:0/1570956493 learned_addr learned my addr 172.21.15.125:0/1570956493 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:20.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd38d404700 1 --2- 172.21.15.125:0/1570956493 >> v2:172.21.15.167:3300/0 conn(0x7fd38806cb50 0x7fd388163b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd3877fe700 1 -- 172.21.15.125:0/1570956493 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071212426 0 0) 0x7fd3880cbcc0 con 0x7fd388158e10 2023-11-28T11:09:20.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd3877fe700 1 -- 172.21.15.125:0/1570956493 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3780035b0 con 0x7fd388158e10 2023-11-28T11:09:20.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd3877fe700 1 -- 172.21.15.125:0/1570956493 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230857447 0 0) 0x7fd3880ca140 con 0x7fd3880ae850 2023-11-28T11:09:20.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd3877fe700 1 -- 172.21.15.125:0/1570956493 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3880cbcc0 con 0x7fd3880ae850 2023-11-28T11:09:20.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd3877fe700 1 -- 172.21.15.125:0/1570956493 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1531472789 0 0) 0x7fd3780035b0 con 0x7fd388158e10 2023-11-28T11:09:20.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd38d404700 1 -- 172.21.15.125:0/1570956493 >> v1:172.21.15.167:6789/0 conn(0x7fd3880ae850 legacy=0x7fd38806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd38d404700 1 -- 172.21.15.125:0/1570956493 >> v1:172.21.15.125:6789/0 conn(0x7fd388158e10 legacy=0x7fd3880cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd38d404700 1 -- 172.21.15.125:0/1570956493 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388071380 con 0x7fd38806cb50 2023-11-28T11:09:20.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd38d404700 1 --2- 172.21.15.125:0/1570956493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38806cb50 0x7fd388163b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd380009d90 tx=0x7fd38000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1ec4a05d8324206 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:20.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd3877fe700 1 -- 172.21.15.125:0/1570956493 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38000e070 con 0x7fd38806cb50 2023-11-28T11:09:20.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd3877fe700 1 -- 172.21.15.125:0/1570956493 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380003a20 con 0x7fd38806cb50 2023-11-28T11:09:20.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.213+0000 7fd3877fe700 1 -- 172.21.15.125:0/1570956493 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c001670 con 0x7fd38806cb50 2023-11-28T11:09:20.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.214+0000 7fd38ee67700 1 -- 172.21.15.125:0/1570956493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38806cb50 msgr2=0x7fd388163b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.214+0000 7fd38ee67700 1 --2- 172.21.15.125:0/1570956493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38806cb50 0x7fd388163b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd380009d90 tx=0x7fd38000b330 comp rx=0 tx=0).stop 2023-11-28T11:09:20.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.214+0000 7fd38ee67700 1 -- 172.21.15.125:0/1570956493 shutdown_connections 2023-11-28T11:09:20.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.214+0000 7fd38ee67700 1 --2- 172.21.15.125:0/1570956493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38806cb50 0x7fd388163b50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.214+0000 7fd38ee67700 1 -- 172.21.15.125:0/1570956493 >> 172.21.15.125:0/1570956493 conn(0x7fd3880cf400 msgr2=0x7fd3880cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:20.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.214+0000 7fd38ee67700 1 -- 172.21.15.125:0/1570956493 shutdown_connections 2023-11-28T11:09:20.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.214+0000 7fd38ee67700 1 -- 172.21.15.125:0/1570956493 wait complete. 2023-11-28T11:09:20.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.215+0000 7fd38ee67700 1 Processor -- start 2023-11-28T11:09:20.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.215+0000 7fd38ee67700 1 -- start start 2023-11-28T11:09:20.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.216+0000 7fd38ee67700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38806cb50 0x7fd388150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.216+0000 7fd38ee67700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3880ae850 0x7fd3880b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.216+0000 7fd38ee67700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd388158e10 0x7fd3881592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.216+0000 7fd38ee67700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880af8d0 con 0x7fd3880ae850 2023-11-28T11:09:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.216+0000 7fd38ee67700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880ced00 con 0x7fd38806cb50 2023-11-28T11:09:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.216+0000 7fd38ee67700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880cefe0 con 0x7fd388158e10 2023-11-28T11:09:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.216+0000 7fd387fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3880ae850 0x7fd3880b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.216+0000 7fd387fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3880ae850 0x7fd3880b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58256/0 (socket says 172.21.15.125:58256) 2023-11-28T11:09:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.216+0000 7fd387fff700 1 -- 172.21.15.125:0/3155018445 learned_addr learned my addr 172.21.15.125:0/3155018445 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.216+0000 7fd38d404700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd388158e10 0x7fd3881592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.216+0000 7fd38cc03700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38806cb50 0x7fd388150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.217+0000 7fd387fff700 1 -- 172.21.15.125:0/3155018445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd388158e10 msgr2=0x7fd3881592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.217+0000 7fd387fff700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd388158e10 0x7fd3881592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.217+0000 7fd387fff700 1 -- 172.21.15.125:0/3155018445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38806cb50 msgr2=0x7fd388150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.217+0000 7fd387fff700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38806cb50 0x7fd388150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.217+0000 7fd387fff700 1 -- 172.21.15.125:0/3155018445 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380009a70 con 0x7fd3880ae850 2023-11-28T11:09:20.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.217+0000 7fd387fff700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3880ae850 0x7fd3880b0040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd37400c490 tx=0x7fd37400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:20.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.217+0000 7fd3857fa700 1 -- 172.21.15.125:0/3155018445 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37400cea0 con 0x7fd3880ae850 2023-11-28T11:09:20.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.217+0000 7fd3857fa700 1 -- 172.21.15.125:0/3155018445 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3740052f0 con 0x7fd3880ae850 2023-11-28T11:09:20.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.217+0000 7fd38ee67700 1 -- 172.21.15.125:0/3155018445 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3880c9e60 con 0x7fd3880ae850 2023-11-28T11:09:20.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.217+0000 7fd3857fa700 1 -- 172.21.15.125:0/3155018445 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374003680 con 0x7fd3880ae850 2023-11-28T11:09:20.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.217+0000 7fd38ee67700 1 -- 172.21.15.125:0/3155018445 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3880c9b80 con 0x7fd3880ae850 2023-11-28T11:09:20.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.218+0000 7fd38ee67700 1 -- 172.21.15.125:0/3155018445 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38806ae20 con 0x7fd3880ae850 2023-11-28T11:09:20.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.218+0000 7fd3857fa700 1 -- 172.21.15.125:0/3155018445 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd374019030 con 0x7fd3880ae850 2023-11-28T11:09:20.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.219+0000 7fd3857fa700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd36c0682f0 0x7fd36c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.219+0000 7fd3857fa700 1 -- 172.21.15.125:0/3155018445 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd374084f40 con 0x7fd3880ae850 2023-11-28T11:09:20.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.219+0000 7fd38cc03700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd36c0682f0 0x7fd36c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.219+0000 7fd38cc03700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd36c0682f0 0x7fd36c06a7a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0017a0 tx=0x7fd37c001670 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:20.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.223+0000 7fd3857fa700 1 -- 172.21.15.125:0/3155018445 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd374051700 con 0x7fd3880ae850 2023-11-28T11:09:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.404+0000 7fd38ee67700 1 -- 172.21.15.125:0/3155018445 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3880cf150 con 0x7fd3880ae850 2023-11-28T11:09:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.404+0000 7fd3857fa700 1 -- 172.21.15.125:0/3155018445 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd374017020 con 0x7fd3880ae850 2023-11-28T11:09:20.406 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 -- 172.21.15.125:0/3155018445 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd36c0682f0 msgr2=0x7fd36c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd36c0682f0 0x7fd36c06a7a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0017a0 tx=0x7fd37c001670 comp rx=0 tx=0).stop 2023-11-28T11:09:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 -- 172.21.15.125:0/3155018445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3880ae850 msgr2=0x7fd3880b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3880ae850 0x7fd3880b0040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd37400c490 tx=0x7fd37400c7a0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 -- 172.21.15.125:0/3155018445 shutdown_connections 2023-11-28T11:09:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd36c0682f0 0x7fd36c06a7a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd388158e10 0x7fd3881592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd38806cb50 0x7fd388150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 --2- 172.21.15.125:0/3155018445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3880ae850 0x7fd3880b0040 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 -- 172.21.15.125:0/3155018445 >> 172.21.15.125:0/3155018445 conn(0x7fd3880cf400 msgr2=0x7fd38815c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:20.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 -- 172.21.15.125:0/3155018445 shutdown_connections 2023-11-28T11:09:20.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.407+0000 7fd38ee67700 1 -- 172.21.15.125:0/3155018445 wait complete. 2023-11-28T11:09:20.420 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:20.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.541+0000 7f67977d1700 1 Processor -- start 2023-11-28T11:09:20.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.541+0000 7f67977d1700 1 -- start start 2023-11-28T11:09:20.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f67977d1700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67900cf710 0x7f67900ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f67977d1700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6790071890 0x7f6790071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f67977d1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f679006a270 0x7f679006a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f67977d1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679006ac30 con 0x7f679006a270 2023-11-28T11:09:20.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f67977d1700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679015cc10 con 0x7f6790071890 2023-11-28T11:09:20.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f67977d1700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679006c9b0 con 0x7f67900cf710 2023-11-28T11:09:20.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f6795d6e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f679006a270 0x7f679006a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f6795d6e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f679006a270 0x7f679006a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58264/0 (socket says 172.21.15.125:58264) 2023-11-28T11:09:20.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f6795d6e700 1 -- 172.21.15.125:0/2900789707 learned_addr learned my addr 172.21.15.125:0/2900789707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:20.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f6794d6c700 1 --2- 172.21.15.125:0/2900789707 >> v2:172.21.15.167:3300/0 conn(0x7f6790071890 0x7f6790071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f679556d700 1 --2- 172.21.15.125:0/2900789707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67900cf710 0x7f67900ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f6795d6e700 1 -- 172.21.15.125:0/2900789707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67900cf710 msgr2=0x7f67900ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:20.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f6795d6e700 1 --2- 172.21.15.125:0/2900789707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67900cf710 0x7f67900ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f6795d6e700 1 -- 172.21.15.125:0/2900789707 >> v2:172.21.15.167:3300/0 conn(0x7f6790071890 msgr2=0x7f6790071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:20.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f6795d6e700 1 --2- 172.21.15.125:0/2900789707 >> v2:172.21.15.167:3300/0 conn(0x7f6790071890 0x7f6790071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f6795d6e700 1 -- 172.21.15.125:0/2900789707 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679006cc90 con 0x7f679006a270 2023-11-28T11:09:20.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.542+0000 7f679556d700 1 --2- 172.21.15.125:0/2900789707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67900cf710 0x7f67900ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:20.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.543+0000 7f6795d6e700 1 --2- 172.21.15.125:0/2900789707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f679006a270 0x7f679006a6f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f67900b2780 tx=0x7f678800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f21706dbc8b32 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:20.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.543+0000 7f6787fff700 1 -- 172.21.15.125:0/2900789707 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800e070 con 0x7f679006a270 2023-11-28T11:09:20.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.543+0000 7f6787fff700 1 -- 172.21.15.125:0/2900789707 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678800b9c0 con 0x7f679006a270 2023-11-28T11:09:20.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.543+0000 7f6787fff700 1 -- 172.21.15.125:0/2900789707 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800bd70 con 0x7f679006a270 2023-11-28T11:09:20.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.543+0000 7f67977d1700 1 -- 172.21.15.125:0/2900789707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f679006a270 msgr2=0x7f679006a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.543+0000 7f67977d1700 1 --2- 172.21.15.125:0/2900789707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f679006a270 0x7f679006a6f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f67900b2780 tx=0x7f678800b330 comp rx=0 tx=0).stop 2023-11-28T11:09:20.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.543+0000 7f67977d1700 1 -- 172.21.15.125:0/2900789707 shutdown_connections 2023-11-28T11:09:20.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.543+0000 7f67977d1700 1 --2- 172.21.15.125:0/2900789707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f679006a270 0x7f679006a6f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.543+0000 7f67977d1700 1 --2- 172.21.15.125:0/2900789707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67900cf710 0x7f67900ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.543+0000 7f67977d1700 1 --2- 172.21.15.125:0/2900789707 >> v2:172.21.15.167:3300/0 conn(0x7f6790071890 0x7f6790071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.543+0000 7f67977d1700 1 -- 172.21.15.125:0/2900789707 >> 172.21.15.125:0/2900789707 conn(0x7f679006c010 msgr2=0x7f67900cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:20.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.544+0000 7f67977d1700 1 -- 172.21.15.125:0/2900789707 shutdown_connections 2023-11-28T11:09:20.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.544+0000 7f67977d1700 1 -- 172.21.15.125:0/2900789707 wait complete. 2023-11-28T11:09:20.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.545+0000 7f67977d1700 1 Processor -- start 2023-11-28T11:09:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.545+0000 7f67977d1700 1 -- start start 2023-11-28T11:09:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.545+0000 7f67977d1700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f679006a270 0x7f679014cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.545+0000 7f67977d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6790071890 0x7f679015e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.545+0000 7f67977d1700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67900cf710 0x7f679015f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.545+0000 7f67977d1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679015cf80 con 0x7f6790071890 2023-11-28T11:09:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.545+0000 7f67977d1700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679015d260 con 0x7f679006a270 2023-11-28T11:09:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.545+0000 7f67977d1700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679015d540 con 0x7f67900cf710 2023-11-28T11:09:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.545+0000 7f6794d6c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6790071890 0x7f679015e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6794d6c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6790071890 0x7f679015e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58272/0 (socket says 172.21.15.125:58272) 2023-11-28T11:09:20.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6794d6c700 1 -- 172.21.15.125:0/2543422556 learned_addr learned my addr 172.21.15.125:0/2543422556 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:20.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6795d6e700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67900cf710 0x7f679015f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6794d6c700 1 -- 172.21.15.125:0/2543422556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67900cf710 msgr2=0x7f679015f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6794d6c700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67900cf710 0x7f679015f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6794d6c700 1 -- 172.21.15.125:0/2543422556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f679006a270 msgr2=0x7f679014cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f679556d700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f679006a270 0x7f679014cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6794d6c700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f679006a270 0x7f679014cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6794d6c700 1 -- 172.21.15.125:0/2543422556 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6788009b30 con 0x7f6790071890 2023-11-28T11:09:20.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6794d6c700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6790071890 0x7f679015e020 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f678c00e810 tx=0x7f678c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:20.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6785ffb700 1 -- 172.21.15.125:0/2543422556 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c013610 con 0x7f6790071890 2023-11-28T11:09:20.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6785ffb700 1 -- 172.21.15.125:0/2543422556 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c013770 con 0x7f6790071890 2023-11-28T11:09:20.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f67977d1700 1 -- 172.21.15.125:0/2543422556 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679006d250 con 0x7f6790071890 2023-11-28T11:09:20.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f6785ffb700 1 -- 172.21.15.125:0/2543422556 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c013b00 con 0x7f6790071890 2023-11-28T11:09:20.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.546+0000 7f67977d1700 1 -- 172.21.15.125:0/2543422556 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679006cf70 con 0x7f6790071890 2023-11-28T11:09:20.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.547+0000 7f67977d1700 1 -- 172.21.15.125:0/2543422556 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679006d530 con 0x7f6790071890 2023-11-28T11:09:20.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.548+0000 7f6785ffb700 1 -- 172.21.15.125:0/2543422556 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f678c023070 con 0x7f6790071890 2023-11-28T11:09:20.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.548+0000 7f6785ffb700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f67740682f0 0x7f677406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.548+0000 7f6785ffb700 1 -- 172.21.15.125:0/2543422556 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f678c085900 con 0x7f6790071890 2023-11-28T11:09:20.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.548+0000 7f679556d700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f67740682f0 0x7f677406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.548+0000 7f679556d700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f67740682f0 0x7f677406a7a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6780006fd0 tx=0x7f6780008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:20.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.552+0000 7f6785ffb700 1 -- 172.21.15.125:0/2543422556 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f678c052120 con 0x7f6790071890 2023-11-28T11:09:20.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.734+0000 7f67977d1700 1 -- 172.21.15.125:0/2543422556 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67900cdae0 con 0x7f6790071890 2023-11-28T11:09:20.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.734+0000 7f6785ffb700 1 -- 172.21.15.125:0/2543422556 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f678c00f040 con 0x7f6790071890 2023-11-28T11:09:20.736 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:20.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.736+0000 7f67977d1700 1 -- 172.21.15.125:0/2543422556 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f67740682f0 msgr2=0x7f677406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.736+0000 7f67977d1700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f67740682f0 0x7f677406a7a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6780006fd0 tx=0x7f6780008040 comp rx=0 tx=0).stop 2023-11-28T11:09:20.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.736+0000 7f67977d1700 1 -- 172.21.15.125:0/2543422556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6790071890 msgr2=0x7f679015e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.736+0000 7f67977d1700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6790071890 0x7f679015e020 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f678c00e810 tx=0x7f678c00ebd0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.736+0000 7f67977d1700 1 -- 172.21.15.125:0/2543422556 shutdown_connections 2023-11-28T11:09:20.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.736+0000 7f67977d1700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f67740682f0 0x7f677406a7a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.736+0000 7f67977d1700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67900cf710 0x7f679015f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.736+0000 7f67977d1700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f679006a270 0x7f679014cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.736+0000 7f67977d1700 1 --2- 172.21.15.125:0/2543422556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6790071890 0x7f679015e020 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.736+0000 7f67977d1700 1 -- 172.21.15.125:0/2543422556 >> 172.21.15.125:0/2543422556 conn(0x7f679006c010 msgr2=0x7f67900ac8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:20.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.737+0000 7f67977d1700 1 -- 172.21.15.125:0/2543422556 shutdown_connections 2023-11-28T11:09:20.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.737+0000 7f67977d1700 1 -- 172.21.15.125:0/2543422556 wait complete. 2023-11-28T11:09:20.750 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:09:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.869+0000 7f43124a0700 1 Processor -- start 2023-11-28T11:09:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.869+0000 7f43124a0700 1 -- start start 2023-11-28T11:09:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f43124a0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f430c15fe50 0x7f430c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f43124a0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f430c0b3b80 0x7f430c160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f43124a0700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f430c0b27d0 0x7f430c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f43124a0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c0b3190 con 0x7f430c0b3b80 2023-11-28T11:09:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f43124a0700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c160220 con 0x7f430c0b27d0 2023-11-28T11:09:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f43124a0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c161370 con 0x7f430c15fe50 2023-11-28T11:09:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f430b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f430c0b3b80 0x7f430c160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f430b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f430c0b3b80 0x7f430c160ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58282/0 (socket says 172.21.15.125:58282) 2023-11-28T11:09:20.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f430bfff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f430c15fe50 0x7f430c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f430b7fe700 1 -- 172.21.15.125:0/3935191959 learned_addr learned my addr 172.21.15.125:0/3935191959 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:20.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f4310a3d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f430c0b27d0 0x7f430c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f430b7fe700 1 -- 172.21.15.125:0/3935191959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f430c15fe50 msgr2=0x7f430c06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:20.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f430b7fe700 1 --2- 172.21.15.125:0/3935191959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f430c15fe50 0x7f430c06d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f430b7fe700 1 -- 172.21.15.125:0/3935191959 >> v2:172.21.15.167:3300/0 conn(0x7f430c0b27d0 msgr2=0x7f430c0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:20.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f430b7fe700 1 --2- 172.21.15.125:0/3935191959 >> v2:172.21.15.167:3300/0 conn(0x7f430c0b27d0 0x7f430c0b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f430b7fe700 1 -- 172.21.15.125:0/3935191959 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0cf700 con 0x7f430c0b3b80 2023-11-28T11:09:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.870+0000 7f430b7fe700 1 --2- 172.21.15.125:0/3935191959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f430c0b3b80 0x7f430c160ad0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f430c0b0760 tx=0x7f42fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b566e1a01547564 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f430affd700 1 -- 172.21.15.125:0/3935191959 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc011830 con 0x7f430c0b3b80 2023-11-28T11:09:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f430affd700 1 -- 172.21.15.125:0/3935191959 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc011990 con 0x7f430c0b3b80 2023-11-28T11:09:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f430affd700 1 -- 172.21.15.125:0/3935191959 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc011d20 con 0x7f430c0b3b80 2023-11-28T11:09:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f43124a0700 1 -- 172.21.15.125:0/3935191959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f430c0b3b80 msgr2=0x7f430c160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f43124a0700 1 --2- 172.21.15.125:0/3935191959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f430c0b3b80 0x7f430c160ad0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f430c0b0760 tx=0x7f42fc009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f43124a0700 1 -- 172.21.15.125:0/3935191959 shutdown_connections 2023-11-28T11:09:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f43124a0700 1 --2- 172.21.15.125:0/3935191959 >> v2:172.21.15.167:3300/0 conn(0x7f430c0b27d0 0x7f430c0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f43124a0700 1 --2- 172.21.15.125:0/3935191959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f430c15fe50 0x7f430c06d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f43124a0700 1 --2- 172.21.15.125:0/3935191959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f430c0b3b80 0x7f430c160ad0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f43124a0700 1 -- 172.21.15.125:0/3935191959 >> 172.21.15.125:0/3935191959 conn(0x7f430c06ea80 msgr2=0x7f430c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:20.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f43124a0700 1 -- 172.21.15.125:0/3935191959 shutdown_connections 2023-11-28T11:09:20.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.871+0000 7f43124a0700 1 -- 172.21.15.125:0/3935191959 wait complete. 2023-11-28T11:09:20.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.872+0000 7f43124a0700 1 Processor -- start 2023-11-28T11:09:20.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.873+0000 7f43124a0700 1 -- start start 2023-11-28T11:09:20.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.873+0000 7f43124a0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f430c0b27d0 0x7f430c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.873+0000 7f43124a0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f430c0b3b80 0x7f430c0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.873+0000 7f43124a0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f430c15fe50 0x7f430c0ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.873+0000 7f43124a0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c15bb40 con 0x7f430c0b3b80 2023-11-28T11:09:20.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.873+0000 7f43124a0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c0af460 con 0x7f430c15fe50 2023-11-28T11:09:20.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.873+0000 7f43124a0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c0ad300 con 0x7f430c0b27d0 2023-11-28T11:09:20.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.873+0000 7f430b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f430c0b3b80 0x7f430c0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.873+0000 7f430b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f430c0b3b80 0x7f430c0ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58284/0 (socket says 172.21.15.125:58284) 2023-11-28T11:09:20.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.873+0000 7f430b7fe700 1 -- 172.21.15.125:0/26274732 learned_addr learned my addr 172.21.15.125:0/26274732 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:20.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f430bfff700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f430c0b27d0 0x7f430c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f430b7fe700 1 -- 172.21.15.125:0/26274732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f430c0b27d0 msgr2=0x7f430c15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f4310a3d700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f430c15fe50 0x7f430c0ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f430b7fe700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f430c0b27d0 0x7f430c15b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f430b7fe700 1 -- 172.21.15.125:0/26274732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f430c15fe50 msgr2=0x7f430c0ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f430b7fe700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f430c15fe50 0x7f430c0ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f430b7fe700 1 -- 172.21.15.125:0/26274732 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc009550 con 0x7f430c0b3b80 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f430b7fe700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f430c0b3b80 0x7f430c0ca520 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f42fc000c00 tx=0x7f42fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f4308ff9700 1 -- 172.21.15.125:0/26274732 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc004510 con 0x7f430c0b3b80 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f4308ff9700 1 -- 172.21.15.125:0/26274732 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc01e070 con 0x7f430c0b3b80 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f43124a0700 1 -- 172.21.15.125:0/26274732 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c0cedd0 con 0x7f430c0b3b80 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f4308ff9700 1 -- 172.21.15.125:0/26274732 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc0038a0 con 0x7f430c0b3b80 2023-11-28T11:09:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.874+0000 7f43124a0700 1 -- 172.21.15.125:0/26274732 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c0b3fd0 con 0x7f430c0b3b80 2023-11-28T11:09:20.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.875+0000 7f43124a0700 1 -- 172.21.15.125:0/26274732 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c0cf0b0 con 0x7f430c0b3b80 2023-11-28T11:09:20.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.875+0000 7f4308ff9700 1 -- 172.21.15.125:0/26274732 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f42fc00f050 con 0x7f430c0b3b80 2023-11-28T11:09:20.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.876+0000 7f4308ff9700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42ec0682f0 0x7f42ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:20.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.876+0000 7f430bfff700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42ec0682f0 0x7f42ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:20.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.876+0000 7f4308ff9700 1 -- 172.21.15.125:0/26274732 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f42fc086b80 con 0x7f430c0b3b80 2023-11-28T11:09:20.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.876+0000 7f430bfff700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42ec0682f0 0x7f42ec06a7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009990 tx=0x7f42f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:20.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:20.880+0000 7f4308ff9700 1 -- 172.21.15.125:0/26274732 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f42fc0533a0 con 0x7f430c0b3b80 2023-11-28T11:09:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.078+0000 7f43124a0700 1 -- 172.21.15.125:0/26274732 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f430c06f0b0 con 0x7f430c0b3b80 2023-11-28T11:09:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.078+0000 7f4308ff9700 1 -- 172.21.15.125:0/26274732 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f42fc015080 con 0x7f430c0b3b80 2023-11-28T11:09:21.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.080+0000 7f43124a0700 1 -- 172.21.15.125:0/26274732 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42ec0682f0 msgr2=0x7f42ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.080+0000 7f43124a0700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42ec0682f0 0x7f42ec06a7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009990 tx=0x7f42f4008040 comp rx=0 tx=0).stop 2023-11-28T11:09:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.080+0000 7f43124a0700 1 -- 172.21.15.125:0/26274732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f430c0b3b80 msgr2=0x7f430c0ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.080+0000 7f43124a0700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f430c0b3b80 0x7f430c0ca520 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f42fc000c00 tx=0x7f42fc004750 comp rx=0 tx=0).stop 2023-11-28T11:09:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.081+0000 7f43124a0700 1 -- 172.21.15.125:0/26274732 shutdown_connections 2023-11-28T11:09:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.081+0000 7f43124a0700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f430c15fe50 0x7f430c0ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.081+0000 7f43124a0700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f42ec0682f0 0x7f42ec06a7a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.081+0000 7f43124a0700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f430c0b27d0 0x7f430c15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.081+0000 7f43124a0700 1 --2- 172.21.15.125:0/26274732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f430c0b3b80 0x7f430c0ca520 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.081+0000 7f43124a0700 1 -- 172.21.15.125:0/26274732 >> 172.21.15.125:0/26274732 conn(0x7f430c06ea80 msgr2=0x7f430c15f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.081+0000 7f43124a0700 1 -- 172.21.15.125:0/26274732 shutdown_connections 2023-11-28T11:09:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.081+0000 7f43124a0700 1 -- 172.21.15.125:0/26274732 wait complete. 2023-11-28T11:09:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:09:21.094 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:09:21.095 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:21.112 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:21.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.270+0000 7f1e65ba3700 1 Processor -- start 2023-11-28T11:09:21.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.270+0000 7f1e65ba3700 1 -- start start 2023-11-28T11:09:21.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.271+0000 7f1e65ba3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e6006a270 0x7f1e6006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.271+0000 7f1e65ba3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e60070d90 0x7f1e600711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.271+0000 7f1e65ba3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e60151a50 con 0x7f1e6006da40 2023-11-28T11:09:21.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.271+0000 7f1e65ba3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6015f0c0 con 0x7f1e6006a270 2023-11-28T11:09:21.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.271+0000 7f1e65ba3700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6015b440 con 0x7f1e60070d90 2023-11-28T11:09:21.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.271+0000 7f1e5f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e6006a270 0x7f1e6006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.271+0000 7f1e5ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1e6006da40 0x7f1e6006de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42416/0 (socket says 172.21.15.125:42416) 2023-11-28T11:09:21.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.271+0000 7f1e5ffff700 1 -- 172.21.15.125:0/1074957767 learned_addr learned my addr 172.21.15.125:0/1074957767 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:21.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.271+0000 7f1e5effd700 1 --2- 172.21.15.125:0/1074957767 >> v2:172.21.15.167:3300/0 conn(0x7f1e60070d90 0x7f1e600711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e5f7fe700 1 -- 172.21.15.125:0/1074957767 >> v2:172.21.15.167:3300/0 conn(0x7f1e60070d90 msgr2=0x7f1e600711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:21.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e5f7fe700 1 --2- 172.21.15.125:0/1074957767 >> v2:172.21.15.167:3300/0 conn(0x7f1e60070d90 0x7f1e600711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e5f7fe700 1 -- 172.21.15.125:0/1074957767 >> v1:172.21.15.125:6789/0 conn(0x7f1e6006da40 legacy=0x7f1e6006de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e5e7fc700 1 -- 172.21.15.125:0/1074957767 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653653755 0 0) 0x7f1e60151a50 con 0x7f1e6006da40 2023-11-28T11:09:21.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e5f7fe700 1 -- 172.21.15.125:0/1074957767 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6006ab80 con 0x7f1e6006a270 2023-11-28T11:09:21.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e5effd700 1 --2- 172.21.15.125:0/1074957767 >> v2:172.21.15.167:3300/0 conn(0x7f1e60070d90 0x7f1e600711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:21.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e5f7fe700 1 --2- 172.21.15.125:0/1074957767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6006a270 0x7f1e6006a640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e600cd4f0 tx=0x7f1e54009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cc9838b5098277 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:21.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e5e7fc700 1 -- 172.21.15.125:0/1074957767 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54011830 con 0x7f1e6006a270 2023-11-28T11:09:21.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e5e7fc700 1 -- 172.21.15.125:0/1074957767 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e54011990 con 0x7f1e6006a270 2023-11-28T11:09:21.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e5e7fc700 1 -- 172.21.15.125:0/1074957767 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54011d20 con 0x7f1e6006a270 2023-11-28T11:09:21.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e65ba3700 1 -- 172.21.15.125:0/1074957767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6006a270 msgr2=0x7f1e6006a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e65ba3700 1 --2- 172.21.15.125:0/1074957767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6006a270 0x7f1e6006a640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e600cd4f0 tx=0x7f1e54009b20 comp rx=0 tx=0).stop 2023-11-28T11:09:21.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e65ba3700 1 -- 172.21.15.125:0/1074957767 shutdown_connections 2023-11-28T11:09:21.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e65ba3700 1 --2- 172.21.15.125:0/1074957767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6006a270 0x7f1e6006a640 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e65ba3700 1 --2- 172.21.15.125:0/1074957767 >> v2:172.21.15.167:3300/0 conn(0x7f1e60070d90 0x7f1e600711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e65ba3700 1 -- 172.21.15.125:0/1074957767 >> 172.21.15.125:0/1074957767 conn(0x7f1e6006c010 msgr2=0x7f1e600cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:21.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e65ba3700 1 -- 172.21.15.125:0/1074957767 shutdown_connections 2023-11-28T11:09:21.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.272+0000 7f1e65ba3700 1 -- 172.21.15.125:0/1074957767 wait complete. 2023-11-28T11:09:21.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.274+0000 7f1e65ba3700 1 Processor -- start 2023-11-28T11:09:21.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.274+0000 7f1e65ba3700 1 -- start start 2023-11-28T11:09:21.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.274+0000 7f1e65ba3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6006a270 0x7f1e60150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.274+0000 7f1e65ba3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6006da40 0x7f1e601545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.274+0000 7f1e65ba3700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e60070d90 0x7f1e60154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.274+0000 7f1e65ba3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600c6e60 con 0x7f1e6006a270 2023-11-28T11:09:21.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.274+0000 7f1e65ba3700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e601e57e0 con 0x7f1e60070d90 2023-11-28T11:09:21.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.274+0000 7f1e65ba3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e601e5ac0 con 0x7f1e6006da40 2023-11-28T11:09:21.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6006a270 0x7f1e60150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6006a270 0x7f1e60150b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58298/0 (socket says 172.21.15.125:58298) 2023-11-28T11:09:21.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5f7fe700 1 -- 172.21.15.125:0/3464476297 learned_addr learned my addr 172.21.15.125:0/3464476297 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:21.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5ffff700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e60070d90 0x7f1e60154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5effd700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6006da40 0x7f1e601545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5f7fe700 1 -- 172.21.15.125:0/3464476297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6006da40 msgr2=0x7f1e601545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5f7fe700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6006da40 0x7f1e601545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5f7fe700 1 -- 172.21.15.125:0/3464476297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e60070d90 msgr2=0x7f1e60154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5f7fe700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e60070d90 0x7f1e60154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5f7fe700 1 -- 172.21.15.125:0/3464476297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540094a0 con 0x7f1e6006a270 2023-11-28T11:09:21.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5effd700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6006da40 0x7f1e601545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:21.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e5f7fe700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6006a270 0x7f1e60150b20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1e54000c00 tx=0x7f1e54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:21.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e47fff700 1 -- 172.21.15.125:0/3464476297 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540038a0 con 0x7f1e6006a270 2023-11-28T11:09:21.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e47fff700 1 -- 172.21.15.125:0/3464476297 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5401f070 con 0x7f1e6006a270 2023-11-28T11:09:21.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e47fff700 1 -- 172.21.15.125:0/3464476297 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54003c40 con 0x7f1e6006a270 2023-11-28T11:09:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e65ba3700 1 -- 172.21.15.125:0/3464476297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6015adf0 con 0x7f1e6006a270 2023-11-28T11:09:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.275+0000 7f1e65ba3700 1 -- 172.21.15.125:0/3464476297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e60071ac0 con 0x7f1e6006a270 2023-11-28T11:09:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.276+0000 7f1e65ba3700 1 -- 172.21.15.125:0/3464476297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6015b0d0 con 0x7f1e6006a270 2023-11-28T11:09:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.276+0000 7f1e47fff700 1 -- 172.21.15.125:0/3464476297 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1e5400f050 con 0x7f1e6006a270 2023-11-28T11:09:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.277+0000 7f1e47fff700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e4c0682f0 0x7f1e4c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.277+0000 7f1e47fff700 1 -- 172.21.15.125:0/3464476297 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1e54021070 con 0x7f1e6006a270 2023-11-28T11:09:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.277+0000 7f1e5effd700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e4c0682f0 0x7f1e4c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.277+0000 7f1e5effd700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e4c0682f0 0x7f1e4c06a7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1e60154390 tx=0x7f1e50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:21.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.281+0000 7f1e47fff700 1 -- 172.21.15.125:0/3464476297 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1e54053f90 con 0x7f1e6006a270 2023-11-28T11:09:21.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.464+0000 7f1e65ba3700 1 -- 172.21.15.125:0/3464476297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e6006c4b0 con 0x7f1e6006a270 2023-11-28T11:09:21.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.465+0000 7f1e47fff700 1 -- 172.21.15.125:0/3464476297 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7f1e54015090 con 0x7f1e6006a270 2023-11-28T11:09:21.467 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:21.467 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":26,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:19.047682+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:21.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 -- 172.21.15.125:0/3464476297 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e4c0682f0 msgr2=0x7f1e4c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e4c0682f0 0x7f1e4c06a7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1e60154390 tx=0x7f1e50008040 comp rx=0 tx=0).stop 2023-11-28T11:09:21.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 -- 172.21.15.125:0/3464476297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6006a270 msgr2=0x7f1e60150b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6006a270 0x7f1e60150b20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1e54000c00 tx=0x7f1e54004750 comp rx=0 tx=0).stop 2023-11-28T11:09:21.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 -- 172.21.15.125:0/3464476297 shutdown_connections 2023-11-28T11:09:21.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e60070d90 0x7f1e60154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6006a270 0x7f1e60150b20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e4c0682f0 0x7f1e4c06a7a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 --2- 172.21.15.125:0/3464476297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6006da40 0x7f1e601545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 -- 172.21.15.125:0/3464476297 >> 172.21.15.125:0/3464476297 conn(0x7f1e6006c010 msgr2=0x7f1e6006de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:21.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 -- 172.21.15.125:0/3464476297 shutdown_connections 2023-11-28T11:09:21.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.467+0000 7f1e65ba3700 1 -- 172.21.15.125:0/3464476297 wait complete. 2023-11-28T11:09:21.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:21.481 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:21.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.602+0000 7f459922f700 1 Processor -- start 2023-11-28T11:09:21.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.602+0000 7f459922f700 1 -- start start 2023-11-28T11:09:21.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f459922f700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4594070370 0x7f45940cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f459922f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940c9a50 0x7f45940c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f459922f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459406a310 con 0x7f4594159710 2023-11-28T11:09:21.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f459922f700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45940707f0 con 0x7f4594070370 2023-11-28T11:09:21.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f459922f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45940ca410 con 0x7f45940c9a50 2023-11-28T11:09:21.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f4592d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4594159710 0x7f45940cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42430/0 (socket says 172.21.15.125:42430) 2023-11-28T11:09:21.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f4592d9d700 1 -- 172.21.15.125:0/1751891080 learned_addr learned my addr 172.21.15.125:0/1751891080 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:21.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f459359e700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940c9a50 0x7f45940c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560400835 0 0) 0x7f459406a310 con 0x7f4594159710 2023-11-28T11:09:21.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f457c0057c0 con 0x7f4594159710 2023-11-28T11:09:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f459259c700 1 --2- 172.21.15.125:0/1751891080 >> v2:172.21.15.167:3300/0 conn(0x7f4594070370 0x7f45940cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59120586 0 0) 0x7f457c0057c0 con 0x7f4594159710 2023-11-28T11:09:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940c9a50 msgr2=0x7f45940c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.603+0000 7f4591d9b700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940c9a50 0x7f45940c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 >> v2:172.21.15.167:3300/0 conn(0x7f4594070370 msgr2=0x7f45940cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 --2- 172.21.15.125:0/1751891080 >> v2:172.21.15.167:3300/0 conn(0x7f4594070370 0x7f45940cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45940ce7e0 con 0x7f4594159710 2023-11-28T11:09:21.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f4588001670 con 0x7f4594159710 2023-11-28T11:09:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 >> v1:172.21.15.125:6789/0 conn(0x7f4594159710 legacy=0x7f45940cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940c9a50 0x7f457c005c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f457c006190 0x7f457c006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f457c006fa0 0x7f457c007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940707f0 con 0x7f457c006fa0 2023-11-28T11:09:21.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940ca410 con 0x7f457c006190 2023-11-28T11:09:21.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c00dc50 con 0x7f45940c9a50 2023-11-28T11:09:21.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f459359e700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f457c006fa0 0x7f457c007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4592d9d700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940c9a50 0x7f457c005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f459259c700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f457c006190 0x7f457c006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f459359e700 1 -- 172.21.15.125:0/1751891080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940c9a50 msgr2=0x7f457c005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:21.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f459359e700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940c9a50 0x7f457c005c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f459359e700 1 -- 172.21.15.125:0/1751891080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f457c006190 msgr2=0x7f457c006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f459359e700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f457c006190 0x7f457c006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f459359e700 1 -- 172.21.15.125:0/1751891080 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c0057c0 con 0x7f457c006fa0 2023-11-28T11:09:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f459359e700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f457c006fa0 0x7f457c007410 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f458c009fc0 tx=0x7f457c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b85b4267fd67692 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c00ec30 con 0x7f457c006fa0 2023-11-28T11:09:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c00f040 con 0x7f457c006fa0 2023-11-28T11:09:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.604+0000 7f4591d9b700 1 -- 172.21.15.125:0/1751891080 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c014480 con 0x7f457c006fa0 2023-11-28T11:09:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.605+0000 7f459922f700 1 -- 172.21.15.125:0/1751891080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f457c006fa0 msgr2=0x7f457c007410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.605+0000 7f459922f700 1 --2- 172.21.15.125:0/1751891080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f457c006fa0 0x7f457c007410 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f458c009fc0 tx=0x7f457c007a90 comp rx=0 tx=0).stop 2023-11-28T11:09:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.605+0000 7f459359e700 1 -- 172.21.15.125:0/1751891080 reap_dead start 2023-11-28T11:09:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.605+0000 7f459922f700 1 -- 172.21.15.125:0/1751891080 shutdown_connections 2023-11-28T11:09:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.605+0000 7f459922f700 1 -- 172.21.15.125:0/1751891080 >> 172.21.15.125:0/1751891080 conn(0x7f45940cf400 msgr2=0x7f45940cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.605+0000 7f459922f700 1 -- 172.21.15.125:0/1751891080 shutdown_connections 2023-11-28T11:09:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.605+0000 7f459922f700 1 -- 172.21.15.125:0/1751891080 wait complete. 2023-11-28T11:09:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.606+0000 7f459922f700 1 Processor -- start 2023-11-28T11:09:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.606+0000 7f459922f700 1 -- start start 2023-11-28T11:09:21.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459922f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45940c8e00 0x7f45941ee930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459922f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b4260 0x7f45940b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459922f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594156020 0x7f4594156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459922f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940b4c10 con 0x7f4594156020 2023-11-28T11:09:21.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459922f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941eee70 con 0x7f45940c8e00 2023-11-28T11:09:21.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459922f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45940c32d0 con 0x7f45940b4260 2023-11-28T11:09:21.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594156020 0x7f4594156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594156020 0x7f4594156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58320/0 (socket says 172.21.15.125:58320) 2023-11-28T11:09:21.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459359e700 1 -- 172.21.15.125:0/854594360 learned_addr learned my addr 172.21.15.125:0/854594360 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:21.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459259c700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b4260 0x7f45940b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f4592d9d700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45940c8e00 0x7f45941ee930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459359e700 1 -- 172.21.15.125:0/854594360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b4260 msgr2=0x7f45940b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459359e700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b4260 0x7f45940b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459359e700 1 -- 172.21.15.125:0/854594360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45940c8e00 msgr2=0x7f45941ee930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.607+0000 7f459359e700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45940c8e00 0x7f45941ee930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.608+0000 7f459359e700 1 -- 172.21.15.125:0/854594360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459406a890 con 0x7f4594156020 2023-11-28T11:09:21.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.608+0000 7f459359e700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594156020 0x7f4594156490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f457c006970 tx=0x7f458c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:21.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.608+0000 7f457b7fe700 1 -- 172.21.15.125:0/854594360 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c007000 con 0x7f4594156020 2023-11-28T11:09:21.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.608+0000 7f457b7fe700 1 -- 172.21.15.125:0/854594360 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c022070 con 0x7f4594156020 2023-11-28T11:09:21.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.608+0000 7f459922f700 1 -- 172.21.15.125:0/854594360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459406a5b0 con 0x7f4594156020 2023-11-28T11:09:21.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.608+0000 7f457b7fe700 1 -- 172.21.15.125:0/854594360 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c029480 con 0x7f4594156020 2023-11-28T11:09:21.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.608+0000 7f459922f700 1 -- 172.21.15.125:0/854594360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45940ceac0 con 0x7f4594156020 2023-11-28T11:09:21.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.609+0000 7f459922f700 1 -- 172.21.15.125:0/854594360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4594159ae0 con 0x7f4594156020 2023-11-28T11:09:21.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.609+0000 7f457b7fe700 1 -- 172.21.15.125:0/854594360 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f458c01e430 con 0x7f4594156020 2023-11-28T11:09:21.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.610+0000 7f457b7fe700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45800682f0 0x7f458006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.610+0000 7f457b7fe700 1 -- 172.21.15.125:0/854594360 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f458c024070 con 0x7f4594156020 2023-11-28T11:09:21.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.610+0000 7f4592d9d700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45800682f0 0x7f458006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.610+0000 7f4592d9d700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45800682f0 0x7f458006a7a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45880048d0 tx=0x7f4588009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:21.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.614+0000 7f457b7fe700 1 -- 172.21.15.125:0/854594360 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f458c0547c0 con 0x7f4594156020 2023-11-28T11:09:21.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.799+0000 7f459922f700 1 -- 172.21.15.125:0/854594360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45940743f0 con 0x7f4594156020 2023-11-28T11:09:21.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.799+0000 7f457b7fe700 1 -- 172.21.15.125:0/854594360 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f458c057de0 con 0x7f4594156020 2023-11-28T11:09:21.801 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:21.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.801+0000 7f459922f700 1 -- 172.21.15.125:0/854594360 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45800682f0 msgr2=0x7f458006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.801+0000 7f459922f700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45800682f0 0x7f458006a7a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45880048d0 tx=0x7f4588009040 comp rx=0 tx=0).stop 2023-11-28T11:09:21.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.801+0000 7f459922f700 1 -- 172.21.15.125:0/854594360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594156020 msgr2=0x7f4594156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.801+0000 7f459922f700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594156020 0x7f4594156490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f457c006970 tx=0x7f458c009750 comp rx=0 tx=0).stop 2023-11-28T11:09:21.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.802+0000 7f459922f700 1 -- 172.21.15.125:0/854594360 shutdown_connections 2023-11-28T11:09:21.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.802+0000 7f459922f700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594156020 0x7f4594156490 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.802+0000 7f459922f700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45940c8e00 0x7f45941ee930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.802+0000 7f459922f700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45800682f0 0x7f458006a7a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.802+0000 7f459922f700 1 --2- 172.21.15.125:0/854594360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45940b4260 0x7f45940b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.802+0000 7f459922f700 1 -- 172.21.15.125:0/854594360 >> 172.21.15.125:0/854594360 conn(0x7f45940cf400 msgr2=0x7f45940cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:21.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.802+0000 7f459922f700 1 -- 172.21.15.125:0/854594360 shutdown_connections 2023-11-28T11:09:21.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.802+0000 7f459922f700 1 -- 172.21.15.125:0/854594360 wait complete. 2023-11-28T11:09:21.816 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:21.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.939+0000 7fa2ede4d700 1 Processor -- start 2023-11-28T11:09:21.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.939+0000 7fa2ede4d700 1 -- start start 2023-11-28T11:09:21.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.940+0000 7fa2ede4d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2e8158980 0x7fa2e80ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.940+0000 7fa2ede4d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2e80ccda0 0x7fa2e806b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.940+0000 7fa2ede4d700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e80cdf00 con 0x7fa2e8158d50 2023-11-28T11:09:21.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.940+0000 7fa2ede4d700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e806d170 con 0x7fa2e8158980 2023-11-28T11:09:21.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.940+0000 7fa2ede4d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80ce8d0 con 0x7fa2e80ccda0 2023-11-28T11:09:21.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.940+0000 7fa2e77fe700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2e8158980 0x7fa2e80ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.940+0000 7fa2e7fff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2e80ccda0 0x7fa2e806b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.940+0000 7fa2e77fe700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2e8158980 0x7fa2e80ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:55054/0 (socket says 172.21.15.125:55054) 2023-11-28T11:09:21.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.940+0000 7fa2deffd700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa2e8158d50 0x7fa2e80cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:45250/0 (socket says 172.21.15.125:45250) 2023-11-28T11:09:21.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.940+0000 7fa2e77fe700 1 -- 172.21.15.125:0/2856608065 learned_addr learned my addr 172.21.15.125:0/2856608065 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:21.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.941+0000 7fa2e77fe700 1 -- 172.21.15.125:0/2856608065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2e80ccda0 msgr2=0x7fa2e806b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:21.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.941+0000 7fa2e77fe700 1 --2- 172.21.15.125:0/2856608065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2e80ccda0 0x7fa2e806b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.941+0000 7fa2e77fe700 1 -- 172.21.15.125:0/2856608065 >> v1:172.21.15.167:6789/0 conn(0x7fa2e8158d50 legacy=0x7fa2e80cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.941+0000 7fa2e77fe700 1 -- 172.21.15.125:0/2856608065 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80c9110 con 0x7fa2e8158980 2023-11-28T11:09:21.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.941+0000 7fa2e7fff700 1 --2- 172.21.15.125:0/2856608065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2e80ccda0 0x7fa2e806b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:21.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.941+0000 7fa2e77fe700 1 --2- 172.21.15.125:0/2856608065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e8158980 0x7fa2e80ce390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800aa90 tx=0x7fa2d800ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba124bc9a6151272 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:21.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.941+0000 7fa2e6ffd700 1 -- 172.21.15.125:0/2856608065 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800cb70 con 0x7fa2e8158980 2023-11-28T11:09:21.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.941+0000 7fa2e6ffd700 1 -- 172.21.15.125:0/2856608065 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d800ccd0 con 0x7fa2e8158980 2023-11-28T11:09:21.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.941+0000 7fa2e6ffd700 1 -- 172.21.15.125:0/2856608065 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8018620 con 0x7fa2e8158980 2023-11-28T11:09:21.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.942+0000 7fa2ede4d700 1 -- 172.21.15.125:0/2856608065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e8158980 msgr2=0x7fa2e80ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.942+0000 7fa2ede4d700 1 --2- 172.21.15.125:0/2856608065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e8158980 0x7fa2e80ce390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800aa90 tx=0x7fa2d800ada0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.942+0000 7fa2ede4d700 1 -- 172.21.15.125:0/2856608065 shutdown_connections 2023-11-28T11:09:21.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.942+0000 7fa2ede4d700 1 --2- 172.21.15.125:0/2856608065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e8158980 0x7fa2e80ce390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.942+0000 7fa2ede4d700 1 --2- 172.21.15.125:0/2856608065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2e80ccda0 0x7fa2e806b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.942+0000 7fa2ede4d700 1 -- 172.21.15.125:0/2856608065 >> 172.21.15.125:0/2856608065 conn(0x7fa2e80cb540 msgr2=0x7fa2e80cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:21.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.942+0000 7fa2ede4d700 1 -- 172.21.15.125:0/2856608065 shutdown_connections 2023-11-28T11:09:21.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.942+0000 7fa2ede4d700 1 -- 172.21.15.125:0/2856608065 wait complete. 2023-11-28T11:09:21.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.943+0000 7fa2ede4d700 1 Processor -- start 2023-11-28T11:09:21.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.943+0000 7fa2ede4d700 1 -- start start 2023-11-28T11:09:21.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2ede4d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2e80ccda0 0x7fa2e80b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2ede4d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e8158980 0x7fa2e8159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2ede4d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2e8158d50 0x7fa2e81ee010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2ede4d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e81f15f0 con 0x7fa2e8158d50 2023-11-28T11:09:21.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2ede4d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e8159f80 con 0x7fa2e8158980 2023-11-28T11:09:21.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2ede4d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80b18f0 con 0x7fa2e80ccda0 2023-11-28T11:09:21.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2e7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2e8158d50 0x7fa2e81ee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2e7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2e8158d50 0x7fa2e81ee010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58334/0 (socket says 172.21.15.125:58334) 2023-11-28T11:09:21.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2e7fff700 1 -- 172.21.15.125:0/155562550 learned_addr learned my addr 172.21.15.125:0/155562550 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:21.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2e77fe700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2e80ccda0 0x7fa2e80b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2deffd700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e8158980 0x7fa2e8159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2e7fff700 1 -- 172.21.15.125:0/155562550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2e80ccda0 msgr2=0x7fa2e80b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2e7fff700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2e80ccda0 0x7fa2e80b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2e7fff700 1 -- 172.21.15.125:0/155562550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e8158980 msgr2=0x7fa2e8159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:21.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2e7fff700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e8158980 0x7fa2e8159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:21.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2e7fff700 1 -- 172.21.15.125:0/155562550 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e0009a70 con 0x7fa2e8158d50 2023-11-28T11:09:21.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.944+0000 7fa2e7fff700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2e8158d50 0x7fa2e81ee010 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000ef90 tx=0x7fa2e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:21.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.945+0000 7fa2e4ff9700 1 -- 172.21.15.125:0/155562550 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0009d70 con 0x7fa2e8158d50 2023-11-28T11:09:21.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.945+0000 7fa2e4ff9700 1 -- 172.21.15.125:0/155562550 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e000f040 con 0x7fa2e8158d50 2023-11-28T11:09:21.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.945+0000 7fa2ede4d700 1 -- 172.21.15.125:0/155562550 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d800a6f0 con 0x7fa2e8158d50 2023-11-28T11:09:21.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.945+0000 7fa2e4ff9700 1 -- 172.21.15.125:0/155562550 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0014480 con 0x7fa2e8158d50 2023-11-28T11:09:21.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.945+0000 7fa2ede4d700 1 -- 172.21.15.125:0/155562550 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e80cd8b0 con 0x7fa2e8158d50 2023-11-28T11:09:21.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.945+0000 7fa2ede4d700 1 -- 172.21.15.125:0/155562550 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e80c93f0 con 0x7fa2e8158d50 2023-11-28T11:09:21.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.946+0000 7fa2e4ff9700 1 -- 172.21.15.125:0/155562550 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa2e00145e0 con 0x7fa2e8158d50 2023-11-28T11:09:21.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.946+0000 7fa2e4ff9700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa2c8068320 0x7fa2c806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:21.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.946+0000 7fa2e4ff9700 1 -- 172.21.15.125:0/155562550 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa2e0086bb0 con 0x7fa2e8158d50 2023-11-28T11:09:21.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.946+0000 7fa2e77fe700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa2c8068320 0x7fa2c806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:21.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.947+0000 7fa2e77fe700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa2c8068320 0x7fa2c806a7d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800ade0 tx=0x7fa2d8012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:21.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:21.951+0000 7fa2e4ff9700 1 -- 172.21.15.125:0/155562550 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa2e008d080 con 0x7fa2e8158d50 2023-11-28T11:09:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.130+0000 7fa2ede4d700 1 -- 172.21.15.125:0/155562550 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa2e80cdb90 con 0x7fa2e8158d50 2023-11-28T11:09:22.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.131+0000 7fa2e4ff9700 1 -- 172.21.15.125:0/155562550 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa2e0018020 con 0x7fa2e8158d50 2023-11-28T11:09:22.132 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:22.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 -- 172.21.15.125:0/155562550 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa2c8068320 msgr2=0x7fa2c806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa2c8068320 0x7fa2c806a7d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800ade0 tx=0x7fa2d8012000 comp rx=0 tx=0).stop 2023-11-28T11:09:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 -- 172.21.15.125:0/155562550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2e8158d50 msgr2=0x7fa2e81ee010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2e8158d50 0x7fa2e81ee010 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000ef90 tx=0x7fa2e000c3a0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 -- 172.21.15.125:0/155562550 shutdown_connections 2023-11-28T11:09:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2e8158d50 0x7fa2e81ee010 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa2c8068320 0x7fa2c806a7d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2e80ccda0 0x7fa2e80b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 --2- 172.21.15.125:0/155562550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e8158980 0x7fa2e8159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 -- 172.21.15.125:0/155562550 >> 172.21.15.125:0/155562550 conn(0x7fa2e80cb540 msgr2=0x7fa2e806f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:22.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 -- 172.21.15.125:0/155562550 shutdown_connections 2023-11-28T11:09:22.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.133+0000 7fa2ede4d700 1 -- 172.21.15.125:0/155562550 wait complete. 2023-11-28T11:09:22.147 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:22.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.269+0000 7f85f23e3700 1 Processor -- start 2023-11-28T11:09:22.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.269+0000 7f85f23e3700 1 -- start start 2023-11-28T11:09:22.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.269+0000 7f85f23e3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f85ec0718e0 0x7f85ec06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.269+0000 7f85f23e3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ec160a50 con 0x7f85ec15c810 2023-11-28T11:09:22.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.269+0000 7f85f23e3700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ec160d30 con 0x7f85ec06cdc0 2023-11-28T11:09:22.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.269+0000 7f85f23e3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec15cbe0 con 0x7f85ec0718e0 2023-11-28T11:09:22.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85eb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f85ec0718e0 0x7f85ec06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85eb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f85ec0718e0 0x7f85ec06c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58340/0 (socket says 172.21.15.125:58340) 2023-11-28T11:09:22.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85eb7fe700 1 -- 172.21.15.125:0/3081676459 learned_addr learned my addr 172.21.15.125:0/3081676459 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:22.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85ebfff700 1 --1- 172.21.15.125:0/3081676459 >> v1:172.21.15.125:6789/0 conn(0x7f85ec15c810 0x7f85ec160260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42462/0 (socket says 172.21.15.125:42462) 2023-11-28T11:09:22.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85eb7fe700 1 -- 172.21.15.125:0/3081676459 >> v1:172.21.15.167:6789/0 conn(0x7f85ec06cdc0 legacy=0x7f85ec06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:22.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85eb7fe700 1 -- 172.21.15.125:0/3081676459 >> v1:172.21.15.125:6789/0 conn(0x7f85ec15c810 legacy=0x7f85ec160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85eb7fe700 1 -- 172.21.15.125:0/3081676459 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec161010 con 0x7f85ec0718e0 2023-11-28T11:09:22.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85eaffd700 1 -- 172.21.15.125:0/3081676459 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009534109 0 0) 0x7f85ec160a50 con 0x7f85ec15c810 2023-11-28T11:09:22.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85eb7fe700 1 --2- 172.21.15.125:0/3081676459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85ec0718e0 0x7f85ec06c880 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009920 tx=0x7f85e0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cb2d48fce8bc30 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:22.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85eaffd700 1 -- 172.21.15.125:0/3081676459 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0004230 con 0x7f85ec0718e0 2023-11-28T11:09:22.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85eaffd700 1 -- 172.21.15.125:0/3081676459 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0004390 con 0x7f85ec0718e0 2023-11-28T11:09:22.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.270+0000 7f85eaffd700 1 -- 172.21.15.125:0/3081676459 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0009e70 con 0x7f85ec0718e0 2023-11-28T11:09:22.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.271+0000 7f85f23e3700 1 -- 172.21.15.125:0/3081676459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85ec0718e0 msgr2=0x7f85ec06c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.271+0000 7f85f23e3700 1 --2- 172.21.15.125:0/3081676459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85ec0718e0 0x7f85ec06c880 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009920 tx=0x7f85e0009c30 comp rx=0 tx=0).stop 2023-11-28T11:09:22.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.271+0000 7f85f23e3700 1 -- 172.21.15.125:0/3081676459 shutdown_connections 2023-11-28T11:09:22.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.271+0000 7f85f23e3700 1 --2- 172.21.15.125:0/3081676459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85ec0718e0 0x7f85ec06c880 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.271+0000 7f85f23e3700 1 -- 172.21.15.125:0/3081676459 >> 172.21.15.125:0/3081676459 conn(0x7f85ec06c010 msgr2=0x7f85ec0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:22.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.271+0000 7f85f23e3700 1 -- 172.21.15.125:0/3081676459 shutdown_connections 2023-11-28T11:09:22.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.271+0000 7f85f23e3700 1 -- 172.21.15.125:0/3081676459 wait complete. 2023-11-28T11:09:22.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.272+0000 7f85f23e3700 1 Processor -- start 2023-11-28T11:09:22.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.272+0000 7f85f23e3700 1 -- start start 2023-11-28T11:09:22.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85f23e3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85ec06cdc0 0x7f85ec1f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85f23e3700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85ec0718e0 0x7f85ec0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85f23e3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85ec15c810 0x7f85ec0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85f23e3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec1f1f10 con 0x7f85ec06cdc0 2023-11-28T11:09:22.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85f23e3700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0b3370 con 0x7f85ec0718e0 2023-11-28T11:09:22.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85f23e3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0c7750 con 0x7f85ec15c810 2023-11-28T11:09:22.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85ebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85ec06cdc0 0x7f85ec1f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85ebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85ec06cdc0 0x7f85ec1f19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58344/0 (socket says 172.21.15.125:58344) 2023-11-28T11:09:22.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85ebfff700 1 -- 172.21.15.125:0/3562034404 learned_addr learned my addr 172.21.15.125:0/3562034404 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:22.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85eb7fe700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85ec0718e0 0x7f85ec0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85f0980700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85ec15c810 0x7f85ec0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85ebfff700 1 -- 172.21.15.125:0/3562034404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85ec15c810 msgr2=0x7f85ec0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85ebfff700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85ec15c810 0x7f85ec0cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85ebfff700 1 -- 172.21.15.125:0/3562034404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85ec0718e0 msgr2=0x7f85ec0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85ebfff700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85ec0718e0 0x7f85ec0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85ebfff700 1 -- 172.21.15.125:0/3562034404 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0009550 con 0x7f85ec06cdc0 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85eb7fe700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85ec0718e0 0x7f85ec0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.273+0000 7f85ebfff700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85ec06cdc0 0x7f85ec1f19d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00c580 tx=0x7f85dc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.274+0000 7f85e8ff9700 1 -- 172.21.15.125:0/3562034404 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc004c80 con 0x7f85ec06cdc0 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.274+0000 7f85e8ff9700 1 -- 172.21.15.125:0/3562034404 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc004e00 con 0x7f85ec06cdc0 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.274+0000 7f85f23e3700 1 -- 172.21.15.125:0/3562034404 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec0ce740 con 0x7f85ec06cdc0 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.274+0000 7f85e8ff9700 1 -- 172.21.15.125:0/3562034404 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc007310 con 0x7f85ec06cdc0 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.274+0000 7f85f23e3700 1 -- 172.21.15.125:0/3562034404 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec0ceb20 con 0x7f85ec06cdc0 2023-11-28T11:09:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.275+0000 7f85f23e3700 1 -- 172.21.15.125:0/3562034404 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec0ce8d0 con 0x7f85ec06cdc0 2023-11-28T11:09:22.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.275+0000 7f85e8ff9700 1 -- 172.21.15.125:0/3562034404 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f85dc01a020 con 0x7f85ec06cdc0 2023-11-28T11:09:22.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.275+0000 7f85e8ff9700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f85d80682f0 0x7f85d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.276+0000 7f85e8ff9700 1 -- 172.21.15.125:0/3562034404 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f85dc085880 con 0x7f85ec06cdc0 2023-11-28T11:09:22.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.276+0000 7f85eb7fe700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f85d80682f0 0x7f85d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.276+0000 7f85eb7fe700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f85d80682f0 0x7f85d806a7a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009130 tx=0x7f85e0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:22.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.280+0000 7f85e8ff9700 1 -- 172.21.15.125:0/3562034404 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f85dc0520a0 con 0x7f85ec06cdc0 2023-11-28T11:09:22.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.463+0000 7f85f23e3700 1 -- 172.21.15.125:0/3562034404 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85ec0cf930 con 0x7f85ec06cdc0 2023-11-28T11:09:22.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.464+0000 7f85e8ff9700 1 -- 172.21.15.125:0/3562034404 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85dc0556c0 con 0x7f85ec06cdc0 2023-11-28T11:09:22.466 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:22.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 -- 172.21.15.125:0/3562034404 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f85d80682f0 msgr2=0x7f85d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f85d80682f0 0x7f85d806a7a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009130 tx=0x7f85e0008030 comp rx=0 tx=0).stop 2023-11-28T11:09:22.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 -- 172.21.15.125:0/3562034404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85ec06cdc0 msgr2=0x7f85ec1f19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85ec06cdc0 0x7f85ec1f19d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00c580 tx=0x7f85dc00c940 comp rx=0 tx=0).stop 2023-11-28T11:09:22.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 -- 172.21.15.125:0/3562034404 shutdown_connections 2023-11-28T11:09:22.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f85d80682f0 0x7f85d806a7a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85ec15c810 0x7f85ec0cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85ec06cdc0 0x7f85ec1f19d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 --2- 172.21.15.125:0/3562034404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85ec0718e0 0x7f85ec0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 -- 172.21.15.125:0/3562034404 >> 172.21.15.125:0/3562034404 conn(0x7f85ec06c010 msgr2=0x7f85ec0d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:22.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 -- 172.21.15.125:0/3562034404 shutdown_connections 2023-11-28T11:09:22.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.466+0000 7f85f23e3700 1 -- 172.21.15.125:0/3562034404 wait complete. 2023-11-28T11:09:22.480 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:22.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.600+0000 7f06e7498700 1 Processor -- start 2023-11-28T11:09:22.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.600+0000 7f06e7498700 1 -- start start 2023-11-28T11:09:22.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.601+0000 7f06e7498700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06e015c810 0x7f06e0160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.601+0000 7f06e7498700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f06e006a270 0x7f06e006a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.601+0000 7f06e7498700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e006abb0 con 0x7f06e00718e0 2023-11-28T11:09:22.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.601+0000 7f06e7498700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e015cbe0 con 0x7f06e015c810 2023-11-28T11:09:22.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.601+0000 7f06e7498700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e01607a0 con 0x7f06e006a270 2023-11-28T11:09:22.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06e5234700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06e015c810 0x7f06e0160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06e5234700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06e015c810 0x7f06e0160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58354/0 (socket says 172.21.15.125:58354) 2023-11-28T11:09:22.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06e4a33700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f06e00718e0 0x7f06e006c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42476/0 (socket says 172.21.15.125:42476) 2023-11-28T11:09:22.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06e5234700 1 -- 172.21.15.125:0/4192043165 learned_addr learned my addr 172.21.15.125:0/4192043165 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:22.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06e5a35700 1 --2- 172.21.15.125:0/4192043165 >> v2:172.21.15.167:3300/0 conn(0x7f06e006a270 0x7f06e006a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06e5234700 1 -- 172.21.15.125:0/4192043165 >> v2:172.21.15.167:3300/0 conn(0x7f06e006a270 msgr2=0x7f06e006a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:22.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06e5234700 1 --2- 172.21.15.125:0/4192043165 >> v2:172.21.15.167:3300/0 conn(0x7f06e006a270 0x7f06e006a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06e5234700 1 -- 172.21.15.125:0/4192043165 >> v1:172.21.15.125:6789/0 conn(0x7f06e00718e0 legacy=0x7f06e006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06e5234700 1 -- 172.21.15.125:0/4192043165 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0160a50 con 0x7f06e015c810 2023-11-28T11:09:22.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06d7fff700 1 -- 172.21.15.125:0/4192043165 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293364386 0 0) 0x7f06e006abb0 con 0x7f06e00718e0 2023-11-28T11:09:22.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06e5234700 1 --2- 172.21.15.125:0/4192043165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06e015c810 0x7f06e0160260 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f06e0071870 tx=0x7f06d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21741ac99545805c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:22.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06d7fff700 1 -- 172.21.15.125:0/4192043165 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000b870 con 0x7f06e015c810 2023-11-28T11:09:22.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06d7fff700 1 -- 172.21.15.125:0/4192043165 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000b9d0 con 0x7f06e015c810 2023-11-28T11:09:22.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.602+0000 7f06d7fff700 1 -- 172.21.15.125:0/4192043165 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000bd60 con 0x7f06e015c810 2023-11-28T11:09:22.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.603+0000 7f06e7498700 1 -- 172.21.15.125:0/4192043165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06e015c810 msgr2=0x7f06e0160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.603+0000 7f06e7498700 1 --2- 172.21.15.125:0/4192043165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06e015c810 0x7f06e0160260 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f06e0071870 tx=0x7f06d0009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.603+0000 7f06e7498700 1 -- 172.21.15.125:0/4192043165 shutdown_connections 2023-11-28T11:09:22.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.603+0000 7f06e7498700 1 --2- 172.21.15.125:0/4192043165 >> v2:172.21.15.167:3300/0 conn(0x7f06e006a270 0x7f06e006a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.603+0000 7f06e7498700 1 --2- 172.21.15.125:0/4192043165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06e015c810 0x7f06e0160260 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.603+0000 7f06e7498700 1 -- 172.21.15.125:0/4192043165 >> 172.21.15.125:0/4192043165 conn(0x7f06e006c010 msgr2=0x7f06e00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:22.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.603+0000 7f06e7498700 1 -- 172.21.15.125:0/4192043165 shutdown_connections 2023-11-28T11:09:22.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.603+0000 7f06e7498700 1 -- 172.21.15.125:0/4192043165 wait complete. 2023-11-28T11:09:22.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.604+0000 7f06e7498700 1 Processor -- start 2023-11-28T11:09:22.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.604+0000 7f06e7498700 1 -- start start 2023-11-28T11:09:22.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e7498700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e006a270 0x7f06e01e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e7498700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06e00718e0 0x7f06e0157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e7498700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06e015c810 0x7f06e00b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e7498700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01e8530 con 0x7f06e00718e0 2023-11-28T11:09:22.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e7498700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01e76c0 con 0x7f06e015c810 2023-11-28T11:09:22.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e7498700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01e78b0 con 0x7f06e006a270 2023-11-28T11:09:22.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e4a33700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06e00718e0 0x7f06e0157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e4a33700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06e00718e0 0x7f06e0157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58360/0 (socket says 172.21.15.125:58360) 2023-11-28T11:09:22.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e4a33700 1 -- 172.21.15.125:0/2267902908 learned_addr learned my addr 172.21.15.125:0/2267902908 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:22.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e5a35700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06e015c810 0x7f06e00b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e5234700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e006a270 0x7f06e01e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e4a33700 1 -- 172.21.15.125:0/2267902908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e006a270 msgr2=0x7f06e01e7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e4a33700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e006a270 0x7f06e01e7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e4a33700 1 -- 172.21.15.125:0/2267902908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06e015c810 msgr2=0x7f06e00b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e4a33700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06e015c810 0x7f06e00b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e4a33700 1 -- 172.21.15.125:0/2267902908 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d0009550 con 0x7f06e00718e0 2023-11-28T11:09:22.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e5a35700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06e015c810 0x7f06e00b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:22.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e4a33700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06e00718e0 0x7f06e0157710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0011e0 tx=0x7f06dc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:22.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06d5ffb700 1 -- 172.21.15.125:0/2267902908 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc004c80 con 0x7f06e00718e0 2023-11-28T11:09:22.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06d5ffb700 1 -- 172.21.15.125:0/2267902908 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc004e00 con 0x7f06e00718e0 2023-11-28T11:09:22.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06e7498700 1 -- 172.21.15.125:0/2267902908 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e0161010 con 0x7f06e00718e0 2023-11-28T11:09:22.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.605+0000 7f06d5ffb700 1 -- 172.21.15.125:0/2267902908 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc007310 con 0x7f06e00718e0 2023-11-28T11:09:22.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.606+0000 7f06e7498700 1 -- 172.21.15.125:0/2267902908 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e0160d30 con 0x7f06e00718e0 2023-11-28T11:09:22.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.607+0000 7f06e7498700 1 -- 172.21.15.125:0/2267902908 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e00ceb20 con 0x7f06e00718e0 2023-11-28T11:09:22.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.607+0000 7f06d5ffb700 1 -- 172.21.15.125:0/2267902908 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f06dc01a020 con 0x7f06e00718e0 2023-11-28T11:09:22.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.607+0000 7f06d5ffb700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06c40682f0 0x7f06c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.607+0000 7f06e5234700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06c40682f0 0x7f06c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.607+0000 7f06d5ffb700 1 -- 172.21.15.125:0/2267902908 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f06dc085910 con 0x7f06e00718e0 2023-11-28T11:09:22.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.608+0000 7f06e5234700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06c40682f0 0x7f06c406a7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f06d0014040 tx=0x7f06d0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:22.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.612+0000 7f06d5ffb700 1 -- 172.21.15.125:0/2267902908 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f06dc0521e0 con 0x7f06e00718e0 2023-11-28T11:09:22.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.795+0000 7f06e7498700 1 -- 172.21.15.125:0/2267902908 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06e01e8670 con 0x7f06e00718e0 2023-11-28T11:09:22.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.795+0000 7f06d5ffb700 1 -- 172.21.15.125:0/2267902908 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06e01e8670 con 0x7f06e00718e0 2023-11-28T11:09:22.797 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:22.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 -- 172.21.15.125:0/2267902908 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06c40682f0 msgr2=0x7f06c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06c40682f0 0x7f06c406a7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f06d0014040 tx=0x7f06d0008030 comp rx=0 tx=0).stop 2023-11-28T11:09:22.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 -- 172.21.15.125:0/2267902908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06e00718e0 msgr2=0x7f06e0157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06e00718e0 0x7f06e0157710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0011e0 tx=0x7f06dc00cae0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 -- 172.21.15.125:0/2267902908 shutdown_connections 2023-11-28T11:09:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06e015c810 0x7f06e00b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f06c40682f0 0x7f06c406a7a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e006a270 0x7f06e01e7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 --2- 172.21.15.125:0/2267902908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06e00718e0 0x7f06e0157710 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 -- 172.21.15.125:0/2267902908 >> 172.21.15.125:0/2267902908 conn(0x7f06e006c010 msgr2=0x7f06e00c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 -- 172.21.15.125:0/2267902908 shutdown_connections 2023-11-28T11:09:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.797+0000 7f06e7498700 1 -- 172.21.15.125:0/2267902908 wait complete. 2023-11-28T11:09:22.811 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:09:22.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.930+0000 7fe41fcae700 1 Processor -- start 2023-11-28T11:09:22.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.930+0000 7fe41fcae700 1 -- start start 2023-11-28T11:09:22.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41fcae700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe41815a590 0x7fe41806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41fcae700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4180cd480 con 0x7fe4180b50d0 2023-11-28T11:09:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41fcae700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4180cd760 con 0x7fe41806cb50 2023-11-28T11:09:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41fcae700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4180cda40 con 0x7fe41815a590 2023-11-28T11:09:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41da4a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe41815a590 0x7fe41806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41d249700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe4180b50d0 0x7fe41806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42490/0 (socket says 172.21.15.125:42490) 2023-11-28T11:09:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41d249700 1 -- 172.21.15.125:0/3687979420 learned_addr learned my addr 172.21.15.125:0/3687979420 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41ca48700 1 -- 172.21.15.125:0/3687979420 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731578347 0 0) 0x7fe4180cd480 con 0x7fe4180b50d0 2023-11-28T11:09:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41ca48700 1 -- 172.21.15.125:0/3687979420 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4040035b0 con 0x7fe4180b50d0 2023-11-28T11:09:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41da4a700 1 -- 172.21.15.125:0/3687979420 >> v1:172.21.15.167:6789/0 conn(0x7fe41806cb50 legacy=0x7fe41806a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41da4a700 1 -- 172.21.15.125:0/3687979420 >> v1:172.21.15.125:6789/0 conn(0x7fe4180b50d0 legacy=0x7fe41806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41da4a700 1 -- 172.21.15.125:0/3687979420 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4180cdd20 con 0x7fe41815a590 2023-11-28T11:09:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41da4a700 1 --2- 172.21.15.125:0/3687979420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe41815a590 0x7fe41806b5b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe408009840 tx=0x7fe408009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21203c71127a68d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41ca48700 1 -- 172.21.15.125:0/3687979420 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408004230 con 0x7fe41815a590 2023-11-28T11:09:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41ca48700 1 -- 172.21.15.125:0/3687979420 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408004390 con 0x7fe41815a590 2023-11-28T11:09:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.931+0000 7fe41ca48700 1 -- 172.21.15.125:0/3687979420 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4080036c0 con 0x7fe41815a590 2023-11-28T11:09:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.932+0000 7fe41fcae700 1 -- 172.21.15.125:0/3687979420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe41815a590 msgr2=0x7fe41806b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.932+0000 7fe41fcae700 1 --2- 172.21.15.125:0/3687979420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe41815a590 0x7fe41806b5b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe408009840 tx=0x7fe408009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.932+0000 7fe41fcae700 1 -- 172.21.15.125:0/3687979420 shutdown_connections 2023-11-28T11:09:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.932+0000 7fe41fcae700 1 --2- 172.21.15.125:0/3687979420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe41815a590 0x7fe41806b5b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.932+0000 7fe41fcae700 1 -- 172.21.15.125:0/3687979420 >> 172.21.15.125:0/3687979420 conn(0x7fe4180cf400 msgr2=0x7fe4180cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.932+0000 7fe41fcae700 1 -- 172.21.15.125:0/3687979420 shutdown_connections 2023-11-28T11:09:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.932+0000 7fe41fcae700 1 -- 172.21.15.125:0/3687979420 wait complete. 2023-11-28T11:09:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.933+0000 7fe41fcae700 1 Processor -- start 2023-11-28T11:09:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.933+0000 7fe41fcae700 1 -- start start 2023-11-28T11:09:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41fcae700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe41806cb50 0x7fe41814b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41fcae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4180b50d0 0x7fe4180c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41fcae700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe41815a590 0x7fe41815b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41fcae700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41814bda0 con 0x7fe4180b50d0 2023-11-28T11:09:22.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41fcae700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4180c77e0 con 0x7fe41806cb50 2023-11-28T11:09:22.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41fcae700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4180c7ac0 con 0x7fe41815a590 2023-11-28T11:09:22.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41d249700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4180b50d0 0x7fe4180c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41d249700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4180b50d0 0x7fe4180c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58374/0 (socket says 172.21.15.125:58374) 2023-11-28T11:09:22.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41d249700 1 -- 172.21.15.125:0/204580455 learned_addr learned my addr 172.21.15.125:0/204580455 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:22.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41da4a700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe41806cb50 0x7fe41814b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41e24b700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe41815a590 0x7fe41815b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41d249700 1 -- 172.21.15.125:0/204580455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe41815a590 msgr2=0x7fe41815b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41d249700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe41815a590 0x7fe41815b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41d249700 1 -- 172.21.15.125:0/204580455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe41806cb50 msgr2=0x7fe41814b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:22.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41d249700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe41806cb50 0x7fe41814b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:22.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41d249700 1 -- 172.21.15.125:0/204580455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4080094a0 con 0x7fe4180b50d0 2023-11-28T11:09:22.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe41d249700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4180b50d0 0x7fe4180c6eb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c500 tx=0x7fe41400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:22.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.934+0000 7fe40e7fc700 1 -- 172.21.15.125:0/204580455 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414005d70 con 0x7fe4180b50d0 2023-11-28T11:09:22.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.935+0000 7fe40e7fc700 1 -- 172.21.15.125:0/204580455 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4140070d0 con 0x7fe4180b50d0 2023-11-28T11:09:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.935+0000 7fe41fcae700 1 -- 172.21.15.125:0/204580455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41806baf0 con 0x7fe4180b50d0 2023-11-28T11:09:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.935+0000 7fe40e7fc700 1 -- 172.21.15.125:0/204580455 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414007480 con 0x7fe4180b50d0 2023-11-28T11:09:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.935+0000 7fe41fcae700 1 -- 172.21.15.125:0/204580455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4180ce000 con 0x7fe4180b50d0 2023-11-28T11:09:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.936+0000 7fe41fcae700 1 -- 172.21.15.125:0/204580455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4180724c0 con 0x7fe4180b50d0 2023-11-28T11:09:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.936+0000 7fe40e7fc700 1 -- 172.21.15.125:0/204580455 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe414019030 con 0x7fe4180b50d0 2023-11-28T11:09:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.936+0000 7fe40e7fc700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3fc0682f0 0x7fe3fc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.936+0000 7fe40e7fc700 1 -- 172.21.15.125:0/204580455 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe414084f70 con 0x7fe4180b50d0 2023-11-28T11:09:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.936+0000 7fe41da4a700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3fc0682f0 0x7fe3fc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.937+0000 7fe41da4a700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3fc0682f0 0x7fe3fc06a7a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe4080090b0 tx=0x7fe408010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:22.940+0000 7fe40e7fc700 1 -- 172.21.15.125:0/204580455 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe414051790 con 0x7fe4180b50d0 2023-11-28T11:09:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.137+0000 7fe41fcae700 1 -- 172.21.15.125:0/204580455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe41806c440 con 0x7fe4180b50d0 2023-11-28T11:09:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.138+0000 7fe40e7fc700 1 -- 172.21.15.125:0/204580455 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe414017020 con 0x7fe4180b50d0 2023-11-28T11:09:23.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.139+0000 7fe41fcae700 1 -- 172.21.15.125:0/204580455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3fc0682f0 msgr2=0x7fe3fc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.139+0000 7fe41fcae700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3fc0682f0 0x7fe3fc06a7a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe4080090b0 tx=0x7fe408010000 comp rx=0 tx=0).stop 2023-11-28T11:09:23.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.140+0000 7fe41fcae700 1 -- 172.21.15.125:0/204580455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4180b50d0 msgr2=0x7fe4180c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.140+0000 7fe41fcae700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4180b50d0 0x7fe4180c6eb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c500 tx=0x7fe41400c810 comp rx=0 tx=0).stop 2023-11-28T11:09:23.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.140+0000 7fe41fcae700 1 -- 172.21.15.125:0/204580455 shutdown_connections 2023-11-28T11:09:23.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.140+0000 7fe41fcae700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3fc0682f0 0x7fe3fc06a7a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.140+0000 7fe41fcae700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe41815a590 0x7fe41815b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.140+0000 7fe41fcae700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe41806cb50 0x7fe41814b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.140+0000 7fe41fcae700 1 --2- 172.21.15.125:0/204580455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4180b50d0 0x7fe4180c6eb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.140+0000 7fe41fcae700 1 -- 172.21.15.125:0/204580455 >> 172.21.15.125:0/204580455 conn(0x7fe4180cf400 msgr2=0x7fe4180b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:23.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.140+0000 7fe41fcae700 1 -- 172.21.15.125:0/204580455 shutdown_connections 2023-11-28T11:09:23.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.140+0000 7fe41fcae700 1 -- 172.21.15.125:0/204580455 wait complete. 2023-11-28T11:09:23.145 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:09:23.153 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-11-28T11:09:23.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:23.154 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-28T11:09:23.198 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:09:23.273 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:09:23.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:23.274 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T11:09:23.292 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:09:23.292 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:23.314 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:09:23.315 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:23.375 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:23.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.494+0000 7f48c2b5e700 1 Processor -- start 2023-11-28T11:09:23.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.494+0000 7f48c2b5e700 1 -- start start 2023-11-28T11:09:23.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.494+0000 7f48c2b5e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc06e400 0x7f48bc0b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:23.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.494+0000 7f48c2b5e700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f48bc160e70 0x7f48bc15c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:23.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48c2b5e700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc06e900 con 0x7f48bc0d0c60 2023-11-28T11:09:23.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48c2b5e700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc160390 con 0x7f48bc160e70 2023-11-28T11:09:23.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48c2b5e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc160670 con 0x7f48bc06e400 2023-11-28T11:09:23.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48c10fb700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f48bc160e70 0x7f48bc15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48bbfff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc06e400 0x7f48bc0b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48c08fa700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f48bc0d0c60 0x7f48bc0d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:45306/0 (socket says 172.21.15.125:45306) 2023-11-28T11:09:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48bbfff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc06e400 0x7f48bc0b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:53390/0 (socket says 172.21.15.125:53390) 2023-11-28T11:09:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48c10fb700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f48bc160e70 0x7f48bc15c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:55114/0 (socket says 172.21.15.125:55114) 2023-11-28T11:09:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48bbfff700 1 -- 172.21.15.125:0/2698638763 learned_addr learned my addr 172.21.15.125:0/2698638763 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48bbfff700 1 -- 172.21.15.125:0/2698638763 >> v2:172.21.15.167:3300/0 conn(0x7f48bc160e70 msgr2=0x7f48bc15c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48bbfff700 1 --2- 172.21.15.125:0/2698638763 >> v2:172.21.15.167:3300/0 conn(0x7f48bc160e70 0x7f48bc15c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48bbfff700 1 -- 172.21.15.125:0/2698638763 >> v1:172.21.15.167:6789/0 conn(0x7f48bc0d0c60 legacy=0x7f48bc0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48bbfff700 1 -- 172.21.15.125:0/2698638763 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc160950 con 0x7f48bc06e400 2023-11-28T11:09:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48c10fb700 1 --2- 172.21.15.125:0/2698638763 >> v2:172.21.15.167:3300/0 conn(0x7f48bc160e70 0x7f48bc15c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:23.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.495+0000 7f48bbfff700 1 --2- 172.21.15.125:0/2698638763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc06e400 0x7f48bc0b5be0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f48a80098f0 tx=0x7f48a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9972a4fe85945602 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.496+0000 7f48bb7fe700 1 -- 172.21.15.125:0/2698638763 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8011830 con 0x7f48bc06e400 2023-11-28T11:09:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.496+0000 7f48bb7fe700 1 -- 172.21.15.125:0/2698638763 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a8011990 con 0x7f48bc06e400 2023-11-28T11:09:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.496+0000 7f48bb7fe700 1 -- 172.21.15.125:0/2698638763 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8011d20 con 0x7f48bc06e400 2023-11-28T11:09:23.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.496+0000 7f48c2b5e700 1 -- 172.21.15.125:0/2698638763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc06e400 msgr2=0x7f48bc0b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.496+0000 7f48c2b5e700 1 --2- 172.21.15.125:0/2698638763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc06e400 0x7f48bc0b5be0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f48a80098f0 tx=0x7f48a8009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:23.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.496+0000 7f48c2b5e700 1 -- 172.21.15.125:0/2698638763 shutdown_connections 2023-11-28T11:09:23.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.496+0000 7f48c2b5e700 1 --2- 172.21.15.125:0/2698638763 >> v2:172.21.15.167:3300/0 conn(0x7f48bc160e70 0x7f48bc15c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.496+0000 7f48c2b5e700 1 --2- 172.21.15.125:0/2698638763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc06e400 0x7f48bc0b5be0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.496+0000 7f48c2b5e700 1 -- 172.21.15.125:0/2698638763 >> 172.21.15.125:0/2698638763 conn(0x7f48bc06a270 msgr2=0x7f48bc06a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:23.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.496+0000 7f48c2b5e700 1 -- 172.21.15.125:0/2698638763 shutdown_connections 2023-11-28T11:09:23.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.496+0000 7f48c2b5e700 1 -- 172.21.15.125:0/2698638763 wait complete. 2023-11-28T11:09:23.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.498+0000 7f48c2b5e700 1 Processor -- start 2023-11-28T11:09:23.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.498+0000 7f48c2b5e700 1 -- start start 2023-11-28T11:09:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c2b5e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48bc06e400 0x7f48bc1e6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c2b5e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc0d0c60 0x7f48bc159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:23.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c2b5e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48bc160e70 0x7f48bc151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c2b5e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc1e6610 con 0x7f48bc06e400 2023-11-28T11:09:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c2b5e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc1e68f0 con 0x7f48bc160e70 2023-11-28T11:09:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c2b5e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc1e6bd0 con 0x7f48bc0d0c60 2023-11-28T11:09:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c08fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48bc06e400 0x7f48bc1e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c08fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48bc06e400 0x7f48bc1e6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58386/0 (socket says 172.21.15.125:58386) 2023-11-28T11:09:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c08fa700 1 -- 172.21.15.125:0/3587459666 learned_addr learned my addr 172.21.15.125:0/3587459666 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48bbfff700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc0d0c60 0x7f48bc159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c10fb700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48bc160e70 0x7f48bc151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c08fa700 1 -- 172.21.15.125:0/3587459666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc0d0c60 msgr2=0x7f48bc159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c08fa700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc0d0c60 0x7f48bc159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c08fa700 1 -- 172.21.15.125:0/3587459666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48bc160e70 msgr2=0x7f48bc151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c08fa700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48bc160e70 0x7f48bc151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.499+0000 7f48c08fa700 1 -- 172.21.15.125:0/3587459666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4009a70 con 0x7f48bc06e400 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.500+0000 7f48c08fa700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48bc06e400 0x7f48bc1e6030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f48b000c490 tx=0x7f48b000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.500+0000 7f48b97fa700 1 -- 172.21.15.125:0/3587459666 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0005cb0 con 0x7f48bc06e400 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.500+0000 7f48b97fa700 1 -- 172.21.15.125:0/3587459666 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b000ce90 con 0x7f48bc06e400 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.500+0000 7f48c2b5e700 1 -- 172.21.15.125:0/3587459666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a8009550 con 0x7f48bc06e400 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.500+0000 7f48b97fa700 1 -- 172.21.15.125:0/3587459666 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b00072d0 con 0x7f48bc06e400 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.500+0000 7f48c2b5e700 1 -- 172.21.15.125:0/3587459666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc15ceb0 con 0x7f48bc06e400 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.501+0000 7f48c2b5e700 1 -- 172.21.15.125:0/3587459666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc0d0740 con 0x7f48bc06e400 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.501+0000 7f48b97fa700 1 -- 172.21.15.125:0/3587459666 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f48b0019030 con 0x7f48bc06e400 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.501+0000 7f48b97fa700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f48a00682f0 0x7f48a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:23.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.501+0000 7f48b97fa700 1 -- 172.21.15.125:0/3587459666 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f48b0084dc0 con 0x7f48bc06e400 2023-11-28T11:09:23.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.502+0000 7f48bbfff700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f48a00682f0 0x7f48a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:23.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.502+0000 7f48bbfff700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f48a00682f0 0x7f48a006a7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f48bc06e830 tx=0x7f48a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:23.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.505+0000 7f48b97fa700 1 -- 172.21.15.125:0/3587459666 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f48b004b5e0 con 0x7f48bc06e400 2023-11-28T11:09:23.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.689+0000 7f48c2b5e700 1 -- 172.21.15.125:0/3587459666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48bc15d040 con 0x7f48bc06e400 2023-11-28T11:09:23.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.690+0000 7f48b97fa700 1 -- 172.21.15.125:0/3587459666 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7f48b0017020 con 0x7f48bc06e400 2023-11-28T11:09:23.692 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:23.692 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":26,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:19.047682+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:23.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 -- 172.21.15.125:0/3587459666 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f48a00682f0 msgr2=0x7f48a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f48a00682f0 0x7f48a006a7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f48bc06e830 tx=0x7f48a8008030 comp rx=0 tx=0).stop 2023-11-28T11:09:23.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 -- 172.21.15.125:0/3587459666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48bc06e400 msgr2=0x7f48bc1e6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48bc06e400 0x7f48bc1e6030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f48b000c490 tx=0x7f48b000c7a0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 -- 172.21.15.125:0/3587459666 shutdown_connections 2023-11-28T11:09:23.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48bc160e70 0x7f48bc151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48bc06e400 0x7f48bc1e6030 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f48a00682f0 0x7f48a006a7a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 --2- 172.21.15.125:0/3587459666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48bc0d0c60 0x7f48bc159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 -- 172.21.15.125:0/3587459666 >> 172.21.15.125:0/3587459666 conn(0x7f48bc06a270 msgr2=0x7f48bc1578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:23.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 -- 172.21.15.125:0/3587459666 shutdown_connections 2023-11-28T11:09:23.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.692+0000 7f48c2b5e700 1 -- 172.21.15.125:0/3587459666 wait complete. 2023-11-28T11:09:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:23.706 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:23.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.828+0000 7fa994039700 1 Processor -- start 2023-11-28T11:09:23.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.828+0000 7fa994039700 1 -- start start 2023-11-28T11:09:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.829+0000 7fa994039700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa98c0b2ee0 0x7fa98c0b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.829+0000 7fa994039700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c161370 con 0x7fa98c15fe50 2023-11-28T11:09:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.829+0000 7fa994039700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c0cf700 con 0x7fa98c06d170 2023-11-28T11:09:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.829+0000 7fa994039700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c06d5c0 con 0x7fa98c0b2ee0 2023-11-28T11:09:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.829+0000 7fa9925d6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa98c0b2ee0 0x7fa98c0b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.829+0000 7fa991dd5700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa98c15fe50 0x7fa98c160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42518/0 (socket says 172.21.15.125:42518) 2023-11-28T11:09:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.829+0000 7fa991dd5700 1 -- 172.21.15.125:0/1182987360 learned_addr learned my addr 172.21.15.125:0/1182987360 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.829+0000 7fa9925d6700 1 -- 172.21.15.125:0/1182987360 >> v1:172.21.15.167:6789/0 conn(0x7fa98c06d170 legacy=0x7fa98c0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.829+0000 7fa9925d6700 1 -- 172.21.15.125:0/1182987360 >> v1:172.21.15.125:6789/0 conn(0x7fa98c15fe50 legacy=0x7fa98c160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.829+0000 7fa9925d6700 1 -- 172.21.15.125:0/1182987360 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0cedd0 con 0x7fa98c0b2ee0 2023-11-28T11:09:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.829+0000 7fa990dd3700 1 -- 172.21.15.125:0/1182987360 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702294099 0 0) 0x7fa98c161370 con 0x7fa98c15fe50 2023-11-28T11:09:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.830+0000 7fa9925d6700 1 --2- 172.21.15.125:0/1182987360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa98c0b2ee0 0x7fa98c0b3b80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa984009d90 tx=0x7fa98400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974f587dd73a752c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.830+0000 7fa990dd3700 1 -- 172.21.15.125:0/1182987360 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400e070 con 0x7fa98c0b2ee0 2023-11-28T11:09:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.830+0000 7fa990dd3700 1 -- 172.21.15.125:0/1182987360 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98400bbd0 con 0x7fa98c0b2ee0 2023-11-28T11:09:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.830+0000 7fa990dd3700 1 -- 172.21.15.125:0/1182987360 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984012430 con 0x7fa98c0b2ee0 2023-11-28T11:09:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.830+0000 7fa994039700 1 -- 172.21.15.125:0/1182987360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa98c0b2ee0 msgr2=0x7fa98c0b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.830+0000 7fa994039700 1 --2- 172.21.15.125:0/1182987360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa98c0b2ee0 0x7fa98c0b3b80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa984009d90 tx=0x7fa98400b330 comp rx=0 tx=0).stop 2023-11-28T11:09:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.830+0000 7fa994039700 1 -- 172.21.15.125:0/1182987360 shutdown_connections 2023-11-28T11:09:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.830+0000 7fa994039700 1 --2- 172.21.15.125:0/1182987360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa98c0b2ee0 0x7fa98c0b3b80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.830+0000 7fa994039700 1 -- 172.21.15.125:0/1182987360 >> 172.21.15.125:0/1182987360 conn(0x7fa98c06ea80 msgr2=0x7fa98c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:23.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.830+0000 7fa994039700 1 -- 172.21.15.125:0/1182987360 shutdown_connections 2023-11-28T11:09:23.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.830+0000 7fa994039700 1 -- 172.21.15.125:0/1182987360 wait complete. 2023-11-28T11:09:23.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.831+0000 7fa994039700 1 Processor -- start 2023-11-28T11:09:23.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.832+0000 7fa994039700 1 -- start start 2023-11-28T11:09:23.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.832+0000 7fa994039700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa98c06d170 0x7fa98c0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:23.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.832+0000 7fa994039700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c0b2ee0 0x7fa98c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:23.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.832+0000 7fa994039700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa98c15fe50 0x7fa98c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:23.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.832+0000 7fa994039700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0c9250 con 0x7fa98c06d170 2023-11-28T11:09:23.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.832+0000 7fa994039700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0c83e0 con 0x7fa98c0b2ee0 2023-11-28T11:09:23.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.832+0000 7fa994039700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0c86c0 con 0x7fa98c15fe50 2023-11-28T11:09:23.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.832+0000 7fa991dd5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa98c06d170 0x7fa98c0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:23.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.832+0000 7fa991dd5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa98c06d170 0x7fa98c0c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58400/0 (socket says 172.21.15.125:58400) 2023-11-28T11:09:23.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.832+0000 7fa991dd5700 1 -- 172.21.15.125:0/1761528629 learned_addr learned my addr 172.21.15.125:0/1761528629 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:23.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa9925d6700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa98c15fe50 0x7fa98c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:23.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa9915d4700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c0b2ee0 0x7fa98c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:23.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa991dd5700 1 -- 172.21.15.125:0/1761528629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa98c15fe50 msgr2=0x7fa98c06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa991dd5700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa98c15fe50 0x7fa98c06f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa991dd5700 1 -- 172.21.15.125:0/1761528629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c0b2ee0 msgr2=0x7fa98c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:23.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa991dd5700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c0b2ee0 0x7fa98c0cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:23.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa991dd5700 1 -- 172.21.15.125:0/1761528629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa984009a70 con 0x7fa98c06d170 2023-11-28T11:09:23.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa9925d6700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa98c15fe50 0x7fa98c06f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:23.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa9915d4700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c0b2ee0 0x7fa98c0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:23.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa991dd5700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa98c06d170 0x7fa98c0c7e00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c520 tx=0x7fa97c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:23.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa9827fc700 1 -- 172.21.15.125:0/1761528629 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c004c80 con 0x7fa98c06d170 2023-11-28T11:09:23.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa9827fc700 1 -- 172.21.15.125:0/1761528629 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c004e20 con 0x7fa98c06d170 2023-11-28T11:09:23.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa994039700 1 -- 172.21.15.125:0/1761528629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c0cf390 con 0x7fa98c06d170 2023-11-28T11:09:23.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa9827fc700 1 -- 172.21.15.125:0/1761528629 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c007310 con 0x7fa98c06d170 2023-11-28T11:09:23.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.833+0000 7fa994039700 1 -- 172.21.15.125:0/1761528629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c0cf0b0 con 0x7fa98c06d170 2023-11-28T11:09:23.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.834+0000 7fa994039700 1 -- 172.21.15.125:0/1761528629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c0cfb70 con 0x7fa98c06d170 2023-11-28T11:09:23.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.834+0000 7fa9827fc700 1 -- 172.21.15.125:0/1761528629 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa97c01a020 con 0x7fa98c06d170 2023-11-28T11:09:23.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.835+0000 7fa9827fc700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9700682f0 0x7fa97006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:23.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.835+0000 7fa9827fc700 1 -- 172.21.15.125:0/1761528629 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa97c085860 con 0x7fa98c06d170 2023-11-28T11:09:23.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.835+0000 7fa9915d4700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9700682f0 0x7fa97006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:23.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.835+0000 7fa9915d4700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9700682f0 0x7fa97006a7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0c47d0 tx=0x7fa988009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:23.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:23.839+0000 7fa9827fc700 1 -- 172.21.15.125:0/1761528629 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa97c052020 con 0x7fa98c06d170 2023-11-28T11:09:24.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.022+0000 7fa994039700 1 -- 172.21.15.125:0/1761528629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa98c0743f0 con 0x7fa98c06d170 2023-11-28T11:09:24.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.023+0000 7fa9827fc700 1 -- 172.21.15.125:0/1761528629 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa97c055640 con 0x7fa98c06d170 2023-11-28T11:09:24.025 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:24.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 -- 172.21.15.125:0/1761528629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9700682f0 msgr2=0x7fa97006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9700682f0 0x7fa97006a7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0c47d0 tx=0x7fa988009040 comp rx=0 tx=0).stop 2023-11-28T11:09:24.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 -- 172.21.15.125:0/1761528629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa98c06d170 msgr2=0x7fa98c0c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa98c06d170 0x7fa98c0c7e00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c520 tx=0x7fa97c00c8e0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 -- 172.21.15.125:0/1761528629 shutdown_connections 2023-11-28T11:09:24.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9700682f0 0x7fa97006a7a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa98c15fe50 0x7fa98c06f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa98c06d170 0x7fa98c0c7e00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 --2- 172.21.15.125:0/1761528629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c0b2ee0 0x7fa98c0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 -- 172.21.15.125:0/1761528629 >> 172.21.15.125:0/1761528629 conn(0x7fa98c06ea80 msgr2=0x7fa98c15b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:24.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 -- 172.21.15.125:0/1761528629 shutdown_connections 2023-11-28T11:09:24.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.025+0000 7fa994039700 1 -- 172.21.15.125:0/1761528629 wait complete. 2023-11-28T11:09:24.038 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:24.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.160+0000 7f1486cab700 1 Processor -- start 2023-11-28T11:09:24.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.160+0000 7f1486cab700 1 -- start start 2023-11-28T11:09:24.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.161+0000 7f1486cab700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f148015c810 0x7f1480160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.161+0000 7f1486cab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14800718e0 0x7f148006c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.161+0000 7f1486cab700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14801607a0 con 0x7f148006cdc0 2023-11-28T11:09:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.161+0000 7f1486cab700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148015cbe0 con 0x7f14800718e0 2023-11-28T11:09:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.161+0000 7f1486cab700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1480160a50 con 0x7f148015c810 2023-11-28T11:09:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.161+0000 7f147ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14800718e0 0x7f148006c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.161+0000 7f147ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14800718e0 0x7f148006c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58410/0 (socket says 172.21.15.125:58410) 2023-11-28T11:09:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.161+0000 7f147ffff700 1 -- 172.21.15.125:0/2032838036 learned_addr learned my addr 172.21.15.125:0/2032838036 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.161+0000 7f1484a47700 1 --2- 172.21.15.125:0/2032838036 >> v2:172.21.15.167:3300/0 conn(0x7f148015c810 0x7f1480160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f147ffff700 1 -- 172.21.15.125:0/2032838036 >> v2:172.21.15.167:3300/0 conn(0x7f148015c810 msgr2=0x7f1480160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f147ffff700 1 --2- 172.21.15.125:0/2032838036 >> v2:172.21.15.167:3300/0 conn(0x7f148015c810 0x7f1480160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f147ffff700 1 -- 172.21.15.125:0/2032838036 >> v1:172.21.15.167:6789/0 conn(0x7f148006cdc0 legacy=0x7f148006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f147ffff700 1 -- 172.21.15.125:0/2032838036 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1480160d30 con 0x7f14800718e0 2023-11-28T11:09:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f147ffff700 1 --2- 172.21.15.125:0/2032838036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14800718e0 0x7f148006c880 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f14800b27c0 tx=0x7f146c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499e4c44c8ca6b69 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f147f7fe700 1 -- 172.21.15.125:0/2032838036 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c011830 con 0x7f14800718e0 2023-11-28T11:09:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f147f7fe700 1 -- 172.21.15.125:0/2032838036 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c011990 con 0x7f14800718e0 2023-11-28T11:09:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f147f7fe700 1 -- 172.21.15.125:0/2032838036 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c011d20 con 0x7f14800718e0 2023-11-28T11:09:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f1486cab700 1 -- 172.21.15.125:0/2032838036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14800718e0 msgr2=0x7f148006c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f1486cab700 1 --2- 172.21.15.125:0/2032838036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14800718e0 0x7f148006c880 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f14800b27c0 tx=0x7f146c009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f1486cab700 1 -- 172.21.15.125:0/2032838036 shutdown_connections 2023-11-28T11:09:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f1486cab700 1 --2- 172.21.15.125:0/2032838036 >> v2:172.21.15.167:3300/0 conn(0x7f148015c810 0x7f1480160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f1486cab700 1 --2- 172.21.15.125:0/2032838036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14800718e0 0x7f148006c880 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f1486cab700 1 -- 172.21.15.125:0/2032838036 >> 172.21.15.125:0/2032838036 conn(0x7f148006c010 msgr2=0x7f14800cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:24.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f1486cab700 1 -- 172.21.15.125:0/2032838036 shutdown_connections 2023-11-28T11:09:24.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.162+0000 7f1486cab700 1 -- 172.21.15.125:0/2032838036 wait complete. 2023-11-28T11:09:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.164+0000 7f1486cab700 1 Processor -- start 2023-11-28T11:09:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.164+0000 7f1486cab700 1 -- start start 2023-11-28T11:09:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1486cab700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f148006cdc0 0x7f1480155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1486cab700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800718e0 0x7f1480158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1486cab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f148015c810 0x7f14801578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1486cab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c9b80 con 0x7f148015c810 2023-11-28T11:09:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1486cab700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c6dd0 con 0x7f148006cdc0 2023-11-28T11:09:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1486cab700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c70b0 con 0x7f14800718e0 2023-11-28T11:09:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1485248700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f148015c810 0x7f14801578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1485248700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f148015c810 0x7f14801578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58418/0 (socket says 172.21.15.125:58418) 2023-11-28T11:09:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1485248700 1 -- 172.21.15.125:0/1922604723 learned_addr learned my addr 172.21.15.125:0/1922604723 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1484a47700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f148006cdc0 0x7f1480155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f147ffff700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800718e0 0x7f1480158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1485248700 1 -- 172.21.15.125:0/1922604723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800718e0 msgr2=0x7f1480158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1485248700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800718e0 0x7f1480158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1485248700 1 -- 172.21.15.125:0/1922604723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f148006cdc0 msgr2=0x7f1480155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1485248700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f148006cdc0 0x7f1480155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1485248700 1 -- 172.21.15.125:0/1922604723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c009550 con 0x7f148015c810 2023-11-28T11:09:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1485248700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f148015c810 0x7f14801578d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f147800cbc0 tx=0x7f147800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f147d7fa700 1 -- 172.21.15.125:0/1922604723 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478003c00 con 0x7f148015c810 2023-11-28T11:09:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f147d7fa700 1 -- 172.21.15.125:0/1922604723 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1478003d60 con 0x7f148015c810 2023-11-28T11:09:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1486cab700 1 -- 172.21.15.125:0/1922604723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14800ceb20 con 0x7f148015c810 2023-11-28T11:09:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f147d7fa700 1 -- 172.21.15.125:0/1922604723 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147800abf0 con 0x7f148015c810 2023-11-28T11:09:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.165+0000 7f1486cab700 1 -- 172.21.15.125:0/1922604723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1480161010 con 0x7f148015c810 2023-11-28T11:09:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.166+0000 7f1486cab700 1 -- 172.21.15.125:0/1922604723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14800ce740 con 0x7f148015c810 2023-11-28T11:09:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.167+0000 7f147d7fa700 1 -- 172.21.15.125:0/1922604723 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1478010050 con 0x7f148015c810 2023-11-28T11:09:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.167+0000 7f147d7fa700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14640682f0 0x7f146406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.167+0000 7f147d7fa700 1 -- 172.21.15.125:0/1922604723 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1478085c50 con 0x7f148015c810 2023-11-28T11:09:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.167+0000 7f1484a47700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14640682f0 0x7f146406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.168+0000 7f1484a47700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14640682f0 0x7f146406a7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1474009ad0 tx=0x7f1474008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:24.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.171+0000 7f147d7fa700 1 -- 172.21.15.125:0/1922604723 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1478052470 con 0x7f148015c810 2023-11-28T11:09:24.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.353+0000 7f1486cab700 1 -- 172.21.15.125:0/1922604723 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f14801f3150 con 0x7f148015c810 2023-11-28T11:09:24.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.354+0000 7f147d7fa700 1 -- 172.21.15.125:0/1922604723 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f14801f3150 con 0x7f148015c810 2023-11-28T11:09:24.356 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:24.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 -- 172.21.15.125:0/1922604723 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14640682f0 msgr2=0x7f146406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14640682f0 0x7f146406a7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1474009ad0 tx=0x7f1474008040 comp rx=0 tx=0).stop 2023-11-28T11:09:24.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 -- 172.21.15.125:0/1922604723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f148015c810 msgr2=0x7f14801578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f148015c810 0x7f14801578d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f147800cbc0 tx=0x7f147800cf80 comp rx=0 tx=0).stop 2023-11-28T11:09:24.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 -- 172.21.15.125:0/1922604723 shutdown_connections 2023-11-28T11:09:24.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f148015c810 0x7f14801578d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f148006cdc0 0x7f1480155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f14640682f0 0x7f146406a7a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 --2- 172.21.15.125:0/1922604723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800718e0 0x7f1480158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 -- 172.21.15.125:0/1922604723 >> 172.21.15.125:0/1922604723 conn(0x7f148006c010 msgr2=0x7f14800cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:24.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 -- 172.21.15.125:0/1922604723 shutdown_connections 2023-11-28T11:09:24.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.356+0000 7f1486cab700 1 -- 172.21.15.125:0/1922604723 wait complete. 2023-11-28T11:09:24.371 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:24.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.496+0000 7fafdef36700 1 Processor -- start 2023-11-28T11:09:24.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.496+0000 7fafdef36700 1 -- start start 2023-11-28T11:09:24.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.497+0000 7fafdef36700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd8158e10 0x7fafd80cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.497+0000 7fafdef36700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fafd80ae850 0x7fafd806c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.497+0000 7fafdef36700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd80ca140 con 0x7fafd806c980 2023-11-28T11:09:24.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.497+0000 7fafdef36700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd806ac30 con 0x7fafd80ae850 2023-11-28T11:09:24.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.497+0000 7fafdef36700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd806ce00 con 0x7fafd8158e10 2023-11-28T11:09:24.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.497+0000 7fafdd4d3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fafd806c980 0x7fafd815c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42548/0 (socket says 172.21.15.125:42548) 2023-11-28T11:09:24.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.497+0000 7fafdd4d3700 1 -- 172.21.15.125:0/3251327934 learned_addr learned my addr 172.21.15.125:0/3251327934 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:24.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.497+0000 7fafdccd2700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd8158e10 0x7fafd80cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.497+0000 7fafd7fff700 1 --2- 172.21.15.125:0/3251327934 >> v2:172.21.15.167:3300/0 conn(0x7fafd80ae850 0x7fafd806c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.497+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325479341 0 0) 0x7fafd80ca140 con 0x7fafd806c980 2023-11-28T11:09:24.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc80046c0 con 0x7fafd806c980 2023-11-28T11:09:24.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4166075115 0 0) 0x7fafc80046c0 con 0x7fafd806c980 2023-11-28T11:09:24.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd8158e10 msgr2=0x7fafd80cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:24.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd8158e10 0x7fafd80cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 >> v2:172.21.15.167:3300/0 conn(0x7fafd80ae850 msgr2=0x7fafd806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:24.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 --2- 172.21.15.125:0/3251327934 >> v2:172.21.15.167:3300/0 conn(0x7fafd80ae850 0x7fafd806c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8071380 con 0x7fafd806c980 2023-11-28T11:09:24.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fafd00019f0 con 0x7fafd806c980 2023-11-28T11:09:24.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 >> v1:172.21.15.125:6789/0 conn(0x7fafd806c980 legacy=0x7fafd815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc8004b10 0x7fafc8004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc8005540 0x7fafc8005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd8158e10 0x7fafc8006170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd806ce00 con 0x7fafc8005540 2023-11-28T11:09:24.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc800cb20 con 0x7fafc8004b10 2023-11-28T11:09:24.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc800cc60 con 0x7fafd8158e10 2023-11-28T11:09:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd7fff700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc8005540 0x7fafc8005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafdccd2700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc8004b10 0x7fafc8004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafdd4d3700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd8158e10 0x7fafc8006170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd7fff700 1 -- 172.21.15.125:0/3251327934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd8158e10 msgr2=0x7fafc8006170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:24.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd7fff700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd8158e10 0x7fafc8006170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd7fff700 1 -- 172.21.15.125:0/3251327934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc8004b10 msgr2=0x7fafc8004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:24.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd7fff700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc8004b10 0x7fafc8004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd7fff700 1 -- 172.21.15.125:0/3251327934 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc80046c0 con 0x7fafc8005540 2023-11-28T11:09:24.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.498+0000 7fafd7fff700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc8005540 0x7fafc8005a00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009b90 tx=0x7fafc8006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bc2e95343d66ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:24.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.499+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400e6c0 con 0x7fafc8005540 2023-11-28T11:09:24.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.499+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc400e820 con 0x7fafc8005540 2023-11-28T11:09:24.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.499+0000 7fafd77fe700 1 -- 172.21.15.125:0/3251327934 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400eb90 con 0x7fafc8005540 2023-11-28T11:09:24.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.499+0000 7fafdef36700 1 -- 172.21.15.125:0/3251327934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc8005540 msgr2=0x7fafc8005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.499+0000 7fafdef36700 1 --2- 172.21.15.125:0/3251327934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc8005540 0x7fafc8005a00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009b90 tx=0x7fafc8006990 comp rx=0 tx=0).stop 2023-11-28T11:09:24.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.499+0000 7fafdd4d3700 1 -- 172.21.15.125:0/3251327934 reap_dead start 2023-11-28T11:09:24.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.499+0000 7fafdef36700 1 -- 172.21.15.125:0/3251327934 shutdown_connections 2023-11-28T11:09:24.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.499+0000 7fafdef36700 1 -- 172.21.15.125:0/3251327934 >> 172.21.15.125:0/3251327934 conn(0x7fafd80cf400 msgr2=0x7fafd80cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:24.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.499+0000 7fafdef36700 1 -- 172.21.15.125:0/3251327934 shutdown_connections 2023-11-28T11:09:24.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.499+0000 7fafdef36700 1 -- 172.21.15.125:0/3251327934 wait complete. 2023-11-28T11:09:24.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.500+0000 7fafdef36700 1 Processor -- start 2023-11-28T11:09:24.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.500+0000 7fafdef36700 1 -- start start 2023-11-28T11:09:24.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.501+0000 7fafdef36700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc8005540 0x7fafd8154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.501+0000 7fafdef36700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd8159270 0x7fafd80c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.501+0000 7fafdef36700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd80b2e80 0x7fafd80b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.501+0000 7fafdef36700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80b3840 con 0x7fafd8159270 2023-11-28T11:09:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.501+0000 7fafdef36700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd81599e0 con 0x7fafc8005540 2023-11-28T11:09:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.501+0000 7fafdef36700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8159cc0 con 0x7fafd80b2e80 2023-11-28T11:09:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.501+0000 7fafd7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd8159270 0x7fafd80c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.501+0000 7fafd7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd8159270 0x7fafd80c5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58434/0 (socket says 172.21.15.125:58434) 2023-11-28T11:09:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.501+0000 7fafd7fff700 1 -- 172.21.15.125:0/4004983486 learned_addr learned my addr 172.21.15.125:0/4004983486 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:24.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafdd4d3700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd80b2e80 0x7fafd80b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafdccd2700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc8005540 0x7fafd8154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafd7fff700 1 -- 172.21.15.125:0/4004983486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd80b2e80 msgr2=0x7fafd80b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafd7fff700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd80b2e80 0x7fafd80b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafd7fff700 1 -- 172.21.15.125:0/4004983486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc8005540 msgr2=0x7fafd8154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafd7fff700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc8005540 0x7fafd8154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafd7fff700 1 -- 172.21.15.125:0/4004983486 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd80c9e60 con 0x7fafd8159270 2023-11-28T11:09:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafd7fff700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd8159270 0x7fafd80c5200 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fafc8006880 tx=0x7fafc40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafd57fa700 1 -- 172.21.15.125:0/4004983486 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4021070 con 0x7fafd8159270 2023-11-28T11:09:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafd57fa700 1 -- 172.21.15.125:0/4004983486 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc40045d0 con 0x7fafd8159270 2023-11-28T11:09:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafd57fa700 1 -- 172.21.15.125:0/4004983486 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400e6c0 con 0x7fafd8159270 2023-11-28T11:09:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafdef36700 1 -- 172.21.15.125:0/4004983486 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd80c9b80 con 0x7fafd8159270 2023-11-28T11:09:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.502+0000 7fafdef36700 1 -- 172.21.15.125:0/4004983486 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd806ae20 con 0x7fafd8159270 2023-11-28T11:09:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.503+0000 7fafdef36700 1 -- 172.21.15.125:0/4004983486 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd80743f0 con 0x7fafd8159270 2023-11-28T11:09:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.503+0000 7fafd57fa700 1 -- 172.21.15.125:0/4004983486 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fafc402e030 con 0x7fafd8159270 2023-11-28T11:09:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.504+0000 7fafd57fa700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafbc0682f0 0x7fafbc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.504+0000 7fafd57fa700 1 -- 172.21.15.125:0/4004983486 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fafc4087110 con 0x7fafd8159270 2023-11-28T11:09:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.504+0000 7fafdccd2700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafbc0682f0 0x7fafbc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.504+0000 7fafdccd2700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafbc0682f0 0x7fafbc06a7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fafd815a650 tx=0x7fafcc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.508+0000 7fafd57fa700 1 -- 172.21.15.125:0/4004983486 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fafc4053930 con 0x7fafd8159270 2023-11-28T11:09:24.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.690+0000 7fafdef36700 1 -- 172.21.15.125:0/4004983486 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafd8073330 con 0x7fafd8159270 2023-11-28T11:09:24.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.691+0000 7fafd57fa700 1 -- 172.21.15.125:0/4004983486 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafc4056f50 con 0x7fafd8159270 2023-11-28T11:09:24.693 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:24.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 -- 172.21.15.125:0/4004983486 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafbc0682f0 msgr2=0x7fafbc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafbc0682f0 0x7fafbc06a7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fafd815a650 tx=0x7fafcc008040 comp rx=0 tx=0).stop 2023-11-28T11:09:24.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 -- 172.21.15.125:0/4004983486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd8159270 msgr2=0x7fafd80c5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd8159270 0x7fafd80c5200 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fafc8006880 tx=0x7fafc40047c0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 -- 172.21.15.125:0/4004983486 shutdown_connections 2023-11-28T11:09:24.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fafbc0682f0 0x7fafbc06a7a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafd80b2e80 0x7fafd80b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc8005540 0x7fafd8154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 --2- 172.21.15.125:0/4004983486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd8159270 0x7fafd80c5200 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 -- 172.21.15.125:0/4004983486 >> 172.21.15.125:0/4004983486 conn(0x7fafd80cf400 msgr2=0x7fafd80cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:24.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 -- 172.21.15.125:0/4004983486 shutdown_connections 2023-11-28T11:09:24.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.693+0000 7fafdef36700 1 -- 172.21.15.125:0/4004983486 wait complete. 2023-11-28T11:09:24.707 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.827+0000 7f53213e2700 1 Processor -- start 2023-11-28T11:09:24.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.827+0000 7f53213e2700 1 -- start start 2023-11-28T11:09:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.828+0000 7f53213e2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f531c15c8c0 0x7f531c160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.828+0000 7f53213e2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c0d2d30 con 0x7f531c06b220 2023-11-28T11:09:24.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.828+0000 7f53213e2700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c0d0b40 con 0x7f531c0b5dc0 2023-11-28T11:09:24.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.828+0000 7f53213e2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c1611f0 con 0x7f531c15c8c0 2023-11-28T11:09:24.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.828+0000 7f531b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f531c06b220 0x7f531c0d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42568/0 (socket says 172.21.15.125:42568) 2023-11-28T11:09:24.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.828+0000 7f531b7fe700 1 -- 172.21.15.125:0/3638228698 learned_addr learned my addr 172.21.15.125:0/3638228698 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:24.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.828+0000 7f531affd700 1 --2- 172.21.15.125:0/3638228698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f531c15c8c0 0x7f531c160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.828+0000 7f5319ffb700 1 -- 172.21.15.125:0/3638228698 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870159745 0 0) 0x7f5314001490 con 0x7f531c06b220 2023-11-28T11:09:24.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.828+0000 7f5319ffb700 1 -- 172.21.15.125:0/3638228698 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53040035b0 con 0x7f531c06b220 2023-11-28T11:09:24.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.829+0000 7f5319ffb700 1 -- 172.21.15.125:0/3638228698 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3024110388 0 0) 0x7f53040035b0 con 0x7f531c06b220 2023-11-28T11:09:24.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.829+0000 7f531affd700 1 -- 172.21.15.125:0/3638228698 >> v1:172.21.15.167:6789/0 conn(0x7f531c0b5dc0 legacy=0x7f531c06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.829+0000 7f531affd700 1 -- 172.21.15.125:0/3638228698 >> v1:172.21.15.125:6789/0 conn(0x7f531c06b220 legacy=0x7f531c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.829+0000 7f531affd700 1 -- 172.21.15.125:0/3638228698 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0d2a50 con 0x7f531c15c8c0 2023-11-28T11:09:24.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.829+0000 7f531affd700 1 --2- 172.21.15.125:0/3638228698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f531c15c8c0 0x7f531c160cb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5310009870 tx=0x7f5310009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d87fac0dea107cc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:24.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.829+0000 7f5319ffb700 1 -- 172.21.15.125:0/3638228698 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314001b80 con 0x7f531c15c8c0 2023-11-28T11:09:24.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.829+0000 7f5319ffb700 1 -- 172.21.15.125:0/3638228698 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310004030 con 0x7f531c15c8c0 2023-11-28T11:09:24.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.829+0000 7f5319ffb700 1 -- 172.21.15.125:0/3638228698 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53100043a0 con 0x7f531c15c8c0 2023-11-28T11:09:24.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.830+0000 7f53213e2700 1 -- 172.21.15.125:0/3638228698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f531c15c8c0 msgr2=0x7f531c160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.830+0000 7f53213e2700 1 --2- 172.21.15.125:0/3638228698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f531c15c8c0 0x7f531c160cb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5310009870 tx=0x7f5310009b80 comp rx=0 tx=0).stop 2023-11-28T11:09:24.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.830+0000 7f53213e2700 1 -- 172.21.15.125:0/3638228698 shutdown_connections 2023-11-28T11:09:24.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.830+0000 7f53213e2700 1 --2- 172.21.15.125:0/3638228698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f531c15c8c0 0x7f531c160cb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.830+0000 7f53213e2700 1 -- 172.21.15.125:0/3638228698 >> 172.21.15.125:0/3638228698 conn(0x7f531c06c520 msgr2=0x7f531c06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:24.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.830+0000 7f53213e2700 1 -- 172.21.15.125:0/3638228698 shutdown_connections 2023-11-28T11:09:24.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.830+0000 7f53213e2700 1 -- 172.21.15.125:0/3638228698 wait complete. 2023-11-28T11:09:24.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.831+0000 7f53213e2700 1 Processor -- start 2023-11-28T11:09:24.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.831+0000 7f53213e2700 1 -- start start 2023-11-28T11:09:24.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f53213e2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f531c06b220 0x7f531c0c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f53213e2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f531c0b5dc0 0x7f531c0ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f53213e2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f531c15c8c0 0x7f531c14ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f53213e2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c0cab40 con 0x7f531c06b220 2023-11-28T11:09:24.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f53213e2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c14cfc0 con 0x7f531c15c8c0 2023-11-28T11:09:24.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f53213e2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c0c7270 con 0x7f531c0b5dc0 2023-11-28T11:09:24.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f531affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f531c06b220 0x7f531c0c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f531affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f531c06b220 0x7f531c0c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58446/0 (socket says 172.21.15.125:58446) 2023-11-28T11:09:24.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f531affd700 1 -- 172.21.15.125:0/4099184654 learned_addr learned my addr 172.21.15.125:0/4099184654 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:24.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f531a7fc700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f531c0b5dc0 0x7f531c0ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f531b7fe700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f531c15c8c0 0x7f531c14ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f531affd700 1 -- 172.21.15.125:0/4099184654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f531c0b5dc0 msgr2=0x7f531c0ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f531affd700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f531c0b5dc0 0x7f531c0ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f531affd700 1 -- 172.21.15.125:0/4099184654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f531c15c8c0 msgr2=0x7f531c14ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:24.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f531affd700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f531c15c8c0 0x7f531c14ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:24.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f531affd700 1 -- 172.21.15.125:0/4099184654 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53100094a0 con 0x7f531c06b220 2023-11-28T11:09:24.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f531affd700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f531c06b220 0x7f531c0c90f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f531c0d0960 tx=0x7f5310004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:24.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f53037fe700 1 -- 172.21.15.125:0/4099184654 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310010590 con 0x7f531c06b220 2023-11-28T11:09:24.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.832+0000 7f53037fe700 1 -- 172.21.15.125:0/4099184654 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53100106f0 con 0x7f531c06b220 2023-11-28T11:09:24.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.833+0000 7f53213e2700 1 -- 172.21.15.125:0/4099184654 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c0cda40 con 0x7f531c06b220 2023-11-28T11:09:24.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.833+0000 7f53037fe700 1 -- 172.21.15.125:0/4099184654 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310010aa0 con 0x7f531c06b220 2023-11-28T11:09:24.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.833+0000 7f53213e2700 1 -- 172.21.15.125:0/4099184654 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c0cd760 con 0x7f531c06b220 2023-11-28T11:09:24.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.833+0000 7f53213e2700 1 -- 172.21.15.125:0/4099184654 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531c0d2700 con 0x7f531c06b220 2023-11-28T11:09:24.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.834+0000 7f53037fe700 1 -- 172.21.15.125:0/4099184654 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f531000f050 con 0x7f531c06b220 2023-11-28T11:09:24.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.834+0000 7f53037fe700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53080682f0 0x7f530806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:24.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.834+0000 7f53037fe700 1 -- 172.21.15.125:0/4099184654 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5310087300 con 0x7f531c06b220 2023-11-28T11:09:24.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.834+0000 7f531a7fc700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53080682f0 0x7f530806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:24.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.835+0000 7f531a7fc700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53080682f0 0x7f530806a7a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f531c0c9b80 tx=0x7f530c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:24.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:24.839+0000 7f53037fe700 1 -- 172.21.15.125:0/4099184654 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5310053b20 con 0x7f531c06b220 2023-11-28T11:09:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.020+0000 7f53213e2700 1 -- 172.21.15.125:0/4099184654 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f531c067d70 con 0x7f531c06b220 2023-11-28T11:09:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.021+0000 7f53037fe700 1 -- 172.21.15.125:0/4099184654 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5310057140 con 0x7f531c06b220 2023-11-28T11:09:25.023 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 -- 172.21.15.125:0/4099184654 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53080682f0 msgr2=0x7f530806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53080682f0 0x7f530806a7a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f531c0c9b80 tx=0x7f530c009040 comp rx=0 tx=0).stop 2023-11-28T11:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 -- 172.21.15.125:0/4099184654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f531c06b220 msgr2=0x7f531c0c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f531c06b220 0x7f531c0c90f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f531c0d0960 tx=0x7f5310004750 comp rx=0 tx=0).stop 2023-11-28T11:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 -- 172.21.15.125:0/4099184654 shutdown_connections 2023-11-28T11:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f531c15c8c0 0x7f531c14ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f531c06b220 0x7f531c0c90f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53080682f0 0x7f530806a7a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 --2- 172.21.15.125:0/4099184654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f531c0b5dc0 0x7f531c0ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 -- 172.21.15.125:0/4099184654 >> 172.21.15.125:0/4099184654 conn(0x7f531c06c520 msgr2=0x7f531c15ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 -- 172.21.15.125:0/4099184654 shutdown_connections 2023-11-28T11:09:25.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.023+0000 7f53213e2700 1 -- 172.21.15.125:0/4099184654 wait complete. 2023-11-28T11:09:25.037 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:09:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.157+0000 7f301c250700 1 Processor -- start 2023-11-28T11:09:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.157+0000 7f301c250700 1 -- start start 2023-11-28T11:09:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.158+0000 7f301c250700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f301406a980 0x7f30140ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.158+0000 7f301c250700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301415cc10 con 0x7f30140cf710 2023-11-28T11:09:25.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.158+0000 7f301c250700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301406c9b0 con 0x7f3014071890 2023-11-28T11:09:25.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.158+0000 7f301c250700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301406cc90 con 0x7f301406a980 2023-11-28T11:09:25.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.158+0000 7f30197eb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f301406a980 0x7f30140ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.158+0000 7f3019fec700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f30140cf710 0x7f301406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42578/0 (socket says 172.21.15.125:42578) 2023-11-28T11:09:25.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.158+0000 7f3019fec700 1 -- 172.21.15.125:0/3605635701 learned_addr learned my addr 172.21.15.125:0/3605635701 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:25.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.158+0000 7f30197eb700 1 -- 172.21.15.125:0/3605635701 >> v1:172.21.15.167:6789/0 conn(0x7f3014071890 legacy=0x7f3014160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:25.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.158+0000 7f30197eb700 1 -- 172.21.15.125:0/3605635701 >> v1:172.21.15.125:6789/0 conn(0x7f30140cf710 legacy=0x7f301406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.159+0000 7f30197eb700 1 -- 172.21.15.125:0/3605635701 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301406cf70 con 0x7f301406a980 2023-11-28T11:09:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.159+0000 7f3018fea700 1 -- 172.21.15.125:0/3605635701 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040479957 0 0) 0x7f301415cc10 con 0x7f30140cf710 2023-11-28T11:09:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.159+0000 7f30197eb700 1 --2- 172.21.15.125:0/3605635701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f301406a980 0x7f30140ce740 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3010009840 tx=0x7f3010009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f78eabff94fba4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.159+0000 7f3018fea700 1 -- 172.21.15.125:0/3605635701 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010004230 con 0x7f301406a980 2023-11-28T11:09:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.159+0000 7f3018fea700 1 -- 172.21.15.125:0/3605635701 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3010004390 con 0x7f301406a980 2023-11-28T11:09:25.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.159+0000 7f3018fea700 1 -- 172.21.15.125:0/3605635701 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30100036a0 con 0x7f301406a980 2023-11-28T11:09:25.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.159+0000 7f301c250700 1 -- 172.21.15.125:0/3605635701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f301406a980 msgr2=0x7f30140ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.159+0000 7f301c250700 1 --2- 172.21.15.125:0/3605635701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f301406a980 0x7f30140ce740 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3010009840 tx=0x7f3010009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:25.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.159+0000 7f301c250700 1 -- 172.21.15.125:0/3605635701 shutdown_connections 2023-11-28T11:09:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.159+0000 7f301c250700 1 --2- 172.21.15.125:0/3605635701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f301406a980 0x7f30140ce740 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.159+0000 7f301c250700 1 -- 172.21.15.125:0/3605635701 >> 172.21.15.125:0/3605635701 conn(0x7f301406c010 msgr2=0x7f30140cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.160+0000 7f301c250700 1 -- 172.21.15.125:0/3605635701 shutdown_connections 2023-11-28T11:09:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.160+0000 7f301c250700 1 -- 172.21.15.125:0/3605635701 wait complete. 2023-11-28T11:09:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.161+0000 7f301c250700 1 Processor -- start 2023-11-28T11:09:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.161+0000 7f301c250700 1 -- start start 2023-11-28T11:09:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.161+0000 7f301c250700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f301406a980 0x7f3014155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.161+0000 7f301c250700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3014071890 0x7f30140b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.161+0000 7f301c250700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30140cf710 0x7f30140c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.161+0000 7f301c250700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30141f1cf0 con 0x7f30140cf710 2023-11-28T11:09:25.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.161+0000 7f301c250700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30140b2480 con 0x7f301406a980 2023-11-28T11:09:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.161+0000 7f301c250700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30140c4390 con 0x7f3014071890 2023-11-28T11:09:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.161+0000 7f301a7ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30140cf710 0x7f30140c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f301a7ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30140cf710 0x7f30140c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58464/0 (socket says 172.21.15.125:58464) 2023-11-28T11:09:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f301a7ed700 1 -- 172.21.15.125:0/3327736810 learned_addr learned my addr 172.21.15.125:0/3327736810 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f3019fec700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f301406a980 0x7f3014155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f30197eb700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3014071890 0x7f30140b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f301a7ed700 1 -- 172.21.15.125:0/3327736810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3014071890 msgr2=0x7f30140b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f301a7ed700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3014071890 0x7f30140b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f301a7ed700 1 -- 172.21.15.125:0/3327736810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f301406a980 msgr2=0x7f3014155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f301a7ed700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f301406a980 0x7f3014155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f301a7ed700 1 -- 172.21.15.125:0/3327736810 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30100094a0 con 0x7f30140cf710 2023-11-28T11:09:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f3019fec700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f301406a980 0x7f3014155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f30197eb700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3014071890 0x7f30140b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f301a7ed700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30140cf710 0x7f30140c5090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f300c00cc10 tx=0x7f300c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f300a7fc700 1 -- 172.21.15.125:0/3327736810 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c00abb0 con 0x7f30140cf710 2023-11-28T11:09:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f300a7fc700 1 -- 172.21.15.125:0/3327736810 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c00ad10 con 0x7f30140cf710 2023-11-28T11:09:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f301c250700 1 -- 172.21.15.125:0/3327736810 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301406d530 con 0x7f30140cf710 2023-11-28T11:09:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f300a7fc700 1 -- 172.21.15.125:0/3327736810 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c012660 con 0x7f30140cf710 2023-11-28T11:09:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.162+0000 7f301c250700 1 -- 172.21.15.125:0/3327736810 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301406d250 con 0x7f30140cf710 2023-11-28T11:09:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.163+0000 7f301c250700 1 -- 172.21.15.125:0/3327736810 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30140743f0 con 0x7f30140cf710 2023-11-28T11:09:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.164+0000 7f300a7fc700 1 -- 172.21.15.125:0/3327736810 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f300c022070 con 0x7f30140cf710 2023-11-28T11:09:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.164+0000 7f300a7fc700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ff80682f0 0x7f2ff806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.164+0000 7f300a7fc700 1 -- 172.21.15.125:0/3327736810 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f300c086390 con 0x7f30140cf710 2023-11-28T11:09:25.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.164+0000 7f3019fec700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ff80682f0 0x7f2ff806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.164+0000 7f3019fec700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ff80682f0 0x7f2ff806a7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3004007fd0 tx=0x7f3004009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:25.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.168+0000 7f300a7fc700 1 -- 172.21.15.125:0/3327736810 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f300c052bb0 con 0x7f30140cf710 2023-11-28T11:09:25.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.365+0000 7f301c250700 1 -- 172.21.15.125:0/3327736810 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f30140711a0 con 0x7f30140cf710 2023-11-28T11:09:25.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.365+0000 7f300a7fc700 1 -- 172.21.15.125:0/3327736810 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f300c0561d0 con 0x7f30140cf710 2023-11-28T11:09:25.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 -- 172.21.15.125:0/3327736810 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ff80682f0 msgr2=0x7f2ff806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ff80682f0 0x7f2ff806a7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3004007fd0 tx=0x7f3004009040 comp rx=0 tx=0).stop 2023-11-28T11:09:25.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 -- 172.21.15.125:0/3327736810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30140cf710 msgr2=0x7f30140c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30140cf710 0x7f30140c5090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f300c00cc10 tx=0x7f300c00a060 comp rx=0 tx=0).stop 2023-11-28T11:09:25.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 -- 172.21.15.125:0/3327736810 shutdown_connections 2023-11-28T11:09:25.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30140cf710 0x7f30140c5090 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f301406a980 0x7f3014155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2ff80682f0 0x7f2ff806a7a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 --2- 172.21.15.125:0/3327736810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3014071890 0x7f30140b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 -- 172.21.15.125:0/3327736810 >> 172.21.15.125:0/3327736810 conn(0x7f301406c010 msgr2=0x7f301415edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:25.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 -- 172.21.15.125:0/3327736810 shutdown_connections 2023-11-28T11:09:25.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.367+0000 7f301c250700 1 -- 172.21.15.125:0/3327736810 wait complete. 2023-11-28T11:09:25.370 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:09:25.380 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:09:25.381 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:25.402 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:25.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.520+0000 7ff94540a700 1 Processor -- start 2023-11-28T11:09:25.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.520+0000 7ff94540a700 1 -- start start 2023-11-28T11:09:25.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff94540a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9400ae520 0x7ff940071f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff94540a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9400ac420 0x7ff9400ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff94540a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9400af0c0 con 0x7ff94006a270 2023-11-28T11:09:25.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff94540a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9400b0590 con 0x7ff9400ac420 2023-11-28T11:09:25.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff94540a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff940159280 con 0x7ff9400ae520 2023-11-28T11:09:25.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff93f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9400ac420 0x7ff9400ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff93effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff94006a270 0x7ff94006a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42592/0 (socket says 172.21.15.125:42592) 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff93effd700 1 -- 172.21.15.125:0/311177420 learned_addr learned my addr 172.21.15.125:0/311177420 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff93e7fc700 1 --2- 172.21.15.125:0/311177420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9400ae520 0x7ff940071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff93f7fe700 1 -- 172.21.15.125:0/311177420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9400ae520 msgr2=0x7ff940071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff93f7fe700 1 --2- 172.21.15.125:0/311177420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9400ae520 0x7ff940071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff93f7fe700 1 -- 172.21.15.125:0/311177420 >> v1:172.21.15.125:6789/0 conn(0x7ff94006a270 legacy=0x7ff94006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff93dffb700 1 -- 172.21.15.125:0/311177420 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999703163 0 0) 0x7ff9400af0c0 con 0x7ff94006a270 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff93f7fe700 1 -- 172.21.15.125:0/311177420 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9400b0d10 con 0x7ff9400ac420 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.521+0000 7ff93f7fe700 1 --2- 172.21.15.125:0/311177420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9400ac420 0x7ff9400ac8a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff938009d90 tx=0x7ff93800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307f72c23c91271f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.522+0000 7ff93dffb700 1 -- 172.21.15.125:0/311177420 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800e070 con 0x7ff9400ac420 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.522+0000 7ff93dffb700 1 -- 172.21.15.125:0/311177420 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93800bbd0 con 0x7ff9400ac420 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.522+0000 7ff93dffb700 1 -- 172.21.15.125:0/311177420 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938012430 con 0x7ff9400ac420 2023-11-28T11:09:25.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.522+0000 7ff94540a700 1 -- 172.21.15.125:0/311177420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9400ac420 msgr2=0x7ff9400ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.522+0000 7ff94540a700 1 --2- 172.21.15.125:0/311177420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9400ac420 0x7ff9400ac8a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff938009d90 tx=0x7ff93800b330 comp rx=0 tx=0).stop 2023-11-28T11:09:25.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.522+0000 7ff94540a700 1 -- 172.21.15.125:0/311177420 shutdown_connections 2023-11-28T11:09:25.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.522+0000 7ff94540a700 1 --2- 172.21.15.125:0/311177420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9400ac420 0x7ff9400ac8a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.522+0000 7ff94540a700 1 --2- 172.21.15.125:0/311177420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9400ae520 0x7ff940071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.522+0000 7ff94540a700 1 -- 172.21.15.125:0/311177420 >> 172.21.15.125:0/311177420 conn(0x7ff9400b2fc0 msgr2=0x7ff940071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:25.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.522+0000 7ff94540a700 1 -- 172.21.15.125:0/311177420 shutdown_connections 2023-11-28T11:09:25.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.522+0000 7ff94540a700 1 -- 172.21.15.125:0/311177420 wait complete. 2023-11-28T11:09:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.523+0000 7ff94540a700 1 Processor -- start 2023-11-28T11:09:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.523+0000 7ff94540a700 1 -- start start 2023-11-28T11:09:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.524+0000 7ff94540a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff94006a270 0x7ff940097560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.524+0000 7ff94540a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9400ac420 0x7ff9401545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.524+0000 7ff94540a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9400ae520 0x7ff940154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.524+0000 7ff94540a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9400c93b0 con 0x7ff94006a270 2023-11-28T11:09:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.524+0000 7ff94540a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9401508e0 con 0x7ff9400ae520 2023-11-28T11:09:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.524+0000 7ff94540a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff940150170 con 0x7ff9400ac420 2023-11-28T11:09:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.524+0000 7ff93effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff94006a270 0x7ff940097560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.524+0000 7ff93effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff94006a270 0x7ff940097560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58474/0 (socket says 172.21.15.125:58474) 2023-11-28T11:09:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.524+0000 7ff93effd700 1 -- 172.21.15.125:0/2502435313 learned_addr learned my addr 172.21.15.125:0/2502435313 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.525+0000 7ff93effd700 1 -- 172.21.15.125:0/2502435313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9400ac420 msgr2=0x7ff9401545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.525+0000 7ff93effd700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9400ac420 0x7ff9401545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.525+0000 7ff93effd700 1 -- 172.21.15.125:0/2502435313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9400ae520 msgr2=0x7ff940154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.525+0000 7ff93effd700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9400ae520 0x7ff940154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.525+0000 7ff93effd700 1 -- 172.21.15.125:0/2502435313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938009a70 con 0x7ff94006a270 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.525+0000 7ff93effd700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff94006a270 0x7ff940097560 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c550 tx=0x7ff93400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.525+0000 7ff9277fe700 1 -- 172.21.15.125:0/2502435313 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934004c80 con 0x7ff94006a270 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.525+0000 7ff9277fe700 1 -- 172.21.15.125:0/2502435313 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff934004e00 con 0x7ff94006a270 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.525+0000 7ff94540a700 1 -- 172.21.15.125:0/2502435313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9400afc60 con 0x7ff94006a270 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.525+0000 7ff9277fe700 1 -- 172.21.15.125:0/2502435313 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934007310 con 0x7ff94006a270 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.525+0000 7ff94540a700 1 -- 172.21.15.125:0/2502435313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff940072670 con 0x7ff94006a270 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.526+0000 7ff94540a700 1 -- 172.21.15.125:0/2502435313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9400aff40 con 0x7ff94006a270 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.526+0000 7ff9277fe700 1 -- 172.21.15.125:0/2502435313 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff93401a020 con 0x7ff94006a270 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.527+0000 7ff9277fe700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff92c0682f0 0x7ff92c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.527+0000 7ff93e7fc700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff92c0682f0 0x7ff92c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.527+0000 7ff9277fe700 1 -- 172.21.15.125:0/2502435313 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff934085800 con 0x7ff94006a270 2023-11-28T11:09:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.527+0000 7ff93e7fc700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff92c0682f0 0x7ff92c06a7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff9400ad100 tx=0x7ff930008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.531+0000 7ff9277fe700 1 -- 172.21.15.125:0/2502435313 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff934052020 con 0x7ff94006a270 2023-11-28T11:09:25.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.715+0000 7ff94540a700 1 -- 172.21.15.125:0/2502435313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9400743f0 con 0x7ff94006a270 2023-11-28T11:09:25.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.717+0000 7ff9277fe700 1 -- 172.21.15.125:0/2502435313 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7ff934055640 con 0x7ff94006a270 2023-11-28T11:09:25.718 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:25.719 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":26,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:19.047682+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 -- 172.21.15.125:0/2502435313 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff92c0682f0 msgr2=0x7ff92c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff92c0682f0 0x7ff92c06a7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff9400ad100 tx=0x7ff930008040 comp rx=0 tx=0).stop 2023-11-28T11:09:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 -- 172.21.15.125:0/2502435313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff94006a270 msgr2=0x7ff940097560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff94006a270 0x7ff940097560 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c550 tx=0x7ff93400c910 comp rx=0 tx=0).stop 2023-11-28T11:09:25.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 -- 172.21.15.125:0/2502435313 shutdown_connections 2023-11-28T11:09:25.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9400ae520 0x7ff940154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff94006a270 0x7ff940097560 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff92c0682f0 0x7ff92c06a7a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 --2- 172.21.15.125:0/2502435313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9400ac420 0x7ff9401545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 -- 172.21.15.125:0/2502435313 >> 172.21.15.125:0/2502435313 conn(0x7ff9400b2fc0 msgr2=0x7ff94006d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:25.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 -- 172.21.15.125:0/2502435313 shutdown_connections 2023-11-28T11:09:25.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.719+0000 7ff94540a700 1 -- 172.21.15.125:0/2502435313 wait complete. 2023-11-28T11:09:25.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:25.733 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:25.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.854+0000 7fde46c78700 1 Processor -- start 2023-11-28T11:09:25.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.854+0000 7fde46c78700 1 -- start start 2023-11-28T11:09:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde46c78700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fde401599b0 0x7fde4015d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde46c78700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde40159ec0 con 0x7fde400af0a0 2023-11-28T11:09:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde46c78700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4015aa60 con 0x7fde400b1650 2023-11-28T11:09:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde46c78700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4015d8a0 con 0x7fde401599b0 2023-11-28T11:09:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde45215700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fde400af0a0 0x7fde4015a350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42610/0 (socket says 172.21.15.125:42610) 2023-11-28T11:09:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde45215700 1 -- 172.21.15.125:0/1495396749 learned_addr learned my addr 172.21.15.125:0/1495396749 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde3ffff700 1 --2- 172.21.15.125:0/1495396749 >> v2:172.21.15.167:3300/0 conn(0x7fde401599b0 0x7fde4015d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606102846 0 0) 0x7fde40159ec0 con 0x7fde400af0a0 2023-11-28T11:09:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde300035b0 con 0x7fde400af0a0 2023-11-28T11:09:25.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700607098 0 0) 0x7fde4015aa60 con 0x7fde400b1650 2023-11-28T11:09:25.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde40159ec0 con 0x7fde400b1650 2023-11-28T11:09:25.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 34486589 0 0) 0x7fde300035b0 con 0x7fde400af0a0 2023-11-28T11:09:25.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 >> v2:172.21.15.167:3300/0 conn(0x7fde401599b0 msgr2=0x7fde4015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:25.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde3f7fe700 1 --2- 172.21.15.125:0/1495396749 >> v2:172.21.15.167:3300/0 conn(0x7fde401599b0 0x7fde4015d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.855+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 >> v1:172.21.15.167:6789/0 conn(0x7fde400b1650 legacy=0x7fde400b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4015db80 con 0x7fde400af0a0 2023-11-28T11:09:25.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fde380019f0 con 0x7fde400af0a0 2023-11-28T11:09:25.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 >> v1:172.21.15.125:6789/0 conn(0x7fde400af0a0 legacy=0x7fde4015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde30003b90 0x7fde30003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde30004850 0x7fde30004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde30005200 0x7fde3000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4015d8a0 con 0x7fde30003b90 2023-11-28T11:09:25.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3000c060 con 0x7fde30005200 2023-11-28T11:09:25.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3000c220 con 0x7fde30004850 2023-11-28T11:09:25.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde44a14700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde30003b90 0x7fde30003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde45215700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde30005200 0x7fde3000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3ffff700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde30004850 0x7fde30004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde44a14700 1 -- 172.21.15.125:0/1495396749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde30004850 msgr2=0x7fde30004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:25.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde44a14700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde30004850 0x7fde30004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde44a14700 1 -- 172.21.15.125:0/1495396749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde30005200 msgr2=0x7fde3000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:25.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde44a14700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde30005200 0x7fde3000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde45215700 1 -- 172.21.15.125:0/1495396749 reap_dead start 2023-11-28T11:09:25.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde44a14700 1 -- 172.21.15.125:0/1495396749 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde300035b0 con 0x7fde30003b90 2023-11-28T11:09:25.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3ffff700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde30004850 0x7fde30004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:25.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde44a14700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde30003b90 0x7fde30003f80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fde34001940 tx=0x7fde30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00bc45488e15368 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:25.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34001430 con 0x7fde30003b90 2023-11-28T11:09:25.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde34001d70 con 0x7fde30003b90 2023-11-28T11:09:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.856+0000 7fde3f7fe700 1 -- 172.21.15.125:0/1495396749 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34005530 con 0x7fde30003b90 2023-11-28T11:09:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.857+0000 7fde46c78700 1 -- 172.21.15.125:0/1495396749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde30003b90 msgr2=0x7fde30003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.857+0000 7fde46c78700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde30003b90 0x7fde30003f80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fde34001940 tx=0x7fde30005880 comp rx=0 tx=0).stop 2023-11-28T11:09:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.857+0000 7fde46c78700 1 -- 172.21.15.125:0/1495396749 shutdown_connections 2023-11-28T11:09:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.857+0000 7fde46c78700 1 --2- 172.21.15.125:0/1495396749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde30003b90 0x7fde30003f80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.857+0000 7fde46c78700 1 -- 172.21.15.125:0/1495396749 >> 172.21.15.125:0/1495396749 conn(0x7fde4006c010 msgr2=0x7fde400cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.857+0000 7fde46c78700 1 -- 172.21.15.125:0/1495396749 shutdown_connections 2023-11-28T11:09:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.857+0000 7fde46c78700 1 -- 172.21.15.125:0/1495396749 wait complete. 2023-11-28T11:09:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.858+0000 7fde46c78700 1 Processor -- start 2023-11-28T11:09:25.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.858+0000 7fde46c78700 1 -- start start 2023-11-28T11:09:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde46c78700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde30003b90 0x7fde4014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde46c78700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde400c63e0 0x7fde400c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde46c78700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde400c6850 0x7fde400c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde46c78700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde400c7af0 con 0x7fde400c63e0 2023-11-28T11:09:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde46c78700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde400c5340 con 0x7fde30003b90 2023-11-28T11:09:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde46c78700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde400c5620 con 0x7fde400c6850 2023-11-28T11:09:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde3ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde400c63e0 0x7fde400c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde3ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde400c63e0 0x7fde400c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58496/0 (socket says 172.21.15.125:58496) 2023-11-28T11:09:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde3ffff700 1 -- 172.21.15.125:0/2154936286 learned_addr learned my addr 172.21.15.125:0/2154936286 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde44a14700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde30003b90 0x7fde4014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde45215700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde400c6850 0x7fde400c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde3ffff700 1 -- 172.21.15.125:0/2154936286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde400c6850 msgr2=0x7fde400c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde3ffff700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde400c6850 0x7fde400c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde3ffff700 1 -- 172.21.15.125:0/2154936286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde30003b90 msgr2=0x7fde4014cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:25.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde3ffff700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde30003b90 0x7fde4014cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.859+0000 7fde3ffff700 1 -- 172.21.15.125:0/2154936286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4015a350 con 0x7fde400c63e0 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.860+0000 7fde3ffff700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde400c63e0 0x7fde400c6ca0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fde2c011510 tx=0x7fde2c011820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.860+0000 7fde3d7fa700 1 -- 172.21.15.125:0/2154936286 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c004440 con 0x7fde400c63e0 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.860+0000 7fde3d7fa700 1 -- 172.21.15.125:0/2154936286 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c0045a0 con 0x7fde400c63e0 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.860+0000 7fde46c78700 1 -- 172.21.15.125:0/2154936286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4015de60 con 0x7fde400c63e0 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.860+0000 7fde3d7fa700 1 -- 172.21.15.125:0/2154936286 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c0038e0 con 0x7fde400c63e0 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.860+0000 7fde46c78700 1 -- 172.21.15.125:0/2154936286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4015a4e0 con 0x7fde400c63e0 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.861+0000 7fde46c78700 1 -- 172.21.15.125:0/2154936286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde400c6230 con 0x7fde400c63e0 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.861+0000 7fde3d7fa700 1 -- 172.21.15.125:0/2154936286 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fde2c00f070 con 0x7fde400c63e0 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.861+0000 7fde3d7fa700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fde240682f0 0x7fde2406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.861+0000 7fde3d7fa700 1 -- 172.21.15.125:0/2154936286 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fde2c086010 con 0x7fde400c63e0 2023-11-28T11:09:25.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.861+0000 7fde44a14700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fde240682f0 0x7fde2406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:25.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.862+0000 7fde44a14700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fde240682f0 0x7fde2406a7a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fde34000c00 tx=0x7fde3401f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:25.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:25.865+0000 7fde3d7fa700 1 -- 172.21.15.125:0/2154936286 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fde2c052830 con 0x7fde400c63e0 2023-11-28T11:09:26.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.046+0000 7fde46c78700 1 -- 172.21.15.125:0/2154936286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde4015a880 con 0x7fde400c63e0 2023-11-28T11:09:26.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.046+0000 7fde3d7fa700 1 -- 172.21.15.125:0/2154936286 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde2c055e50 con 0x7fde400c63e0 2023-11-28T11:09:26.048 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:26.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 -- 172.21.15.125:0/2154936286 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fde240682f0 msgr2=0x7fde2406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fde240682f0 0x7fde2406a7a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fde34000c00 tx=0x7fde3401f040 comp rx=0 tx=0).stop 2023-11-28T11:09:26.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 -- 172.21.15.125:0/2154936286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde400c63e0 msgr2=0x7fde400c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde400c63e0 0x7fde400c6ca0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fde2c011510 tx=0x7fde2c011820 comp rx=0 tx=0).stop 2023-11-28T11:09:26.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 -- 172.21.15.125:0/2154936286 shutdown_connections 2023-11-28T11:09:26.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fde240682f0 0x7fde2406a7a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde400c6850 0x7fde400c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde30003b90 0x7fde4014cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 --2- 172.21.15.125:0/2154936286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde400c63e0 0x7fde400c6ca0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 -- 172.21.15.125:0/2154936286 >> 172.21.15.125:0/2154936286 conn(0x7fde4006c010 msgr2=0x7fde4006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:26.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 -- 172.21.15.125:0/2154936286 shutdown_connections 2023-11-28T11:09:26.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.048+0000 7fde46c78700 1 -- 172.21.15.125:0/2154936286 wait complete. 2023-11-28T11:09:26.062 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:26.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.185+0000 7f13ee379700 1 Processor -- start 2023-11-28T11:09:26.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.185+0000 7f13ee379700 1 -- start start 2023-11-28T11:09:26.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.186+0000 7f13ee379700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13e8158e10 0x7f13e80cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.186+0000 7f13ee379700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13e80ae850 0x7f13e806c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.186+0000 7f13ee379700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f13e806c980 0x7f13e815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.186+0000 7f13ee379700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e806ac30 con 0x7f13e8158e10 2023-11-28T11:09:26.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.186+0000 7f13ee379700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e806ce00 con 0x7f13e806c980 2023-11-28T11:09:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.186+0000 7f13ee379700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80ca140 con 0x7f13e80ae850 2023-11-28T11:09:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.186+0000 7f13e7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13e8158e10 0x7f13e80cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.186+0000 7f13e7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13e8158e10 0x7f13e80cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58502/0 (socket says 172.21.15.125:58502) 2023-11-28T11:09:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.186+0000 7f13e7fff700 1 -- 172.21.15.125:0/2169643065 learned_addr learned my addr 172.21.15.125:0/2169643065 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13ec916700 1 --2- 172.21.15.125:0/2169643065 >> v2:172.21.15.167:3300/0 conn(0x7f13e806c980 0x7f13e815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13dffff700 1 --2- 172.21.15.125:0/2169643065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13e80ae850 0x7f13e806c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13e7fff700 1 -- 172.21.15.125:0/2169643065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13e80ae850 msgr2=0x7f13e806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13e7fff700 1 --2- 172.21.15.125:0/2169643065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13e80ae850 0x7f13e806c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13e7fff700 1 -- 172.21.15.125:0/2169643065 >> v2:172.21.15.167:3300/0 conn(0x7f13e806c980 msgr2=0x7f13e815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13e7fff700 1 --2- 172.21.15.125:0/2169643065 >> v2:172.21.15.167:3300/0 conn(0x7f13e806c980 0x7f13e815c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13e7fff700 1 -- 172.21.15.125:0/2169643065 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e80c9b80 con 0x7f13e8158e10 2023-11-28T11:09:26.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13dffff700 1 --2- 172.21.15.125:0/2169643065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13e80ae850 0x7f13e806c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:26.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13ec916700 1 --2- 172.21.15.125:0/2169643065 >> v2:172.21.15.167:3300/0 conn(0x7f13e806c980 0x7f13e815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:26.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13e7fff700 1 --2- 172.21.15.125:0/2169643065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13e8158e10 0x7f13e80cb5b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f13e80cae10 tx=0x7f13d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3541a691fd6c69c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:26.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13e77fe700 1 -- 172.21.15.125:0/2169643065 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d800b870 con 0x7f13e8158e10 2023-11-28T11:09:26.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13e77fe700 1 -- 172.21.15.125:0/2169643065 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d800b9d0 con 0x7f13e8158e10 2023-11-28T11:09:26.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13e77fe700 1 -- 172.21.15.125:0/2169643065 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d800bd60 con 0x7f13e8158e10 2023-11-28T11:09:26.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13ee379700 1 -- 172.21.15.125:0/2169643065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13e8158e10 msgr2=0x7f13e80cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13ee379700 1 --2- 172.21.15.125:0/2169643065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13e8158e10 0x7f13e80cb5b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f13e80cae10 tx=0x7f13d8009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13ee379700 1 -- 172.21.15.125:0/2169643065 shutdown_connections 2023-11-28T11:09:26.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13ee379700 1 --2- 172.21.15.125:0/2169643065 >> v2:172.21.15.167:3300/0 conn(0x7f13e806c980 0x7f13e815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13ee379700 1 --2- 172.21.15.125:0/2169643065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13e8158e10 0x7f13e80cb5b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13ee379700 1 --2- 172.21.15.125:0/2169643065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13e80ae850 0x7f13e806c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.187+0000 7f13ee379700 1 -- 172.21.15.125:0/2169643065 >> 172.21.15.125:0/2169643065 conn(0x7f13e80cf400 msgr2=0x7f13e80cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:26.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.188+0000 7f13ee379700 1 -- 172.21.15.125:0/2169643065 shutdown_connections 2023-11-28T11:09:26.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.188+0000 7f13ee379700 1 -- 172.21.15.125:0/2169643065 wait complete. 2023-11-28T11:09:26.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.189+0000 7f13ee379700 1 Processor -- start 2023-11-28T11:09:26.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.189+0000 7f13ee379700 1 -- start start 2023-11-28T11:09:26.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.189+0000 7f13ee379700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e806c980 0x7f13e815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.189+0000 7f13ee379700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13e80ae850 0x7f13e80c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.189+0000 7f13ee379700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13e8158e10 0x7f13e80cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.189+0000 7f13ee379700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80b2380 con 0x7f13e80ae850 2023-11-28T11:09:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.189+0000 7f13ee379700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80b3ac0 con 0x7f13e806c980 2023-11-28T11:09:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.189+0000 7f13ee379700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e815b7c0 con 0x7f13e8158e10 2023-11-28T11:09:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.189+0000 7f13dffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13e80ae850 0x7f13e80c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13dffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13e80ae850 0x7f13e80c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58510/0 (socket says 172.21.15.125:58510) 2023-11-28T11:09:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13dffff700 1 -- 172.21.15.125:0/1907625121 learned_addr learned my addr 172.21.15.125:0/1907625121 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13e7fff700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e806c980 0x7f13e815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13ec916700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13e8158e10 0x7f13e80cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13dffff700 1 -- 172.21.15.125:0/1907625121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13e8158e10 msgr2=0x7f13e80cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13dffff700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13e8158e10 0x7f13e80cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13dffff700 1 -- 172.21.15.125:0/1907625121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e806c980 msgr2=0x7f13e815aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13dffff700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e806c980 0x7f13e815aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13dffff700 1 -- 172.21.15.125:0/1907625121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d8009550 con 0x7f13e80ae850 2023-11-28T11:09:26.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13dffff700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13e80ae850 0x7f13e80c3f80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c750 tx=0x7f13d000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:26.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13e57fa700 1 -- 172.21.15.125:0/1907625121 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0011800 con 0x7f13e80ae850 2023-11-28T11:09:26.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13e57fa700 1 -- 172.21.15.125:0/1907625121 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d0011960 con 0x7f13e80ae850 2023-11-28T11:09:26.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13ee379700 1 -- 172.21.15.125:0/1907625121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e806ae20 con 0x7f13e80ae850 2023-11-28T11:09:26.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13e57fa700 1 -- 172.21.15.125:0/1907625121 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0011cd0 con 0x7f13e80ae850 2023-11-28T11:09:26.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.190+0000 7f13ee379700 1 -- 172.21.15.125:0/1907625121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e80c9e60 con 0x7f13e80ae850 2023-11-28T11:09:26.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.191+0000 7f13ee379700 1 -- 172.21.15.125:0/1907625121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e806b100 con 0x7f13e80ae850 2023-11-28T11:09:26.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.191+0000 7f13e57fa700 1 -- 172.21.15.125:0/1907625121 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f13d0020070 con 0x7f13e80ae850 2023-11-28T11:09:26.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.192+0000 7f13e57fa700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13c80682f0 0x7f13c806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.192+0000 7f13e57fa700 1 -- 172.21.15.125:0/1907625121 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f13d00859b0 con 0x7f13e80ae850 2023-11-28T11:09:26.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.192+0000 7f13e7fff700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13c80682f0 0x7f13c806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.192+0000 7f13e7fff700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13c80682f0 0x7f13c806a7a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f13d8014040 tx=0x7f13d8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:26.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.196+0000 7f13e57fa700 1 -- 172.21.15.125:0/1907625121 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f13d00521d0 con 0x7f13e80ae850 2023-11-28T11:09:26.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.378+0000 7f13ee379700 1 -- 172.21.15.125:0/1907625121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f13e8074440 con 0x7f13e80ae850 2023-11-28T11:09:26.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.379+0000 7f13e57fa700 1 -- 172.21.15.125:0/1907625121 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f13d00557f0 con 0x7f13e80ae850 2023-11-28T11:09:26.380 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 -- 172.21.15.125:0/1907625121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13c80682f0 msgr2=0x7f13c806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13c80682f0 0x7f13c806a7a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f13d8014040 tx=0x7f13d8008030 comp rx=0 tx=0).stop 2023-11-28T11:09:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 -- 172.21.15.125:0/1907625121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13e80ae850 msgr2=0x7f13e80c3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13e80ae850 0x7f13e80c3f80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c750 tx=0x7f13d000ca60 comp rx=0 tx=0).stop 2023-11-28T11:09:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 -- 172.21.15.125:0/1907625121 shutdown_connections 2023-11-28T11:09:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13c80682f0 0x7f13c806a7a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13e8158e10 0x7f13e80cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e806c980 0x7f13e815aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 --2- 172.21.15.125:0/1907625121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13e80ae850 0x7f13e80c3f80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 -- 172.21.15.125:0/1907625121 >> 172.21.15.125:0/1907625121 conn(0x7f13e80cf400 msgr2=0x7f13e80aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 -- 172.21.15.125:0/1907625121 shutdown_connections 2023-11-28T11:09:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.381+0000 7f13ee379700 1 -- 172.21.15.125:0/1907625121 wait complete. 2023-11-28T11:09:26.395 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.516+0000 7f168d768700 1 Processor -- start 2023-11-28T11:09:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.516+0000 7f168d768700 1 -- start start 2023-11-28T11:09:26.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.516+0000 7f168d768700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158d50 0x7f16880cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.516+0000 7f168d768700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16880cdf00 con 0x7f1688158980 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.516+0000 7f168d768700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16880c9110 con 0x7f168806d4e0 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.516+0000 7f168d768700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168806d170 con 0x7f1688158d50 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.517+0000 7f1686ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1688158980 0x7f16880ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42640/0 (socket says 172.21.15.125:42640) 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.517+0000 7f1686ffd700 1 -- 172.21.15.125:0/3624335914 learned_addr learned my addr 172.21.15.125:0/3624335914 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.517+0000 7f16867fc700 1 --2- 172.21.15.125:0/3624335914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158d50 0x7f16880cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.517+0000 7f1685ffb700 1 -- 172.21.15.125:0/3624335914 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897662464 0 0) 0x7f16880cdf00 con 0x7f1688158980 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.517+0000 7f1685ffb700 1 -- 172.21.15.125:0/3624335914 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16700035b0 con 0x7f1688158980 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.517+0000 7f1685ffb700 1 -- 172.21.15.125:0/3624335914 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705119126 0 0) 0x7f16880c9110 con 0x7f168806d4e0 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.517+0000 7f16867fc700 1 -- 172.21.15.125:0/3624335914 >> v1:172.21.15.167:6789/0 conn(0x7f168806d4e0 legacy=0x7f168806b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.517+0000 7f16867fc700 1 -- 172.21.15.125:0/3624335914 >> v1:172.21.15.125:6789/0 conn(0x7f1688158980 legacy=0x7f16880ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.517+0000 7f16867fc700 1 -- 172.21.15.125:0/3624335914 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16880c93f0 con 0x7f1688158d50 2023-11-28T11:09:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.517+0000 7f16867fc700 1 --2- 172.21.15.125:0/3624335914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158d50 0x7f16880cc690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f167c009870 tx=0x7f167c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3020e35b3dd9fdf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.517+0000 7f1685ffb700 1 -- 172.21.15.125:0/3624335914 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678001670 con 0x7f1688158d50 2023-11-28T11:09:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.518+0000 7f1685ffb700 1 -- 172.21.15.125:0/3624335914 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167c004030 con 0x7f1688158d50 2023-11-28T11:09:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.518+0000 7f1685ffb700 1 -- 172.21.15.125:0/3624335914 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c0043c0 con 0x7f1688158d50 2023-11-28T11:09:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.518+0000 7f168d768700 1 -- 172.21.15.125:0/3624335914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158d50 msgr2=0x7f16880cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.518+0000 7f168d768700 1 --2- 172.21.15.125:0/3624335914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158d50 0x7f16880cc690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f167c009870 tx=0x7f167c009b80 comp rx=0 tx=0).stop 2023-11-28T11:09:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.518+0000 7f168d768700 1 -- 172.21.15.125:0/3624335914 shutdown_connections 2023-11-28T11:09:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.518+0000 7f168d768700 1 --2- 172.21.15.125:0/3624335914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158d50 0x7f16880cc690 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.518+0000 7f168d768700 1 -- 172.21.15.125:0/3624335914 >> 172.21.15.125:0/3624335914 conn(0x7f16880cb540 msgr2=0x7f16880cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.518+0000 7f168d768700 1 -- 172.21.15.125:0/3624335914 shutdown_connections 2023-11-28T11:09:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.518+0000 7f168d768700 1 -- 172.21.15.125:0/3624335914 wait complete. 2023-11-28T11:09:26.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.519+0000 7f168d768700 1 Processor -- start 2023-11-28T11:09:26.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.519+0000 7f168d768700 1 -- start start 2023-11-28T11:09:26.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f168d768700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f168806d4e0 0x7f16880b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f168d768700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158980 0x7f16880c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f168d768700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1688158d50 0x7f16880c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f168d768700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16880c80b0 con 0x7f168806d4e0 2023-11-28T11:09:26.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f168d768700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16880c7200 con 0x7f1688158d50 2023-11-28T11:09:26.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f168d768700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16880c74a0 con 0x7f1688158980 2023-11-28T11:09:26.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f1686ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f168806d4e0 0x7f16880b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f1686ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f168806d4e0 0x7f16880b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58522/0 (socket says 172.21.15.125:58522) 2023-11-28T11:09:26.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f1686ffd700 1 -- 172.21.15.125:0/4286715940 learned_addr learned my addr 172.21.15.125:0/4286715940 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:26.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f16877fe700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1688158d50 0x7f16880c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f16867fc700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158980 0x7f16880c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.520+0000 7f1686ffd700 1 -- 172.21.15.125:0/4286715940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158980 msgr2=0x7f16880c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f1686ffd700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158980 0x7f16880c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f1686ffd700 1 -- 172.21.15.125:0/4286715940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1688158d50 msgr2=0x7f16880c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f1686ffd700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1688158d50 0x7f16880c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f1686ffd700 1 -- 172.21.15.125:0/4286715940 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c0094a0 con 0x7f168806d4e0 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f16867fc700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158980 0x7f16880c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f16877fe700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1688158d50 0x7f16880c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f1686ffd700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f168806d4e0 0x7f16880b1ba0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f167800c750 tx=0x7f167800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f166f7fe700 1 -- 172.21.15.125:0/4286715940 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678004c80 con 0x7f168806d4e0 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f166f7fe700 1 -- 172.21.15.125:0/4286715940 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1678004de0 con 0x7f168806d4e0 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f166f7fe700 1 -- 172.21.15.125:0/4286715940 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678007310 con 0x7f168806d4e0 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f168d768700 1 -- 172.21.15.125:0/4286715940 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16880cdb90 con 0x7f168806d4e0 2023-11-28T11:09:26.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.521+0000 7f168d768700 1 -- 172.21.15.125:0/4286715940 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16880cd8b0 con 0x7f168806d4e0 2023-11-28T11:09:26.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.522+0000 7f168d768700 1 -- 172.21.15.125:0/4286715940 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16880cd350 con 0x7f168806d4e0 2023-11-28T11:09:26.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.522+0000 7f166f7fe700 1 -- 172.21.15.125:0/4286715940 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1678010070 con 0x7f168806d4e0 2023-11-28T11:09:26.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.523+0000 7f166f7fe700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f16740682f0 0x7f167406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.523+0000 7f166f7fe700 1 -- 172.21.15.125:0/4286715940 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1678084e10 con 0x7f168806d4e0 2023-11-28T11:09:26.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.523+0000 7f16867fc700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f16740682f0 0x7f167406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.523+0000 7f16867fc700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f16740682f0 0x7f167406a7a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f167c009870 tx=0x7f167c008000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:26.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.527+0000 7f166f7fe700 1 -- 172.21.15.125:0/4286715940 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1678051630 con 0x7f168806d4e0 2023-11-28T11:09:26.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.707+0000 7f168d768700 1 -- 172.21.15.125:0/4286715940 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16880c8390 con 0x7f168806d4e0 2023-11-28T11:09:26.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.708+0000 7f166f7fe700 1 -- 172.21.15.125:0/4286715940 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16780180a0 con 0x7f168806d4e0 2023-11-28T11:09:26.710 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:26.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 -- 172.21.15.125:0/4286715940 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f16740682f0 msgr2=0x7f167406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f16740682f0 0x7f167406a7a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f167c009870 tx=0x7f167c008000 comp rx=0 tx=0).stop 2023-11-28T11:09:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 -- 172.21.15.125:0/4286715940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f168806d4e0 msgr2=0x7f16880b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f168806d4e0 0x7f16880b1ba0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f167800c750 tx=0x7f167800cb10 comp rx=0 tx=0).stop 2023-11-28T11:09:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 -- 172.21.15.125:0/4286715940 shutdown_connections 2023-11-28T11:09:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1688158d50 0x7f16880c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f168806d4e0 0x7f16880b1ba0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f16740682f0 0x7f167406a7a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 --2- 172.21.15.125:0/4286715940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1688158980 0x7f16880c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 -- 172.21.15.125:0/4286715940 >> 172.21.15.125:0/4286715940 conn(0x7f16880cb540 msgr2=0x7f16880ae460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:26.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 -- 172.21.15.125:0/4286715940 shutdown_connections 2023-11-28T11:09:26.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.710+0000 7f168d768700 1 -- 172.21.15.125:0/4286715940 wait complete. 2023-11-28T11:09:26.723 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:26.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.844+0000 7fc3f4c1e700 1 Processor -- start 2023-11-28T11:09:26.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.844+0000 7fc3f4c1e700 1 -- start start 2023-11-28T11:09:26.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.845+0000 7fc3f4c1e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f015c810 0x7fc3f0160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.845+0000 7fc3f4c1e700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc3f00718e0 0x7fc3f006c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.845+0000 7fc3f4c1e700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f01607a0 con 0x7fc3f006cdc0 2023-11-28T11:09:26.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.845+0000 7fc3f4c1e700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f015cbe0 con 0x7fc3f00718e0 2023-11-28T11:09:26.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.845+0000 7fc3f4c1e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f0160a50 con 0x7fc3f015c810 2023-11-28T11:09:26.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.845+0000 7fc3ee59c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f015c810 0x7fc3f0160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.845+0000 7fc3edd9b700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc3f00718e0 0x7fc3f006c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.845+0000 7fc3eed9d700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc3f006cdc0 0x7fc3f006a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:45460/0 (socket says 172.21.15.125:45460) 2023-11-28T11:09:26.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.845+0000 7fc3eed9d700 1 -- 172.21.15.125:0/1741808201 learned_addr learned my addr 172.21.15.125:0/1741808201 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:26.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.846+0000 7fc3ed59a700 1 -- 172.21.15.125:0/1741808201 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731763598 0 0) 0x7fc3f01607a0 con 0x7fc3f006cdc0 2023-11-28T11:09:26.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.846+0000 7fc3ee59c700 1 -- 172.21.15.125:0/1741808201 >> v2:172.21.15.167:3300/0 conn(0x7fc3f00718e0 msgr2=0x7fc3f006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:26.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.846+0000 7fc3ee59c700 1 --2- 172.21.15.125:0/1741808201 >> v2:172.21.15.167:3300/0 conn(0x7fc3f00718e0 0x7fc3f006c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.846+0000 7fc3ee59c700 1 -- 172.21.15.125:0/1741808201 >> v1:172.21.15.167:6789/0 conn(0x7fc3f006cdc0 legacy=0x7fc3f006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.846+0000 7fc3ee59c700 1 -- 172.21.15.125:0/1741808201 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f0160d30 con 0x7fc3f015c810 2023-11-28T11:09:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.846+0000 7fc3ee59c700 1 --2- 172.21.15.125:0/1741808201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f015c810 0x7fc3f0160260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009840 tx=0x7fc3e4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f652aedd83694a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.846+0000 7fc3ed59a700 1 -- 172.21.15.125:0/1741808201 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4011830 con 0x7fc3f015c810 2023-11-28T11:09:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.846+0000 7fc3ed59a700 1 -- 172.21.15.125:0/1741808201 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e4011990 con 0x7fc3f015c810 2023-11-28T11:09:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.846+0000 7fc3ed59a700 1 -- 172.21.15.125:0/1741808201 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4011d20 con 0x7fc3f015c810 2023-11-28T11:09:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.847+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/1741808201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f015c810 msgr2=0x7fc3f0160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.847+0000 7fc3f4c1e700 1 --2- 172.21.15.125:0/1741808201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f015c810 0x7fc3f0160260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009840 tx=0x7fc3e4009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.847+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/1741808201 shutdown_connections 2023-11-28T11:09:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.847+0000 7fc3f4c1e700 1 --2- 172.21.15.125:0/1741808201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f015c810 0x7fc3f0160260 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.847+0000 7fc3f4c1e700 1 --2- 172.21.15.125:0/1741808201 >> v2:172.21.15.167:3300/0 conn(0x7fc3f00718e0 0x7fc3f006c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.847+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/1741808201 >> 172.21.15.125:0/1741808201 conn(0x7fc3f006c010 msgr2=0x7fc3f00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:26.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.847+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/1741808201 shutdown_connections 2023-11-28T11:09:26.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.847+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/1741808201 wait complete. 2023-11-28T11:09:26.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.848+0000 7fc3f4c1e700 1 Processor -- start 2023-11-28T11:09:26.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.848+0000 7fc3f4c1e700 1 -- start start 2023-11-28T11:09:26.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3f4c1e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3f006cdc0 0x7fc3f0152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3f4c1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3f00718e0 0x7fc3f00b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3f4c1e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f015c810 0x7fc3f00b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3f4c1e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f0152960 con 0x7fc3f00718e0 2023-11-28T11:09:26.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3f4c1e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f015cec0 con 0x7fc3f006cdc0 2023-11-28T11:09:26.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3f4c1e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f015d1a0 con 0x7fc3f015c810 2023-11-28T11:09:26.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3edd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3f00718e0 0x7fc3f00b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3edd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3f00718e0 0x7fc3f00b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58538/0 (socket says 172.21.15.125:58538) 2023-11-28T11:09:26.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3edd9b700 1 -- 172.21.15.125:0/2974102219 learned_addr learned my addr 172.21.15.125:0/2974102219 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:26.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3eed9d700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f015c810 0x7fc3f00b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3ee59c700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3f006cdc0 0x7fc3f0152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3edd9b700 1 -- 172.21.15.125:0/2974102219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f015c810 msgr2=0x7fc3f00b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3edd9b700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f015c810 0x7fc3f00b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3edd9b700 1 -- 172.21.15.125:0/2974102219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3f006cdc0 msgr2=0x7fc3f0152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:26.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3edd9b700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3f006cdc0 0x7fc3f0152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:26.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3edd9b700 1 -- 172.21.15.125:0/2974102219 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e40094a0 con 0x7fc3f00718e0 2023-11-28T11:09:26.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3edd9b700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3f00718e0 0x7fc3f00b2a00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000e9b0 tx=0x7fc3e000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:26.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.849+0000 7fc3deffd700 1 -- 172.21.15.125:0/2974102219 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0009710 con 0x7fc3f00718e0 2023-11-28T11:09:26.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.850+0000 7fc3deffd700 1 -- 172.21.15.125:0/2974102219 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e000ee50 con 0x7fc3f00718e0 2023-11-28T11:09:26.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.850+0000 7fc3deffd700 1 -- 172.21.15.125:0/2974102219 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000ca50 con 0x7fc3f00718e0 2023-11-28T11:09:26.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.850+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/2974102219 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f00ceb20 con 0x7fc3f00718e0 2023-11-28T11:09:26.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.850+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/2974102219 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f0161010 con 0x7fc3f00718e0 2023-11-28T11:09:26.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.851+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/2974102219 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f00ce740 con 0x7fc3f00718e0 2023-11-28T11:09:26.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.851+0000 7fc3deffd700 1 -- 172.21.15.125:0/2974102219 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc3e0019030 con 0x7fc3f00718e0 2023-11-28T11:09:26.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.851+0000 7fc3deffd700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3d00682f0 0x7fc3d006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:26.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.851+0000 7fc3deffd700 1 -- 172.21.15.125:0/2974102219 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc3e0085be0 con 0x7fc3f00718e0 2023-11-28T11:09:26.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.851+0000 7fc3ee59c700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3d00682f0 0x7fc3d006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:26.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.852+0000 7fc3ee59c700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3d00682f0 0x7fc3d006a7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009fd0 tx=0x7fc3e401d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:26.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:26.856+0000 7fc3deffd700 1 -- 172.21.15.125:0/2974102219 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc3e0052380 con 0x7fc3f00718e0 2023-11-28T11:09:27.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.038+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/2974102219 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3f015ddb0 con 0x7fc3f00718e0 2023-11-28T11:09:27.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.038+0000 7fc3deffd700 1 -- 172.21.15.125:0/2974102219 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3e00559a0 con 0x7fc3f00718e0 2023-11-28T11:09:27.043 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:27.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/2974102219 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3d00682f0 msgr2=0x7fc3d006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3d00682f0 0x7fc3d006a7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009fd0 tx=0x7fc3e401d040 comp rx=0 tx=0).stop 2023-11-28T11:09:27.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/2974102219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3f00718e0 msgr2=0x7fc3f00b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3f00718e0 0x7fc3f00b2a00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000e9b0 tx=0x7fc3e000ecc0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/2974102219 shutdown_connections 2023-11-28T11:09:27.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3d00682f0 0x7fc3d006a7a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f015c810 0x7fc3f00b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3f006cdc0 0x7fc3f0152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 --2- 172.21.15.125:0/2974102219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3f00718e0 0x7fc3f00b2a00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/2974102219 >> 172.21.15.125:0/2974102219 conn(0x7fc3f006c010 msgr2=0x7fc3f006a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:27.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/2974102219 shutdown_connections 2023-11-28T11:09:27.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.040+0000 7fc3f4c1e700 1 -- 172.21.15.125:0/2974102219 wait complete. 2023-11-28T11:09:27.054 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:09:27.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.175+0000 7f881aacf700 1 Processor -- start 2023-11-28T11:09:27.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.175+0000 7f881aacf700 1 -- start start 2023-11-28T11:09:27.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.176+0000 7f881aacf700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881406a980 0x7f88140ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.176+0000 7f881aacf700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8814071890 0x7f8814071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.176+0000 7f881aacf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881415cc10 con 0x7f88140cf710 2023-11-28T11:09:27.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.176+0000 7f881aacf700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881406c9b0 con 0x7f8814071890 2023-11-28T11:09:27.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.176+0000 7f881aacf700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881406cc90 con 0x7f881406a980 2023-11-28T11:09:27.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.176+0000 7f881886b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f88140cf710 0x7f881406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42668/0 (socket says 172.21.15.125:42668) 2023-11-28T11:09:27.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.176+0000 7f881886b700 1 -- 172.21.15.125:0/2162383830 learned_addr learned my addr 172.21.15.125:0/2162383830 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:27.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.176+0000 7f8813fff700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881406a980 0x7f88140ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.176+0000 7f881906c700 1 --2- 172.21.15.125:0/2162383830 >> v2:172.21.15.167:3300/0 conn(0x7f8814071890 0x7f8814071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.176+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382648034 0 0) 0x7f881415cc10 con 0x7f88140cf710 2023-11-28T11:09:27.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.176+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88040035b0 con 0x7f88140cf710 2023-11-28T11:09:27.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3252528598 0 0) 0x7f88040035b0 con 0x7f88140cf710 2023-11-28T11:09:27.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881406a980 msgr2=0x7f88140ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:27.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881406a980 0x7f88140ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 >> v2:172.21.15.167:3300/0 conn(0x7f8814071890 msgr2=0x7f8814071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:27.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 --2- 172.21.15.125:0/2162383830 >> v2:172.21.15.167:3300/0 conn(0x7f8814071890 0x7f8814071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881406cf70 con 0x7f88140cf710 2023-11-28T11:09:27.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f8808001670 con 0x7f88140cf710 2023-11-28T11:09:27.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 >> v1:172.21.15.125:6789/0 conn(0x7f88140cf710 legacy=0x7f881406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 0x7f8804003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881406a980 0x7f8804004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8804004d90 0x7f8804005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881406c9b0 con 0x7f8804003a00 2023-11-28T11:09:27.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881406cc90 con 0x7f8804004d90 2023-11-28T11:09:27.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880400ba10 con 0x7f881406a980 2023-11-28T11:09:27.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f881886b700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 0x7f8804003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f8813fff700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881406a980 0x7f8804004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f881906c700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8804004d90 0x7f8804005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f881886b700 1 -- 172.21.15.125:0/2162383830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881406a980 msgr2=0x7f8804004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:27.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f881886b700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881406a980 0x7f8804004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f881886b700 1 -- 172.21.15.125:0/2162383830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8804004d90 msgr2=0x7f8804005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:27.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f881886b700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8804004d90 0x7f8804005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f881886b700 1 -- 172.21.15.125:0/2162383830 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88040035b0 con 0x7f8804003a00 2023-11-28T11:09:27.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f881886b700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 0x7f8804003e10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f880800c370 tx=0x7f8804005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75319cfe43af5d86 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:27.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808007c60 con 0x7f8804003a00 2023-11-28T11:09:27.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8808005960 con 0x7f8804003a00 2023-11-28T11:09:27.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.177+0000 7f88137fe700 1 -- 172.21.15.125:0/2162383830 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808005d10 con 0x7f8804003a00 2023-11-28T11:09:27.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.178+0000 7f881aacf700 1 -- 172.21.15.125:0/2162383830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 msgr2=0x7f8804003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.178+0000 7f881aacf700 1 --2- 172.21.15.125:0/2162383830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 0x7f8804003e10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f880800c370 tx=0x7f8804005880 comp rx=0 tx=0).stop 2023-11-28T11:09:27.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.178+0000 7f881906c700 1 -- 172.21.15.125:0/2162383830 reap_dead start 2023-11-28T11:09:27.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.178+0000 7f881aacf700 1 -- 172.21.15.125:0/2162383830 shutdown_connections 2023-11-28T11:09:27.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.178+0000 7f881aacf700 1 -- 172.21.15.125:0/2162383830 >> 172.21.15.125:0/2162383830 conn(0x7f881406c010 msgr2=0x7f88140cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:27.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.178+0000 7f881aacf700 1 -- 172.21.15.125:0/2162383830 shutdown_connections 2023-11-28T11:09:27.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.178+0000 7f881aacf700 1 -- 172.21.15.125:0/2162383830 wait complete. 2023-11-28T11:09:27.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.179+0000 7f881aacf700 1 Processor -- start 2023-11-28T11:09:27.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.179+0000 7f881aacf700 1 -- start start 2023-11-28T11:09:27.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881aacf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 0x7f881415f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881aacf700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881414d1d0 0x7f88140cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881aacf700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88140c6ca0 0x7f88140c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881aacf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88140cb7a0 con 0x7f8804003a00 2023-11-28T11:09:27.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881aacf700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88140cba40 con 0x7f88140c6ca0 2023-11-28T11:09:27.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881aacf700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88140cbd20 con 0x7f881414d1d0 2023-11-28T11:09:27.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881886b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 0x7f881415f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881886b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 0x7f881415f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58556/0 (socket says 172.21.15.125:58556) 2023-11-28T11:09:27.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881886b700 1 -- 172.21.15.125:0/735163559 learned_addr learned my addr 172.21.15.125:0/735163559 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:27.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f8813fff700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881414d1d0 0x7f88140cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881906c700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88140c6ca0 0x7f88140c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881886b700 1 -- 172.21.15.125:0/735163559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881414d1d0 msgr2=0x7f88140cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.180+0000 7f881886b700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881414d1d0 0x7f88140cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.181+0000 7f881886b700 1 -- 172.21.15.125:0/735163559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88140c6ca0 msgr2=0x7f88140c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.181+0000 7f881886b700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88140c6ca0 0x7f88140c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.181+0000 7f881886b700 1 -- 172.21.15.125:0/735163559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881406d530 con 0x7f8804003a00 2023-11-28T11:09:27.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.181+0000 7f881886b700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 0x7f881415f8e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f880800c960 tx=0x7f8808000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:27.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.181+0000 7f88117fa700 1 -- 172.21.15.125:0/735163559 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808004870 con 0x7f8804003a00 2023-11-28T11:09:27.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.181+0000 7f88117fa700 1 -- 172.21.15.125:0/735163559 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88080049f0 con 0x7f8804003a00 2023-11-28T11:09:27.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.181+0000 7f881aacf700 1 -- 172.21.15.125:0/735163559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881406d250 con 0x7f8804003a00 2023-11-28T11:09:27.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.181+0000 7f88117fa700 1 -- 172.21.15.125:0/735163559 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808004da0 con 0x7f8804003a00 2023-11-28T11:09:27.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.181+0000 7f881aacf700 1 -- 172.21.15.125:0/735163559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88140ce740 con 0x7f8804003a00 2023-11-28T11:09:27.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.182+0000 7f881aacf700 1 -- 172.21.15.125:0/735163559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881414d5a0 con 0x7f8804003a00 2023-11-28T11:09:27.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.182+0000 7f88117fa700 1 -- 172.21.15.125:0/735163559 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8808024030 con 0x7f8804003a00 2023-11-28T11:09:27.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.183+0000 7f88117fa700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87f80682f0 0x7f87f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.183+0000 7f88117fa700 1 -- 172.21.15.125:0/735163559 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8808087340 con 0x7f8804003a00 2023-11-28T11:09:27.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.183+0000 7f8813fff700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87f80682f0 0x7f87f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.183+0000 7f8813fff700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87f80682f0 0x7f87f806a7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f881406ad70 tx=0x7f8800008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:27.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.187+0000 7f88117fa700 1 -- 172.21.15.125:0/735163559 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8808053ae0 con 0x7f8804003a00 2023-11-28T11:09:27.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.383+0000 7f881aacf700 1 -- 172.21.15.125:0/735163559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f88140743f0 con 0x7f8804003a00 2023-11-28T11:09:27.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.383+0000 7f88117fa700 1 -- 172.21.15.125:0/735163559 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8808007dc0 con 0x7f8804003a00 2023-11-28T11:09:27.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 -- 172.21.15.125:0/735163559 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87f80682f0 msgr2=0x7f87f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87f80682f0 0x7f87f806a7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f881406ad70 tx=0x7f8800008040 comp rx=0 tx=0).stop 2023-11-28T11:09:27.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 -- 172.21.15.125:0/735163559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 msgr2=0x7f881415f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 0x7f881415f8e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f880800c960 tx=0x7f8808000fe0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 -- 172.21.15.125:0/735163559 shutdown_connections 2023-11-28T11:09:27.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88140c6ca0 0x7f88140c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8804003a00 0x7f881415f8e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87f80682f0 0x7f87f806a7a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 --2- 172.21.15.125:0/735163559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f881414d1d0 0x7f88140cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 -- 172.21.15.125:0/735163559 >> 172.21.15.125:0/735163559 conn(0x7f881406c010 msgr2=0x7f88140b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:27.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 -- 172.21.15.125:0/735163559 shutdown_connections 2023-11-28T11:09:27.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.385+0000 7f881aacf700 1 -- 172.21.15.125:0/735163559 wait complete. 2023-11-28T11:09:27.388 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:09:27.399 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi167.front.sepia.ceph.com... 2023-11-28T11:09:27.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:27.399 DEBUG:teuthology.orchestra.run.smithi167:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-28T11:09:27.442 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:09:27.442 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:09:27.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:27.443 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T11:09:27.502 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T11:09:27.503 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:09:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.622+0000 7ff35251b700 1 Processor -- start 2023-11-28T11:09:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.623+0000 7ff35251b700 1 -- start start 2023-11-28T11:09:27.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.623+0000 7ff35251b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff34c06a270 0x7ff34c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.623+0000 7ff35251b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c06ab80 con 0x7ff34c06e570 2023-11-28T11:09:27.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.623+0000 7ff35251b700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c0b1810 con 0x7ff34c15cc80 2023-11-28T11:09:27.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.623+0000 7ff35251b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34c0b2490 con 0x7ff34c06a270 2023-11-28T11:09:27.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.623+0000 7ff34bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff34c06a270 0x7ff34c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.623+0000 7ff350ab8700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff34c06e570 0x7ff34c070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42688/0 (socket says 172.21.15.125:42688) 2023-11-28T11:09:27.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.623+0000 7ff350ab8700 1 -- 172.21.15.125:0/1012236036 learned_addr learned my addr 172.21.15.125:0/1012236036 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:27.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.624+0000 7ff34bfff700 1 -- 172.21.15.125:0/1012236036 >> v1:172.21.15.167:6789/0 conn(0x7ff34c15cc80 legacy=0x7ff34c06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:27.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.624+0000 7ff34bfff700 1 -- 172.21.15.125:0/1012236036 >> v1:172.21.15.125:6789/0 conn(0x7ff34c06e570 legacy=0x7ff34c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.624+0000 7ff34bfff700 1 -- 172.21.15.125:0/1012236036 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c0b1af0 con 0x7ff34c06a270 2023-11-28T11:09:27.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.624+0000 7ff34affd700 1 -- 172.21.15.125:0/1012236036 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445352185 0 0) 0x7ff34c06ab80 con 0x7ff34c06e570 2023-11-28T11:09:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.624+0000 7ff34bfff700 1 --2- 172.21.15.125:0/1012236036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c06a270 0x7ff34c06a640 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009840 tx=0x7ff33c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b808007b4add44 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.624+0000 7ff34affd700 1 -- 172.21.15.125:0/1012236036 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c004230 con 0x7ff34c06a270 2023-11-28T11:09:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.624+0000 7ff34affd700 1 -- 172.21.15.125:0/1012236036 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c004390 con 0x7ff34c06a270 2023-11-28T11:09:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.624+0000 7ff34affd700 1 -- 172.21.15.125:0/1012236036 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0036a0 con 0x7ff34c06a270 2023-11-28T11:09:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.625+0000 7ff35251b700 1 -- 172.21.15.125:0/1012236036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c06a270 msgr2=0x7ff34c06a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.625+0000 7ff35251b700 1 --2- 172.21.15.125:0/1012236036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c06a270 0x7ff34c06a640 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009840 tx=0x7ff33c009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.625+0000 7ff35251b700 1 -- 172.21.15.125:0/1012236036 shutdown_connections 2023-11-28T11:09:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.625+0000 7ff35251b700 1 --2- 172.21.15.125:0/1012236036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c06a270 0x7ff34c06a640 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.625+0000 7ff35251b700 1 -- 172.21.15.125:0/1012236036 >> 172.21.15.125:0/1012236036 conn(0x7ff34c06c010 msgr2=0x7ff34c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:27.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.625+0000 7ff35251b700 1 -- 172.21.15.125:0/1012236036 shutdown_connections 2023-11-28T11:09:27.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.625+0000 7ff35251b700 1 -- 172.21.15.125:0/1012236036 wait complete. 2023-11-28T11:09:27.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.626+0000 7ff35251b700 1 Processor -- start 2023-11-28T11:09:27.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.626+0000 7ff35251b700 1 -- start start 2023-11-28T11:09:27.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff35251b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff34c06a270 0x7ff34c06da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff35251b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c06e570 0x7ff34c14c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff35251b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff34c15cc80 0x7ff34c14ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff35251b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c15ab80 con 0x7ff34c06e570 2023-11-28T11:09:27.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff35251b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c15e7d0 con 0x7ff34c15cc80 2023-11-28T11:09:27.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff35251b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c15ae80 con 0x7ff34c06a270 2023-11-28T11:09:27.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff34b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c06e570 0x7ff34c14c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff34b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c06e570 0x7ff34c14c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58570/0 (socket says 172.21.15.125:58570) 2023-11-28T11:09:27.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff34b7fe700 1 -- 172.21.15.125:0/2621031180 learned_addr learned my addr 172.21.15.125:0/2621031180 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:27.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff350ab8700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff34c15cc80 0x7ff34c14ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff34b7fe700 1 -- 172.21.15.125:0/2621031180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff34c06a270 msgr2=0x7ff34c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff34b7fe700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff34c06a270 0x7ff34c06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff34b7fe700 1 -- 172.21.15.125:0/2621031180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff34c15cc80 msgr2=0x7ff34c14ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff34b7fe700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff34c15cc80 0x7ff34c14ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff34b7fe700 1 -- 172.21.15.125:0/2621031180 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c0094a0 con 0x7ff34c06e570 2023-11-28T11:09:27.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff34b7fe700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c06e570 0x7ff34c14c4c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff34000c4d0 tx=0x7ff34000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:27.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff348ff9700 1 -- 172.21.15.125:0/2621031180 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340011790 con 0x7ff34c06e570 2023-11-28T11:09:27.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff348ff9700 1 -- 172.21.15.125:0/2621031180 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3400118f0 con 0x7ff34c06e570 2023-11-28T11:09:27.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff35251b700 1 -- 172.21.15.125:0/2621031180 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c0b20b0 con 0x7ff34c06e570 2023-11-28T11:09:27.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff348ff9700 1 -- 172.21.15.125:0/2621031180 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340011ca0 con 0x7ff34c06e570 2023-11-28T11:09:27.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.627+0000 7ff35251b700 1 -- 172.21.15.125:0/2621031180 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c0b1dd0 con 0x7ff34c06e570 2023-11-28T11:09:27.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.628+0000 7ff35251b700 1 -- 172.21.15.125:0/2621031180 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c15daa0 con 0x7ff34c06e570 2023-11-28T11:09:27.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.629+0000 7ff348ff9700 1 -- 172.21.15.125:0/2621031180 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff340010050 con 0x7ff34c06e570 2023-11-28T11:09:27.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.629+0000 7ff348ff9700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3380682f0 0x7ff33806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.629+0000 7ff348ff9700 1 -- 172.21.15.125:0/2621031180 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff340085a50 con 0x7ff34c06e570 2023-11-28T11:09:27.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.629+0000 7ff34bfff700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3380682f0 0x7ff33806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:27.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.630+0000 7ff34bfff700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3380682f0 0x7ff33806a7a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0090b0 tx=0x7ff33c013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:27.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.633+0000 7ff348ff9700 1 -- 172.21.15.125:0/2621031180 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff340052270 con 0x7ff34c06e570 2023-11-28T11:09:27.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.859+0000 7ff35251b700 1 -- 172.21.15.125:0/2621031180 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff34c0743f0 con 0x7ff34c06e570 2023-11-28T11:09:27.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.860+0000 7ff348ff9700 1 -- 172.21.15.125:0/2621031180 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7ff340055890 con 0x7ff34c06e570 2023-11-28T11:09:27.863 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:27.863 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/678190712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":678190712},{"type":"v1","addr":"172.21.15.167:6835","nonce":678190712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2090095557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2090095557},{"type":"v1","addr":"172.21.15.167:6834","nonce":2090095557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3827244932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3827244932},{"type":"v1","addr":"172.21.15.125:6836","nonce":3827244932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:08:36.383224+0000","modified":"2023-11-28T11:08:39.391168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/573741186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":573741186},{"type":"v1","addr":"172.21.15.125:6837","nonce":573741186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:09:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 -- 172.21.15.125:0/2621031180 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3380682f0 msgr2=0x7ff33806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3380682f0 0x7ff33806a7a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0090b0 tx=0x7ff33c013040 comp rx=0 tx=0).stop 2023-11-28T11:09:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 -- 172.21.15.125:0/2621031180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c06e570 msgr2=0x7ff34c14c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c06e570 0x7ff34c14c4c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff34000c4d0 tx=0x7ff34000c890 comp rx=0 tx=0).stop 2023-11-28T11:09:27.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 -- 172.21.15.125:0/2621031180 shutdown_connections 2023-11-28T11:09:27.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff34c15cc80 0x7ff34c14ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3380682f0 0x7ff33806a7a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff34c06a270 0x7ff34c06da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 --2- 172.21.15.125:0/2621031180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c06e570 0x7ff34c14c4c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:27.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 -- 172.21.15.125:0/2621031180 >> 172.21.15.125:0/2621031180 conn(0x7ff34c06c010 msgr2=0x7ff34c0cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:27.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 -- 172.21.15.125:0/2621031180 shutdown_connections 2023-11-28T11:09:27.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.862+0000 7ff35251b700 1 -- 172.21.15.125:0/2621031180 wait complete. 2023-11-28T11:09:27.868 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-11-28T11:09:27.877 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.996+0000 7f0cba906700 1 Processor -- start 2023-11-28T11:09:27.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.996+0000 7f0cba906700 1 -- start start 2023-11-28T11:09:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.997+0000 7f0cba906700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb406a270 0x7f0cb406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:27.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.997+0000 7f0cba906700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0cb406e570 0x7f0cb4070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.997+0000 7f0cba906700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb406ab80 con 0x7f0cb415cc80 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.997+0000 7f0cba906700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb40b2490 con 0x7f0cb406e570 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.997+0000 7f0cba906700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb406e9b0 con 0x7f0cb406a270 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.997+0000 7f0cb3fff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb406a270 0x7f0cb406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.997+0000 7f0cb8ea3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0cb406e570 0x7f0cb4070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.997+0000 7f0cb3fff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb406a270 0x7f0cb406a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:53584/0 (socket says 172.21.15.125:53584) 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.997+0000 7f0cb37fe700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0cb415cc80 0x7f0cb406de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:45502/0 (socket says 172.21.15.125:45502) 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.997+0000 7f0cb8ea3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0cb406e570 0x7f0cb4070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:55306/0 (socket says 172.21.15.125:55306) 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.997+0000 7f0cb3fff700 1 -- 172.21.15.125:0/722996405 learned_addr learned my addr 172.21.15.125:0/722996405 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.998+0000 7f0cb8ea3700 1 -- 172.21.15.125:0/722996405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb406a270 msgr2=0x7f0cb406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.998+0000 7f0cb8ea3700 1 --2- 172.21.15.125:0/722996405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb406a270 0x7f0cb406a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.998+0000 7f0cb8ea3700 1 -- 172.21.15.125:0/722996405 >> v1:172.21.15.167:6789/0 conn(0x7f0cb415cc80 legacy=0x7f0cb406de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.998+0000 7f0cb8ea3700 1 -- 172.21.15.125:0/722996405 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb40b1810 con 0x7f0cb406e570 2023-11-28T11:09:28.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.998+0000 7f0cb3fff700 1 --2- 172.21.15.125:0/722996405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb406a270 0x7f0cb406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:28.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.998+0000 7f0cb8ea3700 1 --2- 172.21.15.125:0/722996405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb406e570 0x7f0cb4070d20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009d90 tx=0x7f0cac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de5e12356a86188c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:28.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.998+0000 7f0cb2ffd700 1 -- 172.21.15.125:0/722996405 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00e070 con 0x7f0cb406e570 2023-11-28T11:09:28.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.998+0000 7f0cb2ffd700 1 -- 172.21.15.125:0/722996405 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac00bb20 con 0x7f0cb406e570 2023-11-28T11:09:28.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.998+0000 7f0cb2ffd700 1 -- 172.21.15.125:0/722996405 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac012430 con 0x7f0cb406e570 2023-11-28T11:09:28.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.999+0000 7f0cba906700 1 -- 172.21.15.125:0/722996405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb406e570 msgr2=0x7f0cb4070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.999+0000 7f0cba906700 1 --2- 172.21.15.125:0/722996405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb406e570 0x7f0cb4070d20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009d90 tx=0x7f0cac00b330 comp rx=0 tx=0).stop 2023-11-28T11:09:28.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.999+0000 7f0cba906700 1 -- 172.21.15.125:0/722996405 shutdown_connections 2023-11-28T11:09:28.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.999+0000 7f0cba906700 1 --2- 172.21.15.125:0/722996405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb406e570 0x7f0cb4070d20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.999+0000 7f0cba906700 1 --2- 172.21.15.125:0/722996405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb406a270 0x7f0cb406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.999+0000 7f0cba906700 1 -- 172.21.15.125:0/722996405 >> 172.21.15.125:0/722996405 conn(0x7f0cb406c010 msgr2=0x7f0cb40cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.999+0000 7f0cba906700 1 -- 172.21.15.125:0/722996405 shutdown_connections 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:27.999+0000 7f0cba906700 1 -- 172.21.15.125:0/722996405 wait complete. 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.000+0000 7f0cba906700 1 Processor -- start 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.000+0000 7f0cba906700 1 -- start start 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cba906700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a270 0x7f0cb40cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cba906700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb406e570 0x7f0cb4152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cba906700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb415cc80 0x7f0cb415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cba906700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40b5500 con 0x7f0cb406a270 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cba906700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4153350 con 0x7f0cb406e570 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cba906700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40cc500 con 0x7f0cb415cc80 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a270 0x7f0cb40cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a270 0x7f0cb40cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58580/0 (socket says 172.21.15.125:58580) 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb3fff700 1 -- 172.21.15.125:0/3059747088 learned_addr learned my addr 172.21.15.125:0/3059747088 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb37fe700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb406e570 0x7f0cb4152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb8ea3700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb415cc80 0x7f0cb415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb3fff700 1 -- 172.21.15.125:0/3059747088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb415cc80 msgr2=0x7f0cb415b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb3fff700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb415cc80 0x7f0cb415b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb3fff700 1 -- 172.21.15.125:0/3059747088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb406e570 msgr2=0x7f0cb4152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb3fff700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb406e570 0x7f0cb4152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb3fff700 1 -- 172.21.15.125:0/3059747088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8009550 con 0x7f0cb406a270 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb3fff700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a270 0x7f0cb40cbfc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800e9e0 tx=0x7f0ca800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb0ff9700 1 -- 172.21.15.125:0/3059747088 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800ee80 con 0x7f0cb406a270 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb0ff9700 1 -- 172.21.15.125:0/3059747088 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca800c850 con 0x7f0cb406a270 2023-11-28T11:09:28.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cba906700 1 -- 172.21.15.125:0/3059747088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cac009a70 con 0x7f0cb406a270 2023-11-28T11:09:28.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.001+0000 7f0cb0ff9700 1 -- 172.21.15.125:0/3059747088 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800cbc0 con 0x7f0cb406a270 2023-11-28T11:09:28.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.002+0000 7f0cba906700 1 -- 172.21.15.125:0/3059747088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb40b1dd0 con 0x7f0cb406a270 2023-11-28T11:09:28.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.002+0000 7f0cba906700 1 -- 172.21.15.125:0/3059747088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb40b1af0 con 0x7f0cb406a270 2023-11-28T11:09:28.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.003+0000 7f0cb0ff9700 1 -- 172.21.15.125:0/3059747088 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0ca8019030 con 0x7f0cb406a270 2023-11-28T11:09:28.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.003+0000 7f0cb0ff9700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ca0068320 0x7f0ca006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.003+0000 7f0cb0ff9700 1 -- 172.21.15.125:0/3059747088 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0ca8085ab0 con 0x7f0cb406a270 2023-11-28T11:09:28.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.003+0000 7f0cb37fe700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ca0068320 0x7f0ca006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.004+0000 7f0cb37fe700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ca0068320 0x7f0ca006a7d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4000f60 tx=0x7f0ca4007f10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:28.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.007+0000 7f0cb0ff9700 1 -- 172.21.15.125:0/3059747088 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0ca80522d0 con 0x7f0cb406a270 2023-11-28T11:09:28.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.191+0000 7f0cba906700 1 -- 172.21.15.125:0/3059747088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cb40b20b0 con 0x7f0cb406a270 2023-11-28T11:09:28.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.192+0000 7f0cb0ff9700 1 -- 172.21.15.125:0/3059747088 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7f0ca8021070 con 0x7f0cb406a270 2023-11-28T11:09:28.194 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:28.194 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":26,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:19.047682+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:28.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 -- 172.21.15.125:0/3059747088 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ca0068320 msgr2=0x7f0ca006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ca0068320 0x7f0ca006a7d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4000f60 tx=0x7f0ca4007f10 comp rx=0 tx=0).stop 2023-11-28T11:09:28.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 -- 172.21.15.125:0/3059747088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a270 msgr2=0x7f0cb40cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a270 0x7f0cb40cbfc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800e9e0 tx=0x7f0ca800ecf0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 -- 172.21.15.125:0/3059747088 shutdown_connections 2023-11-28T11:09:28.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0ca0068320 0x7f0ca006a7d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cb415cc80 0x7f0cb415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cb406a270 0x7f0cb40cbfc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 --2- 172.21.15.125:0/3059747088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb406e570 0x7f0cb4152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 -- 172.21.15.125:0/3059747088 >> 172.21.15.125:0/3059747088 conn(0x7f0cb406c010 msgr2=0x7f0cb40b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 -- 172.21.15.125:0/3059747088 shutdown_connections 2023-11-28T11:09:28.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.194+0000 7f0cba906700 1 -- 172.21.15.125:0/3059747088 wait complete. 2023-11-28T11:09:28.208 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:08:34.927739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:08:35.335059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:28.208 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:28.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.329+0000 7f05a3612700 1 Processor -- start 2023-11-28T11:09:28.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.329+0000 7f05a3612700 1 -- start start 2023-11-28T11:09:28.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.330+0000 7f05a3612700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c158e10 0x7f059c0cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.330+0000 7f05a3612700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f059c06cb50 0x7f059c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.330+0000 7f05a3612700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c0ca140 con 0x7f059c0ae850 2023-11-28T11:09:28.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.330+0000 7f05a3612700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c06ac30 con 0x7f059c06cb50 2023-11-28T11:09:28.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.330+0000 7f05a3612700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0c9b80 con 0x7f059c158e10 2023-11-28T11:09:28.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.330+0000 7f05a0bad700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f059c0ae850 0x7f059c06c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42712/0 (socket says 172.21.15.125:42712) 2023-11-28T11:09:28.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.330+0000 7f05a0bad700 1 -- 172.21.15.125:0/1329938907 learned_addr learned my addr 172.21.15.125:0/1329938907 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:28.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.330+0000 7f05a1baf700 1 --2- 172.21.15.125:0/1329938907 >> v2:172.21.15.167:3300/0 conn(0x7f059c06cb50 0x7f059c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.330+0000 7f05a13ae700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c158e10 0x7f059c0cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.330+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859538320 0 0) 0x7f059c0ca140 con 0x7f059c0ae850 2023-11-28T11:09:28.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.330+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05880035b0 con 0x7f059c0ae850 2023-11-28T11:09:28.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 568104331 0 0) 0x7f05880035b0 con 0x7f059c0ae850 2023-11-28T11:09:28.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c158e10 msgr2=0x7f059c0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:28.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c158e10 0x7f059c0cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 >> v2:172.21.15.167:3300/0 conn(0x7f059c06cb50 msgr2=0x7f059c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:28.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 --2- 172.21.15.125:0/1329938907 >> v2:172.21.15.167:3300/0 conn(0x7f059c06cb50 0x7f059c070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0c9e60 con 0x7f059c0ae850 2023-11-28T11:09:28.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f0598001670 con 0x7f059c0ae850 2023-11-28T11:09:28.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 >> v1:172.21.15.125:6789/0 conn(0x7f059c0ae850 legacy=0x7f059c06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c158e10 0x7f0588003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 0x7f0588004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0588004d90 0x7f0588005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0c9b80 con 0x7f0588003f80 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058800ba10 con 0x7f0588004d90 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058800bb80 con 0x7f059c158e10 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f05a0bad700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 0x7f0588004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f05a13ae700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c158e10 0x7f0588003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f05a1baf700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0588004d90 0x7f0588005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f05a0bad700 1 -- 172.21.15.125:0/1329938907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c158e10 msgr2=0x7f0588003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f05a0bad700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c158e10 0x7f0588003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f05a0bad700 1 -- 172.21.15.125:0/1329938907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0588004d90 msgr2=0x7f0588005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f05a0bad700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0588004d90 0x7f0588005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f05a0bad700 1 -- 172.21.15.125:0/1329938907 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05880035b0 con 0x7f0588003f80 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f05a0bad700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 0x7f0588004850 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f059800d2f0 tx=0x7f0588005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb72d3189139efc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:28.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598007cf0 con 0x7f0588003f80 2023-11-28T11:09:28.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059800dc30 con 0x7f0588003f80 2023-11-28T11:09:28.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.331+0000 7f0593fff700 1 -- 172.21.15.125:0/1329938907 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598005960 con 0x7f0588003f80 2023-11-28T11:09:28.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.332+0000 7f05a3612700 1 -- 172.21.15.125:0/1329938907 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 msgr2=0x7f0588004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.332+0000 7f05a3612700 1 --2- 172.21.15.125:0/1329938907 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 0x7f0588004850 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f059800d2f0 tx=0x7f0588005880 comp rx=0 tx=0).stop 2023-11-28T11:09:28.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.332+0000 7f05a1baf700 1 -- 172.21.15.125:0/1329938907 reap_dead start 2023-11-28T11:09:28.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.332+0000 7f05a3612700 1 -- 172.21.15.125:0/1329938907 shutdown_connections 2023-11-28T11:09:28.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.332+0000 7f05a3612700 1 -- 172.21.15.125:0/1329938907 >> 172.21.15.125:0/1329938907 conn(0x7f059c0cf400 msgr2=0x7f059c0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:28.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.332+0000 7f05a3612700 1 -- 172.21.15.125:0/1329938907 shutdown_connections 2023-11-28T11:09:28.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.332+0000 7f05a3612700 1 -- 172.21.15.125:0/1329938907 wait complete. 2023-11-28T11:09:28.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.333+0000 7f05a3612700 1 Processor -- start 2023-11-28T11:09:28.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.333+0000 7f05a3612700 1 -- start start 2023-11-28T11:09:28.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a3612700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 0x7f059c1f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a3612700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f059c0c8710 0x7f059c0ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a3612700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c1f2500 0x7f059c1f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a3612700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c154090 con 0x7f0588003f80 2023-11-28T11:09:28.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a3612700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0c8b80 con 0x7f059c0c8710 2023-11-28T11:09:28.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a3612700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c1f6360 con 0x7f059c1f2500 2023-11-28T11:09:28.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a13ae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 0x7f059c1f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a13ae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 0x7f059c1f5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58602/0 (socket says 172.21.15.125:58602) 2023-11-28T11:09:28.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a13ae700 1 -- 172.21.15.125:0/3891744357 learned_addr learned my addr 172.21.15.125:0/3891744357 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:28.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a0bad700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f059c0c8710 0x7f059c0ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a1baf700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c1f2500 0x7f059c1f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a13ae700 1 -- 172.21.15.125:0/3891744357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c1f2500 msgr2=0x7f059c1f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a13ae700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c1f2500 0x7f059c1f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a13ae700 1 -- 172.21.15.125:0/3891744357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f059c0c8710 msgr2=0x7f059c0ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a13ae700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f059c0c8710 0x7f059c0ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a13ae700 1 -- 172.21.15.125:0/3891744357 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c06b100 con 0x7f0588003f80 2023-11-28T11:09:28.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.334+0000 7f05a0bad700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f059c0c8710 0x7f059c0ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:28.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.335+0000 7f05a13ae700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 0x7f059c1f5430 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f058c011aa0 tx=0x7f058c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:28.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.335+0000 7f0591ffb700 1 -- 172.21.15.125:0/3891744357 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00f980 con 0x7f0588003f80 2023-11-28T11:09:28.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.335+0000 7f0591ffb700 1 -- 172.21.15.125:0/3891744357 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00fae0 con 0x7f0588003f80 2023-11-28T11:09:28.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.335+0000 7f0591ffb700 1 -- 172.21.15.125:0/3891744357 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00fe90 con 0x7f0588003f80 2023-11-28T11:09:28.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.335+0000 7f05a3612700 1 -- 172.21.15.125:0/3891744357 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c06ae20 con 0x7f0588003f80 2023-11-28T11:09:28.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.335+0000 7f05a3612700 1 -- 172.21.15.125:0/3891744357 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c06b620 con 0x7f0588003f80 2023-11-28T11:09:28.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.336+0000 7f05a3612700 1 -- 172.21.15.125:0/3891744357 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c0743f0 con 0x7f0588003f80 2023-11-28T11:09:28.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.336+0000 7f0591ffb700 1 -- 172.21.15.125:0/3891744357 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f058c014440 con 0x7f0588003f80 2023-11-28T11:09:28.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.337+0000 7f0591ffb700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05800682f0 0x7f058006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.337+0000 7f0591ffb700 1 -- 172.21.15.125:0/3891744357 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f058c0865c0 con 0x7f0588003f80 2023-11-28T11:09:28.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.337+0000 7f05a0bad700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05800682f0 0x7f058006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.337+0000 7f05a0bad700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05800682f0 0x7f058006a7a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0598000c00 tx=0x7f0598007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:28.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.341+0000 7f0591ffb700 1 -- 172.21.15.125:0/3891744357 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f058c052d50 con 0x7f0588003f80 2023-11-28T11:09:28.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.524+0000 7f05a3612700 1 -- 172.21.15.125:0/3891744357 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f059c0b5380 con 0x7f0588003f80 2023-11-28T11:09:28.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.524+0000 7f0591ffb700 1 -- 172.21.15.125:0/3891744357 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f058c056370 con 0x7f0588003f80 2023-11-28T11:09:28.526 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:28.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 -- 172.21.15.125:0/3891744357 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05800682f0 msgr2=0x7f058006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05800682f0 0x7f058006a7a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0598000c00 tx=0x7f0598007000 comp rx=0 tx=0).stop 2023-11-28T11:09:28.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 -- 172.21.15.125:0/3891744357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 msgr2=0x7f059c1f5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 0x7f059c1f5430 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f058c011aa0 tx=0x7f058c011e60 comp rx=0 tx=0).stop 2023-11-28T11:09:28.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 -- 172.21.15.125:0/3891744357 shutdown_connections 2023-11-28T11:09:28.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f05800682f0 0x7f058006a7a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f059c1f2500 0x7f059c1f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0588003f80 0x7f059c1f5430 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 --2- 172.21.15.125:0/3891744357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f059c0c8710 0x7f059c0ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 -- 172.21.15.125:0/3891744357 >> 172.21.15.125:0/3891744357 conn(0x7f059c0cf400 msgr2=0x7f059c0af160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:28.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 -- 172.21.15.125:0/3891744357 shutdown_connections 2023-11-28T11:09:28.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.526+0000 7f05a3612700 1 -- 172.21.15.125:0/3891744357 wait complete. 2023-11-28T11:09:28.540 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:28.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.662+0000 7f11f01de700 1 Processor -- start 2023-11-28T11:09:28.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.662+0000 7f11f01de700 1 -- start start 2023-11-28T11:09:28.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11f01de700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11e8070370 0x7f11e80cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11f01de700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e80c9a50 0x7f11e80c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11f01de700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e806a310 con 0x7f11e8159710 2023-11-28T11:09:28.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11f01de700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e80707f0 con 0x7f11e8070370 2023-11-28T11:09:28.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11f01de700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80ca410 con 0x7f11e80c9a50 2023-11-28T11:09:28.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11ed779700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11e8070370 0x7f11e80cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11ed779700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11e8070370 0x7f11e80cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58610/0 (socket says 172.21.15.125:58610) 2023-11-28T11:09:28.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11ed779700 1 -- 172.21.15.125:0/2345026091 learned_addr learned my addr 172.21.15.125:0/2345026091 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11ed779700 1 -- 172.21.15.125:0/2345026091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e80c9a50 msgr2=0x7f11e80c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11ee77b700 1 --2- 172.21.15.125:0/2345026091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e80c9a50 0x7f11e80c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11ed779700 1 --2- 172.21.15.125:0/2345026091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e80c9a50 0x7f11e80c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11ed779700 1 -- 172.21.15.125:0/2345026091 >> v1:172.21.15.167:6789/0 conn(0x7f11e8159710 legacy=0x7f11e80cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11ed779700 1 -- 172.21.15.125:0/2345026091 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e80ce7e0 con 0x7f11e8070370 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11ee77b700 1 --2- 172.21.15.125:0/2345026091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e80c9a50 0x7f11e80c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.663+0000 7f11ed779700 1 --2- 172.21.15.125:0/2345026091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11e8070370 0x7f11e80cee40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009920 tx=0x7f11e4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2e931ce4c11c37 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.664+0000 7f11ecf78700 1 -- 172.21.15.125:0/2345026091 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e4004230 con 0x7f11e8070370 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.664+0000 7f11ecf78700 1 -- 172.21.15.125:0/2345026091 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e4004390 con 0x7f11e8070370 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.664+0000 7f11ecf78700 1 -- 172.21.15.125:0/2345026091 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e4009e70 con 0x7f11e8070370 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.664+0000 7f11f01de700 1 -- 172.21.15.125:0/2345026091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11e8070370 msgr2=0x7f11e80cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.664+0000 7f11f01de700 1 --2- 172.21.15.125:0/2345026091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11e8070370 0x7f11e80cee40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009920 tx=0x7f11e4009c30 comp rx=0 tx=0).stop 2023-11-28T11:09:28.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.664+0000 7f11f01de700 1 -- 172.21.15.125:0/2345026091 shutdown_connections 2023-11-28T11:09:28.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.664+0000 7f11f01de700 1 --2- 172.21.15.125:0/2345026091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e80c9a50 0x7f11e80c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.664+0000 7f11f01de700 1 --2- 172.21.15.125:0/2345026091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11e8070370 0x7f11e80cee40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.664+0000 7f11f01de700 1 -- 172.21.15.125:0/2345026091 >> 172.21.15.125:0/2345026091 conn(0x7f11e80cf400 msgr2=0x7f11e80cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:28.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.664+0000 7f11f01de700 1 -- 172.21.15.125:0/2345026091 shutdown_connections 2023-11-28T11:09:28.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.664+0000 7f11f01de700 1 -- 172.21.15.125:0/2345026091 wait complete. 2023-11-28T11:09:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.665+0000 7f11f01de700 1 Processor -- start 2023-11-28T11:09:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.665+0000 7f11f01de700 1 -- start start 2023-11-28T11:09:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.666+0000 7f11f01de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11e8070370 0x7f11e80b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.666+0000 7f11f01de700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e80c9a50 0x7f11e806c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.666+0000 7f11f01de700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e8159710 0x7f11e806c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.666+0000 7f11f01de700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80c32f0 con 0x7f11e8070370 2023-11-28T11:09:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.666+0000 7f11f01de700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e814b190 con 0x7f11e8159710 2023-11-28T11:09:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.666+0000 7f11f01de700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80c4e70 con 0x7f11e80c9a50 2023-11-28T11:09:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.666+0000 7f11edf7a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11e8070370 0x7f11e80b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.666+0000 7f11edf7a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11e8070370 0x7f11e80b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58614/0 (socket says 172.21.15.125:58614) 2023-11-28T11:09:28.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.666+0000 7f11edf7a700 1 -- 172.21.15.125:0/1148052629 learned_addr learned my addr 172.21.15.125:0/1148052629 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.666+0000 7f11ed779700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e80c9a50 0x7f11e806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11ee77b700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e8159710 0x7f11e806c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11edf7a700 1 -- 172.21.15.125:0/1148052629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e80c9a50 msgr2=0x7f11e806c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11edf7a700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e80c9a50 0x7f11e806c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11edf7a700 1 -- 172.21.15.125:0/1148052629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e8159710 msgr2=0x7f11e806c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11edf7a700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e8159710 0x7f11e806c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11edf7a700 1 -- 172.21.15.125:0/1148052629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e4009550 con 0x7f11e8070370 2023-11-28T11:09:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11edf7a700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11e8070370 0x7f11e80b3e80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f11d800c4d0 tx=0x7f11d800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11de7fc700 1 -- 172.21.15.125:0/1148052629 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8011790 con 0x7f11e8070370 2023-11-28T11:09:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11de7fc700 1 -- 172.21.15.125:0/1148052629 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d80118f0 con 0x7f11e8070370 2023-11-28T11:09:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11f01de700 1 -- 172.21.15.125:0/1148052629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e806a890 con 0x7f11e8070370 2023-11-28T11:09:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11de7fc700 1 -- 172.21.15.125:0/1148052629 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8011ca0 con 0x7f11e8070370 2023-11-28T11:09:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.667+0000 7f11f01de700 1 -- 172.21.15.125:0/1148052629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e806a5b0 con 0x7f11e8070370 2023-11-28T11:09:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.668+0000 7f11f01de700 1 -- 172.21.15.125:0/1148052629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e80ceac0 con 0x7f11e8070370 2023-11-28T11:09:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.668+0000 7f11de7fc700 1 -- 172.21.15.125:0/1148052629 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f11d8010050 con 0x7f11e8070370 2023-11-28T11:09:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.669+0000 7f11de7fc700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11cc0682f0 0x7f11cc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.669+0000 7f11ed779700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11cc0682f0 0x7f11cc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.669+0000 7f11de7fc700 1 -- 172.21.15.125:0/1148052629 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f11d8085a50 con 0x7f11e8070370 2023-11-28T11:09:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.669+0000 7f11ed779700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11cc0682f0 0x7f11cc06a7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009130 tx=0x7f11e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:28.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.673+0000 7f11de7fc700 1 -- 172.21.15.125:0/1148052629 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f11d8052270 con 0x7f11e8070370 2023-11-28T11:09:28.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.855+0000 7f11f01de700 1 -- 172.21.15.125:0/1148052629 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f11e80b03c0 con 0x7f11e8070370 2023-11-28T11:09:28.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.855+0000 7f11de7fc700 1 -- 172.21.15.125:0/1148052629 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f11d8055890 con 0x7f11e8070370 2023-11-28T11:09:28.857 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:28.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.857+0000 7f11f01de700 1 -- 172.21.15.125:0/1148052629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11cc0682f0 msgr2=0x7f11cc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.857+0000 7f11f01de700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11cc0682f0 0x7f11cc06a7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009130 tx=0x7f11e4008030 comp rx=0 tx=0).stop 2023-11-28T11:09:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.857+0000 7f11f01de700 1 -- 172.21.15.125:0/1148052629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11e8070370 msgr2=0x7f11e80b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.857+0000 7f11f01de700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11e8070370 0x7f11e80b3e80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f11d800c4d0 tx=0x7f11d800c890 comp rx=0 tx=0).stop 2023-11-28T11:09:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.858+0000 7f11f01de700 1 -- 172.21.15.125:0/1148052629 shutdown_connections 2023-11-28T11:09:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.858+0000 7f11f01de700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e8159710 0x7f11e806c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.858+0000 7f11f01de700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11e8070370 0x7f11e80b3e80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.858+0000 7f11f01de700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f11cc0682f0 0x7f11cc06a7a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.858+0000 7f11f01de700 1 --2- 172.21.15.125:0/1148052629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e80c9a50 0x7f11e806c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.858+0000 7f11f01de700 1 -- 172.21.15.125:0/1148052629 >> 172.21.15.125:0/1148052629 conn(0x7f11e80cf400 msgr2=0x7f11e80afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.858+0000 7f11f01de700 1 -- 172.21.15.125:0/1148052629 shutdown_connections 2023-11-28T11:09:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.858+0000 7f11f01de700 1 -- 172.21.15.125:0/1148052629 wait complete. 2023-11-28T11:09:28.871 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:28.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.993+0000 7f639af30700 1 Processor -- start 2023-11-28T11:09:28.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.993+0000 7f639af30700 1 -- start start 2023-11-28T11:09:28.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f639af30700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f639415a5f0 0x7f63940d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f639af30700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f63940b2ee0 0x7f63940ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f639af30700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639415a9c0 con 0x7f63940cc200 2023-11-28T11:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f639af30700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940c7b80 con 0x7f639415a5f0 2023-11-28T11:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f639af30700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940cc990 con 0x7f63940b2ee0 2023-11-28T11:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f6398ccc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f639415a5f0 0x7f63940d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f6393fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f63940cc200 0x7f63940b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42748/0 (socket says 172.21.15.125:42748) 2023-11-28T11:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f6393fff700 1 -- 172.21.15.125:0/3620970404 learned_addr learned my addr 172.21.15.125:0/3620970404 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f63994cd700 1 --2- 172.21.15.125:0/3620970404 >> v2:172.21.15.167:3300/0 conn(0x7f63940b2ee0 0x7f63940ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f6398ccc700 1 -- 172.21.15.125:0/3620970404 >> v2:172.21.15.167:3300/0 conn(0x7f63940b2ee0 msgr2=0x7f63940ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f6398ccc700 1 --2- 172.21.15.125:0/3620970404 >> v2:172.21.15.167:3300/0 conn(0x7f63940b2ee0 0x7f63940ced30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f6398ccc700 1 -- 172.21.15.125:0/3620970404 >> v1:172.21.15.125:6789/0 conn(0x7f63940cc200 legacy=0x7f63940b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f63937fe700 1 -- 172.21.15.125:0/3620970404 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029943827 0 0) 0x7f639415a9c0 con 0x7f63940cc200 2023-11-28T11:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f6398ccc700 1 -- 172.21.15.125:0/3620970404 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63940ccc70 con 0x7f639415a5f0 2023-11-28T11:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f6398ccc700 1 --2- 172.21.15.125:0/3620970404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f639415a5f0 0x7f63940d0ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f63940b3630 tx=0x7f6388009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811af3799c63dd98 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f63937fe700 1 -- 172.21.15.125:0/3620970404 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388011830 con 0x7f639415a5f0 2023-11-28T11:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f63937fe700 1 -- 172.21.15.125:0/3620970404 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6388011990 con 0x7f639415a5f0 2023-11-28T11:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.994+0000 7f63937fe700 1 -- 172.21.15.125:0/3620970404 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388011d20 con 0x7f639415a5f0 2023-11-28T11:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.995+0000 7f639af30700 1 -- 172.21.15.125:0/3620970404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f639415a5f0 msgr2=0x7f63940d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.995+0000 7f639af30700 1 --2- 172.21.15.125:0/3620970404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f639415a5f0 0x7f63940d0ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f63940b3630 tx=0x7f6388009b20 comp rx=0 tx=0).stop 2023-11-28T11:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.995+0000 7f639af30700 1 -- 172.21.15.125:0/3620970404 shutdown_connections 2023-11-28T11:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.995+0000 7f639af30700 1 --2- 172.21.15.125:0/3620970404 >> v2:172.21.15.167:3300/0 conn(0x7f63940b2ee0 0x7f63940ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:28.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.995+0000 7f639af30700 1 --2- 172.21.15.125:0/3620970404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f639415a5f0 0x7f63940d0ad0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.995+0000 7f639af30700 1 -- 172.21.15.125:0/3620970404 >> 172.21.15.125:0/3620970404 conn(0x7f639406ea80 msgr2=0x7f639406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.995+0000 7f639af30700 1 -- 172.21.15.125:0/3620970404 shutdown_connections 2023-11-28T11:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.995+0000 7f639af30700 1 -- 172.21.15.125:0/3620970404 wait complete. 2023-11-28T11:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.996+0000 7f639af30700 1 Processor -- start 2023-11-28T11:09:29.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.996+0000 7f639af30700 1 -- start start 2023-11-28T11:09:29.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f639af30700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63940b2ee0 0x7f639414df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f639af30700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63940cc200 0x7f63940c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f639af30700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f639415a5f0 0x7f63940c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f639af30700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63940c8650 con 0x7f63940b2ee0 2023-11-28T11:09:29.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f639af30700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63940c8930 con 0x7f63940cc200 2023-11-28T11:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f639af30700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63940c8c10 con 0x7f639415a5f0 2023-11-28T11:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f6398ccc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63940b2ee0 0x7f639414df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f6398ccc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63940b2ee0 0x7f639414df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58628/0 (socket says 172.21.15.125:58628) 2023-11-28T11:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f6398ccc700 1 -- 172.21.15.125:0/3711403765 learned_addr learned my addr 172.21.15.125:0/3711403765 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f6398ccc700 1 -- 172.21.15.125:0/3711403765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f639415a5f0 msgr2=0x7f63940c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f6393fff700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63940cc200 0x7f63940c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f6398ccc700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f639415a5f0 0x7f63940c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f6398ccc700 1 -- 172.21.15.125:0/3711403765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63940cc200 msgr2=0x7f63940c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f6398ccc700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63940cc200 0x7f63940c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.997+0000 7f6398ccc700 1 -- 172.21.15.125:0/3711403765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63880094a0 con 0x7f63940b2ee0 2023-11-28T11:09:29.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.998+0000 7f6398ccc700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63940b2ee0 0x7f639414df60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6388000c00 tx=0x7f6388004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.998+0000 7f63917fa700 1 -- 172.21.15.125:0/3711403765 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63880038a0 con 0x7f63940b2ee0 2023-11-28T11:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.998+0000 7f639af30700 1 -- 172.21.15.125:0/3711403765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63940cd230 con 0x7f63940b2ee0 2023-11-28T11:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.998+0000 7f63917fa700 1 -- 172.21.15.125:0/3711403765 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638801f070 con 0x7f63940b2ee0 2023-11-28T11:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.998+0000 7f639af30700 1 -- 172.21.15.125:0/3711403765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63940ccf50 con 0x7f63940b2ee0 2023-11-28T11:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.998+0000 7f63917fa700 1 -- 172.21.15.125:0/3711403765 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388003c00 con 0x7f63940b2ee0 2023-11-28T11:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.999+0000 7f639af30700 1 -- 172.21.15.125:0/3711403765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63740052f0 con 0x7f63940b2ee0 2023-11-28T11:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.999+0000 7f63917fa700 1 -- 172.21.15.125:0/3711403765 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f638800f050 con 0x7f63940b2ee0 2023-11-28T11:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:28.999+0000 7f63917fa700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f63780682f0 0x7f637806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.000+0000 7f63917fa700 1 -- 172.21.15.125:0/3711403765 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6388021070 con 0x7f63940b2ee0 2023-11-28T11:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.000+0000 7f6393fff700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f63780682f0 0x7f637806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.000+0000 7f6393fff700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f63780682f0 0x7f637806a7a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f63940b2500 tx=0x7f6380009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:29.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.004+0000 7f63917fa700 1 -- 172.21.15.125:0/3711403765 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6388053f50 con 0x7f63940b2ee0 2023-11-28T11:09:29.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.186+0000 7f639af30700 1 -- 172.21.15.125:0/3711403765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6374005b20 con 0x7f63940b2ee0 2023-11-28T11:09:29.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.187+0000 7f63917fa700 1 -- 172.21.15.125:0/3711403765 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6388057570 con 0x7f63940b2ee0 2023-11-28T11:09:29.188 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:29.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 -- 172.21.15.125:0/3711403765 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f63780682f0 msgr2=0x7f637806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f63780682f0 0x7f637806a7a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f63940b2500 tx=0x7f6380009040 comp rx=0 tx=0).stop 2023-11-28T11:09:29.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 -- 172.21.15.125:0/3711403765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63940b2ee0 msgr2=0x7f639414df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63940b2ee0 0x7f639414df60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6388000c00 tx=0x7f6388004750 comp rx=0 tx=0).stop 2023-11-28T11:09:29.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 -- 172.21.15.125:0/3711403765 shutdown_connections 2023-11-28T11:09:29.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f63780682f0 0x7f637806a7a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f639415a5f0 0x7f63940c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63940b2ee0 0x7f639414df60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 --2- 172.21.15.125:0/3711403765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63940cc200 0x7f63940c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 -- 172.21.15.125:0/3711403765 >> 172.21.15.125:0/3711403765 conn(0x7f639406ea80 msgr2=0x7f63940b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:29.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 -- 172.21.15.125:0/3711403765 shutdown_connections 2023-11-28T11:09:29.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.189+0000 7f639af30700 1 -- 172.21.15.125:0/3711403765 wait complete. 2023-11-28T11:09:29.202 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:29.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.323+0000 7f71f86dc700 1 Processor -- start 2023-11-28T11:09:29.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.324+0000 7f71f86dc700 1 -- start start 2023-11-28T11:09:29.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.324+0000 7f71f86dc700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f71f015fe50 0x7f71f006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.324+0000 7f71f86dc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00b27d0 0x7f71f00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.324+0000 7f71f86dc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f0161370 con 0x7f71f00b3b80 2023-11-28T11:09:29.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.324+0000 7f71f86dc700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f00b3190 con 0x7f71f015fe50 2023-11-28T11:09:29.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.324+0000 7f71f86dc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0160220 con 0x7f71f00b27d0 2023-11-28T11:09:29.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5c77700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f71f00b3b80 0x7f71f0160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42760/0 (socket says 172.21.15.125:42760) 2023-11-28T11:09:29.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5c77700 1 -- 172.21.15.125:0/2872767991 learned_addr learned my addr 172.21.15.125:0/2872767991 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:29.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265970198 0 0) 0x7f71f0161370 con 0x7f71f00b3b80 2023-11-28T11:09:29.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f6c79700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00b27d0 0x7f71f00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f6478700 1 --2- 172.21.15.125:0/2872767991 >> v2:172.21.15.167:3300/0 conn(0x7f71f015fe50 0x7f71f006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71dc0035b0 con 0x7f71f00b3b80 2023-11-28T11:09:29.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2991828968 0 0) 0x7f71dc0035b0 con 0x7f71f00b3b80 2023-11-28T11:09:29.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00b27d0 msgr2=0x7f71f00b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:29.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00b27d0 0x7f71f00b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 >> v2:172.21.15.167:3300/0 conn(0x7f71f015fe50 msgr2=0x7f71f006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:29.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 --2- 172.21.15.125:0/2872767991 >> v2:172.21.15.167:3300/0 conn(0x7f71f015fe50 0x7f71f006d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00cf700 con 0x7f71f00b3b80 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f71ec001670 con 0x7f71f00b3b80 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f6c79700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00b27d0 0x7f71f00b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 >> v1:172.21.15.125:6789/0 conn(0x7f71f00b3b80 legacy=0x7f71f0160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71dc003a00 0x7f71dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71dc004850 0x7f71dc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00b27d0 0x7f71dc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00b3190 con 0x7f71dc003a00 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0160220 con 0x7f71dc004850 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc00ba60 con 0x7f71f00b27d0 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f6478700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71dc003a00 0x7f71dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f5c77700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71dc004850 0x7f71dc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.325+0000 7f71f6c79700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00b27d0 0x7f71dc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f6478700 1 -- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00b27d0 msgr2=0x7f71dc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:29.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f6478700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00b27d0 0x7f71dc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f6478700 1 -- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71dc004850 msgr2=0x7f71dc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:29.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f6478700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71dc004850 0x7f71dc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f6478700 1 -- 172.21.15.125:0/2872767991 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0035b0 con 0x7f71dc003a00 2023-11-28T11:09:29.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f5c77700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71dc004850 0x7f71dc004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:29.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f6c79700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00b27d0 0x7f71dc005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:29.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f6478700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71dc003a00 0x7f71dc003e10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f71e00098c0 tx=0x7f71dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e933bc2ce580c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:29.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e000c070 con 0x7f71dc003a00 2023-11-28T11:09:29.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e0013610 con 0x7f71dc003a00 2023-11-28T11:09:29.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f5476700 1 -- 172.21.15.125:0/2872767991 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00139a0 con 0x7f71dc003a00 2023-11-28T11:09:29.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f86dc700 1 -- 172.21.15.125:0/2872767991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71dc003a00 msgr2=0x7f71dc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f86dc700 1 --2- 172.21.15.125:0/2872767991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71dc003a00 0x7f71dc003e10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f71e00098c0 tx=0x7f71dc005880 comp rx=0 tx=0).stop 2023-11-28T11:09:29.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f6c79700 1 -- 172.21.15.125:0/2872767991 reap_dead start 2023-11-28T11:09:29.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f86dc700 1 -- 172.21.15.125:0/2872767991 shutdown_connections 2023-11-28T11:09:29.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.326+0000 7f71f86dc700 1 -- 172.21.15.125:0/2872767991 >> 172.21.15.125:0/2872767991 conn(0x7f71f006ea80 msgr2=0x7f71f006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:29.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.327+0000 7f71f86dc700 1 -- 172.21.15.125:0/2872767991 shutdown_connections 2023-11-28T11:09:29.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.327+0000 7f71f86dc700 1 -- 172.21.15.125:0/2872767991 wait complete. 2023-11-28T11:09:29.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.328+0000 7f71f86dc700 1 Processor -- start 2023-11-28T11:09:29.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.328+0000 7f71f86dc700 1 -- start start 2023-11-28T11:09:29.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.328+0000 7f71f86dc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71dc003a00 0x7f71f0155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.328+0000 7f71f86dc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00cb310 0x7f71f00cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.328+0000 7f71f86dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f00c8ee0 0x7f71f00c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.328+0000 7f71f86dc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00c7390 con 0x7f71f00c8ee0 2023-11-28T11:09:29.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.328+0000 7f71f86dc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00cbcc0 con 0x7f71dc003a00 2023-11-28T11:09:29.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.328+0000 7f71f86dc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00c9ca0 con 0x7f71f00cb310 2023-11-28T11:09:29.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f6c79700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f00c8ee0 0x7f71f00c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f6c79700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f00c8ee0 0x7f71f00c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58652/0 (socket says 172.21.15.125:58652) 2023-11-28T11:09:29.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f6c79700 1 -- 172.21.15.125:0/2791017611 learned_addr learned my addr 172.21.15.125:0/2791017611 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:29.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f6478700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71dc003a00 0x7f71f0155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f5c77700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00cb310 0x7f71f00cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f6c79700 1 -- 172.21.15.125:0/2791017611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00cb310 msgr2=0x7f71f00cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f6c79700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00cb310 0x7f71f00cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f6c79700 1 -- 172.21.15.125:0/2791017611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71dc003a00 msgr2=0x7f71f0155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f6c79700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71dc003a00 0x7f71f0155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f6c79700 1 -- 172.21.15.125:0/2791017611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00cedd0 con 0x7f71f00c8ee0 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f6478700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71dc003a00 0x7f71f0155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f6c79700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f00c8ee0 0x7f71f00c9350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f71f0072a50 tx=0x7f71e8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71e6ffd700 1 -- 172.21.15.125:0/2791017611 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8007b80 con 0x7f71f00c8ee0 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71e6ffd700 1 -- 172.21.15.125:0/2791017611 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e800f050 con 0x7f71f00c8ee0 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71e6ffd700 1 -- 172.21.15.125:0/2791017611 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8014410 con 0x7f71f00c8ee0 2023-11-28T11:09:29.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f86dc700 1 -- 172.21.15.125:0/2791017611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f00b3fd0 con 0x7f71f00c8ee0 2023-11-28T11:09:29.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.329+0000 7f71f86dc700 1 -- 172.21.15.125:0/2791017611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f00cf0b0 con 0x7f71f00c8ee0 2023-11-28T11:09:29.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.330+0000 7f71f86dc700 1 -- 172.21.15.125:0/2791017611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f00743f0 con 0x7f71f00c8ee0 2023-11-28T11:09:29.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.330+0000 7f71e6ffd700 1 -- 172.21.15.125:0/2791017611 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f71e8014570 con 0x7f71f00c8ee0 2023-11-28T11:09:29.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.331+0000 7f71e6ffd700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71d40682f0 0x7f71d406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.331+0000 7f71e6ffd700 1 -- 172.21.15.125:0/2791017611 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f71e8086100 con 0x7f71f00c8ee0 2023-11-28T11:09:29.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.331+0000 7f71f6478700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71d40682f0 0x7f71d406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.331+0000 7f71f6478700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71d40682f0 0x7f71d406a7a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71e0016040 tx=0x7f71e001e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:29.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.335+0000 7f71e6ffd700 1 -- 172.21.15.125:0/2791017611 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f71e80528c0 con 0x7f71f00c8ee0 2023-11-28T11:09:29.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.516+0000 7f71f86dc700 1 -- 172.21.15.125:0/2791017611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71f00b2e50 con 0x7f71f00c8ee0 2023-11-28T11:09:29.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.517+0000 7f71e6ffd700 1 -- 172.21.15.125:0/2791017611 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71e8055ee0 con 0x7f71f00c8ee0 2023-11-28T11:09:29.518 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:09:29.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.518+0000 7f71f86dc700 1 -- 172.21.15.125:0/2791017611 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71d40682f0 msgr2=0x7f71d406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.518+0000 7f71f86dc700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71d40682f0 0x7f71d406a7a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71e0016040 tx=0x7f71e001e040 comp rx=0 tx=0).stop 2023-11-28T11:09:29.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.518+0000 7f71f86dc700 1 -- 172.21.15.125:0/2791017611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f00c8ee0 msgr2=0x7f71f00c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.518+0000 7f71f86dc700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f00c8ee0 0x7f71f00c9350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f71f0072a50 tx=0x7f71e8004740 comp rx=0 tx=0).stop 2023-11-28T11:09:29.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.518+0000 7f71f86dc700 1 -- 172.21.15.125:0/2791017611 shutdown_connections 2023-11-28T11:09:29.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.518+0000 7f71f86dc700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71f00c8ee0 0x7f71f00c9350 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.519+0000 7f71f86dc700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71dc003a00 0x7f71f0155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.519+0000 7f71f86dc700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71d40682f0 0x7f71d406a7a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.519+0000 7f71f86dc700 1 --2- 172.21.15.125:0/2791017611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71f00cb310 0x7f71f00cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.519+0000 7f71f86dc700 1 -- 172.21.15.125:0/2791017611 >> 172.21.15.125:0/2791017611 conn(0x7f71f006ea80 msgr2=0x7f71f00b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:29.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.519+0000 7f71f86dc700 1 -- 172.21.15.125:0/2791017611 shutdown_connections 2023-11-28T11:09:29.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.519+0000 7f71f86dc700 1 -- 172.21.15.125:0/2791017611 wait complete. 2023-11-28T11:09:29.532 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:09:29.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.652+0000 7f60e7b42700 1 Processor -- start 2023-11-28T11:09:29.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.652+0000 7f60e7b42700 1 -- start start 2023-11-28T11:09:29.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e7b42700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60e00d0c60 0x7f60e00b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e7b42700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60e006e400 0x7f60e00d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e7b42700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e00d1570 con 0x7f60e0160e70 2023-11-28T11:09:29.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e7b42700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e006e900 con 0x7f60e006e400 2023-11-28T11:09:29.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e7b42700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0160390 con 0x7f60e00d0c60 2023-11-28T11:09:29.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e60df700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f60e0160e70 0x7f60e006f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42784/0 (socket says 172.21.15.125:42784) 2023-11-28T11:09:29.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e60df700 1 -- 172.21.15.125:0/1404727500 learned_addr learned my addr 172.21.15.125:0/1404727500 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:29.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e50dd700 1 --2- 172.21.15.125:0/1404727500 >> v2:172.21.15.167:3300/0 conn(0x7f60e006e400 0x7f60e00d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e58de700 1 --2- 172.21.15.125:0/1404727500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60e00d0c60 0x7f60e00b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e48dc700 1 -- 172.21.15.125:0/1404727500 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753889188 0 0) 0x7f60e00d1570 con 0x7f60e0160e70 2023-11-28T11:09:29.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e48dc700 1 -- 172.21.15.125:0/1404727500 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60cc0035b0 con 0x7f60e0160e70 2023-11-28T11:09:29.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e48dc700 1 -- 172.21.15.125:0/1404727500 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1719910606 0 0) 0x7f60cc0035b0 con 0x7f60e0160e70 2023-11-28T11:09:29.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e50dd700 1 -- 172.21.15.125:0/1404727500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60e00d0c60 msgr2=0x7f60e00b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:29.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e50dd700 1 --2- 172.21.15.125:0/1404727500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60e00d0c60 0x7f60e00b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.653+0000 7f60e50dd700 1 -- 172.21.15.125:0/1404727500 >> v1:172.21.15.125:6789/0 conn(0x7f60e0160e70 legacy=0x7f60e006f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e50dd700 1 -- 172.21.15.125:0/1404727500 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0160670 con 0x7f60e006e400 2023-11-28T11:09:29.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e58de700 1 --2- 172.21.15.125:0/1404727500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60e00d0c60 0x7f60e00b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:29.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e50dd700 1 --2- 172.21.15.125:0/1404727500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60e006e400 0x7f60e00d1030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009840 tx=0x7f60dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3300bcdc9edc24da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:29.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e48dc700 1 -- 172.21.15.125:0/1404727500 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80019f0 con 0x7f60e006e400 2023-11-28T11:09:29.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e48dc700 1 -- 172.21.15.125:0/1404727500 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc004030 con 0x7f60e006e400 2023-11-28T11:09:29.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e48dc700 1 -- 172.21.15.125:0/1404727500 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0043c0 con 0x7f60e006e400 2023-11-28T11:09:29.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e7b42700 1 -- 172.21.15.125:0/1404727500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60e006e400 msgr2=0x7f60e00d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e7b42700 1 --2- 172.21.15.125:0/1404727500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60e006e400 0x7f60e00d1030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009840 tx=0x7f60dc009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:29.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e7b42700 1 -- 172.21.15.125:0/1404727500 shutdown_connections 2023-11-28T11:09:29.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e7b42700 1 --2- 172.21.15.125:0/1404727500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60e00d0c60 0x7f60e00b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e7b42700 1 --2- 172.21.15.125:0/1404727500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60e006e400 0x7f60e00d1030 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e7b42700 1 -- 172.21.15.125:0/1404727500 >> 172.21.15.125:0/1404727500 conn(0x7f60e006a270 msgr2=0x7f60e006a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:29.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.654+0000 7f60e7b42700 1 -- 172.21.15.125:0/1404727500 shutdown_connections 2023-11-28T11:09:29.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.655+0000 7f60e7b42700 1 -- 172.21.15.125:0/1404727500 wait complete. 2023-11-28T11:09:29.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.656+0000 7f60e7b42700 1 Processor -- start 2023-11-28T11:09:29.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.656+0000 7f60e7b42700 1 -- start start 2023-11-28T11:09:29.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.656+0000 7f60e7b42700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60e006e400 0x7f60e01498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.656+0000 7f60e7b42700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60e00d0c60 0x7f60e015f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.656+0000 7f60e7b42700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60e0160e70 0x7f60e0151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.656+0000 7f60e7b42700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01f2470 con 0x7f60e006e400 2023-11-28T11:09:29.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.656+0000 7f60e7b42700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01f3290 con 0x7f60e0160e70 2023-11-28T11:09:29.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.656+0000 7f60e7b42700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01f2680 con 0x7f60e00d0c60 2023-11-28T11:09:29.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.656+0000 7f60e58de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60e006e400 0x7f60e01498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e58de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60e006e400 0x7f60e01498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58662/0 (socket says 172.21.15.125:58662) 2023-11-28T11:09:29.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e58de700 1 -- 172.21.15.125:0/3174234706 learned_addr learned my addr 172.21.15.125:0/3174234706 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:29.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e60df700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60e0160e70 0x7f60e0151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e50dd700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60e00d0c60 0x7f60e015f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e58de700 1 -- 172.21.15.125:0/3174234706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60e00d0c60 msgr2=0x7f60e015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e58de700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60e00d0c60 0x7f60e015f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e58de700 1 -- 172.21.15.125:0/3174234706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60e0160e70 msgr2=0x7f60e0151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e58de700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60e0160e70 0x7f60e0151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e58de700 1 -- 172.21.15.125:0/3174234706 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d00094a0 con 0x7f60e006e400 2023-11-28T11:09:29.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e60df700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60e0160e70 0x7f60e0151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:29.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e58de700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60e006e400 0x7f60e01498f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f60d000ebe0 tx=0x7f60d0009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:29.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60d67fc700 1 -- 172.21.15.125:0/3174234706 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d000c910 con 0x7f60e006e400 2023-11-28T11:09:29.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60d67fc700 1 -- 172.21.15.125:0/3174234706 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d000ca70 con 0x7f60e006e400 2023-11-28T11:09:29.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e7b42700 1 -- 172.21.15.125:0/3174234706 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60dc0094a0 con 0x7f60e006e400 2023-11-28T11:09:29.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60d67fc700 1 -- 172.21.15.125:0/3174234706 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d000cde0 con 0x7f60e006e400 2023-11-28T11:09:29.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.657+0000 7f60e7b42700 1 -- 172.21.15.125:0/3174234706 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e00d0740 con 0x7f60e006e400 2023-11-28T11:09:29.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.658+0000 7f60e7b42700 1 -- 172.21.15.125:0/3174234706 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e0160950 con 0x7f60e006e400 2023-11-28T11:09:29.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.659+0000 7f60d67fc700 1 -- 172.21.15.125:0/3174234706 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f60d0019030 con 0x7f60e006e400 2023-11-28T11:09:29.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.659+0000 7f60d67fc700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f60c40682f0 0x7f60c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:29.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.660+0000 7f60d67fc700 1 -- 172.21.15.125:0/3174234706 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f60d0086620 con 0x7f60e006e400 2023-11-28T11:09:29.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.660+0000 7f60e50dd700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f60c40682f0 0x7f60c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:29.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.660+0000 7f60e50dd700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f60c40682f0 0x7f60c406a7a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f60e006e830 tx=0x7f60dc013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:29.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.663+0000 7f60d67fc700 1 -- 172.21.15.125:0/3174234706 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f60d0052dd0 con 0x7f60e006e400 2023-11-28T11:09:29.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.889+0000 7f60e7b42700 1 -- 172.21.15.125:0/3174234706 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60e015d980 con 0x7f60e006e400 2023-11-28T11:09:29.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.889+0000 7f60d67fc700 1 -- 172.21.15.125:0/3174234706 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f60d00563f0 con 0x7f60e006e400 2023-11-28T11:09:29.891 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:29.891 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/678190712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":678190712},{"type":"v1","addr":"172.21.15.167:6835","nonce":678190712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2090095557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2090095557},{"type":"v1","addr":"172.21.15.167:6834","nonce":2090095557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3827244932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3827244932},{"type":"v1","addr":"172.21.15.125:6836","nonce":3827244932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:08:36.383224+0000","modified":"2023-11-28T11:08:39.391168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/573741186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":573741186},{"type":"v1","addr":"172.21.15.125:6837","nonce":573741186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:09:29.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 -- 172.21.15.125:0/3174234706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f60c40682f0 msgr2=0x7f60c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f60c40682f0 0x7f60c406a7a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f60e006e830 tx=0x7f60dc013040 comp rx=0 tx=0).stop 2023-11-28T11:09:29.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 -- 172.21.15.125:0/3174234706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60e006e400 msgr2=0x7f60e01498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:29.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60e006e400 0x7f60e01498f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f60d000ebe0 tx=0x7f60d0009ec0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 -- 172.21.15.125:0/3174234706 shutdown_connections 2023-11-28T11:09:29.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60e0160e70 0x7f60e0151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60e006e400 0x7f60e01498f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f60c40682f0 0x7f60c406a7a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 --2- 172.21.15.125:0/3174234706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60e00d0c60 0x7f60e015f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:29.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 -- 172.21.15.125:0/3174234706 >> 172.21.15.125:0/3174234706 conn(0x7f60e006a270 msgr2=0x7f60e006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:29.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 -- 172.21.15.125:0/3174234706 shutdown_connections 2023-11-28T11:09:29.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:29.891+0000 7f60e7b42700 1 -- 172.21.15.125:0/3174234706 wait complete. 2023-11-28T11:09:29.894 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-11-28T11:09:29.905 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:30.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.026+0000 7f232ef41700 1 Processor -- start 2023-11-28T11:09:30.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.026+0000 7f232ef41700 1 -- start start 2023-11-28T11:09:30.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ef41700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f232806e400 0x7f232806e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ef41700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f232815e010 0x7f23280ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ef41700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232815af30 con 0x7f23280d15f0 2023-11-28T11:09:30.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ef41700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232815a9d0 con 0x7f232806e400 2023-11-28T11:09:30.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ef41700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23281584e0 con 0x7f232815e010 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ccdd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f232806e400 0x7f232806e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ccdd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f232806e400 0x7f232806e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58670/0 (socket says 172.21.15.125:58670) 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ccdd700 1 -- 172.21.15.125:0/1746116432 learned_addr learned my addr 172.21.15.125:0/1746116432 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232d4de700 1 --2- 172.21.15.125:0/1746116432 >> v2:172.21.15.167:3300/0 conn(0x7f232815e010 0x7f23280ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ccdd700 1 -- 172.21.15.125:0/1746116432 >> v2:172.21.15.167:3300/0 conn(0x7f232815e010 msgr2=0x7f23280ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ccdd700 1 --2- 172.21.15.125:0/1746116432 >> v2:172.21.15.167:3300/0 conn(0x7f232815e010 0x7f23280ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ccdd700 1 -- 172.21.15.125:0/1746116432 >> v1:172.21.15.167:6789/0 conn(0x7f23280d15f0 legacy=0x7f232815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ccdd700 1 -- 172.21.15.125:0/1746116432 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232815ef40 con 0x7f232806e400 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232d4de700 1 --2- 172.21.15.125:0/1746116432 >> v2:172.21.15.167:3300/0 conn(0x7f232815e010 0x7f23280ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.027+0000 7f232ccdd700 1 --2- 172.21.15.125:0/1746116432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232806e400 0x7f232806e7d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f23280b60f0 tx=0x7f231c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bfbd9ab576240 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.028+0000 7f23277fe700 1 -- 172.21.15.125:0/1746116432 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00b870 con 0x7f232806e400 2023-11-28T11:09:30.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.028+0000 7f23277fe700 1 -- 172.21.15.125:0/1746116432 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c00b9d0 con 0x7f232806e400 2023-11-28T11:09:30.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.028+0000 7f23277fe700 1 -- 172.21.15.125:0/1746116432 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00bd60 con 0x7f232806e400 2023-11-28T11:09:30.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.028+0000 7f232ef41700 1 -- 172.21.15.125:0/1746116432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232806e400 msgr2=0x7f232806e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.028+0000 7f232ef41700 1 --2- 172.21.15.125:0/1746116432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232806e400 0x7f232806e7d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f23280b60f0 tx=0x7f231c009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.028+0000 7f232ef41700 1 -- 172.21.15.125:0/1746116432 shutdown_connections 2023-11-28T11:09:30.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.028+0000 7f232ef41700 1 --2- 172.21.15.125:0/1746116432 >> v2:172.21.15.167:3300/0 conn(0x7f232815e010 0x7f23280ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.028+0000 7f232ef41700 1 --2- 172.21.15.125:0/1746116432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232806e400 0x7f232806e7d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.028+0000 7f232ef41700 1 -- 172.21.15.125:0/1746116432 >> 172.21.15.125:0/1746116432 conn(0x7f232806a270 msgr2=0x7f232806a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:30.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.028+0000 7f232ef41700 1 -- 172.21.15.125:0/1746116432 shutdown_connections 2023-11-28T11:09:30.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.028+0000 7f232ef41700 1 -- 172.21.15.125:0/1746116432 wait complete. 2023-11-28T11:09:30.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.029+0000 7f232ef41700 1 Processor -- start 2023-11-28T11:09:30.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.029+0000 7f232ef41700 1 -- start start 2023-11-28T11:09:30.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.030+0000 7f232ef41700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f232806e400 0x7f23280b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.030+0000 7f232ef41700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23280d15f0 0x7f232814c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.030+0000 7f232ef41700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815e010 0x7f232814d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.030+0000 7f232ef41700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23280cf910 con 0x7f23280d15f0 2023-11-28T11:09:30.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.030+0000 7f232ef41700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23280cfbf0 con 0x7f232815e010 2023-11-28T11:09:30.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.030+0000 7f232ef41700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23280cfed0 con 0x7f232806e400 2023-11-28T11:09:30.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.030+0000 7f2327fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23280d15f0 0x7f232814c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.030+0000 7f2327fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23280d15f0 0x7f232814c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58680/0 (socket says 172.21.15.125:58680) 2023-11-28T11:09:30.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.030+0000 7f2327fff700 1 -- 172.21.15.125:0/1841084964 learned_addr learned my addr 172.21.15.125:0/1841084964 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:30.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.030+0000 7f232d4de700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815e010 0x7f232814d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f232ccdd700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f232806e400 0x7f23280b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f2327fff700 1 -- 172.21.15.125:0/1841084964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f232806e400 msgr2=0x7f23280b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f2327fff700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f232806e400 0x7f23280b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f2327fff700 1 -- 172.21.15.125:0/1841084964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815e010 msgr2=0x7f232814d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f2327fff700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815e010 0x7f232814d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f2327fff700 1 -- 172.21.15.125:0/1841084964 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c009550 con 0x7f23280d15f0 2023-11-28T11:09:30.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f232d4de700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815e010 0x7f232814d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:30.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f2327fff700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23280d15f0 0x7f232814c970 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f231400c4b0 tx=0x7f231400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:30.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f23257fa700 1 -- 172.21.15.125:0/1841084964 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23140052d0 con 0x7f23280d15f0 2023-11-28T11:09:30.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f23257fa700 1 -- 172.21.15.125:0/1841084964 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2314005430 con 0x7f23280d15f0 2023-11-28T11:09:30.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f232ef41700 1 -- 172.21.15.125:0/1841084964 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232815e980 con 0x7f23280d15f0 2023-11-28T11:09:30.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f23257fa700 1 -- 172.21.15.125:0/1841084964 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23140038c0 con 0x7f23280d15f0 2023-11-28T11:09:30.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.031+0000 7f232ef41700 1 -- 172.21.15.125:0/1841084964 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232806ed10 con 0x7f23280d15f0 2023-11-28T11:09:30.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.032+0000 7f232ef41700 1 -- 172.21.15.125:0/1841084964 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232815ec60 con 0x7f23280d15f0 2023-11-28T11:09:30.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.033+0000 7f23257fa700 1 -- 172.21.15.125:0/1841084964 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2314019030 con 0x7f23280d15f0 2023-11-28T11:09:30.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.033+0000 7f23257fa700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f230c0682f0 0x7f230c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.033+0000 7f23257fa700 1 -- 172.21.15.125:0/1841084964 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2314085070 con 0x7f23280d15f0 2023-11-28T11:09:30.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.033+0000 7f232ccdd700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f230c0682f0 0x7f230c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.033+0000 7f232ccdd700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f230c0682f0 0x7f230c06a7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f231c000c00 tx=0x7f231c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:30.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.037+0000 7f23257fa700 1 -- 172.21.15.125:0/1841084964 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2314051890 con 0x7f23280d15f0 2023-11-28T11:09:30.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.224+0000 7f232ef41700 1 -- 172.21.15.125:0/1841084964 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23280743f0 con 0x7f23280d15f0 2023-11-28T11:09:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.226+0000 7f23257fa700 1 -- 172.21.15.125:0/1841084964 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7f2314054eb0 con 0x7f23280d15f0 2023-11-28T11:09:30.227 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:30.228 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":26,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:19.047682+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:30.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.227+0000 7f232ef41700 1 -- 172.21.15.125:0/1841084964 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f230c0682f0 msgr2=0x7f230c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.227+0000 7f232ef41700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f230c0682f0 0x7f230c06a7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f231c000c00 tx=0x7f231c008030 comp rx=0 tx=0).stop 2023-11-28T11:09:30.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.227+0000 7f232ef41700 1 -- 172.21.15.125:0/1841084964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23280d15f0 msgr2=0x7f232814c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.227+0000 7f232ef41700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23280d15f0 0x7f232814c970 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f231400c4b0 tx=0x7f231400c870 comp rx=0 tx=0).stop 2023-11-28T11:09:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.228+0000 7f232ef41700 1 -- 172.21.15.125:0/1841084964 shutdown_connections 2023-11-28T11:09:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.228+0000 7f232ef41700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815e010 0x7f232814d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.228+0000 7f232ef41700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f230c0682f0 0x7f230c06a7a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.228+0000 7f232ef41700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f232806e400 0x7f23280b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.228+0000 7f232ef41700 1 --2- 172.21.15.125:0/1841084964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23280d15f0 0x7f232814c970 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.228+0000 7f232ef41700 1 -- 172.21.15.125:0/1841084964 >> 172.21.15.125:0/1841084964 conn(0x7f232806a270 msgr2=0x7f23280b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.228+0000 7f232ef41700 1 -- 172.21.15.125:0/1841084964 shutdown_connections 2023-11-28T11:09:30.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.228+0000 7f232ef41700 1 -- 172.21.15.125:0/1841084964 wait complete. 2023-11-28T11:09:30.242 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:09:30.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:09:30.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.360+0000 7f1ebf9be700 1 Processor -- start 2023-11-28T11:09:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.360+0000 7f1ebf9be700 1 -- start start 2023-11-28T11:09:30.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.361+0000 7f1ebf9be700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1eb80ced70 0x7f1eb80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.361+0000 7f1ebf9be700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1eb80ce1e0 0x7f1eb80b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.361+0000 7f1ebf9be700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb80b4fc0 con 0x7f1eb806feb0 2023-11-28T11:09:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.361+0000 7f1ebf9be700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb8159c30 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.361+0000 7f1ebf9be700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb80b05e0 con 0x7f1eb80ced70 2023-11-28T11:09:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.361+0000 7f1ebdf5b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1eb80ce1e0 0x7f1eb80b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.361+0000 7f1ebdf5b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1eb80ce1e0 0x7f1eb80b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58688/0 (socket says 172.21.15.125:58688) 2023-11-28T11:09:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.361+0000 7f1ebdf5b700 1 -- 172.21.15.125:0/1952235719 learned_addr learned my addr 172.21.15.125:0/1952235719 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.362+0000 7f1ebd75a700 1 --2- 172.21.15.125:0/1952235719 >> v2:172.21.15.167:3300/0 conn(0x7f1eb80ced70 0x7f1eb80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.362+0000 7f1ebdf5b700 1 -- 172.21.15.125:0/1952235719 >> v2:172.21.15.167:3300/0 conn(0x7f1eb80ced70 msgr2=0x7f1eb80b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:30.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.362+0000 7f1ebdf5b700 1 --2- 172.21.15.125:0/1952235719 >> v2:172.21.15.167:3300/0 conn(0x7f1eb80ced70 0x7f1eb80b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.362+0000 7f1ebdf5b700 1 -- 172.21.15.125:0/1952235719 >> v1:172.21.15.167:6789/0 conn(0x7f1eb806feb0 legacy=0x7f1eb806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.362+0000 7f1ebdf5b700 1 -- 172.21.15.125:0/1952235719 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80b08c0 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.362+0000 7f1ebd75a700 1 --2- 172.21.15.125:0/1952235719 >> v2:172.21.15.167:3300/0 conn(0x7f1eb80ced70 0x7f1eb80b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.362+0000 7f1ebdf5b700 1 --2- 172.21.15.125:0/1952235719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1eb80ce1e0 0x7f1eb80b4930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1eb806eee0 tx=0x7f1eb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfc1f182ecdfac6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.362+0000 7f1eaffff700 1 -- 172.21.15.125:0/1952235719 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb000e070 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.362+0000 7f1eaffff700 1 -- 172.21.15.125:0/1952235719 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb000b9c0 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.362+0000 7f1eaffff700 1 -- 172.21.15.125:0/1952235719 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb000bd70 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.363+0000 7f1ebf9be700 1 -- 172.21.15.125:0/1952235719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1eb80ce1e0 msgr2=0x7f1eb80b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.363+0000 7f1ebf9be700 1 --2- 172.21.15.125:0/1952235719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1eb80ce1e0 0x7f1eb80b4930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1eb806eee0 tx=0x7f1eb000b330 comp rx=0 tx=0).stop 2023-11-28T11:09:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.363+0000 7f1ebf9be700 1 -- 172.21.15.125:0/1952235719 shutdown_connections 2023-11-28T11:09:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.363+0000 7f1ebf9be700 1 --2- 172.21.15.125:0/1952235719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1eb80ce1e0 0x7f1eb80b4930 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.363+0000 7f1ebf9be700 1 --2- 172.21.15.125:0/1952235719 >> v2:172.21.15.167:3300/0 conn(0x7f1eb80ced70 0x7f1eb80b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.363+0000 7f1ebf9be700 1 -- 172.21.15.125:0/1952235719 >> 172.21.15.125:0/1952235719 conn(0x7f1eb80b2fc0 msgr2=0x7f1eb8071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.363+0000 7f1ebf9be700 1 -- 172.21.15.125:0/1952235719 shutdown_connections 2023-11-28T11:09:30.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.363+0000 7f1ebf9be700 1 -- 172.21.15.125:0/1952235719 wait complete. 2023-11-28T11:09:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.364+0000 7f1ebf9be700 1 Processor -- start 2023-11-28T11:09:30.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.364+0000 7f1ebf9be700 1 -- start start 2023-11-28T11:09:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebf9be700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb806feb0 0x7f1eb80c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebf9be700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1eb80ce1e0 0x7f1eb809cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebf9be700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1eb80ced70 0x7f1eb80c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebf9be700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb80c7780 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebf9be700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8158f30 con 0x7f1eb806feb0 2023-11-28T11:09:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebf9be700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb80c6b00 con 0x7f1eb80ced70 2023-11-28T11:09:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebcf59700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1eb80ce1e0 0x7f1eb809cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebcf59700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1eb80ce1e0 0x7f1eb809cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58692/0 (socket says 172.21.15.125:58692) 2023-11-28T11:09:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebcf59700 1 -- 172.21.15.125:0/357362965 learned_addr learned my addr 172.21.15.125:0/357362965 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebd75a700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb806feb0 0x7f1eb80c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebdf5b700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1eb80ced70 0x7f1eb80c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebcf59700 1 -- 172.21.15.125:0/357362965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1eb80ced70 msgr2=0x7f1eb80c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebcf59700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1eb80ced70 0x7f1eb80c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebcf59700 1 -- 172.21.15.125:0/357362965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb806feb0 msgr2=0x7f1eb80c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebcf59700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb806feb0 0x7f1eb80c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebcf59700 1 -- 172.21.15.125:0/357362965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb0009b30 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebdf5b700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1eb80ced70 0x7f1eb80c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:30.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebcf59700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1eb80ce1e0 0x7f1eb809cda0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400c480 tx=0x7f1eb400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:30.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1eadffb700 1 -- 172.21.15.125:0/357362965 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40052d0 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1eadffb700 1 -- 172.21.15.125:0/357362965 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb4005430 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1ebf9be700 1 -- 172.21.15.125:0/357362965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb80b5260 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.365+0000 7f1eadffb700 1 -- 172.21.15.125:0/357362965 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40038c0 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.366+0000 7f1ebf9be700 1 -- 172.21.15.125:0/357362965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb80b0ba0 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.367+0000 7f1ebf9be700 1 -- 172.21.15.125:0/357362965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb8072420 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.367+0000 7f1eadffb700 1 -- 172.21.15.125:0/357362965 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1eb4019030 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.367+0000 7f1eadffb700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e9c0682f0 0x7f1e9c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.367+0000 7f1eadffb700 1 -- 172.21.15.125:0/357362965 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1eb4085010 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.367+0000 7f1ebd75a700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e9c0682f0 0x7f1e9c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.368+0000 7f1ebd75a700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e9c0682f0 0x7f1e9c06a7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800c940 tx=0x7f1ea8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:30.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.372+0000 7f1eadffb700 1 -- 172.21.15.125:0/357362965 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1eb4051860 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.596+0000 7f1ebf9be700 1 -- 172.21.15.125:0/357362965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1eb80c78c0 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.596+0000 7f1eadffb700 1 -- 172.21.15.125:0/357362965 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f1eb80c78c0 con 0x7f1eb80ce1e0 2023-11-28T11:09:30.598 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:30.599 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/678190712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":678190712},{"type":"v1","addr":"172.21.15.167:6835","nonce":678190712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2090095557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2090095557},{"type":"v1","addr":"172.21.15.167:6834","nonce":2090095557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3827244932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3827244932},{"type":"v1","addr":"172.21.15.125:6836","nonce":3827244932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:08:36.383224+0000","modified":"2023-11-28T11:08:39.391168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/573741186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":573741186},{"type":"v1","addr":"172.21.15.125:6837","nonce":573741186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:09:30.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 -- 172.21.15.125:0/357362965 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e9c0682f0 msgr2=0x7f1e9c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e9c0682f0 0x7f1e9c06a7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800c940 tx=0x7f1ea8008040 comp rx=0 tx=0).stop 2023-11-28T11:09:30.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 -- 172.21.15.125:0/357362965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1eb80ce1e0 msgr2=0x7f1eb809cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1eb80ce1e0 0x7f1eb809cda0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400c480 tx=0x7f1eb400c790 comp rx=0 tx=0).stop 2023-11-28T11:09:30.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 -- 172.21.15.125:0/357362965 shutdown_connections 2023-11-28T11:09:30.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e9c0682f0 0x7f1e9c06a7a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1eb80ced70 0x7f1eb80c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb806feb0 0x7f1eb80c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 --2- 172.21.15.125:0/357362965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1eb80ce1e0 0x7f1eb809cda0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 -- 172.21.15.125:0/357362965 >> 172.21.15.125:0/357362965 conn(0x7f1eb80b2fc0 msgr2=0x7f1eb80b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:30.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 -- 172.21.15.125:0/357362965 shutdown_connections 2023-11-28T11:09:30.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.599+0000 7f1ebf9be700 1 -- 172.21.15.125:0/357362965 wait complete. 2023-11-28T11:09:30.602 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-11-28T11:09:30.613 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:09:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.731+0000 7fe2953df700 1 Processor -- start 2023-11-28T11:09:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.731+0000 7fe2953df700 1 -- start start 2023-11-28T11:09:30.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.732+0000 7fe2953df700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 0x7fe29006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.732+0000 7fe2953df700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe290070d90 0x7fe2900711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.732+0000 7fe2953df700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe290151a50 con 0x7fe29006da40 2023-11-28T11:09:30.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.732+0000 7fe2953df700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29015f0c0 con 0x7fe290070d90 2023-11-28T11:09:30.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.732+0000 7fe2953df700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29015b440 con 0x7fe29006a270 2023-11-28T11:09:30.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.732+0000 7fe28e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe290070d90 0x7fe2900711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.732+0000 7fe28f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe29006da40 0x7fe29006dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42824/0 (socket says 172.21.15.125:42824) 2023-11-28T11:09:30.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.732+0000 7fe28f7fe700 1 -- 172.21.15.125:0/2730018813 learned_addr learned my addr 172.21.15.125:0/2730018813 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:30.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.732+0000 7fe28e7fc700 1 -- 172.21.15.125:0/2730018813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 msgr2=0x7fe29006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:30.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.732+0000 7fe28effd700 1 --2- 172.21.15.125:0/2730018813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 0x7fe29006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.732+0000 7fe28dffb700 1 -- 172.21.15.125:0/2730018813 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444252184 0 0) 0x7fe290151a50 con 0x7fe29006da40 2023-11-28T11:09:30.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe28e7fc700 1 --2- 172.21.15.125:0/2730018813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 0x7fe29006a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe28e7fc700 1 -- 172.21.15.125:0/2730018813 >> v1:172.21.15.125:6789/0 conn(0x7fe29006da40 legacy=0x7fe29006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe28e7fc700 1 -- 172.21.15.125:0/2730018813 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29006ab80 con 0x7fe290070d90 2023-11-28T11:09:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe28effd700 1 --2- 172.21.15.125:0/2730018813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 0x7fe29006a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe28e7fc700 1 --2- 172.21.15.125:0/2730018813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe290070d90 0x7fe2900711e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe280009840 tx=0x7fe280009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf377850a89d0bbf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe28dffb700 1 -- 172.21.15.125:0/2730018813 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280011830 con 0x7fe290070d90 2023-11-28T11:09:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe28dffb700 1 -- 172.21.15.125:0/2730018813 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280011990 con 0x7fe290070d90 2023-11-28T11:09:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe28dffb700 1 -- 172.21.15.125:0/2730018813 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280011d20 con 0x7fe290070d90 2023-11-28T11:09:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe2953df700 1 -- 172.21.15.125:0/2730018813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe290070d90 msgr2=0x7fe2900711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe2953df700 1 --2- 172.21.15.125:0/2730018813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe290070d90 0x7fe2900711e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe280009840 tx=0x7fe280009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe2953df700 1 -- 172.21.15.125:0/2730018813 shutdown_connections 2023-11-28T11:09:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe2953df700 1 --2- 172.21.15.125:0/2730018813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 0x7fe29006a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe2953df700 1 --2- 172.21.15.125:0/2730018813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe290070d90 0x7fe2900711e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe2953df700 1 -- 172.21.15.125:0/2730018813 >> 172.21.15.125:0/2730018813 conn(0x7fe29006c010 msgr2=0x7fe2900cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe2953df700 1 -- 172.21.15.125:0/2730018813 shutdown_connections 2023-11-28T11:09:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.733+0000 7fe2953df700 1 -- 172.21.15.125:0/2730018813 wait complete. 2023-11-28T11:09:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.735+0000 7fe2953df700 1 Processor -- start 2023-11-28T11:09:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.735+0000 7fe2953df700 1 -- start start 2023-11-28T11:09:30.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.735+0000 7fe2953df700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 0x7fe2900b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.735+0000 7fe2953df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe29006da40 0x7fe2901511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.735+0000 7fe2953df700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe290070d90 0x7fe290153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.735+0000 7fe2953df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900c47c0 con 0x7fe29006da40 2023-11-28T11:09:30.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.735+0000 7fe2953df700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2901530e0 con 0x7fe290070d90 2023-11-28T11:09:30.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.735+0000 7fe2953df700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe290152840 con 0x7fe29006a270 2023-11-28T11:09:30.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe29006da40 0x7fe2901511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe29006da40 0x7fe2901511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58706/0 (socket says 172.21.15.125:58706) 2023-11-28T11:09:30.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28e7fc700 1 -- 172.21.15.125:0/1345437354 learned_addr learned my addr 172.21.15.125:0/1345437354 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:30.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28effd700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 0x7fe2900b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28f7fe700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe290070d90 0x7fe290153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28e7fc700 1 -- 172.21.15.125:0/1345437354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 msgr2=0x7fe2900b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28e7fc700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 0x7fe2900b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28e7fc700 1 -- 172.21.15.125:0/1345437354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe290070d90 msgr2=0x7fe290153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28e7fc700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe290070d90 0x7fe290153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28e7fc700 1 -- 172.21.15.125:0/1345437354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2800094a0 con 0x7fe29006da40 2023-11-28T11:09:30.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28effd700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 0x7fe2900b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:30.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28f7fe700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe290070d90 0x7fe290153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:30.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe28e7fc700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe29006da40 0x7fe2901511a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe2800090b0 tx=0x7fe280004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:30.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe2777fe700 1 -- 172.21.15.125:0/1345437354 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2800036a0 con 0x7fe29006da40 2023-11-28T11:09:30.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe2777fe700 1 -- 172.21.15.125:0/1345437354 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28001e070 con 0x7fe29006da40 2023-11-28T11:09:30.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe2777fe700 1 -- 172.21.15.125:0/1345437354 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280003a00 con 0x7fe29006da40 2023-11-28T11:09:30.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe2953df700 1 -- 172.21.15.125:0/1345437354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29015adf0 con 0x7fe29006da40 2023-11-28T11:09:30.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.736+0000 7fe2953df700 1 -- 172.21.15.125:0/1345437354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe290071ac0 con 0x7fe29006da40 2023-11-28T11:09:30.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.737+0000 7fe2953df700 1 -- 172.21.15.125:0/1345437354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29015b0d0 con 0x7fe29006da40 2023-11-28T11:09:30.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.738+0000 7fe2777fe700 1 -- 172.21.15.125:0/1345437354 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe28000f050 con 0x7fe29006da40 2023-11-28T11:09:30.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.738+0000 7fe2777fe700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe27c0682f0 0x7fe27c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:30.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.738+0000 7fe2777fe700 1 -- 172.21.15.125:0/1345437354 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe280086ea0 con 0x7fe29006da40 2023-11-28T11:09:30.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.738+0000 7fe28effd700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe27c0682f0 0x7fe27c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:30.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.738+0000 7fe28effd700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe27c0682f0 0x7fe27c06a7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2840089b0 tx=0x7fe284008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:30.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.742+0000 7fe2777fe700 1 -- 172.21.15.125:0/1345437354 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe2800536c0 con 0x7fe29006da40 2023-11-28T11:09:30.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.970+0000 7fe2953df700 1 -- 172.21.15.125:0/1345437354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2900743f0 con 0x7fe29006da40 2023-11-28T11:09:30.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.970+0000 7fe2777fe700 1 -- 172.21.15.125:0/1345437354 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7fe280020020 con 0x7fe29006da40 2023-11-28T11:09:30.972 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:30.972 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/678190712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":678190712},{"type":"v1","addr":"172.21.15.167:6835","nonce":678190712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2090095557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2090095557},{"type":"v1","addr":"172.21.15.167:6834","nonce":2090095557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3827244932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3827244932},{"type":"v1","addr":"172.21.15.125:6836","nonce":3827244932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:08:36.383224+0000","modified":"2023-11-28T11:08:39.391168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/573741186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":573741186},{"type":"v1","addr":"172.21.15.125:6837","nonce":573741186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:09:30.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 -- 172.21.15.125:0/1345437354 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe27c0682f0 msgr2=0x7fe27c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe27c0682f0 0x7fe27c06a7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2840089b0 tx=0x7fe284008040 comp rx=0 tx=0).stop 2023-11-28T11:09:30.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 -- 172.21.15.125:0/1345437354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe29006da40 msgr2=0x7fe2901511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:30.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe29006da40 0x7fe2901511a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe2800090b0 tx=0x7fe280004750 comp rx=0 tx=0).stop 2023-11-28T11:09:30.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 -- 172.21.15.125:0/1345437354 shutdown_connections 2023-11-28T11:09:30.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe290070d90 0x7fe290153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe27c0682f0 0x7fe27c06a7a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe29006a270 0x7fe2900b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 --2- 172.21.15.125:0/1345437354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe29006da40 0x7fe2901511a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:30.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 -- 172.21.15.125:0/1345437354 >> 172.21.15.125:0/1345437354 conn(0x7fe29006c010 msgr2=0x7fe29006de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:30.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 -- 172.21.15.125:0/1345437354 shutdown_connections 2023-11-28T11:09:30.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:30.972+0000 7fe2953df700 1 -- 172.21.15.125:0/1345437354 wait complete. 2023-11-28T11:09:30.976 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-11-28T11:09:30.986 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:31.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.105+0000 7f81453b9700 1 Processor -- start 2023-11-28T11:09:31.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.105+0000 7f81453b9700 1 -- start start 2023-11-28T11:09:31.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f81453b9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f814006a270 0x7f814006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f81453b9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f814006e570 0x7f8140070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f81453b9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814006ab80 con 0x7f814015cc80 2023-11-28T11:09:31.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f81453b9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81400b2490 con 0x7f814006a270 2023-11-28T11:09:31.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f81453b9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81400b1810 con 0x7f814006e570 2023-11-28T11:09:31.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f814006a270 0x7f814006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:31.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f814015cc80 0x7f814006de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42836/0 (socket says 172.21.15.125:42836) 2023-11-28T11:09:31.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813e7fc700 1 -- 172.21.15.125:0/3828631802 learned_addr learned my addr 172.21.15.125:0/3828631802 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:31.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813f7fe700 1 --2- 172.21.15.125:0/3828631802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f814006e570 0x7f8140070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:31.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813effd700 1 -- 172.21.15.125:0/3828631802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f814006e570 msgr2=0x7f8140070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:31.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813effd700 1 --2- 172.21.15.125:0/3828631802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f814006e570 0x7f8140070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813effd700 1 -- 172.21.15.125:0/3828631802 >> v1:172.21.15.125:6789/0 conn(0x7f814015cc80 legacy=0x7f814006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:31.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813effd700 1 -- 172.21.15.125:0/3828631802 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81400b1af0 con 0x7f814006a270 2023-11-28T11:09:31.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813dffb700 1 -- 172.21.15.125:0/3828631802 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188173051 0 0) 0x7f814006ab80 con 0x7f814015cc80 2023-11-28T11:09:31.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813effd700 1 --2- 172.21.15.125:0/3828631802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f814006a270 0x7f814006a640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8134009840 tx=0x7f8134009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dc11bbdab0aa5e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:31.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813dffb700 1 -- 172.21.15.125:0/3828631802 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134011830 con 0x7f814006a270 2023-11-28T11:09:31.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.106+0000 7f813dffb700 1 -- 172.21.15.125:0/3828631802 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8134011990 con 0x7f814006a270 2023-11-28T11:09:31.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.107+0000 7f813dffb700 1 -- 172.21.15.125:0/3828631802 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134011d20 con 0x7f814006a270 2023-11-28T11:09:31.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.107+0000 7f81453b9700 1 -- 172.21.15.125:0/3828631802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f814006a270 msgr2=0x7f814006a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:31.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.107+0000 7f81453b9700 1 --2- 172.21.15.125:0/3828631802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f814006a270 0x7f814006a640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8134009840 tx=0x7f8134009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:31.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.107+0000 7f81453b9700 1 -- 172.21.15.125:0/3828631802 shutdown_connections 2023-11-28T11:09:31.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.107+0000 7f81453b9700 1 --2- 172.21.15.125:0/3828631802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f814006e570 0x7f8140070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.107+0000 7f81453b9700 1 --2- 172.21.15.125:0/3828631802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f814006a270 0x7f814006a640 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.107+0000 7f81453b9700 1 -- 172.21.15.125:0/3828631802 >> 172.21.15.125:0/3828631802 conn(0x7f814006c010 msgr2=0x7f81400cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:31.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.107+0000 7f81453b9700 1 -- 172.21.15.125:0/3828631802 shutdown_connections 2023-11-28T11:09:31.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.107+0000 7f81453b9700 1 -- 172.21.15.125:0/3828631802 wait complete. 2023-11-28T11:09:31.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.108+0000 7f81453b9700 1 Processor -- start 2023-11-28T11:09:31.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.108+0000 7f81453b9700 1 -- start start 2023-11-28T11:09:31.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.109+0000 7f81453b9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f814006a270 0x7f81401e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.109+0000 7f81453b9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f814006e570 0x7f8140152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.109+0000 7f81453b9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f814015cc80 0x7f814015ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.109+0000 7f81453b9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81401e6910 con 0x7f814015cc80 2023-11-28T11:09:31.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.109+0000 7f81453b9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81401e9110 con 0x7f814006e570 2023-11-28T11:09:31.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.109+0000 7f81453b9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81401e8070 con 0x7f814006a270 2023-11-28T11:09:31.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.109+0000 7f813f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f814015cc80 0x7f814015ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.109+0000 7f813f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f814015cc80 0x7f814015ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58722/0 (socket says 172.21.15.125:58722) 2023-11-28T11:09:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.109+0000 7f813f7fe700 1 -- 172.21.15.125:0/2682414948 learned_addr learned my addr 172.21.15.125:0/2682414948 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.109+0000 7f813e7fc700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f814006e570 0x7f8140152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.109+0000 7f813effd700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f814006a270 0x7f81401e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.110+0000 7f813f7fe700 1 -- 172.21.15.125:0/2682414948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f814006a270 msgr2=0x7f81401e63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.110+0000 7f813f7fe700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f814006a270 0x7f81401e63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.110+0000 7f813f7fe700 1 -- 172.21.15.125:0/2682414948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f814006e570 msgr2=0x7f8140152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.110+0000 7f813f7fe700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f814006e570 0x7f8140152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.110+0000 7f813f7fe700 1 -- 172.21.15.125:0/2682414948 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81340094a0 con 0x7f814015cc80 2023-11-28T11:09:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.110+0000 7f813f7fe700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f814015cc80 0x7f814015ee00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f813800cc30 tx=0x7f813800a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:31.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.110+0000 7f81277fe700 1 -- 172.21.15.125:0/2682414948 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800ab70 con 0x7f814015cc80 2023-11-28T11:09:31.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.110+0000 7f81277fe700 1 -- 172.21.15.125:0/2682414948 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813800acd0 con 0x7f814015cc80 2023-11-28T11:09:31.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.110+0000 7f81277fe700 1 -- 172.21.15.125:0/2682414948 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138003c40 con 0x7f814015cc80 2023-11-28T11:09:31.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.110+0000 7f81453b9700 1 -- 172.21.15.125:0/2682414948 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81400b20b0 con 0x7f814015cc80 2023-11-28T11:09:31.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.110+0000 7f81453b9700 1 -- 172.21.15.125:0/2682414948 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81400b1dd0 con 0x7f814015cc80 2023-11-28T11:09:31.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.111+0000 7f81453b9700 1 -- 172.21.15.125:0/2682414948 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814015daa0 con 0x7f814015cc80 2023-11-28T11:09:31.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.111+0000 7f81277fe700 1 -- 172.21.15.125:0/2682414948 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f813801f070 con 0x7f814015cc80 2023-11-28T11:09:31.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.111+0000 7f81277fe700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f812c0682f0 0x7f812c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.112+0000 7f81277fe700 1 -- 172.21.15.125:0/2682414948 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8138085db0 con 0x7f814015cc80 2023-11-28T11:09:31.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.112+0000 7f813effd700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f812c0682f0 0x7f812c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:31.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.112+0000 7f813effd700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f812c0682f0 0x7f812c06a7a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8134000c00 tx=0x7f8134008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:31.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.116+0000 7f81277fe700 1 -- 172.21.15.125:0/2682414948 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f81380525d0 con 0x7f814015cc80 2023-11-28T11:09:31.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.299+0000 7f81453b9700 1 -- 172.21.15.125:0/2682414948 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81400743f0 con 0x7f814015cc80 2023-11-28T11:09:31.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.300+0000 7f81277fe700 1 -- 172.21.15.125:0/2682414948 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7f8138055bf0 con 0x7f814015cc80 2023-11-28T11:09:31.302 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:31.303 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":26,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:19.047682+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:08:34.927739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:08:35.335059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 -- 172.21.15.125:0/2682414948 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f812c0682f0 msgr2=0x7f812c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f812c0682f0 0x7f812c06a7a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8134000c00 tx=0x7f8134008030 comp rx=0 tx=0).stop 2023-11-28T11:09:31.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 -- 172.21.15.125:0/2682414948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f814015cc80 msgr2=0x7f814015ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f814015cc80 0x7f814015ee00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f813800cc30 tx=0x7f813800a1f0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 -- 172.21.15.125:0/2682414948 shutdown_connections 2023-11-28T11:09:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f814015cc80 0x7f814015ee00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f812c0682f0 0x7f812c06a7a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f814006a270 0x7f81401e63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 --2- 172.21.15.125:0/2682414948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f814006e570 0x7f8140152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 -- 172.21.15.125:0/2682414948 >> 172.21.15.125:0/2682414948 conn(0x7f814006c010 msgr2=0x7f81400ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 -- 172.21.15.125:0/2682414948 shutdown_connections 2023-11-28T11:09:31.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.302+0000 7f81453b9700 1 -- 172.21.15.125:0/2682414948 wait complete. 2023-11-28T11:09:31.317 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T11:09:31.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.435+0000 7fd86b98d700 1 Processor -- start 2023-11-28T11:09:31.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.435+0000 7fd86b98d700 1 -- start start 2023-11-28T11:09:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.436+0000 7fd86b98d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd86406d170 0x7fd8640b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.436+0000 7fd86b98d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8640b27d0 0x7fd8640b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.436+0000 7fd86b98d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd864161370 con 0x7fd86415fe50 2023-11-28T11:09:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.436+0000 7fd86b98d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86406d5c0 con 0x7fd86406d170 2023-11-28T11:09:31.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.436+0000 7fd86b98d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640b3190 con 0x7fd8640b27d0 2023-11-28T11:09:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.436+0000 7fd868f28700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd86406d170 0x7fd8640b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.436+0000 7fd869729700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd86415fe50 0x7fd864160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42850/0 (socket says 172.21.15.125:42850) 2023-11-28T11:09:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.436+0000 7fd869729700 1 -- 172.21.15.125:0/2255303379 learned_addr learned my addr 172.21.15.125:0/2255303379 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.437+0000 7fd868f28700 1 -- 172.21.15.125:0/2255303379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8640b27d0 msgr2=0x7fd8640b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.437+0000 7fd868f28700 1 --2- 172.21.15.125:0/2255303379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8640b27d0 0x7fd8640b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.437+0000 7fd868f28700 1 -- 172.21.15.125:0/2255303379 >> v1:172.21.15.125:6789/0 conn(0x7fd86415fe50 legacy=0x7fd864160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.437+0000 7fd85bfff700 1 -- 172.21.15.125:0/2255303379 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293317349 0 0) 0x7fd864161370 con 0x7fd86415fe50 2023-11-28T11:09:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.437+0000 7fd868f28700 1 -- 172.21.15.125:0/2255303379 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8640cf700 con 0x7fd86406d170 2023-11-28T11:09:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.437+0000 7fd868f28700 1 --2- 172.21.15.125:0/2255303379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd86406d170 0x7fd8640b3b80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd854009840 tx=0x7fd854009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7981fab4a306187 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:31.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.437+0000 7fd85bfff700 1 -- 172.21.15.125:0/2255303379 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854011830 con 0x7fd86406d170 2023-11-28T11:09:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.437+0000 7fd85bfff700 1 -- 172.21.15.125:0/2255303379 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854011990 con 0x7fd86406d170 2023-11-28T11:09:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.437+0000 7fd85bfff700 1 -- 172.21.15.125:0/2255303379 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854011d20 con 0x7fd86406d170 2023-11-28T11:09:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.438+0000 7fd86b98d700 1 -- 172.21.15.125:0/2255303379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd86406d170 msgr2=0x7fd8640b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.438+0000 7fd86b98d700 1 --2- 172.21.15.125:0/2255303379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd86406d170 0x7fd8640b3b80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd854009840 tx=0x7fd854009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.438+0000 7fd86b98d700 1 -- 172.21.15.125:0/2255303379 shutdown_connections 2023-11-28T11:09:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.438+0000 7fd86b98d700 1 --2- 172.21.15.125:0/2255303379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8640b27d0 0x7fd8640b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.438+0000 7fd86b98d700 1 --2- 172.21.15.125:0/2255303379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd86406d170 0x7fd8640b3b80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.438+0000 7fd86b98d700 1 -- 172.21.15.125:0/2255303379 >> 172.21.15.125:0/2255303379 conn(0x7fd86406ea80 msgr2=0x7fd86406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.438+0000 7fd86b98d700 1 -- 172.21.15.125:0/2255303379 shutdown_connections 2023-11-28T11:09:31.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.438+0000 7fd86b98d700 1 -- 172.21.15.125:0/2255303379 wait complete. 2023-11-28T11:09:31.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.439+0000 7fd86b98d700 1 Processor -- start 2023-11-28T11:09:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.439+0000 7fd86b98d700 1 -- start start 2023-11-28T11:09:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.440+0000 7fd86b98d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd86406d170 0x7fd864148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.440+0000 7fd86b98d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8640b27d0 0x7fd8640c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.440+0000 7fd86b98d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd86415fe50 0x7fd8640c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.440+0000 7fd86b98d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640c7e00 con 0x7fd86415fe50 2023-11-28T11:09:31.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.440+0000 7fd86b98d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640c6840 con 0x7fd86406d170 2023-11-28T11:09:31.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.440+0000 7fd86b98d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640c8050 con 0x7fd8640b27d0 2023-11-28T11:09:31.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.440+0000 7fd869f2a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd86415fe50 0x7fd8640c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:31.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.440+0000 7fd869f2a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd86415fe50 0x7fd8640c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58736/0 (socket says 172.21.15.125:58736) 2023-11-28T11:09:31.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.440+0000 7fd869f2a700 1 -- 172.21.15.125:0/54081353 learned_addr learned my addr 172.21.15.125:0/54081353 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:31.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd869f2a700 1 -- 172.21.15.125:0/54081353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8640b27d0 msgr2=0x7fd8640c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:31.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd868f28700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8640b27d0 0x7fd8640c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:31.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd869729700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd86406d170 0x7fd864148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:31.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd869f2a700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8640b27d0 0x7fd8640c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd869f2a700 1 -- 172.21.15.125:0/54081353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd86406d170 msgr2=0x7fd864148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:31.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd869f2a700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd86406d170 0x7fd864148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:31.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd869f2a700 1 -- 172.21.15.125:0/54081353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8540094a0 con 0x7fd86415fe50 2023-11-28T11:09:31.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd869f2a700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd86415fe50 0x7fd8640c6300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00b970 tx=0x7fd85c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:31.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd859ffb700 1 -- 172.21.15.125:0/54081353 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00c9b0 con 0x7fd86415fe50 2023-11-28T11:09:31.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd859ffb700 1 -- 172.21.15.125:0/54081353 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c00cb30 con 0x7fd86415fe50 2023-11-28T11:09:31.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd86b98d700 1 -- 172.21.15.125:0/54081353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8640cf0b0 con 0x7fd86415fe50 2023-11-28T11:09:31.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd859ffb700 1 -- 172.21.15.125:0/54081353 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c014440 con 0x7fd86415fe50 2023-11-28T11:09:31.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.441+0000 7fd86b98d700 1 -- 172.21.15.125:0/54081353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8640cedd0 con 0x7fd86415fe50 2023-11-28T11:09:31.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.442+0000 7fd86b98d700 1 -- 172.21.15.125:0/54081353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8640cf390 con 0x7fd86415fe50 2023-11-28T11:09:31.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.442+0000 7fd859ffb700 1 -- 172.21.15.125:0/54081353 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd85c01b030 con 0x7fd86415fe50 2023-11-28T11:09:31.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.443+0000 7fd859ffb700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd8480682f0 0x7fd84806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:31.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.443+0000 7fd859ffb700 1 -- 172.21.15.125:0/54081353 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd85c006e40 con 0x7fd86415fe50 2023-11-28T11:09:31.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.443+0000 7fd869729700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd8480682f0 0x7fd84806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:31.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.443+0000 7fd869729700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd8480682f0 0x7fd84806a7a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd860000f60 tx=0x7fd860009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:31.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.447+0000 7fd859ffb700 1 -- 172.21.15.125:0/54081353 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd85c052170 con 0x7fd86415fe50 2023-11-28T11:09:31.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:31.676+0000 7fd86b98d700 1 -- 172.21.15.125:0/54081353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd8640743f0 con 0x7fd86415fe50 2023-11-28T11:09:32.097 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-11-28T11:09:32.096+0000 7f87cb91a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T11:09:32.105 INFO:tasks.ceph.mds.a.smithi125.stderr: -3122> 2023-11-28T11:08:36.905+0000 7f9990892700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:09:32.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.105+0000 7fd859ffb700 1 -- 172.21.15.125:0/54081353 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd85c019090 con 0x7fd86415fe50 2023-11-28T11:09:32.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.107+0000 7fd86b98d700 1 -- 172.21.15.125:0/54081353 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd8480682f0 msgr2=0x7fd84806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:32.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.107+0000 7fd86b98d700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd8480682f0 0x7fd84806a7a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd860000f60 tx=0x7fd860009040 comp rx=0 tx=0).stop 2023-11-28T11:09:32.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.107+0000 7fd86b98d700 1 -- 172.21.15.125:0/54081353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd86415fe50 msgr2=0x7fd8640c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:32.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.107+0000 7fd86b98d700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd86415fe50 0x7fd8640c6300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00b970 tx=0x7fd85c00bd30 comp rx=0 tx=0).stop 2023-11-28T11:09:32.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.107+0000 7fd86b98d700 1 -- 172.21.15.125:0/54081353 shutdown_connections 2023-11-28T11:09:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.107+0000 7fd86b98d700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd86415fe50 0x7fd8640c6300 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.107+0000 7fd86b98d700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd86406d170 0x7fd864148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.107+0000 7fd86b98d700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd8480682f0 0x7fd84806a7a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.107+0000 7fd86b98d700 1 --2- 172.21.15.125:0/54081353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8640b27d0 0x7fd8640c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.107+0000 7fd86b98d700 1 -- 172.21.15.125:0/54081353 >> 172.21.15.125:0/54081353 conn(0x7fd86406ea80 msgr2=0x7fd864160b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.108+0000 7fd86b98d700 1 -- 172.21.15.125:0/54081353 shutdown_connections 2023-11-28T11:09:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.108+0000 7fd86b98d700 1 -- 172.21.15.125:0/54081353 wait complete. 2023-11-28T11:09:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T11:09:32.122 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T11:09:32.138 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-11-28T11:09:32.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.245+0000 7fa20f4a9700 1 Processor -- start 2023-11-28T11:09:32.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.245+0000 7fa20f4a9700 1 -- start start 2023-11-28T11:09:32.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.246+0000 7fa20f4a9700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2080cec00 0x7fa208065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:32.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.246+0000 7fa20f4a9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2080cac90 0x7fa2080cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:32.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.246+0000 7fa20f4a9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20815ceb0 con 0x7fa208160300 2023-11-28T11:09:32.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.246+0000 7fa20f4a9700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2080cb650 con 0x7fa2080cec00 2023-11-28T11:09:32.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.246+0000 7fa20f4a9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2081608c0 con 0x7fa2080cac90 2023-11-28T11:09:32.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.246+0000 7fa20ca44700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa208160300 0x7fa20815d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42878/0 (socket says 172.21.15.125:42878) 2023-11-28T11:09:32.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.246+0000 7fa20ca44700 1 -- 172.21.15.125:0/3796176103 learned_addr learned my addr 172.21.15.125:0/3796176103 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:32.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.246+0000 7fa20da46700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2080cac90 0x7fa2080cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:32.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.246+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286345617 0 0) 0x7fa20815ceb0 con 0x7fa208160300 2023-11-28T11:09:32.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.246+0000 7fa20d245700 1 --2- 172.21.15.125:0/3796176103 >> v2:172.21.15.167:3300/0 conn(0x7fa2080cec00 0x7fa208065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:32.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.246+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f40035b0 con 0x7fa208160300 2023-11-28T11:09:32.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2105102489 0 0) 0x7fa1f40035b0 con 0x7fa208160300 2023-11-28T11:09:32.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2080cac90 msgr2=0x7fa2080cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:32.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2080cac90 0x7fa2080cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:32.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 >> v2:172.21.15.167:3300/0 conn(0x7fa2080cec00 msgr2=0x7fa208065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:32.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 --2- 172.21.15.125:0/3796176103 >> v2:172.21.15.167:3300/0 conn(0x7fa2080cec00 0x7fa208065fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:32.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208160ba0 con 0x7fa208160300 2023-11-28T11:09:32.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fa204001670 con 0x7fa208160300 2023-11-28T11:09:32.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 >> v1:172.21.15.125:6789/0 conn(0x7fa208160300 legacy=0x7fa20815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:32.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1f4003a00 0x7fa1f4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:32.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1f4004430 0x7fa1f40048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:32.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2080cac90 0x7fa1f4004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:32.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080cb650 con 0x7fa1f4003a00 2023-11-28T11:09:32.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2081608c0 con 0x7fa1f4004430 2023-11-28T11:09:32.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f400ba10 con 0x7fa2080cac90 2023-11-28T11:09:32.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa20d245700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1f4003a00 0x7fa1f4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:32.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa20da46700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2080cac90 0x7fa1f4004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:32.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa20ca44700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1f4004430 0x7fa1f40048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:32.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa20d245700 1 -- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2080cac90 msgr2=0x7fa1f4004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:32.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa20d245700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2080cac90 0x7fa1f4004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa20d245700 1 -- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1f4004430 msgr2=0x7fa1f40048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa20d245700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1f4004430 0x7fa1f40048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa20d245700 1 -- 172.21.15.125:0/3796176103 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40035b0 con 0x7fa1f4003a00 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa20ca44700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1f4004430 0x7fa1f40048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa20da46700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2080cac90 0x7fa1f4004fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa20d245700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1f4003a00 0x7fa1f4003e10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009b60 tx=0x7fa1f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff5ce0b657fd109 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f800e6c0 con 0x7fa1f4003a00 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f800e820 con 0x7fa1f4003a00 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.247+0000 7fa1fffff700 1 -- 172.21.15.125:0/3796176103 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f800eb90 con 0x7fa1f4003a00 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.248+0000 7fa20f4a9700 1 -- 172.21.15.125:0/3796176103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1f4003a00 msgr2=0x7fa1f4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.248+0000 7fa20f4a9700 1 --2- 172.21.15.125:0/3796176103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1f4003a00 0x7fa1f4003e10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009b60 tx=0x7fa1f4005880 comp rx=0 tx=0).stop 2023-11-28T11:09:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.248+0000 7fa20da46700 1 -- 172.21.15.125:0/3796176103 reap_dead start 2023-11-28T11:09:32.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.248+0000 7fa20f4a9700 1 -- 172.21.15.125:0/3796176103 shutdown_connections 2023-11-28T11:09:32.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.248+0000 7fa20f4a9700 1 -- 172.21.15.125:0/3796176103 >> 172.21.15.125:0/3796176103 conn(0x7fa2080cf400 msgr2=0x7fa2080cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:32.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.248+0000 7fa20f4a9700 1 -- 172.21.15.125:0/3796176103 shutdown_connections 2023-11-28T11:09:32.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.248+0000 7fa20f4a9700 1 -- 172.21.15.125:0/3796176103 wait complete. 2023-11-28T11:09:32.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.249+0000 7fa20f4a9700 1 Processor -- start 2023-11-28T11:09:32.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.249+0000 7fa20f4a9700 1 -- start start 2023-11-28T11:09:32.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20f4a9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1f4003a00 0x7fa208151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:32.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20f4a9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2080ae850 0x7fa208071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:32.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20f4a9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2080aeec0 0x7fa2080af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:32.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20f4a9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080af8a0 con 0x7fa2080aeec0 2023-11-28T11:09:32.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20f4a9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080b4180 con 0x7fa2080ae850 2023-11-28T11:09:32.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20f4a9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080b4460 con 0x7fa1f4003a00 2023-11-28T11:09:32.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20da46700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2080aeec0 0x7fa2080af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:32.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20da46700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2080aeec0 0x7fa2080af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58768/0 (socket says 172.21.15.125:58768) 2023-11-28T11:09:32.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20da46700 1 -- 172.21.15.125:0/2993547877 learned_addr learned my addr 172.21.15.125:0/2993547877 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:32.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20d245700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1f4003a00 0x7fa208151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20ca44700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2080ae850 0x7fa208071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20da46700 1 -- 172.21.15.125:0/2993547877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1f4003a00 msgr2=0x7fa208151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20da46700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1f4003a00 0x7fa208151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20da46700 1 -- 172.21.15.125:0/2993547877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2080ae850 msgr2=0x7fa208071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20da46700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2080ae850 0x7fa208071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20da46700 1 -- 172.21.15.125:0/2993547877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208161160 con 0x7fa2080aeec0 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.250+0000 7fa20ca44700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2080ae850 0x7fa208071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.251+0000 7fa20da46700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2080aeec0 0x7fa2080af360 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa2080cbe50 tx=0x7fa2000104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.251+0000 7fa1fdffb700 1 -- 172.21.15.125:0/2993547877 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20001b070 con 0x7fa2080aeec0 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.251+0000 7fa1fdffb700 1 -- 172.21.15.125:0/2993547877 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20000f040 con 0x7fa2080aeec0 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.251+0000 7fa20f4a9700 1 -- 172.21.15.125:0/2993547877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa208160e80 con 0x7fa2080aeec0 2023-11-28T11:09:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.251+0000 7fa1fdffb700 1 -- 172.21.15.125:0/2993547877 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20000e050 con 0x7fa2080aeec0 2023-11-28T11:09:32.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.251+0000 7fa20f4a9700 1 -- 172.21.15.125:0/2993547877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa208066510 con 0x7fa2080aeec0 2023-11-28T11:09:32.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.252+0000 7fa20f4a9700 1 -- 172.21.15.125:0/2993547877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2080d02e0 con 0x7fa2080aeec0 2023-11-28T11:09:32.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.252+0000 7fa1fdffb700 1 -- 172.21.15.125:0/2993547877 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa200003a20 con 0x7fa2080aeec0 2023-11-28T11:09:32.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.253+0000 7fa1fdffb700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1ec0682f0 0x7fa1ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:32.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.253+0000 7fa1fdffb700 1 -- 172.21.15.125:0/2993547877 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fa200086290 con 0x7fa2080aeec0 2023-11-28T11:09:32.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.253+0000 7fa20d245700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1ec0682f0 0x7fa1ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:32.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.253+0000 7fa20d245700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1ec0682f0 0x7fa1ec06a7a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80090b0 tx=0x7fa1f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:32.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.257+0000 7fa1fdffb700 1 -- 172.21.15.125:0/2993547877 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa200052a60 con 0x7fa2080aeec0 2023-11-28T11:09:32.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:32.485+0000 7fa20f4a9700 1 -- 172.21.15.125:0/2993547877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa2080743f0 con 0x7fa2080aeec0 2023-11-28T11:09:32.658 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:09:32.661 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:09:33.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.111+0000 7fa1fdffb700 1 -- 172.21.15.125:0/2993547877 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa200003cb0 con 0x7fa2080aeec0 2023-11-28T11:09:33.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 -- 172.21.15.125:0/2993547877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1ec0682f0 msgr2=0x7fa1ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:33.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1ec0682f0 0x7fa1ec06a7a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80090b0 tx=0x7fa1f8008030 comp rx=0 tx=0).stop 2023-11-28T11:09:33.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 -- 172.21.15.125:0/2993547877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2080aeec0 msgr2=0x7fa2080af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:33.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2080aeec0 0x7fa2080af360 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa2080cbe50 tx=0x7fa2000104a0 comp rx=0 tx=0).stop 2023-11-28T11:09:33.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 -- 172.21.15.125:0/2993547877 shutdown_connections 2023-11-28T11:09:33.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2080aeec0 0x7fa2080af360 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:33.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1ec0682f0 0x7fa1ec06a7a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:33.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1f4003a00 0x7fa208151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:33.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 --2- 172.21.15.125:0/2993547877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2080ae850 0x7fa208071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:33.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 -- 172.21.15.125:0/2993547877 >> 172.21.15.125:0/2993547877 conn(0x7fa2080cf400 msgr2=0x7fa2080b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:33.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 -- 172.21.15.125:0/2993547877 shutdown_connections 2023-11-28T11:09:33.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.114+0000 7fa20f4a9700 1 -- 172.21.15.125:0/2993547877 wait complete. 2023-11-28T11:09:33.129 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T11:09:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.252+0000 7fa8ae095700 1 Processor -- start 2023-11-28T11:09:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.253+0000 7fa8ae095700 1 -- start start 2023-11-28T11:09:33.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.253+0000 7fa8ae095700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa8a815c8f0 0x7fa8a806b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:33.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.253+0000 7fa8ae095700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a80cbe50 con 0x7fa8a80d0cb0 2023-11-28T11:09:33.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.253+0000 7fa8ae095700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a80cc130 con 0x7fa8a80ccef0 2023-11-28T11:09:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.253+0000 7fa8ae095700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a80cc410 con 0x7fa8a815c8f0 2023-11-28T11:09:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.253+0000 7fa8a77fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa8a80d0cb0 0x7fa8a80d1080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42898/0 (socket says 172.21.15.125:42898) 2023-11-28T11:09:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.253+0000 7fa8a77fe700 1 -- 172.21.15.125:0/2088320542 learned_addr learned my addr 172.21.15.125:0/2088320542 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a6ffd700 1 --2- 172.21.15.125:0/2088320542 >> v2:172.21.15.167:3300/0 conn(0x7fa8a815c8f0 0x7fa8a806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046137710 0 0) 0x7fa8a80cbe50 con 0x7fa8a80d0cb0 2023-11-28T11:09:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8940035b0 con 0x7fa8a80d0cb0 2023-11-28T11:09:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795237865 0 0) 0x7fa8940035b0 con 0x7fa8a80d0cb0 2023-11-28T11:09:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 >> v2:172.21.15.167:3300/0 conn(0x7fa8a815c8f0 msgr2=0x7fa8a806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 --2- 172.21.15.125:0/2088320542 >> v2:172.21.15.167:3300/0 conn(0x7fa8a815c8f0 0x7fa8a806b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:33.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 >> v1:172.21.15.167:6789/0 conn(0x7fa8a80ccef0 legacy=0x7fa8a806b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a80cc6f0 con 0x7fa8a80d0cb0 2023-11-28T11:09:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fa8900017f0 con 0x7fa8a80d0cb0 2023-11-28T11:09:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 >> v1:172.21.15.125:6789/0 conn(0x7fa8a80d0cb0 legacy=0x7fa8a80d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 --2- 172.21.15.125:0/2088320542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa894003a00 0x7fa894003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 --2- 172.21.15.125:0/2088320542 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa894004850 0x7fa894004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 --2- 172.21.15.125:0/2088320542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa894005200 0x7fa89400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80cc410 con 0x7fa894005200 2023-11-28T11:09:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89400c110 con 0x7fa894003a00 2023-11-28T11:09:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89400c2d0 con 0x7fa894004850 2023-11-28T11:09:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a7fff700 1 --2- 172.21.15.125:0/2088320542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa894005200 0x7fa89400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:33.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a77fe700 1 --2- 172.21.15.125:0/2088320542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa894003a00 0x7fa894003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a6ffd700 1 --2- 172.21.15.125:0/2088320542 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa894004850 0x7fa894004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a7fff700 1 -- 172.21.15.125:0/2088320542 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa894004850 msgr2=0x7fa894004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a7fff700 1 --2- 172.21.15.125:0/2088320542 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa894004850 0x7fa894004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a7fff700 1 -- 172.21.15.125:0/2088320542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa894003a00 msgr2=0x7fa894003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a7fff700 1 --2- 172.21.15.125:0/2088320542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa894003a00 0x7fa894003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.254+0000 7fa8a7fff700 1 -- 172.21.15.125:0/2088320542 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940035b0 con 0x7fa894005200 2023-11-28T11:09:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8a7fff700 1 -- 172.21.15.125:0/2088320542 reap_dead start 2023-11-28T11:09:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8a7fff700 1 --2- 172.21.15.125:0/2088320542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa894005200 0x7fa89400ba10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c240 tx=0x7fa894005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd18dbf9020718 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0001df0 con 0x7fa894005200 2023-11-28T11:09:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a000cdc0 con 0x7fa894005200 2023-11-28T11:09:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8a67fc700 1 -- 172.21.15.125:0/2088320542 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0003c40 con 0x7fa894005200 2023-11-28T11:09:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8ae095700 1 -- 172.21.15.125:0/2088320542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa894005200 msgr2=0x7fa89400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8ae095700 1 --2- 172.21.15.125:0/2088320542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa894005200 0x7fa89400ba10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c240 tx=0x7fa894005880 comp rx=0 tx=0).stop 2023-11-28T11:09:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8ae095700 1 -- 172.21.15.125:0/2088320542 shutdown_connections 2023-11-28T11:09:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8ae095700 1 --2- 172.21.15.125:0/2088320542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa894005200 0x7fa89400ba10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8ae095700 1 -- 172.21.15.125:0/2088320542 >> 172.21.15.125:0/2088320542 conn(0x7fa8a806ab90 msgr2=0x7fa8a8099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8ae095700 1 -- 172.21.15.125:0/2088320542 shutdown_connections 2023-11-28T11:09:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.255+0000 7fa8ae095700 1 -- 172.21.15.125:0/2088320542 wait complete. 2023-11-28T11:09:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.257+0000 7fa8ae095700 1 Processor -- start 2023-11-28T11:09:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.257+0000 7fa8ae095700 1 -- start start 2023-11-28T11:09:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8ae095700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa894005200 0x7fa8a81587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8ae095700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8a80b3b80 0x7fa8a80b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8ae095700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8a80b3ff0 0x7fa8a80b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8ae095700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80b4b20 con 0x7fa8a80b3b80 2023-11-28T11:09:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8ae095700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80b4560 con 0x7fa894005200 2023-11-28T11:09:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8ae095700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80b4840 con 0x7fa8a80b3ff0 2023-11-28T11:09:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8a6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8a80b3b80 0x7fa8a80b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8a6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8a80b3b80 0x7fa8a80b4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58788/0 (socket says 172.21.15.125:58788) 2023-11-28T11:09:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8a6ffd700 1 -- 172.21.15.125:0/3592220188 learned_addr learned my addr 172.21.15.125:0/3592220188 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8a77fe700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa894005200 0x7fa8a81587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8a7fff700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8a80b3ff0 0x7fa8a80b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8a6ffd700 1 -- 172.21.15.125:0/3592220188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8a80b3ff0 msgr2=0x7fa8a80b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8a6ffd700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8a80b3ff0 0x7fa8a80b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8a6ffd700 1 -- 172.21.15.125:0/3592220188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa894005200 msgr2=0x7fa8a81587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8a6ffd700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa894005200 0x7fa8a81587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.258+0000 7fa8a6ffd700 1 -- 172.21.15.125:0/3592220188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a80d1080 con 0x7fa8a80b3b80 2023-11-28T11:09:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.259+0000 7fa8a6ffd700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8a80b3b80 0x7fa8a80b4d60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa898011940 tx=0x7fa898011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.259+0000 7fa89ffff700 1 -- 172.21.15.125:0/3592220188 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898011e90 con 0x7fa8a80b3b80 2023-11-28T11:09:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.259+0000 7fa89ffff700 1 -- 172.21.15.125:0/3592220188 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898004240 con 0x7fa8a80b3b80 2023-11-28T11:09:33.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.259+0000 7fa8ae095700 1 -- 172.21.15.125:0/3592220188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a80cc9d0 con 0x7fa8a80b3b80 2023-11-28T11:09:33.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.259+0000 7fa89ffff700 1 -- 172.21.15.125:0/3592220188 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800f730 con 0x7fa8a80b3b80 2023-11-28T11:09:33.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.259+0000 7fa8ae095700 1 -- 172.21.15.125:0/3592220188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a80d1210 con 0x7fa8a80b3b80 2023-11-28T11:09:33.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.260+0000 7fa8ae095700 1 -- 172.21.15.125:0/3592220188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a80743f0 con 0x7fa8a80b3b80 2023-11-28T11:09:33.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.260+0000 7fa89ffff700 1 -- 172.21.15.125:0/3592220188 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa89801b030 con 0x7fa8a80b3b80 2023-11-28T11:09:33.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.260+0000 7fa89ffff700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8880682f0 0x7fa88806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:33.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.261+0000 7fa89ffff700 1 -- 172.21.15.125:0/3592220188 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fa8980863d0 con 0x7fa8a80b3b80 2023-11-28T11:09:33.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.261+0000 7fa8a77fe700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8880682f0 0x7fa88806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:33.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.261+0000 7fa8a77fe700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8880682f0 0x7fa88806a7a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa890001e10 tx=0x7fa890009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:33.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.265+0000 7fa89ffff700 1 -- 172.21.15.125:0/3592220188 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa898052ba0 con 0x7fa8a80b3b80 2023-11-28T11:09:33.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:33.445+0000 7fa8ae095700 1 -- 172.21.15.125:0/3592220188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8a815ff40 con 0x7fa8a80b3b80 2023-11-28T11:09:34.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.123+0000 7fa89ffff700 1 -- 172.21.15.125:0/3592220188 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa8980561c0 con 0x7fa8a80b3b80 2023-11-28T11:09:34.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.126+0000 7fa8ae095700 1 -- 172.21.15.125:0/3592220188 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8880682f0 msgr2=0x7fa88806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:34.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.126+0000 7fa8ae095700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8880682f0 0x7fa88806a7a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa890001e10 tx=0x7fa890009040 comp rx=0 tx=0).stop 2023-11-28T11:09:34.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.126+0000 7fa8ae095700 1 -- 172.21.15.125:0/3592220188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8a80b3b80 msgr2=0x7fa8a80b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:34.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.126+0000 7fa8ae095700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8a80b3b80 0x7fa8a80b4d60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa898011940 tx=0x7fa898011c50 comp rx=0 tx=0).stop 2023-11-28T11:09:34.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.128+0000 7fa8ae095700 1 -- 172.21.15.125:0/3592220188 shutdown_connections 2023-11-28T11:09:34.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.128+0000 7fa8ae095700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8880682f0 0x7fa88806a7a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.128+0000 7fa8ae095700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8a80b3ff0 0x7fa8a80b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.128+0000 7fa8ae095700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa894005200 0x7fa8a81587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.128+0000 7fa8ae095700 1 --2- 172.21.15.125:0/3592220188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8a80b3b80 0x7fa8a80b4d60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.128+0000 7fa8ae095700 1 -- 172.21.15.125:0/3592220188 >> 172.21.15.125:0/3592220188 conn(0x7fa8a806ab90 msgr2=0x7fa8a806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:34.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.128+0000 7fa8ae095700 1 -- 172.21.15.125:0/3592220188 shutdown_connections 2023-11-28T11:09:34.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.128+0000 7fa8ae095700 1 -- 172.21.15.125:0/3592220188 wait complete. 2023-11-28T11:09:34.132 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' removed 2023-11-28T11:09:34.146 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T11:09:34.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.272+0000 7fe97a718700 1 Processor -- start 2023-11-28T11:09:34.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.272+0000 7fe97a718700 1 -- start start 2023-11-28T11:09:34.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe97a718700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe97415e070 0x7fe97406b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:34.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe97a718700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe9740ceea0 0x7fe97406b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:34.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe97a718700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe97415a150 0x7fe97415a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe97a718700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97415ae80 con 0x7fe9740ceea0 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe97a718700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9740cea10 con 0x7fe97415e070 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe97a718700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9740ce0e0 con 0x7fe97415a150 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe9737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe9740ceea0 0x7fe97406b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe9737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe9740ceea0 0x7fe97406b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58794/0 (socket says 172.21.15.125:58794) 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe9737fe700 1 -- 172.21.15.125:0/2033501630 learned_addr learned my addr 172.21.15.125:0/2033501630 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe9737fe700 1 -- 172.21.15.125:0/2033501630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe97415a150 msgr2=0x7fe97415a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe9737fe700 1 --2- 172.21.15.125:0/2033501630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe97415a150 0x7fe97415a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe9737fe700 1 -- 172.21.15.125:0/2033501630 >> v2:172.21.15.167:3300/0 conn(0x7fe97415e070 msgr2=0x7fe97406b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe973fff700 1 --2- 172.21.15.125:0/2033501630 >> v2:172.21.15.167:3300/0 conn(0x7fe97415e070 0x7fe97406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe9737fe700 1 --2- 172.21.15.125:0/2033501630 >> v2:172.21.15.167:3300/0 conn(0x7fe97415e070 0x7fe97406b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.273+0000 7fe9737fe700 1 -- 172.21.15.125:0/2033501630 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9740ce3c0 con 0x7fe9740ceea0 2023-11-28T11:09:34.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe9737fe700 1 --2- 172.21.15.125:0/2033501630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9740ceea0 0x7fe97406b8c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe9740720b0 tx=0x7fe964009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce32c25394204aa2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:34.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe972ffd700 1 -- 172.21.15.125:0/2033501630 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400b870 con 0x7fe9740ceea0 2023-11-28T11:09:34.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe972ffd700 1 -- 172.21.15.125:0/2033501630 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96400b9d0 con 0x7fe9740ceea0 2023-11-28T11:09:34.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe972ffd700 1 -- 172.21.15.125:0/2033501630 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400bd60 con 0x7fe9740ceea0 2023-11-28T11:09:34.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe97a718700 1 -- 172.21.15.125:0/2033501630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9740ceea0 msgr2=0x7fe97406b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:34.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe97a718700 1 --2- 172.21.15.125:0/2033501630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9740ceea0 0x7fe97406b8c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe9740720b0 tx=0x7fe964009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe97a718700 1 -- 172.21.15.125:0/2033501630 shutdown_connections 2023-11-28T11:09:34.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe97a718700 1 --2- 172.21.15.125:0/2033501630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe97415a150 0x7fe97415a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe97a718700 1 --2- 172.21.15.125:0/2033501630 >> v2:172.21.15.167:3300/0 conn(0x7fe97415e070 0x7fe97406b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe97a718700 1 --2- 172.21.15.125:0/2033501630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9740ceea0 0x7fe97406b8c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe97a718700 1 -- 172.21.15.125:0/2033501630 >> 172.21.15.125:0/2033501630 conn(0x7fe9740cfc30 msgr2=0x7fe9740d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:34.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe97a718700 1 -- 172.21.15.125:0/2033501630 shutdown_connections 2023-11-28T11:09:34.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.274+0000 7fe97a718700 1 -- 172.21.15.125:0/2033501630 wait complete. 2023-11-28T11:09:34.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.275+0000 7fe97a718700 1 Processor -- start 2023-11-28T11:09:34.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.276+0000 7fe97a718700 1 -- start start 2023-11-28T11:09:34.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.276+0000 7fe97a718700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9740ceea0 0x7fe97406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:34.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.276+0000 7fe97a718700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe97415a150 0x7fe9740b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:34.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.276+0000 7fe97a718700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe97415e070 0x7fe974147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:34.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.276+0000 7fe97a718700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9740b3af0 con 0x7fe97415e070 2023-11-28T11:09:34.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.276+0000 7fe97a718700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97406cca0 con 0x7fe9740ceea0 2023-11-28T11:09:34.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.276+0000 7fe97a718700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9741478b0 con 0x7fe97415a150 2023-11-28T11:09:34.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.276+0000 7fe978cb5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe97415e070 0x7fe974147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:34.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe978cb5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe97415e070 0x7fe974147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58804/0 (socket says 172.21.15.125:58804) 2023-11-28T11:09:34.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe978cb5700 1 -- 172.21.15.125:0/3925178086 learned_addr learned my addr 172.21.15.125:0/3925178086 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:34.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe973fff700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9740ceea0 0x7fe97406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:34.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe9737fe700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe97415a150 0x7fe9740b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:34.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe978cb5700 1 -- 172.21.15.125:0/3925178086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe97415a150 msgr2=0x7fe9740b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe978cb5700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe97415a150 0x7fe9740b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe978cb5700 1 -- 172.21.15.125:0/3925178086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9740ceea0 msgr2=0x7fe97406eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe978cb5700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9740ceea0 0x7fe97406eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe978cb5700 1 -- 172.21.15.125:0/3925178086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964009550 con 0x7fe97415e070 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe978cb5700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe97415e070 0x7fe974147370 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00b970 tx=0x7fe96c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe970ff9700 1 -- 172.21.15.125:0/3925178086 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c00c9b0 con 0x7fe97415e070 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe970ff9700 1 -- 172.21.15.125:0/3925178086 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c00cb30 con 0x7fe97415e070 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe97a718700 1 -- 172.21.15.125:0/3925178086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97415ab10 con 0x7fe97415e070 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe970ff9700 1 -- 172.21.15.125:0/3925178086 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c014440 con 0x7fe97415e070 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.277+0000 7fe97a718700 1 -- 172.21.15.125:0/3925178086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9740ce6a0 con 0x7fe97415e070 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.279+0000 7fe97a718700 1 -- 172.21.15.125:0/3925178086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe974150080 con 0x7fe97415e070 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.279+0000 7fe970ff9700 1 -- 172.21.15.125:0/3925178086 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe96c01b030 con 0x7fe97415e070 2023-11-28T11:09:34.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.279+0000 7fe970ff9700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9600682f0 0x7fe96006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:34.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.279+0000 7fe970ff9700 1 -- 172.21.15.125:0/3925178086 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fe96c006e40 con 0x7fe97415e070 2023-11-28T11:09:34.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.279+0000 7fe973fff700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9600682f0 0x7fe96006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:34.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.280+0000 7fe973fff700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9600682f0 0x7fe96006a7a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe96800b840 tx=0x7fe968008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:34.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.283+0000 7fe970ff9700 1 -- 172.21.15.125:0/3925178086 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe96c052170 con 0x7fe97415e070 2023-11-28T11:09:34.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:34.469+0000 7fe97a718700 1 -- 172.21.15.125:0/3925178086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe9740743f0 con 0x7fe97415e070 2023-11-28T11:09:35.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.127+0000 7fe970ff9700 1 -- 172.21.15.125:0/3925178086 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe96c0190d0 con 0x7fe97415e070 2023-11-28T11:09:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 -- 172.21.15.125:0/3925178086 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9600682f0 msgr2=0x7fe96006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9600682f0 0x7fe96006a7a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe96800b840 tx=0x7fe968008040 comp rx=0 tx=0).stop 2023-11-28T11:09:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 -- 172.21.15.125:0/3925178086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe97415e070 msgr2=0x7fe974147370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe97415e070 0x7fe974147370 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00b970 tx=0x7fe96c00bd30 comp rx=0 tx=0).stop 2023-11-28T11:09:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 -- 172.21.15.125:0/3925178086 shutdown_connections 2023-11-28T11:09:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe97415e070 0x7fe974147370 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9740ceea0 0x7fe97406eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9600682f0 0x7fe96006a7a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:35.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 --2- 172.21.15.125:0/3925178086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe97415a150 0x7fe9740b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 -- 172.21.15.125:0/3925178086 >> 172.21.15.125:0/3925178086 conn(0x7fe9740cfc30 msgr2=0x7fe9740c5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 -- 172.21.15.125:0/3925178086 shutdown_connections 2023-11-28T11:09:35.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:35.131+0000 7fe97a718700 1 -- 172.21.15.125:0/3925178086 wait complete. 2023-11-28T11:09:35.135 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' removed 2023-11-28T11:09:35.150 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:09:35.150 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T11:09:35.150 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T11:09:35.150 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:09:35.151 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:09:35.151 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T11:09:35.151 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T11:09:35.151 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:09:35.151 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:09:35.151 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T11:09:35.152 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T11:09:35.152 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:09:35.152 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:09:35.152 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T11:09:35.152 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T11:09:35.152 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:09:35.161 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T11:09:35.161 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:09:35.163 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T11:09:35.163 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:09:35.164 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T11:09:35.164 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:09:35.203 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:09:35.204 DEBUG:teuthology.parallel:result is None 2023-11-28T11:09:35.206 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:09:35.206 DEBUG:teuthology.parallel:result is None 2023-11-28T11:09:35.206 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:09:35.207 DEBUG:teuthology.parallel:result is None 2023-11-28T11:09:35.282 INFO:tasks.ceph.mds.c.smithi125.stdout:starting mds.c at 2023-11-28T11:09:35.292 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2023-11-28T11:09:35.292 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2023-11-28T11:09:40.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-28T11:09:41.161 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T11:09:41.161 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:09:41.165 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:09:41.165 DEBUG:teuthology.parallel:result is None 2023-11-28T11:09:41.165 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T11:09:41.255 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-11-28T11:09:41.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.302+0000 7fd3d4664700 1 Processor -- start 2023-11-28T11:09:41.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.302+0000 7fd3d4664700 1 -- start start 2023-11-28T11:09:41.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d4664700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3cc1599b0 0x7fd3cc15d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:41.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d4664700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0af0a0 0x7fd3cc15a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:41.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d4664700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc159ec0 con 0x7fd3cc0b1650 2023-11-28T11:09:41.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d4664700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc15d8a0 con 0x7fd3cc1599b0 2023-11-28T11:09:41.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d4664700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc15db80 con 0x7fd3cc0af0a0 2023-11-28T11:09:41.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d1bff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3cc1599b0 0x7fd3cc15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:41.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d1bff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3cc1599b0 0x7fd3cc15d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58836/0 (socket says 172.21.15.125:58836) 2023-11-28T11:09:41.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d1bff700 1 -- 172.21.15.125:0/3974806505 learned_addr learned my addr 172.21.15.125:0/3974806505 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d2c01700 1 --2- 172.21.15.125:0/3974806505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0af0a0 0x7fd3cc15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d1bff700 1 -- 172.21.15.125:0/3974806505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0af0a0 msgr2=0x7fd3cc15a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d1bff700 1 --2- 172.21.15.125:0/3974806505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0af0a0 0x7fd3cc15a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d1bff700 1 -- 172.21.15.125:0/3974806505 >> v1:172.21.15.167:6789/0 conn(0x7fd3cc0b1650 legacy=0x7fd3cc0b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d1bff700 1 -- 172.21.15.125:0/3974806505 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc15de60 con 0x7fd3cc1599b0 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d2c01700 1 --2- 172.21.15.125:0/3974806505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0af0a0 0x7fd3cc15a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d1bff700 1 --2- 172.21.15.125:0/3974806505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc1599b0 0x7fd3cc15d050 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0098f0 tx=0x7fd3bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaf38ea20c83960 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d13fe700 1 -- 172.21.15.125:0/3974806505 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00b8a0 con 0x7fd3cc1599b0 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d13fe700 1 -- 172.21.15.125:0/3974806505 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00ba00 con 0x7fd3cc1599b0 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.303+0000 7fd3d13fe700 1 -- 172.21.15.125:0/3974806505 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00bd90 con 0x7fd3cc1599b0 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.304+0000 7fd3d4664700 1 -- 172.21.15.125:0/3974806505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc1599b0 msgr2=0x7fd3cc15d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:41.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.304+0000 7fd3d4664700 1 --2- 172.21.15.125:0/3974806505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc1599b0 0x7fd3cc15d050 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0098f0 tx=0x7fd3bc009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:41.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.304+0000 7fd3d4664700 1 -- 172.21.15.125:0/3974806505 shutdown_connections 2023-11-28T11:09:41.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.304+0000 7fd3d4664700 1 --2- 172.21.15.125:0/3974806505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0af0a0 0x7fd3cc15a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:41.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.304+0000 7fd3d4664700 1 --2- 172.21.15.125:0/3974806505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc1599b0 0x7fd3cc15d050 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:41.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.304+0000 7fd3d4664700 1 -- 172.21.15.125:0/3974806505 >> 172.21.15.125:0/3974806505 conn(0x7fd3cc06c010 msgr2=0x7fd3cc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:41.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.304+0000 7fd3d4664700 1 -- 172.21.15.125:0/3974806505 shutdown_connections 2023-11-28T11:09:41.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.304+0000 7fd3d4664700 1 -- 172.21.15.125:0/3974806505 wait complete. 2023-11-28T11:09:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.305+0000 7fd3d4664700 1 Processor -- start 2023-11-28T11:09:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.305+0000 7fd3d4664700 1 -- start start 2023-11-28T11:09:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.306+0000 7fd3d4664700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0af0a0 0x7fd3cc14b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.306+0000 7fd3d4664700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0b1650 0x7fd3cc0af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.306+0000 7fd3d4664700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc0aff10 0x7fd3cc0c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.306+0000 7fd3d4664700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc156880 con 0x7fd3cc0b1650 2023-11-28T11:09:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.306+0000 7fd3d4664700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0b03b0 con 0x7fd3cc0aff10 2023-11-28T11:09:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.306+0000 7fd3d4664700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc14b560 con 0x7fd3cc0af0a0 2023-11-28T11:09:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.306+0000 7fd3d1bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0b1650 0x7fd3cc0af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:41.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.306+0000 7fd3d1bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0b1650 0x7fd3cc0af9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58840/0 (socket says 172.21.15.125:58840) 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.306+0000 7fd3d1bff700 1 -- 172.21.15.125:0/1158264893 learned_addr learned my addr 172.21.15.125:0/1158264893 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.306+0000 7fd3d2c01700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc0aff10 0x7fd3cc0c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.306+0000 7fd3d2400700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0af0a0 0x7fd3cc14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.307+0000 7fd3d1bff700 1 -- 172.21.15.125:0/1158264893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0af0a0 msgr2=0x7fd3cc14b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.307+0000 7fd3d1bff700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0af0a0 0x7fd3cc14b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.307+0000 7fd3d1bff700 1 -- 172.21.15.125:0/1158264893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc0aff10 msgr2=0x7fd3cc0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.307+0000 7fd3d1bff700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc0aff10 0x7fd3cc0c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.307+0000 7fd3d1bff700 1 -- 172.21.15.125:0/1158264893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc009550 con 0x7fd3cc0b1650 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.307+0000 7fd3d1bff700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0b1650 0x7fd3cc0af9d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc000c00 tx=0x7fd3bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.307+0000 7fd3c2ffd700 1 -- 172.21.15.125:0/1158264893 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc004570 con 0x7fd3cc0b1650 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.307+0000 7fd3c2ffd700 1 -- 172.21.15.125:0/1158264893 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc01f070 con 0x7fd3cc0b1650 2023-11-28T11:09:41.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.307+0000 7fd3c2ffd700 1 -- 172.21.15.125:0/1158264893 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0038e0 con 0x7fd3cc0b1650 2023-11-28T11:09:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.307+0000 7fd3d4664700 1 -- 172.21.15.125:0/1158264893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc15a890 con 0x7fd3cc0b1650 2023-11-28T11:09:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.307+0000 7fd3d4664700 1 -- 172.21.15.125:0/1158264893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc15d590 con 0x7fd3cc0b1650 2023-11-28T11:09:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.308+0000 7fd3d4664700 1 -- 172.21.15.125:0/1158264893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc15aa20 con 0x7fd3cc0b1650 2023-11-28T11:09:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.308+0000 7fd3c2ffd700 1 -- 172.21.15.125:0/1158264893 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd3bc02a020 con 0x7fd3cc0b1650 2023-11-28T11:09:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.309+0000 7fd3c2ffd700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b00682f0 0x7fd3b006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.309+0000 7fd3c2ffd700 1 -- 172.21.15.125:0/1158264893 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd3bc0870c0 con 0x7fd3cc0b1650 2023-11-28T11:09:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.309+0000 7fd3d2400700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b00682f0 0x7fd3b006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:41.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.309+0000 7fd3d2400700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b00682f0 0x7fd3b006a7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0c4c30 tx=0x7fd3c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:41.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.313+0000 7fd3c2ffd700 1 -- 172.21.15.125:0/1158264893 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd3bc053ba0 con 0x7fd3cc0b1650 2023-11-28T11:09:41.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:41.509+0000 7fd3d4664700 1 -- 172.21.15.125:0/1158264893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd3cc1569c0 con 0x7fd3cc0b1650 2023-11-28T11:09:42.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.288+0000 7fd3c2ffd700 1 -- 172.21.15.125:0/1158264893 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd3cc1569c0 con 0x7fd3cc0b1650 2023-11-28T11:09:42.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 -- 172.21.15.125:0/1158264893 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b00682f0 msgr2=0x7fd3b006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:42.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b00682f0 0x7fd3b006a7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0c4c30 tx=0x7fd3c8009040 comp rx=0 tx=0).stop 2023-11-28T11:09:42.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 -- 172.21.15.125:0/1158264893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0b1650 msgr2=0x7fd3cc0af9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:42.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0b1650 0x7fd3cc0af9d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc000c00 tx=0x7fd3bc004750 comp rx=0 tx=0).stop 2023-11-28T11:09:42.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 -- 172.21.15.125:0/1158264893 shutdown_connections 2023-11-28T11:09:42.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc0aff10 0x7fd3cc0c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b00682f0 0x7fd3b006a7a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0af0a0 0x7fd3cc14b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 --2- 172.21.15.125:0/1158264893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0b1650 0x7fd3cc0af9d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 -- 172.21.15.125:0/1158264893 >> 172.21.15.125:0/1158264893 conn(0x7fd3cc06c010 msgr2=0x7fd3cc0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:42.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 -- 172.21.15.125:0/1158264893 shutdown_connections 2023-11-28T11:09:42.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.291+0000 7fd3d4664700 1 -- 172.21.15.125:0/1158264893 wait complete. 2023-11-28T11:09:42.294 INFO:teuthology.orchestra.run.smithi125.stderr: removed all blocklist entries 2023-11-28T11:09:42.307 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T11:09:42.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.433+0000 7fda7fc38700 1 Processor -- start 2023-11-28T11:09:42.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.433+0000 7fda7fc38700 1 -- start start 2023-11-28T11:09:42.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.434+0000 7fda7fc38700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fda780ce040 0x7fda7815d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.434+0000 7fda7fc38700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda78142db0 0x7fda7813ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.434+0000 7fda7fc38700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7813fc90 con 0x7fda780b1770 2023-11-28T11:09:42.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.434+0000 7fda7fc38700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7813f6d0 con 0x7fda780ce040 2023-11-28T11:09:42.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.434+0000 7fda7fc38700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7813f9b0 con 0x7fda78142db0 2023-11-28T11:09:42.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.434+0000 7fda7d9d4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fda780ce040 0x7fda7815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:42.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.434+0000 7fda7d9d4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fda780ce040 0x7fda7815d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58850/0 (socket says 172.21.15.125:58850) 2023-11-28T11:09:42.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.434+0000 7fda7d9d4700 1 -- 172.21.15.125:0/897215820 learned_addr learned my addr 172.21.15.125:0/897215820 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:42.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7d9d4700 1 -- 172.21.15.125:0/897215820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda78142db0 msgr2=0x7fda7813ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:42.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7d1d3700 1 --2- 172.21.15.125:0/897215820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda78142db0 0x7fda7813ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:42.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7d9d4700 1 --2- 172.21.15.125:0/897215820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda78142db0 0x7fda7813ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7d9d4700 1 -- 172.21.15.125:0/897215820 >> v1:172.21.15.167:6789/0 conn(0x7fda780b1770 legacy=0x7fda7813cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:42.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7d9d4700 1 -- 172.21.15.125:0/897215820 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7815d100 con 0x7fda780ce040 2023-11-28T11:09:42.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7d9d4700 1 --2- 172.21.15.125:0/897215820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda780ce040 0x7fda7815d900 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fda740098f0 tx=0x7fda74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cac096252a2a53 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:42.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7c9d2700 1 -- 172.21.15.125:0/897215820 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74004230 con 0x7fda780ce040 2023-11-28T11:09:42.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7c9d2700 1 -- 172.21.15.125:0/897215820 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda74004390 con 0x7fda780ce040 2023-11-28T11:09:42.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7c9d2700 1 -- 172.21.15.125:0/897215820 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740036a0 con 0x7fda780ce040 2023-11-28T11:09:42.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7fc38700 1 -- 172.21.15.125:0/897215820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda780ce040 msgr2=0x7fda7815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:42.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7fc38700 1 --2- 172.21.15.125:0/897215820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda780ce040 0x7fda7815d900 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fda740098f0 tx=0x7fda74009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:42.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.435+0000 7fda7fc38700 1 -- 172.21.15.125:0/897215820 shutdown_connections 2023-11-28T11:09:42.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.436+0000 7fda7fc38700 1 --2- 172.21.15.125:0/897215820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda780ce040 0x7fda7815d900 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.436+0000 7fda7fc38700 1 --2- 172.21.15.125:0/897215820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda78142db0 0x7fda7813ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.436+0000 7fda7fc38700 1 -- 172.21.15.125:0/897215820 >> 172.21.15.125:0/897215820 conn(0x7fda7806c010 msgr2=0x7fda780cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:42.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.436+0000 7fda7fc38700 1 -- 172.21.15.125:0/897215820 shutdown_connections 2023-11-28T11:09:42.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.436+0000 7fda7fc38700 1 -- 172.21.15.125:0/897215820 wait complete. 2023-11-28T11:09:42.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.437+0000 7fda7fc38700 1 Processor -- start 2023-11-28T11:09:42.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.437+0000 7fda7fc38700 1 -- start start 2023-11-28T11:09:42.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.437+0000 7fda7fc38700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda780b1770 0x7fda780cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.437+0000 7fda7fc38700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda780ce040 0x7fda781580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.437+0000 7fda7fc38700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda78142db0 0x7fda780c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7fc38700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda781f2b00 con 0x7fda78142db0 2023-11-28T11:09:42.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7fc38700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780c50e0 con 0x7fda780ce040 2023-11-28T11:09:42.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7fc38700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda780cb890 con 0x7fda780b1770 2023-11-28T11:09:42.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7e1d5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda78142db0 0x7fda780c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:42.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7e1d5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda78142db0 0x7fda780c4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58860/0 (socket says 172.21.15.125:58860) 2023-11-28T11:09:42.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7e1d5700 1 -- 172.21.15.125:0/367448254 learned_addr learned my addr 172.21.15.125:0/367448254 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:42.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7d1d3700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda780ce040 0x7fda781580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:42.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7d9d4700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda780b1770 0x7fda780cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:42.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7e1d5700 1 -- 172.21.15.125:0/367448254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda780b1770 msgr2=0x7fda780cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:42.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7e1d5700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda780b1770 0x7fda780cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7e1d5700 1 -- 172.21.15.125:0/367448254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda780ce040 msgr2=0x7fda781580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:42.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7e1d5700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda780ce040 0x7fda781580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7e1d5700 1 -- 172.21.15.125:0/367448254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda74009550 con 0x7fda78142db0 2023-11-28T11:09:42.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7d1d3700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda780ce040 0x7fda781580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:42.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7d9d4700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda780b1770 0x7fda780cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:42.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7e1d5700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda78142db0 0x7fda780c4ba0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fda7000b9a0 tx=0x7fda7000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:42.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda6e7fc700 1 -- 172.21.15.125:0/367448254 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000c9b0 con 0x7fda78142db0 2023-11-28T11:09:42.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda6e7fc700 1 -- 172.21.15.125:0/367448254 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7000cb10 con 0x7fda78142db0 2023-11-28T11:09:42.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7fc38700 1 -- 172.21.15.125:0/367448254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda780ce410 con 0x7fda78142db0 2023-11-28T11:09:42.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda6e7fc700 1 -- 172.21.15.125:0/367448254 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70014440 con 0x7fda78142db0 2023-11-28T11:09:42.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.438+0000 7fda7fc38700 1 -- 172.21.15.125:0/367448254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7815d3e0 con 0x7fda78142db0 2023-11-28T11:09:42.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.439+0000 7fda7fc38700 1 -- 172.21.15.125:0/367448254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda780ce5a0 con 0x7fda78142db0 2023-11-28T11:09:42.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.440+0000 7fda6e7fc700 1 -- 172.21.15.125:0/367448254 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fda7001b030 con 0x7fda78142db0 2023-11-28T11:09:42.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.440+0000 7fda6e7fc700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda5c068320 0x7fda5c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.440+0000 7fda6e7fc700 1 -- 172.21.15.125:0/367448254 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fda700855f0 con 0x7fda78142db0 2023-11-28T11:09:42.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.440+0000 7fda7d9d4700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda5c068320 0x7fda5c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:42.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.440+0000 7fda7d9d4700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda5c068320 0x7fda5c06a7d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fda74009c40 tx=0x7fda74008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:42.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.444+0000 7fda6e7fc700 1 -- 172.21.15.125:0/367448254 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fda70052120 con 0x7fda78142db0 2023-11-28T11:09:42.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.702+0000 7fda7fc38700 1 -- 172.21.15.125:0/367448254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fda780743f0 con 0x7fda78142db0 2023-11-28T11:09:42.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.702+0000 7fda6e7fc700 1 -- 172.21.15.125:0/367448254 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fda70055740 con 0x7fda78142db0 2023-11-28T11:09:42.703 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:42.703 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:09:42.703 INFO:teuthology.orchestra.run.smithi125.stdout: "auth_dump": [ 2023-11-28T11:09:42.703 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.703 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.a", 2023-11-28T11:09:42.703 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlKEkAABAAXjMnHGmTU8Gdre/P6kooJw==", 2023-11-28T11:09:42.703 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.704 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:09:42.704 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:09:42.704 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:09:42.704 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.704 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.704 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.704 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.704 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.b", 2023-11-28T11:09:42.704 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlxhVJDBAAxVivRKj7W5EO227bsIQ1dA==", 2023-11-28T11:09:42.704 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.704 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:09:42.705 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:09:42.705 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:09:42.705 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.705 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.705 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.705 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.705 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.c", 2023-11-28T11:09:42.705 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVltF09BxAAjhpf029IQe6awVbeYEV8qQ==", 2023-11-28T11:09:42.705 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.705 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:09:42.705 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:09:42.706 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:09:42.706 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.706 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.706 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.706 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.706 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.d", 2023-11-28T11:09:42.706 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVl3cCKExAAWAOqQnPUf3vKABnsfyJTKQ==", 2023-11-28T11:09:42.706 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.706 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:09:42.706 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:09:42.706 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.0", 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD6yWVlZHGALxAAwg7519g4L+22B6q8avNECw==", 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.707 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.708 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.708 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.1", 2023-11-28T11:09:42.708 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD9yWVlxElTLxAAWU/HwnR+qTecCapxOKTCBQ==", 2023-11-28T11:09:42.708 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.708 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:09:42.708 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:09:42.708 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.708 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.708 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.709 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.709 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.2", 2023-11-28T11:09:42.709 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAAymVllpzBLhAA1iR/VKxQoh+ekp0oO6Ku2g==", 2023-11-28T11:09:42.709 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.709 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:09:42.709 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:09:42.709 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.709 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.709 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.709 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.709 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.3", 2023-11-28T11:09:42.710 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADymVl9jx+LhAAG+PnOiHMTWVr0p98muHA1Q==", 2023-11-28T11:09:42.710 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.710 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:09:42.710 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:09:42.710 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.710 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.710 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.710 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.4", 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAJymVlCGY+NxAAO5zScvdHMyOEFJcLjlY6qQ==", 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.5", 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAMymVlkPG0NxAAL9zxg4JfD/Gm7bVEY8aEzA==", 2023-11-28T11:09:42.711 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.712 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:09:42.712 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:09:42.712 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.712 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.712 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.712 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.712 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.6", 2023-11-28T11:09:42.712 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAPymVlh0cjNxAACCUdBgzqGw/yMw7P5RKBlQ==", 2023-11-28T11:09:42.712 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.712 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:09:42.712 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.7", 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQASymVltqqRNhAACw31V5Uw92UYbsoOFAt4NA==", 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.713 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.714 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.714 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.0", 2023-11-28T11:09:42.714 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlAiP9FxAAuKva+izyr8tPFad19nH2Pg==", 2023-11-28T11:09:42.714 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.714 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:09:42.714 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-11-28T11:09:42.714 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-11-28T11:09:42.714 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-11-28T11:09:42.714 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.714 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.714 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.715 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.1", 2023-11-28T11:09:42.715 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlcuuuHhAAxxFaW2Ya8S/0QqSKt6+irw==", 2023-11-28T11:09:42.715 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.715 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:09:42.715 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-11-28T11:09:42.715 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-11-28T11:09:42.715 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-11-28T11:09:42.715 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.715 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.715 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.715 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.2", 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlzC5aGxAA+1p7VO2KIABIvIQUxsEpkw==", 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.3", 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVl0A9rJBAAbjYfiY1Ya0jOeM20lriemg==", 2023-11-28T11:09:42.716 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.717 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:09:42.717 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-11-28T11:09:42.717 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-11-28T11:09:42.717 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-11-28T11:09:42.717 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.717 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.717 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.717 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.admin", 2023-11-28T11:09:42.717 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD2yWVlAxDCHhAAbGHarjun9Ha0bFjpBnroEA==", 2023-11-28T11:09:42.717 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.717 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-11-28T11:09:42.718 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:09:42.718 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:09:42.718 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.718 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.718 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.718 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.718 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-mds", 2023-11-28T11:09:42.718 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAcymVl13+FCBAAee76sGpPmXKVqaRZ9s6O/A==", 2023-11-28T11:09:42.718 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.718 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T11:09:42.718 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.719 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.719 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.719 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T11:09:42.719 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAcymVlQYqFCBAALMYYnjvC6AbT/ekQtCfxQw==", 2023-11-28T11:09:42.719 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.719 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T11:09:42.719 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.719 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.719 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.719 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-osd", 2023-11-28T11:09:42.719 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAcymVl3JGFCBAAB9g6OKN2OmcdxcUmUWwd9Q==", 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAcymVl2JqFCBAATY2tGe9ShXT8gxHMIt2oGg==", 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.720 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.721 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T11:09:42.721 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAcymVlZ6KFCBAAW1meJB4kGnKM97WZxJ+8Lg==", 2023-11-28T11:09:42.721 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.721 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T11:09:42.721 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.721 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.721 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.721 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T11:09:42.721 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAcymVlBqqFCBAA1SCOZ9PluBUBptTWxQcLGA==", 2023-11-28T11:09:42.721 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.721 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.x", 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD2yWVlf7E9OBAAT4ET3xArqHRvXN3Y+fN/hQ==", 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:42.722 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:42.723 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.y", 2023-11-28T11:09:42.723 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD2yWVldPhFNBAA/wTA2fq+CmRAx3pWX82SkA==", 2023-11-28T11:09:42.723 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:09:42.723 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-11-28T11:09:42.723 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-11-28T11:09:42.723 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:09:42.723 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.723 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:42.723 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-11-28T11:09:42.723 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:09:42.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.704+0000 7fda7fc38700 1 -- 172.21.15.125:0/367448254 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda5c068320 msgr2=0x7fda5c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:42.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.704+0000 7fda7fc38700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda5c068320 0x7fda5c06a7d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fda74009c40 tx=0x7fda74008030 comp rx=0 tx=0).stop 2023-11-28T11:09:42.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.704+0000 7fda7fc38700 1 -- 172.21.15.125:0/367448254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda78142db0 msgr2=0x7fda780c4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:42.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.704+0000 7fda7fc38700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda78142db0 0x7fda780c4ba0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fda7000b9a0 tx=0x7fda7000bd60 comp rx=0 tx=0).stop 2023-11-28T11:09:42.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.704+0000 7fda7fc38700 1 -- 172.21.15.125:0/367448254 shutdown_connections 2023-11-28T11:09:42.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.704+0000 7fda7fc38700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda78142db0 0x7fda780c4ba0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.704+0000 7fda7fc38700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda5c068320 0x7fda5c06a7d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.704+0000 7fda7fc38700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda780b1770 0x7fda780cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.704+0000 7fda7fc38700 1 --2- 172.21.15.125:0/367448254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda780ce040 0x7fda781580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.704+0000 7fda7fc38700 1 -- 172.21.15.125:0/367448254 >> 172.21.15.125:0/367448254 conn(0x7fda7806c010 msgr2=0x7fda78156110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:42.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.705+0000 7fda7fc38700 1 -- 172.21.15.125:0/367448254 shutdown_connections 2023-11-28T11:09:42.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.705+0000 7fda7fc38700 1 -- 172.21.15.125:0/367448254 wait complete. 2023-11-28T11:09:42.726 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T11:09:42.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.846+0000 7fa6f70cb700 1 Processor -- start 2023-11-28T11:09:42.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.847+0000 7fa6f70cb700 1 -- start start 2023-11-28T11:09:42.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.847+0000 7fa6f70cb700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa6f015c8c0 0x7fa6f0160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.847+0000 7fa6f70cb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6f00b5dc0 0x7fa6f006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.847+0000 7fa6f70cb700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f00d2d30 con 0x7fa6f006b050 2023-11-28T11:09:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.847+0000 7fa6f70cb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f00d0b40 con 0x7fa6f00b5dc0 2023-11-28T11:09:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.847+0000 7fa6f70cb700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f006b490 con 0x7fa6f015c8c0 2023-11-28T11:09:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.847+0000 7fa6effff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6f00b5dc0 0x7fa6f006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.847+0000 7fa6effff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6f00b5dc0 0x7fa6f006ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58866/0 (socket says 172.21.15.125:58866) 2023-11-28T11:09:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.847+0000 7fa6effff700 1 -- 172.21.15.125:0/1141669029 learned_addr learned my addr 172.21.15.125:0/1141669029 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.848+0000 7fa6effff700 1 -- 172.21.15.125:0/1141669029 >> v2:172.21.15.167:3300/0 conn(0x7fa6f015c8c0 msgr2=0x7fa6f0160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.848+0000 7fa6effff700 1 --2- 172.21.15.125:0/1141669029 >> v2:172.21.15.167:3300/0 conn(0x7fa6f015c8c0 0x7fa6f0160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.848+0000 7fa6effff700 1 -- 172.21.15.125:0/1141669029 >> v1:172.21.15.167:6789/0 conn(0x7fa6f006b050 legacy=0x7fa6f00d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.848+0000 7fa6effff700 1 -- 172.21.15.125:0/1141669029 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f01611f0 con 0x7fa6f00b5dc0 2023-11-28T11:09:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.848+0000 7fa6effff700 1 --2- 172.21.15.125:0/1141669029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6f00b5dc0 0x7fa6f006ab10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00d2ed0 tx=0x7fa6dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57f10647c21f881 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.848+0000 7fa6ef7fe700 1 -- 172.21.15.125:0/1141669029 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc004230 con 0x7fa6f00b5dc0 2023-11-28T11:09:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.848+0000 7fa6ef7fe700 1 -- 172.21.15.125:0/1141669029 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc004390 con 0x7fa6f00b5dc0 2023-11-28T11:09:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.848+0000 7fa6ef7fe700 1 -- 172.21.15.125:0/1141669029 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc0036a0 con 0x7fa6f00b5dc0 2023-11-28T11:09:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.848+0000 7fa6f70cb700 1 -- 172.21.15.125:0/1141669029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6f00b5dc0 msgr2=0x7fa6f006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.848+0000 7fa6f70cb700 1 --2- 172.21.15.125:0/1141669029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6f00b5dc0 0x7fa6f006ab10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00d2ed0 tx=0x7fa6dc009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.849+0000 7fa6f70cb700 1 -- 172.21.15.125:0/1141669029 shutdown_connections 2023-11-28T11:09:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.849+0000 7fa6f70cb700 1 --2- 172.21.15.125:0/1141669029 >> v2:172.21.15.167:3300/0 conn(0x7fa6f015c8c0 0x7fa6f0160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.849+0000 7fa6f70cb700 1 --2- 172.21.15.125:0/1141669029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6f00b5dc0 0x7fa6f006ab10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.849+0000 7fa6f70cb700 1 -- 172.21.15.125:0/1141669029 >> 172.21.15.125:0/1141669029 conn(0x7fa6f006c520 msgr2=0x7fa6f006c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.849+0000 7fa6f70cb700 1 -- 172.21.15.125:0/1141669029 shutdown_connections 2023-11-28T11:09:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.849+0000 7fa6f70cb700 1 -- 172.21.15.125:0/1141669029 wait complete. 2023-11-28T11:09:42.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.850+0000 7fa6f70cb700 1 Processor -- start 2023-11-28T11:09:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.850+0000 7fa6f70cb700 1 -- start start 2023-11-28T11:09:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f70cb700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6f006b050 0x7fa6f014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f70cb700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6f00b5dc0 0x7fa6f00c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f70cb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6f015c8c0 0x7fa6f00ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f70cb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f00c9600 con 0x7fa6f015c8c0 2023-11-28T11:09:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f70cb700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f00c9a90 con 0x7fa6f006b050 2023-11-28T11:09:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f70cb700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f00c89f0 con 0x7fa6f00b5dc0 2023-11-28T11:09:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f5668700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6f015c8c0 0x7fa6f00ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f5668700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6f015c8c0 0x7fa6f00ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58874/0 (socket says 172.21.15.125:58874) 2023-11-28T11:09:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f5668700 1 -- 172.21.15.125:0/4217666046 learned_addr learned my addr 172.21.15.125:0/4217666046 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f4e67700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6f006b050 0x7fa6f014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6effff700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6f00b5dc0 0x7fa6f00c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f5668700 1 -- 172.21.15.125:0/4217666046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6f00b5dc0 msgr2=0x7fa6f00c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f5668700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6f00b5dc0 0x7fa6f00c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f5668700 1 -- 172.21.15.125:0/4217666046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6f006b050 msgr2=0x7fa6f014d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f5668700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6f006b050 0x7fa6f014d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f5668700 1 -- 172.21.15.125:0/4217666046 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc009550 con 0x7fa6f015c8c0 2023-11-28T11:09:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f4e67700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6f006b050 0x7fa6f014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f5668700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6f015c8c0 0x7fa6f00ca040 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800c7a0 tx=0x7fa6e800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6ed7fa700 1 -- 172.21.15.125:0/4217666046 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8003e10 con 0x7fa6f015c8c0 2023-11-28T11:09:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6ed7fa700 1 -- 172.21.15.125:0/4217666046 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8005070 con 0x7fa6f015c8c0 2023-11-28T11:09:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f70cb700 1 -- 172.21.15.125:0/4217666046 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f00cd760 con 0x7fa6f015c8c0 2023-11-28T11:09:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6ed7fa700 1 -- 172.21.15.125:0/4217666046 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8005420 con 0x7fa6f015c8c0 2023-11-28T11:09:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.851+0000 7fa6f70cb700 1 -- 172.21.15.125:0/4217666046 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f00d2a50 con 0x7fa6f015c8c0 2023-11-28T11:09:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.852+0000 7fa6f70cb700 1 -- 172.21.15.125:0/4217666046 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f00cda40 con 0x7fa6f015c8c0 2023-11-28T11:09:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.853+0000 7fa6ed7fa700 1 -- 172.21.15.125:0/4217666046 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa6e8019030 con 0x7fa6f015c8c0 2023-11-28T11:09:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.853+0000 7fa6ed7fa700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6d40682f0 0x7fa6d406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.853+0000 7fa6ed7fa700 1 -- 172.21.15.125:0/4217666046 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa6e8084f20 con 0x7fa6f015c8c0 2023-11-28T11:09:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.853+0000 7fa6f4e67700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6d40682f0 0x7fa6d406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.854+0000 7fa6f4e67700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6d40682f0 0x7fa6d406a7a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4006fd0 tx=0x7fa6e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:42.857+0000 7fa6ed7fa700 1 -- 172.21.15.125:0/4217666046 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa6e8051ad0 con 0x7fa6f015c8c0 2023-11-28T11:09:43.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.115+0000 7fa6f70cb700 1 -- 172.21.15.125:0/4217666046 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fa6f0067d70 con 0x7fa6f015c8c0 2023-11-28T11:09:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.118+0000 7fa6ed7fa700 1 -- 172.21.15.125:0/4217666046 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa6e8017020 con 0x7fa6f015c8c0 2023-11-28T11:09:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 -- 172.21.15.125:0/4217666046 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6d40682f0 msgr2=0x7fa6d406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6d40682f0 0x7fa6d406a7a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4006fd0 tx=0x7fa6e4008040 comp rx=0 tx=0).stop 2023-11-28T11:09:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 -- 172.21.15.125:0/4217666046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6f015c8c0 msgr2=0x7fa6f00ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6f015c8c0 0x7fa6f00ca040 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800c7a0 tx=0x7fa6e800cb60 comp rx=0 tx=0).stop 2023-11-28T11:09:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 -- 172.21.15.125:0/4217666046 shutdown_connections 2023-11-28T11:09:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6f015c8c0 0x7fa6f00ca040 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6f006b050 0x7fa6f014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa6d40682f0 0x7fa6d406a7a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 --2- 172.21.15.125:0/4217666046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6f00b5dc0 0x7fa6f00c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 -- 172.21.15.125:0/4217666046 >> 172.21.15.125:0/4217666046 conn(0x7fa6f006c520 msgr2=0x7fa6f00d2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 -- 172.21.15.125:0/4217666046 shutdown_connections 2023-11-28T11:09:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.121+0000 7fa6f70cb700 1 -- 172.21.15.125:0/4217666046 wait complete. 2023-11-28T11:09:43.133 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T11:09:43.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.253+0000 7f9af3946700 1 Processor -- start 2023-11-28T11:09:43.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.254+0000 7f9af3946700 1 -- start start 2023-11-28T11:09:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.254+0000 7f9af3946700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec0cf710 0x7f9aec0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.254+0000 7f9af3946700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aec15cc10 con 0x7f9aec06a980 2023-11-28T11:09:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.254+0000 7f9af3946700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aec06c9b0 con 0x7f9aec071890 2023-11-28T11:09:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.254+0000 7f9af3946700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec06cc90 con 0x7f9aec0cf710 2023-11-28T11:09:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9af1ee3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9aec06a980 0x7f9aec160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43006/0 (socket says 172.21.15.125:43006) 2023-11-28T11:09:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9af1ee3700 1 -- 172.21.15.125:0/3332703880 learned_addr learned my addr 172.21.15.125:0/3332703880 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9af16e2700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec0cf710 0x7f9aec0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302853046 0 0) 0x7f9aec15cc10 con 0x7f9aec06a980 2023-11-28T11:09:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad80035b0 con 0x7f9aec06a980 2023-11-28T11:09:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 465680538 0 0) 0x7f9ad80035b0 con 0x7f9aec06a980 2023-11-28T11:09:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec0cf710 msgr2=0x7f9aec0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec0cf710 0x7f9aec0ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 >> v1:172.21.15.167:6789/0 conn(0x7f9aec071890 legacy=0x7f9aec06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec06cf70 con 0x7f9aec06a980 2023-11-28T11:09:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f9ae40019f0 con 0x7f9aec06a980 2023-11-28T11:09:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 >> v1:172.21.15.125:6789/0 conn(0x7f9aec06a980 legacy=0x7f9aec160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ad8003a30 0x7f9ad8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 0x7f9ad8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec0cf710 0x7f9ad8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec06cc90 con 0x7f9ad8004850 2023-11-28T11:09:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad800bb10 con 0x7f9ad8003a30 2023-11-28T11:09:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad800bcd0 con 0x7f9aec0cf710 2023-11-28T11:09:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9af0ee1700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 0x7f9ad8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9af16e2700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ad8003a30 0x7f9ad8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.255+0000 7f9af1ee3700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec0cf710 0x7f9ad8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af0ee1700 1 -- 172.21.15.125:0/3332703880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec0cf710 msgr2=0x7f9ad8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af0ee1700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec0cf710 0x7f9ad8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af0ee1700 1 -- 172.21.15.125:0/3332703880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ad8003a30 msgr2=0x7f9ad8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af0ee1700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ad8003a30 0x7f9ad8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af0ee1700 1 -- 172.21.15.125:0/3332703880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80035b0 con 0x7f9ad8004850 2023-11-28T11:09:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af0ee1700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 0x7f9ad8004cc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80017c0 tx=0x7f9ad8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6befbbdee0dd19 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80052d0 con 0x7f9ad8004850 2023-11-28T11:09:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae8005430 con 0x7f9ad8004850 2023-11-28T11:09:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9ae3fff700 1 -- 172.21.15.125:0/3332703880 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80038c0 con 0x7f9ad8004850 2023-11-28T11:09:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af3946700 1 -- 172.21.15.125:0/3332703880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 msgr2=0x7f9ad8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af3946700 1 --2- 172.21.15.125:0/3332703880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 0x7f9ad8004cc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80017c0 tx=0x7f9ad8005880 comp rx=0 tx=0).stop 2023-11-28T11:09:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af1ee3700 1 -- 172.21.15.125:0/3332703880 reap_dead start 2023-11-28T11:09:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af3946700 1 -- 172.21.15.125:0/3332703880 shutdown_connections 2023-11-28T11:09:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af3946700 1 -- 172.21.15.125:0/3332703880 >> 172.21.15.125:0/3332703880 conn(0x7f9aec06c010 msgr2=0x7f9aec0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:43.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af3946700 1 -- 172.21.15.125:0/3332703880 shutdown_connections 2023-11-28T11:09:43.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.256+0000 7f9af3946700 1 -- 172.21.15.125:0/3332703880 wait complete. 2023-11-28T11:09:43.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.258+0000 7f9af3946700 1 Processor -- start 2023-11-28T11:09:43.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.258+0000 7f9af3946700 1 -- start start 2023-11-28T11:09:43.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.258+0000 7f9af3946700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 0x7f9aec149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.258+0000 7f9af3946700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aec152130 0x7f9aec156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.258+0000 7f9af3946700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec157b80 0x7f9aec159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.258+0000 7f9af3946700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec156540 con 0x7f9ad8004850 2023-11-28T11:09:43.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.258+0000 7f9af3946700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec155f50 con 0x7f9aec152130 2023-11-28T11:09:43.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.258+0000 7f9af3946700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec149540 con 0x7f9aec157b80 2023-11-28T11:09:43.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.258+0000 7f9af16e2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 0x7f9aec149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.258+0000 7f9af16e2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 0x7f9aec149000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58890/0 (socket says 172.21.15.125:58890) 2023-11-28T11:09:43.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.258+0000 7f9af16e2700 1 -- 172.21.15.125:0/4258878364 learned_addr learned my addr 172.21.15.125:0/4258878364 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:43.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af0ee1700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aec152130 0x7f9aec156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af16e2700 1 -- 172.21.15.125:0/4258878364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec157b80 msgr2=0x7f9aec159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af1ee3700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec157b80 0x7f9aec159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af16e2700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec157b80 0x7f9aec159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af16e2700 1 -- 172.21.15.125:0/4258878364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aec152130 msgr2=0x7f9aec156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af16e2700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aec152130 0x7f9aec156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af16e2700 1 -- 172.21.15.125:0/4258878364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec06d530 con 0x7f9ad8004850 2023-11-28T11:09:43.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af1ee3700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec157b80 0x7f9aec159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:43.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af0ee1700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aec152130 0x7f9aec156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:43.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af16e2700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 0x7f9aec149000 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0119a0 tx=0x7f9adc011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:43.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9ae1ffb700 1 -- 172.21.15.125:0/4258878364 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc00f940 con 0x7f9ad8004850 2023-11-28T11:09:43.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9ae1ffb700 1 -- 172.21.15.125:0/4258878364 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc00faa0 con 0x7f9ad8004850 2023-11-28T11:09:43.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af3946700 1 -- 172.21.15.125:0/4258878364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aec06d250 con 0x7f9ad8004850 2023-11-28T11:09:43.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9ae1ffb700 1 -- 172.21.15.125:0/4258878364 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc00fe30 con 0x7f9ad8004850 2023-11-28T11:09:43.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.259+0000 7f9af3946700 1 -- 172.21.15.125:0/4258878364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aec0ce740 con 0x7f9ad8004850 2023-11-28T11:09:43.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.260+0000 7f9af3946700 1 -- 172.21.15.125:0/4258878364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aec0743f0 con 0x7f9ad8004850 2023-11-28T11:09:43.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.261+0000 7f9ae1ffb700 1 -- 172.21.15.125:0/4258878364 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9adc014440 con 0x7f9ad8004850 2023-11-28T11:09:43.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.261+0000 7f9ae1ffb700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9ad0068320 0x7f9ad006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.261+0000 7f9ae1ffb700 1 -- 172.21.15.125:0/4258878364 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9adc086160 con 0x7f9ad8004850 2023-11-28T11:09:43.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.261+0000 7f9af0ee1700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9ad0068320 0x7f9ad006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.261+0000 7f9af0ee1700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9ad0068320 0x7f9ad006a7d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9aec15a860 tx=0x7f9ae8009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:43.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.265+0000 7f9ae1ffb700 1 -- 172.21.15.125:0/4258878364 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9adc052cb0 con 0x7f9ad8004850 2023-11-28T11:09:43.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.518+0000 7f9af3946700 1 -- 172.21.15.125:0/4258878364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f9aec0b5b50 con 0x7f9ad8004850 2023-11-28T11:09:43.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.522+0000 7f9ae1ffb700 1 -- 172.21.15.125:0/4258878364 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9adc0562d0 con 0x7f9ad8004850 2023-11-28T11:09:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 -- 172.21.15.125:0/4258878364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9ad0068320 msgr2=0x7f9ad006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9ad0068320 0x7f9ad006a7d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9aec15a860 tx=0x7f9ae8009030 comp rx=0 tx=0).stop 2023-11-28T11:09:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 -- 172.21.15.125:0/4258878364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 msgr2=0x7f9aec149000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 0x7f9aec149000 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0119a0 tx=0x7f9adc011d60 comp rx=0 tx=0).stop 2023-11-28T11:09:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 -- 172.21.15.125:0/4258878364 shutdown_connections 2023-11-28T11:09:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9ad0068320 0x7f9ad006a7d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9aec157b80 0x7f9aec159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad8004850 0x7f9aec149000 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 --2- 172.21.15.125:0/4258878364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aec152130 0x7f9aec156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 -- 172.21.15.125:0/4258878364 >> 172.21.15.125:0/4258878364 conn(0x7f9aec06c010 msgr2=0x7f9aec06da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 -- 172.21.15.125:0/4258878364 shutdown_connections 2023-11-28T11:09:43.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.524+0000 7f9af3946700 1 -- 172.21.15.125:0/4258878364 wait complete. 2023-11-28T11:09:43.536 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T11:09:43.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.657+0000 7f71db69c700 1 Processor -- start 2023-11-28T11:09:43.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.657+0000 7f71db69c700 1 -- start start 2023-11-28T11:09:43.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71db69c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d415c810 0x7f71d4160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71db69c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d41607a0 con 0x7f71d406a270 2023-11-28T11:09:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71db69c700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d4160a50 con 0x7f71d40718e0 2023-11-28T11:09:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71db69c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d415cbe0 con 0x7f71d415c810 2023-11-28T11:09:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71d9c39700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f71d406a270 0x7f71d40cf040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43026/0 (socket says 172.21.15.125:43026) 2023-11-28T11:09:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71d9c39700 1 -- 172.21.15.125:0/3448814697 learned_addr learned my addr 172.21.15.125:0/3448814697 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71d9438700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d415c810 0x7f71d4160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65036152 0 0) 0x7f71d41607a0 con 0x7f71d406a270 2023-11-28T11:09:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c00035b0 con 0x7f71d406a270 2023-11-28T11:09:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2431573769 0 0) 0x7f71c00035b0 con 0x7f71d406a270 2023-11-28T11:09:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d415c810 msgr2=0x7f71d4160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:43.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d415c810 0x7f71d4160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 >> v1:172.21.15.167:6789/0 conn(0x7f71d40718e0 legacy=0x7f71d406c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4160d30 con 0x7f71d406a270 2023-11-28T11:09:43.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f71cc0019f0 con 0x7f71d406a270 2023-11-28T11:09:43.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 >> v1:172.21.15.125:6789/0 conn(0x7f71d406a270 legacy=0x7f71d40cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d415c810 0x7f71c0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c0003f70 0x7f71c0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71c0004d90 0x7f71c0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d415cbe0 con 0x7f71c0004d90 2023-11-28T11:09:43.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c000ba40 con 0x7f71c0003f70 2023-11-28T11:09:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.658+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c000bc00 con 0x7f71d415c810 2023-11-28T11:09:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71d9438700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d415c810 0x7f71c0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71d9c39700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71c0004d90 0x7f71c0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71d8c37700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c0003f70 0x7f71c0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71d9c39700 1 -- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d415c810 msgr2=0x7f71c0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71d9c39700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d415c810 0x7f71c0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71d9c39700 1 -- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c0003f70 msgr2=0x7f71c0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71d9c39700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c0003f70 0x7f71c0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71d9c39700 1 -- 172.21.15.125:0/3448814697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c00035b0 con 0x7f71c0004d90 2023-11-28T11:09:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71d9438700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d415c810 0x7f71c0003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71d9c39700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71c0004d90 0x7f71c0005200 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00a7d0 tx=0x7f71c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc1cb37f9062e41 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc012600 con 0x7f71c0004d90 2023-11-28T11:09:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc012760 con 0x7f71c0004d90 2023-11-28T11:09:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.659+0000 7f71cbfff700 1 -- 172.21.15.125:0/3448814697 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc012b10 con 0x7f71c0004d90 2023-11-28T11:09:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.660+0000 7f71db69c700 1 -- 172.21.15.125:0/3448814697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71c0004d90 msgr2=0x7f71c0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.660+0000 7f71db69c700 1 --2- 172.21.15.125:0/3448814697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71c0004d90 0x7f71c0005200 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00a7d0 tx=0x7f71c0005880 comp rx=0 tx=0).stop 2023-11-28T11:09:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.660+0000 7f71d9c39700 1 -- 172.21.15.125:0/3448814697 reap_dead start 2023-11-28T11:09:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.660+0000 7f71db69c700 1 -- 172.21.15.125:0/3448814697 shutdown_connections 2023-11-28T11:09:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.660+0000 7f71db69c700 1 -- 172.21.15.125:0/3448814697 >> 172.21.15.125:0/3448814697 conn(0x7f71d406c010 msgr2=0x7f71d40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.660+0000 7f71db69c700 1 -- 172.21.15.125:0/3448814697 shutdown_connections 2023-11-28T11:09:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.660+0000 7f71db69c700 1 -- 172.21.15.125:0/3448814697 wait complete. 2023-11-28T11:09:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.661+0000 7f71db69c700 1 Processor -- start 2023-11-28T11:09:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.661+0000 7f71db69c700 1 -- start start 2023-11-28T11:09:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71db69c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c0004d90 0x7f71d41f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71db69c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d40c5b80 0x7f71d40c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71db69c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d41f5d00 0x7f71d41f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71db69c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d415d820 con 0x7f71d40c5b80 2023-11-28T11:09:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71db69c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d41f66e0 con 0x7f71c0004d90 2023-11-28T11:09:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71db69c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d40c65d0 con 0x7f71d41f5d00 2023-11-28T11:09:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d8c37700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d40c5b80 0x7f71d40c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d8c37700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d40c5b80 0x7f71d40c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58912/0 (socket says 172.21.15.125:58912) 2023-11-28T11:09:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d8c37700 1 -- 172.21.15.125:0/537702053 learned_addr learned my addr 172.21.15.125:0/537702053 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d9438700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c0004d90 0x7f71d41f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d9c39700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d41f5d00 0x7f71d41f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d8c37700 1 -- 172.21.15.125:0/537702053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d41f5d00 msgr2=0x7f71d41f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d8c37700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d41f5d00 0x7f71d41f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d8c37700 1 -- 172.21.15.125:0/537702053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c0004d90 msgr2=0x7f71d41f38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d8c37700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c0004d90 0x7f71d41f38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d8c37700 1 -- 172.21.15.125:0/537702053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40ceb20 con 0x7f71d40c5b80 2023-11-28T11:09:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d9c39700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d41f5d00 0x7f71d41f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d9438700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c0004d90 0x7f71d41f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71d8c37700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d40c5b80 0x7f71d40c5ff0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f71c400f870 tx=0x7f71c400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71c9ffb700 1 -- 172.21.15.125:0/537702053 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400fe70 con 0x7f71d40c5b80 2023-11-28T11:09:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71c9ffb700 1 -- 172.21.15.125:0/537702053 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c4005320 con 0x7f71d40c5b80 2023-11-28T11:09:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71db69c700 1 -- 172.21.15.125:0/537702053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d4161010 con 0x7f71d40c5b80 2023-11-28T11:09:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.662+0000 7f71c9ffb700 1 -- 172.21.15.125:0/537702053 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4006860 con 0x7f71d40c5b80 2023-11-28T11:09:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.663+0000 7f71db69c700 1 -- 172.21.15.125:0/537702053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d406cf90 con 0x7f71d40c5b80 2023-11-28T11:09:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.664+0000 7f71db69c700 1 -- 172.21.15.125:0/537702053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d415d960 con 0x7f71d40c5b80 2023-11-28T11:09:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.664+0000 7f71c9ffb700 1 -- 172.21.15.125:0/537702053 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f71c401c030 con 0x7f71d40c5b80 2023-11-28T11:09:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.664+0000 7f71c9ffb700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71b80682f0 0x7f71b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:43.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.664+0000 7f71c9ffb700 1 -- 172.21.15.125:0/537702053 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f71c40850d0 con 0x7f71d40c5b80 2023-11-28T11:09:43.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.664+0000 7f71d9438700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71b80682f0 0x7f71b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:43.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.664+0000 7f71d9438700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71b80682f0 0x7f71b806a7a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009d00 tx=0x7f71d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:43.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.668+0000 7f71c9ffb700 1 -- 172.21.15.125:0/537702053 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f71d415d960 con 0x7f71d40c5b80 2023-11-28T11:09:43.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.926+0000 7f71db69c700 1 -- 172.21.15.125:0/537702053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f71d415d960 con 0x7f71d40c5b80 2023-11-28T11:09:43.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.930+0000 7f71c9ffb700 1 -- 172.21.15.125:0/537702053 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f71d415d960 con 0x7f71d40c5b80 2023-11-28T11:09:43.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 -- 172.21.15.125:0/537702053 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71b80682f0 msgr2=0x7f71b806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71b80682f0 0x7f71b806a7a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009d00 tx=0x7f71d0008040 comp rx=0 tx=0).stop 2023-11-28T11:09:43.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 -- 172.21.15.125:0/537702053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d40c5b80 msgr2=0x7f71d40c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:43.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d40c5b80 0x7f71d40c5ff0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f71c400f870 tx=0x7f71c400fc30 comp rx=0 tx=0).stop 2023-11-28T11:09:43.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 -- 172.21.15.125:0/537702053 shutdown_connections 2023-11-28T11:09:43.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71b80682f0 0x7f71b806a7a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d41f5d00 0x7f71d41f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c0004d90 0x7f71d41f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 --2- 172.21.15.125:0/537702053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d40c5b80 0x7f71d40c5ff0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:43.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 -- 172.21.15.125:0/537702053 >> 172.21.15.125:0/537702053 conn(0x7f71d406c010 msgr2=0x7f71d40cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:43.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 -- 172.21.15.125:0/537702053 shutdown_connections 2023-11-28T11:09:43.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:43.932+0000 7f71db69c700 1 -- 172.21.15.125:0/537702053 wait complete. 2023-11-28T11:09:43.944 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T11:09:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.064+0000 7ff3d92a5700 1 Processor -- start 2023-11-28T11:09:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.064+0000 7ff3d92a5700 1 -- start start 2023-11-28T11:09:44.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d92a5700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff3d406b220 0x7ff3d40d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d92a5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d40d2d30 con 0x7ff3d415c8c0 2023-11-28T11:09:44.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d92a5700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d40d0b40 con 0x7ff3d4160cb0 2023-11-28T11:09:44.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d92a5700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d40d2a50 con 0x7ff3d406b220 2023-11-28T11:09:44.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d2ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff3d415c8c0 0x7ff3d40b5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43042/0 (socket says 172.21.15.125:43042) 2023-11-28T11:09:44.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d2ffd700 1 -- 172.21.15.125:0/3859234478 learned_addr learned my addr 172.21.15.125:0/3859234478 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:44.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d37fe700 1 --2- 172.21.15.125:0/3859234478 >> v2:172.21.15.167:3300/0 conn(0x7ff3d406b220 0x7ff3d40d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045161553 0 0) 0x7ff3c8001110 con 0x7ff3d415c8c0 2023-11-28T11:09:44.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3bc0035b0 con 0x7ff3d415c8c0 2023-11-28T11:09:44.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1711134219 0 0) 0x7ff3bc0035b0 con 0x7ff3d415c8c0 2023-11-28T11:09:44.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 >> v2:172.21.15.167:3300/0 conn(0x7ff3d406b220 msgr2=0x7ff3d40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:44.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d1ffb700 1 --2- 172.21.15.125:0/3859234478 >> v2:172.21.15.167:3300/0 conn(0x7ff3d406b220 0x7ff3d40d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 >> v1:172.21.15.167:6789/0 conn(0x7ff3d4160cb0 legacy=0x7ff3d406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d40cd760 con 0x7ff3d415c8c0 2023-11-28T11:09:44.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.065+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7ff3c8001800 con 0x7ff3d415c8c0 2023-11-28T11:09:44.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 >> v1:172.21.15.125:6789/0 conn(0x7ff3d415c8c0 legacy=0x7ff3d40b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d1ffb700 1 --2- 172.21.15.125:0/3859234478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 0x7ff3bc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d1ffb700 1 --2- 172.21.15.125:0/3859234478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3bc004850 0x7ff3bc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d1ffb700 1 --2- 172.21.15.125:0/3859234478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3bc005200 0x7ff3bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40d2a50 con 0x7ff3bc003a00 2023-11-28T11:09:44.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc00c080 con 0x7ff3bc005200 2023-11-28T11:09:44.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc00c240 con 0x7ff3bc004850 2023-11-28T11:09:44.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d2ffd700 1 --2- 172.21.15.125:0/3859234478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 0x7ff3bc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d37fe700 1 --2- 172.21.15.125:0/3859234478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3bc005200 0x7ff3bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d27fc700 1 --2- 172.21.15.125:0/3859234478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3bc004850 0x7ff3bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d2ffd700 1 -- 172.21.15.125:0/3859234478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3bc004850 msgr2=0x7ff3bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:44.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d2ffd700 1 --2- 172.21.15.125:0/3859234478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3bc004850 0x7ff3bc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d2ffd700 1 -- 172.21.15.125:0/3859234478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3bc005200 msgr2=0x7ff3bc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:44.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d2ffd700 1 --2- 172.21.15.125:0/3859234478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3bc005200 0x7ff3bc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d37fe700 1 -- 172.21.15.125:0/3859234478 reap_dead start 2023-11-28T11:09:44.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d2ffd700 1 -- 172.21.15.125:0/3859234478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc0035b0 con 0x7ff3bc003a00 2023-11-28T11:09:44.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d2ffd700 1 --2- 172.21.15.125:0/3859234478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 0x7ff3bc003e10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800c240 tx=0x7ff3bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3e684e256abf2d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:44.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8007db0 con 0x7ff3bc003a00 2023-11-28T11:09:44.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c800cdc0 con 0x7ff3bc003a00 2023-11-28T11:09:44.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.066+0000 7ff3d1ffb700 1 -- 172.21.15.125:0/3859234478 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8005ba0 con 0x7ff3bc003a00 2023-11-28T11:09:44.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.067+0000 7ff3d92a5700 1 -- 172.21.15.125:0/3859234478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 msgr2=0x7ff3bc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.067+0000 7ff3d92a5700 1 --2- 172.21.15.125:0/3859234478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 0x7ff3bc003e10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800c240 tx=0x7ff3bc005880 comp rx=0 tx=0).stop 2023-11-28T11:09:44.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.067+0000 7ff3d92a5700 1 -- 172.21.15.125:0/3859234478 shutdown_connections 2023-11-28T11:09:44.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.067+0000 7ff3d92a5700 1 --2- 172.21.15.125:0/3859234478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 0x7ff3bc003e10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.067+0000 7ff3d92a5700 1 -- 172.21.15.125:0/3859234478 >> 172.21.15.125:0/3859234478 conn(0x7ff3d406c520 msgr2=0x7ff3d406c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:44.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.067+0000 7ff3d92a5700 1 -- 172.21.15.125:0/3859234478 shutdown_connections 2023-11-28T11:09:44.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.067+0000 7ff3d92a5700 1 -- 172.21.15.125:0/3859234478 wait complete. 2023-11-28T11:09:44.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.069+0000 7ff3d92a5700 1 Processor -- start 2023-11-28T11:09:44.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.069+0000 7ff3d92a5700 1 -- start start 2023-11-28T11:09:44.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.069+0000 7ff3d92a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 0x7ff3d41509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d92a5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3d40cb1d0 0x7ff3d40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d92a5700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3d40b7750 0x7ff3d40b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d92a5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40cab60 con 0x7ff3bc003a00 2023-11-28T11:09:44.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d92a5700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d415cc90 con 0x7ff3d40b7750 2023-11-28T11:09:44.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d92a5700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40b8100 con 0x7ff3d40cb1d0 2023-11-28T11:09:44.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 0x7ff3d41509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 0x7ff3d41509c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58930/0 (socket says 172.21.15.125:58930) 2023-11-28T11:09:44.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d2ffd700 1 -- 172.21.15.125:0/1426273232 learned_addr learned my addr 172.21.15.125:0/1426273232 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:44.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d37fe700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3d40b7750 0x7ff3d40b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d27fc700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3d40cb1d0 0x7ff3d40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d2ffd700 1 -- 172.21.15.125:0/1426273232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3d40cb1d0 msgr2=0x7ff3d40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d2ffd700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3d40cb1d0 0x7ff3d40cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d2ffd700 1 -- 172.21.15.125:0/1426273232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3d40b7750 msgr2=0x7ff3d40b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d2ffd700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3d40b7750 0x7ff3d40b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d2ffd700 1 -- 172.21.15.125:0/1426273232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d4161120 con 0x7ff3bc003a00 2023-11-28T11:09:44.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d2ffd700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 0x7ff3d41509c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800c830 tx=0x7ff3c8001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:44.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3bb7fe700 1 -- 172.21.15.125:0/1426273232 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80015c0 con 0x7ff3bc003a00 2023-11-28T11:09:44.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3bb7fe700 1 -- 172.21.15.125:0/1426273232 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c8001740 con 0x7ff3bc003a00 2023-11-28T11:09:44.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d92a5700 1 -- 172.21.15.125:0/1426273232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d40cda40 con 0x7ff3bc003a00 2023-11-28T11:09:44.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3bb7fe700 1 -- 172.21.15.125:0/1426273232 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8007310 con 0x7ff3bc003a00 2023-11-28T11:09:44.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.070+0000 7ff3d92a5700 1 -- 172.21.15.125:0/1426273232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d40d2700 con 0x7ff3bc003a00 2023-11-28T11:09:44.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.071+0000 7ff3d92a5700 1 -- 172.21.15.125:0/1426273232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d4067d70 con 0x7ff3bc003a00 2023-11-28T11:09:44.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.072+0000 7ff3bb7fe700 1 -- 172.21.15.125:0/1426273232 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff3c8024030 con 0x7ff3bc003a00 2023-11-28T11:09:44.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.072+0000 7ff3bb7fe700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3c00682f0 0x7ff3c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.072+0000 7ff3bb7fe700 1 -- 172.21.15.125:0/1426273232 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff3c8086c10 con 0x7ff3bc003a00 2023-11-28T11:09:44.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.072+0000 7ff3d27fc700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3c00682f0 0x7ff3c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.072+0000 7ff3d27fc700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3c00682f0 0x7ff3c006a7a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40ccfb0 tx=0x7ff3c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:44.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.076+0000 7ff3bb7fe700 1 -- 172.21.15.125:0/1426273232 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff3c8053800 con 0x7ff3bc003a00 2023-11-28T11:09:44.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.335+0000 7ff3d92a5700 1 -- 172.21.15.125:0/1426273232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff3d40d2d30 con 0x7ff3bc003a00 2023-11-28T11:09:44.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.338+0000 7ff3bb7fe700 1 -- 172.21.15.125:0/1426273232 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff3d40d2d30 con 0x7ff3bc003a00 2023-11-28T11:09:44.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.340+0000 7ff3d92a5700 1 -- 172.21.15.125:0/1426273232 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3c00682f0 msgr2=0x7ff3c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.340+0000 7ff3d92a5700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3c00682f0 0x7ff3c006a7a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40ccfb0 tx=0x7ff3c4009040 comp rx=0 tx=0).stop 2023-11-28T11:09:44.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.340+0000 7ff3d92a5700 1 -- 172.21.15.125:0/1426273232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 msgr2=0x7ff3d41509c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.340+0000 7ff3d92a5700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 0x7ff3d41509c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800c830 tx=0x7ff3c8001b90 comp rx=0 tx=0).stop 2023-11-28T11:09:44.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.341+0000 7ff3d92a5700 1 -- 172.21.15.125:0/1426273232 shutdown_connections 2023-11-28T11:09:44.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.341+0000 7ff3d92a5700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3d40b7750 0x7ff3d40b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.341+0000 7ff3d92a5700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc003a00 0x7ff3d41509c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.341+0000 7ff3d92a5700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3c00682f0 0x7ff3c006a7a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.341+0000 7ff3d92a5700 1 --2- 172.21.15.125:0/1426273232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3d40cb1d0 0x7ff3d40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.341+0000 7ff3d92a5700 1 -- 172.21.15.125:0/1426273232 >> 172.21.15.125:0/1426273232 conn(0x7ff3d406c520 msgr2=0x7ff3d406c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:44.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.341+0000 7ff3d92a5700 1 -- 172.21.15.125:0/1426273232 shutdown_connections 2023-11-28T11:09:44.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.341+0000 7ff3d92a5700 1 -- 172.21.15.125:0/1426273232 wait complete. 2023-11-28T11:09:44.353 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T11:09:44.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.474+0000 7f6497497700 1 Processor -- start 2023-11-28T11:09:44.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.474+0000 7f6497497700 1 -- start start 2023-11-28T11:09:44.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.474+0000 7f6497497700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64900b1650 0x7f64900b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.474+0000 7f6497497700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64900af0a0 0x7f649015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6497497700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6490159ec0 con 0x7f64901599b0 2023-11-28T11:09:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6497497700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64900b1f60 con 0x7f64900af0a0 2023-11-28T11:09:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6497497700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649015d8a0 con 0x7f64900b1650 2023-11-28T11:09:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6495a34700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64900af0a0 0x7f649015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6495a34700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64900af0a0 0x7f649015a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58942/0 (socket says 172.21.15.125:58942) 2023-11-28T11:09:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6495a34700 1 -- 172.21.15.125:0/917182716 learned_addr learned my addr 172.21.15.125:0/917182716 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6495a34700 1 -- 172.21.15.125:0/917182716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64900b1650 msgr2=0x7f64900b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6495a34700 1 --2- 172.21.15.125:0/917182716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64900b1650 0x7f64900b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6495a34700 1 -- 172.21.15.125:0/917182716 >> v1:172.21.15.167:6789/0 conn(0x7f64901599b0 legacy=0x7f649015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6495a34700 1 -- 172.21.15.125:0/917182716 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649015db80 con 0x7f64900af0a0 2023-11-28T11:09:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6495a34700 1 --2- 172.21.15.125:0/917182716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64900af0a0 0x7f649015a350 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f648800d150 tx=0x7f648800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1740b68fd620cf21 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6487fff700 1 -- 172.21.15.125:0/917182716 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488010070 con 0x7f64900af0a0 2023-11-28T11:09:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6487fff700 1 -- 172.21.15.125:0/917182716 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648800dd80 con 0x7f64900af0a0 2023-11-28T11:09:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.475+0000 7f6487fff700 1 -- 172.21.15.125:0/917182716 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648800b310 con 0x7f64900af0a0 2023-11-28T11:09:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.476+0000 7f6497497700 1 -- 172.21.15.125:0/917182716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64900af0a0 msgr2=0x7f649015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.476+0000 7f6497497700 1 --2- 172.21.15.125:0/917182716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64900af0a0 0x7f649015a350 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f648800d150 tx=0x7f648800d460 comp rx=0 tx=0).stop 2023-11-28T11:09:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.476+0000 7f6497497700 1 -- 172.21.15.125:0/917182716 shutdown_connections 2023-11-28T11:09:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.476+0000 7f6497497700 1 --2- 172.21.15.125:0/917182716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64900af0a0 0x7f649015a350 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.476+0000 7f6497497700 1 --2- 172.21.15.125:0/917182716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64900b1650 0x7f64900b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.476+0000 7f6497497700 1 -- 172.21.15.125:0/917182716 >> 172.21.15.125:0/917182716 conn(0x7f649006c010 msgr2=0x7f64900cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:44.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.476+0000 7f6497497700 1 -- 172.21.15.125:0/917182716 shutdown_connections 2023-11-28T11:09:44.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.476+0000 7f6497497700 1 -- 172.21.15.125:0/917182716 wait complete. 2023-11-28T11:09:44.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.477+0000 7f6497497700 1 Processor -- start 2023-11-28T11:09:44.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.477+0000 7f6497497700 1 -- start start 2023-11-28T11:09:44.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6497497700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64900af0a0 0x7f6490145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6497497700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64900b1650 0x7f64900c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6497497700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64901569b0 0x7f6490070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6497497700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64900c6110 con 0x7f64900b1650 2023-11-28T11:09:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6497497700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64900c6530 con 0x7f64900af0a0 2023-11-28T11:09:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6497497700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64900c51f0 con 0x7f64901569b0 2023-11-28T11:09:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6494a32700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64900b1650 0x7f64900c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6494a32700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64900b1650 0x7f64900c3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58946/0 (socket says 172.21.15.125:58946) 2023-11-28T11:09:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6494a32700 1 -- 172.21.15.125:0/2364945852 learned_addr learned my addr 172.21.15.125:0/2364945852 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6495233700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64900af0a0 0x7f6490145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6495a34700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64901569b0 0x7f6490070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6494a32700 1 -- 172.21.15.125:0/2364945852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64901569b0 msgr2=0x7f6490070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6494a32700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64901569b0 0x7f6490070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6494a32700 1 -- 172.21.15.125:0/2364945852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64900af0a0 msgr2=0x7f6490145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6494a32700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64900af0a0 0x7f6490145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6494a32700 1 -- 172.21.15.125:0/2364945852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648800bd40 con 0x7f64900b1650 2023-11-28T11:09:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6494a32700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64900b1650 0x7f64900c3700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c4a0 tx=0x7f648c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6485ffb700 1 -- 172.21.15.125:0/2364945852 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c011790 con 0x7f64900b1650 2023-11-28T11:09:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6485ffb700 1 -- 172.21.15.125:0/2364945852 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c0118f0 con 0x7f64900b1650 2023-11-28T11:09:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6485ffb700 1 -- 172.21.15.125:0/2364945852 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c011ca0 con 0x7f64900b1650 2023-11-28T11:09:44.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.478+0000 7f6497497700 1 -- 172.21.15.125:0/2364945852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649015a890 con 0x7f64900b1650 2023-11-28T11:09:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.479+0000 7f6497497700 1 -- 172.21.15.125:0/2364945852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649015de60 con 0x7f64900b1650 2023-11-28T11:09:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.480+0000 7f6497497700 1 -- 172.21.15.125:0/2364945852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649015aa20 con 0x7f64900b1650 2023-11-28T11:09:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.480+0000 7f6485ffb700 1 -- 172.21.15.125:0/2364945852 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f648c010050 con 0x7f64900b1650 2023-11-28T11:09:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.480+0000 7f6485ffb700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64740682f0 0x7f647406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.480+0000 7f6485ffb700 1 -- 172.21.15.125:0/2364945852 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f648c0855c0 con 0x7f64900b1650 2023-11-28T11:09:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.480+0000 7f6495233700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64740682f0 0x7f647406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.481+0000 7f6495233700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64740682f0 0x7f647406a7a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6480009970 tx=0x7f6480009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:44.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.484+0000 7f6485ffb700 1 -- 172.21.15.125:0/2364945852 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f648c0520e0 con 0x7f64900b1650 2023-11-28T11:09:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.744+0000 7f6497497700 1 -- 172.21.15.125:0/2364945852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f64900c6250 con 0x7f64900b1650 2023-11-28T11:09:44.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.748+0000 7f6485ffb700 1 -- 172.21.15.125:0/2364945852 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f648c055700 con 0x7f64900b1650 2023-11-28T11:09:44.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 -- 172.21.15.125:0/2364945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64740682f0 msgr2=0x7f647406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64740682f0 0x7f647406a7a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6480009970 tx=0x7f6480009110 comp rx=0 tx=0).stop 2023-11-28T11:09:44.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 -- 172.21.15.125:0/2364945852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64900b1650 msgr2=0x7f64900c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64900b1650 0x7f64900c3700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c4a0 tx=0x7f648c00c7b0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 -- 172.21.15.125:0/2364945852 shutdown_connections 2023-11-28T11:09:44.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64740682f0 0x7f647406a7a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64901569b0 0x7f6490070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64900af0a0 0x7f6490145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 --2- 172.21.15.125:0/2364945852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64900b1650 0x7f64900c3700 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 -- 172.21.15.125:0/2364945852 >> 172.21.15.125:0/2364945852 conn(0x7f649006c010 msgr2=0x7f6490156e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:44.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 -- 172.21.15.125:0/2364945852 shutdown_connections 2023-11-28T11:09:44.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.750+0000 7f6497497700 1 -- 172.21.15.125:0/2364945852 wait complete. 2023-11-28T11:09:44.762 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T11:09:44.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.883+0000 7fdd91122700 1 Processor -- start 2023-11-28T11:09:44.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.883+0000 7fdd91122700 1 -- start start 2023-11-28T11:09:44.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.883+0000 7fdd91122700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdd8c15c810 0x7fdd8c160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd91122700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c1607a0 con 0x7fdd8c06a270 2023-11-28T11:09:44.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd91122700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c160a50 con 0x7fdd8c0718e0 2023-11-28T11:09:44.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd91122700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c15cbe0 con 0x7fdd8c15c810 2023-11-28T11:09:44.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd8b59e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdd8c06a270 0x7fdd8c06a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43078/0 (socket says 172.21.15.125:43078) 2023-11-28T11:09:44.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd8b59e700 1 -- 172.21.15.125:0/1229482009 learned_addr learned my addr 172.21.15.125:0/1229482009 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:44.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366457773 0 0) 0x7fdd8c1607a0 con 0x7fdd8c06a270 2023-11-28T11:09:44.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd740035b0 con 0x7fdd8c06a270 2023-11-28T11:09:44.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd8ad9d700 1 --2- 172.21.15.125:0/1229482009 >> v2:172.21.15.167:3300/0 conn(0x7fdd8c15c810 0x7fdd8c160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2362106713 0 0) 0x7fdd740035b0 con 0x7fdd8c06a270 2023-11-28T11:09:44.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 >> v2:172.21.15.167:3300/0 conn(0x7fdd8c15c810 msgr2=0x7fdd8c160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:44.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 --2- 172.21.15.125:0/1229482009 >> v2:172.21.15.167:3300/0 conn(0x7fdd8c15c810 0x7fdd8c160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 >> v1:172.21.15.167:6789/0 conn(0x7fdd8c0718e0 legacy=0x7fdd8c06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c160d30 con 0x7fdd8c06a270 2023-11-28T11:09:44.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fdd840019f0 con 0x7fdd8c06a270 2023-11-28T11:09:44.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 >> v1:172.21.15.125:6789/0 conn(0x7fdd8c06a270 legacy=0x7fdd8c06a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd74003a00 0x7fdd74003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd74004850 0x7fdd74004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd74005200 0x7fdd7400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c15cbe0 con 0x7fdd74004850 2023-11-28T11:09:44.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7400c080 con 0x7fdd74003a00 2023-11-28T11:09:44.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7400c240 con 0x7fdd74005200 2023-11-28T11:09:44.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd8a59c700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd74004850 0x7fdd74004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.884+0000 7fdd8ad9d700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd74003a00 0x7fdd74003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd8b59e700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd74005200 0x7fdd7400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd8a59c700 1 -- 172.21.15.125:0/1229482009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd74005200 msgr2=0x7fdd7400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:44.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd8a59c700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd74005200 0x7fdd7400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd8a59c700 1 -- 172.21.15.125:0/1229482009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd74003a00 msgr2=0x7fdd74003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:44.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd8a59c700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd74003a00 0x7fdd74003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd8a59c700 1 -- 172.21.15.125:0/1229482009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740035b0 con 0x7fdd74004850 2023-11-28T11:09:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd8b59e700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd74005200 0x7fdd7400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd8b59e700 1 -- 172.21.15.125:0/1229482009 reap_dead start 2023-11-28T11:09:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd8a59c700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd74004850 0x7fdd74004cc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdd800017c0 tx=0x7fdd74005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f45323c72c3327 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800052d0 con 0x7fdd74004850 2023-11-28T11:09:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd80005430 con 0x7fdd74004850 2023-11-28T11:09:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd89d9b700 1 -- 172.21.15.125:0/1229482009 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800038c0 con 0x7fdd74004850 2023-11-28T11:09:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd91122700 1 -- 172.21.15.125:0/1229482009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd74004850 msgr2=0x7fdd74004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd91122700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd74004850 0x7fdd74004cc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdd800017c0 tx=0x7fdd74005880 comp rx=0 tx=0).stop 2023-11-28T11:09:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd91122700 1 -- 172.21.15.125:0/1229482009 shutdown_connections 2023-11-28T11:09:44.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd91122700 1 --2- 172.21.15.125:0/1229482009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd74004850 0x7fdd74004cc0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd91122700 1 -- 172.21.15.125:0/1229482009 >> 172.21.15.125:0/1229482009 conn(0x7fdd8c06c010 msgr2=0x7fdd8c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:44.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd91122700 1 -- 172.21.15.125:0/1229482009 shutdown_connections 2023-11-28T11:09:44.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.885+0000 7fdd91122700 1 -- 172.21.15.125:0/1229482009 wait complete. 2023-11-28T11:09:44.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.887+0000 7fdd91122700 1 Processor -- start 2023-11-28T11:09:44.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.887+0000 7fdd91122700 1 -- start start 2023-11-28T11:09:44.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd91122700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd74004850 0x7fdd8c1f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd91122700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd8c0c6ca0 0x7fdd8c0c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd91122700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd8c0c8e90 0x7fdd8c0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd91122700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1f4db0 con 0x7fdd8c0c6ca0 2023-11-28T11:09:44.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd91122700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c0c7a00 con 0x7fdd74004850 2023-11-28T11:09:44.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd91122700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c0c7720 con 0x7fdd8c0c8e90 2023-11-28T11:09:44.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd8c0c6ca0 0x7fdd8c0c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd8c0c6ca0 0x7fdd8c0c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58964/0 (socket says 172.21.15.125:58964) 2023-11-28T11:09:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8a59c700 1 -- 172.21.15.125:0/3743050780 learned_addr learned my addr 172.21.15.125:0/3743050780 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8ad9d700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd74004850 0x7fdd8c1f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8b59e700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd8c0c8e90 0x7fdd8c0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8a59c700 1 -- 172.21.15.125:0/3743050780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd8c0c8e90 msgr2=0x7fdd8c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8a59c700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd8c0c8e90 0x7fdd8c0c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8a59c700 1 -- 172.21.15.125:0/3743050780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd74004850 msgr2=0x7fdd8c1f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8a59c700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd74004850 0x7fdd8c1f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8a59c700 1 -- 172.21.15.125:0/3743050780 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c0ceb20 con 0x7fdd8c0c6ca0 2023-11-28T11:09:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8b59e700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd8c0c8e90 0x7fdd8c0c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8ad9d700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd74004850 0x7fdd8c1f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd8a59c700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd8c0c6ca0 0x7fdd8c0c7110 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdd80005040 tx=0x7fdd80001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd737fe700 1 -- 172.21.15.125:0/3743050780 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80001290 con 0x7fdd8c0c6ca0 2023-11-28T11:09:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd737fe700 1 -- 172.21.15.125:0/3743050780 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8001d480 con 0x7fdd8c0c6ca0 2023-11-28T11:09:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.888+0000 7fdd91122700 1 -- 172.21.15.125:0/3743050780 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c161010 con 0x7fdd8c0c6ca0 2023-11-28T11:09:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.889+0000 7fdd737fe700 1 -- 172.21.15.125:0/3743050780 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8001d810 con 0x7fdd8c0c6ca0 2023-11-28T11:09:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.889+0000 7fdd91122700 1 -- 172.21.15.125:0/3743050780 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c0ce740 con 0x7fdd8c0c6ca0 2023-11-28T11:09:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.889+0000 7fdd91122700 1 -- 172.21.15.125:0/3743050780 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c0b3dd0 con 0x7fdd8c0c6ca0 2023-11-28T11:09:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.890+0000 7fdd737fe700 1 -- 172.21.15.125:0/3743050780 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdd8002f070 con 0x7fdd8c0c6ca0 2023-11-28T11:09:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.890+0000 7fdd737fe700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd780682f0 0x7fdd7806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.890+0000 7fdd737fe700 1 -- 172.21.15.125:0/3743050780 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdd80086640 con 0x7fdd8c0c6ca0 2023-11-28T11:09:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.890+0000 7fdd8ad9d700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd780682f0 0x7fdd7806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.891+0000 7fdd8ad9d700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd780682f0 0x7fdd7806a7a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009ce0 tx=0x7fdd7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:44.894+0000 7fdd737fe700 1 -- 172.21.15.125:0/3743050780 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdd800531f0 con 0x7fdd8c0c6ca0 2023-11-28T11:09:45.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.153+0000 7fdd91122700 1 -- 172.21.15.125:0/3743050780 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fdd8c0743f0 con 0x7fdd8c0c6ca0 2023-11-28T11:09:45.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.156+0000 7fdd737fe700 1 -- 172.21.15.125:0/3743050780 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdd800170a0 con 0x7fdd8c0c6ca0 2023-11-28T11:09:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 -- 172.21.15.125:0/3743050780 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd780682f0 msgr2=0x7fdd7806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd780682f0 0x7fdd7806a7a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009ce0 tx=0x7fdd7c008040 comp rx=0 tx=0).stop 2023-11-28T11:09:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 -- 172.21.15.125:0/3743050780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd8c0c6ca0 msgr2=0x7fdd8c0c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd8c0c6ca0 0x7fdd8c0c7110 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdd80005040 tx=0x7fdd80001120 comp rx=0 tx=0).stop 2023-11-28T11:09:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 -- 172.21.15.125:0/3743050780 shutdown_connections 2023-11-28T11:09:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd780682f0 0x7fdd7806a7a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd8c0c8e90 0x7fdd8c0c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd74004850 0x7fdd8c1f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 --2- 172.21.15.125:0/3743050780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd8c0c6ca0 0x7fdd8c0c7110 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 -- 172.21.15.125:0/3743050780 >> 172.21.15.125:0/3743050780 conn(0x7fdd8c06c010 msgr2=0x7fdd8c0ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 -- 172.21.15.125:0/3743050780 shutdown_connections 2023-11-28T11:09:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.158+0000 7fdd91122700 1 -- 172.21.15.125:0/3743050780 wait complete. 2023-11-28T11:09:45.171 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.290+0000 7f133d2c3700 1 Processor -- start 2023-11-28T11:09:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.290+0000 7f133d2c3700 1 -- start start 2023-11-28T11:09:45.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f133d2c3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f133806ab10 0x7f133806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f133d2c3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f13380cd5a0 0x7f1338160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f133d2c3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13380b22a0 0x7f1338160840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f133d2c3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13380d1ee0 con 0x7f133806ab10 2023-11-28T11:09:45.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f133d2c3700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133806b420 con 0x7f13380cd5a0 2023-11-28T11:09:45.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f133d2c3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13380cdb10 con 0x7f13380b22a0 2023-11-28T11:09:45.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f1336ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f133806ab10 0x7f133806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f1336ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f133806ab10 0x7f133806aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58970/0 (socket says 172.21.15.125:58970) 2023-11-28T11:09:45.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f1336ffd700 1 -- 172.21.15.125:0/3398699399 learned_addr learned my addr 172.21.15.125:0/3398699399 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:45.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f13377fe700 1 --2- 172.21.15.125:0/3398699399 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13380b22a0 0x7f1338160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f13367fc700 1 --2- 172.21.15.125:0/3398699399 >> v2:172.21.15.167:3300/0 conn(0x7f13380cd5a0 0x7f1338160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f1336ffd700 1 -- 172.21.15.125:0/3398699399 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13380b22a0 msgr2=0x7f1338160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:45.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f1336ffd700 1 --2- 172.21.15.125:0/3398699399 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13380b22a0 0x7f1338160840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f1336ffd700 1 -- 172.21.15.125:0/3398699399 >> v2:172.21.15.167:3300/0 conn(0x7f13380cd5a0 msgr2=0x7f1338160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:45.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f1336ffd700 1 --2- 172.21.15.125:0/3398699399 >> v2:172.21.15.167:3300/0 conn(0x7f13380cd5a0 0x7f1338160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f1336ffd700 1 -- 172.21.15.125:0/3398699399 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13380d1890 con 0x7f133806ab10 2023-11-28T11:09:45.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.291+0000 7f13367fc700 1 --2- 172.21.15.125:0/3398699399 >> v2:172.21.15.167:3300/0 conn(0x7f13380cd5a0 0x7f1338160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:45.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f1336ffd700 1 --2- 172.21.15.125:0/3398699399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f133806ab10 0x7f133806aee0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f13380d0a60 tx=0x7f132c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4097447f13c81290 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:45.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f1335ffb700 1 -- 172.21.15.125:0/3398699399 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00b870 con 0x7f133806ab10 2023-11-28T11:09:45.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f1335ffb700 1 -- 172.21.15.125:0/3398699399 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c00b9d0 con 0x7f133806ab10 2023-11-28T11:09:45.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f1335ffb700 1 -- 172.21.15.125:0/3398699399 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00bd60 con 0x7f133806ab10 2023-11-28T11:09:45.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f133d2c3700 1 -- 172.21.15.125:0/3398699399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f133806ab10 msgr2=0x7f133806aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f133d2c3700 1 --2- 172.21.15.125:0/3398699399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f133806ab10 0x7f133806aee0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f13380d0a60 tx=0x7f132c009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f133d2c3700 1 -- 172.21.15.125:0/3398699399 shutdown_connections 2023-11-28T11:09:45.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f133d2c3700 1 --2- 172.21.15.125:0/3398699399 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13380b22a0 0x7f1338160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f133d2c3700 1 --2- 172.21.15.125:0/3398699399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f133806ab10 0x7f133806aee0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f133d2c3700 1 --2- 172.21.15.125:0/3398699399 >> v2:172.21.15.167:3300/0 conn(0x7f13380cd5a0 0x7f1338160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f133d2c3700 1 -- 172.21.15.125:0/3398699399 >> 172.21.15.125:0/3398699399 conn(0x7f133806c520 msgr2=0x7f133806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f133d2c3700 1 -- 172.21.15.125:0/3398699399 shutdown_connections 2023-11-28T11:09:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.292+0000 7f133d2c3700 1 -- 172.21.15.125:0/3398699399 wait complete. 2023-11-28T11:09:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.294+0000 7f133d2c3700 1 Processor -- start 2023-11-28T11:09:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.294+0000 7f133d2c3700 1 -- start start 2023-11-28T11:09:45.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f133d2c3700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f133806ab10 0x7f13380ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f133d2c3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13380b22a0 0x7f13380b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f133d2c3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13380cd5a0 0x7f13380c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f133d2c3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1338159d50 con 0x7f13380cd5a0 2023-11-28T11:09:45.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f133d2c3700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13381591d0 con 0x7f133806ab10 2023-11-28T11:09:45.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f133d2c3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13381594b0 con 0x7f13380b22a0 2023-11-28T11:09:45.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f13377fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13380cd5a0 0x7f13380c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f13377fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13380cd5a0 0x7f13380c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58978/0 (socket says 172.21.15.125:58978) 2023-11-28T11:09:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f13377fe700 1 -- 172.21.15.125:0/244388472 learned_addr learned my addr 172.21.15.125:0/244388472 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f13367fc700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13380b22a0 0x7f13380b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f1336ffd700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f133806ab10 0x7f13380ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f13377fe700 1 -- 172.21.15.125:0/244388472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13380b22a0 msgr2=0x7f13380b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f13377fe700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13380b22a0 0x7f13380b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f13377fe700 1 -- 172.21.15.125:0/244388472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f133806ab10 msgr2=0x7f13380ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f13377fe700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f133806ab10 0x7f13380ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.295+0000 7f13377fe700 1 -- 172.21.15.125:0/244388472 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c009550 con 0x7f13380cd5a0 2023-11-28T11:09:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.296+0000 7f13377fe700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13380cd5a0 0x7f13380c58a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f133000cd70 tx=0x7f133000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.296+0000 7f131f7fe700 1 -- 172.21.15.125:0/244388472 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330003a20 con 0x7f13380cd5a0 2023-11-28T11:09:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.296+0000 7f131f7fe700 1 -- 172.21.15.125:0/244388472 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330003b80 con 0x7f13380cd5a0 2023-11-28T11:09:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.296+0000 7f131f7fe700 1 -- 172.21.15.125:0/244388472 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330004020 con 0x7f13380cd5a0 2023-11-28T11:09:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.296+0000 7f133d2c3700 1 -- 172.21.15.125:0/244388472 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133815cad0 con 0x7f13380cd5a0 2023-11-28T11:09:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.296+0000 7f133d2c3700 1 -- 172.21.15.125:0/244388472 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13380d1b70 con 0x7f13380cd5a0 2023-11-28T11:09:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.297+0000 7f133d2c3700 1 -- 172.21.15.125:0/244388472 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13380b1ec0 con 0x7f13380cd5a0 2023-11-28T11:09:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.297+0000 7f131f7fe700 1 -- 172.21.15.125:0/244388472 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f133001c020 con 0x7f13380cd5a0 2023-11-28T11:09:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.297+0000 7f131f7fe700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13240682f0 0x7f132406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.297+0000 7f131f7fe700 1 -- 172.21.15.125:0/244388472 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1330012070 con 0x7f13380cd5a0 2023-11-28T11:09:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.297+0000 7f1336ffd700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13240682f0 0x7f132406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.298+0000 7f1336ffd700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13240682f0 0x7f132406a7a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f132c014040 tx=0x7f132c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.301+0000 7f131f7fe700 1 -- 172.21.15.125:0/244388472 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1330052b20 con 0x7f13380cd5a0 2023-11-28T11:09:45.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.484+0000 7f133d2c3700 1 -- 172.21.15.125:0/244388472 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13380743f0 con 0x7f13380cd5a0 2023-11-28T11:09:45.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.485+0000 7f131f7fe700 1 -- 172.21.15.125:0/244388472 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+14315 (secure 0 0 0) 0x7f1330056140 con 0x7f13380cd5a0 2023-11-28T11:09:45.485 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:45.486 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":34,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:42.282730+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:45.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 -- 172.21.15.125:0/244388472 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13240682f0 msgr2=0x7f132406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13240682f0 0x7f132406a7a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f132c014040 tx=0x7f132c008030 comp rx=0 tx=0).stop 2023-11-28T11:09:45.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 -- 172.21.15.125:0/244388472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13380cd5a0 msgr2=0x7f13380c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13380cd5a0 0x7f13380c58a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f133000cd70 tx=0x7f133000a570 comp rx=0 tx=0).stop 2023-11-28T11:09:45.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 -- 172.21.15.125:0/244388472 shutdown_connections 2023-11-28T11:09:45.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13380cd5a0 0x7f13380c58a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f133806ab10 0x7f13380ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f13240682f0 0x7f132406a7a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 --2- 172.21.15.125:0/244388472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13380b22a0 0x7f13380b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 -- 172.21.15.125:0/244388472 >> 172.21.15.125:0/244388472 conn(0x7f133806c520 msgr2=0x7f13380b6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:45.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 -- 172.21.15.125:0/244388472 shutdown_connections 2023-11-28T11:09:45.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.487+0000 7f133d2c3700 1 -- 172.21.15.125:0/244388472 wait complete. 2023-11-28T11:09:45.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:45.500 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:45.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.622+0000 7fa4ecaa5700 1 Processor -- start 2023-11-28T11:09:45.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.622+0000 7fa4ecaa5700 1 -- start start 2023-11-28T11:09:45.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4ecaa5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4e806a980 0x7fa4e80cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4ecaa5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e80cdd50 0x7fa4e80cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4ecaa5700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e815e0d0 con 0x7fa4e815a4d0 2023-11-28T11:09:45.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4ecaa5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e80ce560 con 0x7fa4e806a980 2023-11-28T11:09:45.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4ecaa5700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e815e320 con 0x7fa4e80cdd50 2023-11-28T11:09:45.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4e5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4e806a980 0x7fa4e80cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4e5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4e806a980 0x7fa4e80cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58982/0 (socket says 172.21.15.125:58982) 2023-11-28T11:09:45.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4e5d9b700 1 -- 172.21.15.125:0/768538158 learned_addr learned my addr 172.21.15.125:0/768538158 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:45.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4e6d9d700 1 --2- 172.21.15.125:0/768538158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e80cdd50 0x7fa4e80cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4e5d9b700 1 -- 172.21.15.125:0/768538158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e80cdd50 msgr2=0x7fa4e80cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4e5d9b700 1 --2- 172.21.15.125:0/768538158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e80cdd50 0x7fa4e80cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4e5d9b700 1 -- 172.21.15.125:0/768538158 >> v1:172.21.15.167:6789/0 conn(0x7fa4e815a4d0 legacy=0x7fa4e806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.623+0000 7fa4e5d9b700 1 -- 172.21.15.125:0/768538158 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e815e600 con 0x7fa4e806a980 2023-11-28T11:09:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4e5d9b700 1 --2- 172.21.15.125:0/768538158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4e806a980 0x7fa4e80cd810 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80098f0 tx=0x7fa4d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96a2bb64d117f93 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4e559a700 1 -- 172.21.15.125:0/768538158 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800b8a0 con 0x7fa4e806a980 2023-11-28T11:09:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4e559a700 1 -- 172.21.15.125:0/768538158 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d800ba00 con 0x7fa4e806a980 2023-11-28T11:09:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4e559a700 1 -- 172.21.15.125:0/768538158 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800bd90 con 0x7fa4e806a980 2023-11-28T11:09:45.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/768538158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4e806a980 msgr2=0x7fa4e80cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4ecaa5700 1 --2- 172.21.15.125:0/768538158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4e806a980 0x7fa4e80cd810 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80098f0 tx=0x7fa4d8009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:45.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/768538158 shutdown_connections 2023-11-28T11:09:45.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4ecaa5700 1 --2- 172.21.15.125:0/768538158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e80cdd50 0x7fa4e80cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4ecaa5700 1 --2- 172.21.15.125:0/768538158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4e806a980 0x7fa4e80cd810 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/768538158 >> 172.21.15.125:0/768538158 conn(0x7fa4e806c010 msgr2=0x7fa4e80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:45.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/768538158 shutdown_connections 2023-11-28T11:09:45.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.624+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/768538158 wait complete. 2023-11-28T11:09:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.626+0000 7fa4ecaa5700 1 Processor -- start 2023-11-28T11:09:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.626+0000 7fa4ecaa5700 1 -- start start 2023-11-28T11:09:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.626+0000 7fa4ecaa5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4e806a980 0x7fa4e8158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.626+0000 7fa4ecaa5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e80cdd50 0x7fa4e8152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.626+0000 7fa4ecaa5700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4e815a4d0 0x7fa4e815d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.626+0000 7fa4ecaa5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8157270 con 0x7fa4e806a980 2023-11-28T11:09:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.626+0000 7fa4ecaa5700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8156660 con 0x7fa4e815a4d0 2023-11-28T11:09:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.626+0000 7fa4ecaa5700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8156940 con 0x7fa4e80cdd50 2023-11-28T11:09:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4e659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4e806a980 0x7fa4e8158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4e659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4e806a980 0x7fa4e8158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58988/0 (socket says 172.21.15.125:58988) 2023-11-28T11:09:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4e659c700 1 -- 172.21.15.125:0/4115207554 learned_addr learned my addr 172.21.15.125:0/4115207554 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4e6d9d700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4e815a4d0 0x7fa4e815d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4e659c700 1 -- 172.21.15.125:0/4115207554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e80cdd50 msgr2=0x7fa4e8152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4e5d9b700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e80cdd50 0x7fa4e8152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4e659c700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e80cdd50 0x7fa4e8152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4e659c700 1 -- 172.21.15.125:0/4115207554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4e815a4d0 msgr2=0x7fa4e815d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4e659c700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4e815a4d0 0x7fa4e815d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4e659c700 1 -- 172.21.15.125:0/4115207554 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8009550 con 0x7fa4e806a980 2023-11-28T11:09:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4e659c700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4e806a980 0x7fa4e8158430 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c450 tx=0x7fa4dc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:45.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4d6ffd700 1 -- 172.21.15.125:0/4115207554 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0052d0 con 0x7fa4e806a980 2023-11-28T11:09:45.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4d6ffd700 1 -- 172.21.15.125:0/4115207554 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc005430 con 0x7fa4e806a980 2023-11-28T11:09:45.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/4115207554 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e80ce1b0 con 0x7fa4e806a980 2023-11-28T11:09:45.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4d6ffd700 1 -- 172.21.15.125:0/4115207554 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0038c0 con 0x7fa4e806a980 2023-11-28T11:09:45.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.627+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/4115207554 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e815e8e0 con 0x7fa4e806a980 2023-11-28T11:09:45.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.628+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/4115207554 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e815a8a0 con 0x7fa4e806a980 2023-11-28T11:09:45.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.628+0000 7fa4d6ffd700 1 -- 172.21.15.125:0/4115207554 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa4dc019030 con 0x7fa4e806a980 2023-11-28T11:09:45.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.629+0000 7fa4d6ffd700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4c80682f0 0x7fa4c806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.629+0000 7fa4d6ffd700 1 -- 172.21.15.125:0/4115207554 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa4dc084c20 con 0x7fa4e806a980 2023-11-28T11:09:45.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.629+0000 7fa4e5d9b700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4c80682f0 0x7fa4c806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.629+0000 7fa4e5d9b700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4c80682f0 0x7fa4c806a7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80cd350 tx=0x7fa4d8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:45.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.633+0000 7fa4d6ffd700 1 -- 172.21.15.125:0/4115207554 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa4dc0516e0 con 0x7fa4e806a980 2023-11-28T11:09:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.815+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/4115207554 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4e80743f0 con 0x7fa4e806a980 2023-11-28T11:09:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.816+0000 7fa4d6ffd700 1 -- 172.21.15.125:0/4115207554 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa4dc054d00 con 0x7fa4e806a980 2023-11-28T11:09:45.817 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:45.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/4115207554 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4c80682f0 msgr2=0x7fa4c806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4c80682f0 0x7fa4c806a7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80cd350 tx=0x7fa4d8008030 comp rx=0 tx=0).stop 2023-11-28T11:09:45.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/4115207554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4e806a980 msgr2=0x7fa4e8158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4e806a980 0x7fa4e8158430 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c450 tx=0x7fa4dc00c810 comp rx=0 tx=0).stop 2023-11-28T11:09:45.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/4115207554 shutdown_connections 2023-11-28T11:09:45.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4e815a4d0 0x7fa4e815d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4e806a980 0x7fa4e8158430 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4c80682f0 0x7fa4c806a7a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 --2- 172.21.15.125:0/4115207554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e80cdd50 0x7fa4e8152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/4115207554 >> 172.21.15.125:0/4115207554 conn(0x7fa4e806c010 msgr2=0x7fa4e8154490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/4115207554 shutdown_connections 2023-11-28T11:09:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.818+0000 7fa4ecaa5700 1 -- 172.21.15.125:0/4115207554 wait complete. 2023-11-28T11:09:45.832 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:45.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.954+0000 7fd3d28ee700 1 Processor -- start 2023-11-28T11:09:45.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.954+0000 7fd3d28ee700 1 -- start start 2023-11-28T11:09:45.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3d28ee700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3cc0b1650 0x7fd3cc0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3d28ee700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc1599b0 0x7fd3cc15d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3d28ee700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc159ec0 con 0x7fd3cc0af0a0 2023-11-28T11:09:45.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3d28ee700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc15aa60 con 0x7fd3cc0b1650 2023-11-28T11:09:45.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3d28ee700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0b1f60 con 0x7fd3cc1599b0 2023-11-28T11:09:45.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3cbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3cc0b1650 0x7fd3cc0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3cbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3cc0b1650 0x7fd3cc0b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58996/0 (socket says 172.21.15.125:58996) 2023-11-28T11:09:45.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3cbfff700 1 -- 172.21.15.125:0/286077197 learned_addr learned my addr 172.21.15.125:0/286077197 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:45.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3cb7fe700 1 --2- 172.21.15.125:0/286077197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc1599b0 0x7fd3cc15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3cbfff700 1 -- 172.21.15.125:0/286077197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc1599b0 msgr2=0x7fd3cc15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:45.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3cbfff700 1 --2- 172.21.15.125:0/286077197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc1599b0 0x7fd3cc15d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.955+0000 7fd3cbfff700 1 -- 172.21.15.125:0/286077197 >> v1:172.21.15.167:6789/0 conn(0x7fd3cc0af0a0 legacy=0x7fd3cc15a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3cbfff700 1 -- 172.21.15.125:0/286077197 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc15d8a0 con 0x7fd3cc0b1650 2023-11-28T11:09:45.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3cbfff700 1 --2- 172.21.15.125:0/286077197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0b1650 0x7fd3cc0b1a20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00098f0 tx=0x7fd3c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1912cc13de109d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:45.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3caffd700 1 -- 172.21.15.125:0/286077197 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0011830 con 0x7fd3cc0b1650 2023-11-28T11:09:45.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3caffd700 1 -- 172.21.15.125:0/286077197 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c0011990 con 0x7fd3cc0b1650 2023-11-28T11:09:45.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3caffd700 1 -- 172.21.15.125:0/286077197 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0011d20 con 0x7fd3cc0b1650 2023-11-28T11:09:45.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3d28ee700 1 -- 172.21.15.125:0/286077197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0b1650 msgr2=0x7fd3cc0b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3d28ee700 1 --2- 172.21.15.125:0/286077197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0b1650 0x7fd3cc0b1a20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00098f0 tx=0x7fd3c0009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:45.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3d28ee700 1 -- 172.21.15.125:0/286077197 shutdown_connections 2023-11-28T11:09:45.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3d28ee700 1 --2- 172.21.15.125:0/286077197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0b1650 0x7fd3cc0b1a20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3d28ee700 1 --2- 172.21.15.125:0/286077197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc1599b0 0x7fd3cc15d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3d28ee700 1 -- 172.21.15.125:0/286077197 >> 172.21.15.125:0/286077197 conn(0x7fd3cc06c010 msgr2=0x7fd3cc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:45.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3d28ee700 1 -- 172.21.15.125:0/286077197 shutdown_connections 2023-11-28T11:09:45.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.956+0000 7fd3d28ee700 1 -- 172.21.15.125:0/286077197 wait complete. 2023-11-28T11:09:45.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.958+0000 7fd3d28ee700 1 Processor -- start 2023-11-28T11:09:45.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.958+0000 7fd3d28ee700 1 -- start start 2023-11-28T11:09:45.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.958+0000 7fd3d28ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0af0a0 0x7fd3cc1423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.958+0000 7fd3d28ee700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0b1650 0x7fd3cc15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.958+0000 7fd3d28ee700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc15b810 0x7fd3cc156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.958+0000 7fd3d28ee700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc15bcb0 con 0x7fd3cc0af0a0 2023-11-28T11:09:45.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.958+0000 7fd3d28ee700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc140750 con 0x7fd3cc15b810 2023-11-28T11:09:45.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.958+0000 7fd3d28ee700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc1432e0 con 0x7fd3cc0b1650 2023-11-28T11:09:45.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3cbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0af0a0 0x7fd3cc1423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3cbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0af0a0 0x7fd3cc1423d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59000/0 (socket says 172.21.15.125:59000) 2023-11-28T11:09:45.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3cbfff700 1 -- 172.21.15.125:0/2267278389 learned_addr learned my addr 172.21.15.125:0/2267278389 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:45.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3d0e8b700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc15b810 0x7fd3cc156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3cb7fe700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0b1650 0x7fd3cc15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3cbfff700 1 -- 172.21.15.125:0/2267278389 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0b1650 msgr2=0x7fd3cc15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3cbfff700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0b1650 0x7fd3cc15b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3cbfff700 1 -- 172.21.15.125:0/2267278389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc15b810 msgr2=0x7fd3cc156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:45.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3cbfff700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc15b810 0x7fd3cc156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:45.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3cbfff700 1 -- 172.21.15.125:0/2267278389 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0009550 con 0x7fd3cc0af0a0 2023-11-28T11:09:45.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3cbfff700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0af0a0 0x7fd3cc1423d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0014040 tx=0x7fd3c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:45.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3c8ff9700 1 -- 172.21.15.125:0/2267278389 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c00036a0 con 0x7fd3cc0af0a0 2023-11-28T11:09:45.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3c8ff9700 1 -- 172.21.15.125:0/2267278389 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c001e070 con 0x7fd3cc0af0a0 2023-11-28T11:09:45.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3c8ff9700 1 -- 172.21.15.125:0/2267278389 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0003a60 con 0x7fd3cc0af0a0 2023-11-28T11:09:45.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3d28ee700 1 -- 172.21.15.125:0/2267278389 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc15de60 con 0x7fd3cc0af0a0 2023-11-28T11:09:45.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.959+0000 7fd3d28ee700 1 -- 172.21.15.125:0/2267278389 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc15db80 con 0x7fd3cc0af0a0 2023-11-28T11:09:45.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.960+0000 7fd3d28ee700 1 -- 172.21.15.125:0/2267278389 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc15d590 con 0x7fd3cc0af0a0 2023-11-28T11:09:45.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.961+0000 7fd3c8ff9700 1 -- 172.21.15.125:0/2267278389 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd3c000f050 con 0x7fd3cc0af0a0 2023-11-28T11:09:45.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.961+0000 7fd3c8ff9700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b80682f0 0x7fd3b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:45.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.961+0000 7fd3cb7fe700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b80682f0 0x7fd3b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:45.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.961+0000 7fd3c8ff9700 1 -- 172.21.15.125:0/2267278389 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd3c0086910 con 0x7fd3cc0af0a0 2023-11-28T11:09:45.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.961+0000 7fd3cb7fe700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b80682f0 0x7fd3b806a7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc1f2bc0 tx=0x7fd3bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:45.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:45.965+0000 7fd3c8ff9700 1 -- 172.21.15.125:0/2267278389 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd3c00534c0 con 0x7fd3cc0af0a0 2023-11-28T11:09:46.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.148+0000 7fd3d28ee700 1 -- 172.21.15.125:0/2267278389 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd3cc0743f0 con 0x7fd3cc0af0a0 2023-11-28T11:09:46.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.148+0000 7fd3c8ff9700 1 -- 172.21.15.125:0/2267278389 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd3c00150a0 con 0x7fd3cc0af0a0 2023-11-28T11:09:46.149 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:46.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 -- 172.21.15.125:0/2267278389 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b80682f0 msgr2=0x7fd3b806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b80682f0 0x7fd3b806a7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc1f2bc0 tx=0x7fd3bc008040 comp rx=0 tx=0).stop 2023-11-28T11:09:46.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 -- 172.21.15.125:0/2267278389 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0af0a0 msgr2=0x7fd3cc1423d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0af0a0 0x7fd3cc1423d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0014040 tx=0x7fd3c0004750 comp rx=0 tx=0).stop 2023-11-28T11:09:46.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 -- 172.21.15.125:0/2267278389 shutdown_connections 2023-11-28T11:09:46.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc15b810 0x7fd3cc156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3cc0af0a0 0x7fd3cc1423d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3b80682f0 0x7fd3b806a7a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 --2- 172.21.15.125:0/2267278389 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3cc0b1650 0x7fd3cc15b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 -- 172.21.15.125:0/2267278389 >> 172.21.15.125:0/2267278389 conn(0x7fd3cc06c010 msgr2=0x7fd3cc070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:46.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 -- 172.21.15.125:0/2267278389 shutdown_connections 2023-11-28T11:09:46.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.150+0000 7fd3d28ee700 1 -- 172.21.15.125:0/2267278389 wait complete. 2023-11-28T11:09:46.164 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:09:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.283+0000 7f2237e35700 1 Processor -- start 2023-11-28T11:09:46.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.283+0000 7f2237e35700 1 -- start start 2023-11-28T11:09:46.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f2237e35700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f223006e400 0x7f22300b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f2237e35700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2230160e70 0x7f223015c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f2237e35700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223006e900 con 0x7f22300d0c60 2023-11-28T11:09:46.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f2237e35700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2230160390 con 0x7f223006e400 2023-11-28T11:09:46.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f2237e35700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2230160670 con 0x7f2230160e70 2023-11-28T11:09:46.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f2235bd1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f22300d0c60 0x7f22300d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43132/0 (socket says 172.21.15.125:43132) 2023-11-28T11:09:46.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f2235bd1700 1 -- 172.21.15.125:0/714597212 learned_addr learned my addr 172.21.15.125:0/714597212 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:46.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f22363d2700 1 --2- 172.21.15.125:0/714597212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2230160e70 0x7f223015c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f22353d0700 1 --2- 172.21.15.125:0/714597212 >> v2:172.21.15.167:3300/0 conn(0x7f223006e400 0x7f22300b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f2234bcf700 1 -- 172.21.15.125:0/714597212 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186350757 0 0) 0x7f223006e900 con 0x7f22300d0c60 2023-11-28T11:09:46.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f2234bcf700 1 -- 172.21.15.125:0/714597212 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f221c0035b0 con 0x7f22300d0c60 2023-11-28T11:09:46.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f2234bcf700 1 -- 172.21.15.125:0/714597212 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4180438991 0 0) 0x7f221c0035b0 con 0x7f22300d0c60 2023-11-28T11:09:46.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f22363d2700 1 -- 172.21.15.125:0/714597212 >> v2:172.21.15.167:3300/0 conn(0x7f223006e400 msgr2=0x7f22300b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:46.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f22363d2700 1 --2- 172.21.15.125:0/714597212 >> v2:172.21.15.167:3300/0 conn(0x7f223006e400 0x7f22300b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f22363d2700 1 -- 172.21.15.125:0/714597212 >> v1:172.21.15.125:6789/0 conn(0x7f22300d0c60 legacy=0x7f22300d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f22363d2700 1 -- 172.21.15.125:0/714597212 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230160950 con 0x7f2230160e70 2023-11-28T11:09:46.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.284+0000 7f22353d0700 1 --2- 172.21.15.125:0/714597212 >> v2:172.21.15.167:3300/0 conn(0x7f223006e400 0x7f22300b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:46.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f22363d2700 1 --2- 172.21.15.125:0/714597212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2230160e70 0x7f223015c970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2228009d90 tx=0x7f222800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d8d2c7b08939595 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:46.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f2234bcf700 1 -- 172.21.15.125:0/714597212 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222800e070 con 0x7f2230160e70 2023-11-28T11:09:46.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f2234bcf700 1 -- 172.21.15.125:0/714597212 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2228003a20 con 0x7f2230160e70 2023-11-28T11:09:46.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f2234bcf700 1 -- 172.21.15.125:0/714597212 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c001670 con 0x7f2230160e70 2023-11-28T11:09:46.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f2237e35700 1 -- 172.21.15.125:0/714597212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2230160e70 msgr2=0x7f223015c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f2237e35700 1 --2- 172.21.15.125:0/714597212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2230160e70 0x7f223015c970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2228009d90 tx=0x7f222800b330 comp rx=0 tx=0).stop 2023-11-28T11:09:46.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f2237e35700 1 -- 172.21.15.125:0/714597212 shutdown_connections 2023-11-28T11:09:46.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f2237e35700 1 --2- 172.21.15.125:0/714597212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2230160e70 0x7f223015c970 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f2237e35700 1 --2- 172.21.15.125:0/714597212 >> v2:172.21.15.167:3300/0 conn(0x7f223006e400 0x7f22300b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f2237e35700 1 -- 172.21.15.125:0/714597212 >> 172.21.15.125:0/714597212 conn(0x7f223006a270 msgr2=0x7f223006a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:46.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f2237e35700 1 -- 172.21.15.125:0/714597212 shutdown_connections 2023-11-28T11:09:46.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.285+0000 7f2237e35700 1 -- 172.21.15.125:0/714597212 wait complete. 2023-11-28T11:09:46.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.287+0000 7f2237e35700 1 Processor -- start 2023-11-28T11:09:46.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.287+0000 7f2237e35700 1 -- start start 2023-11-28T11:09:46.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.287+0000 7f2237e35700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f223006e400 0x7f2230153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.287+0000 7f2237e35700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22300d0c60 0x7f223015e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.287+0000 7f2237e35700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2230160e70 0x7f2230159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.287+0000 7f2237e35700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300b26d0 con 0x7f223006e400 2023-11-28T11:09:46.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.287+0000 7f2237e35700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2230157470 con 0x7f22300d0c60 2023-11-28T11:09:46.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.287+0000 7f2237e35700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2230157750 con 0x7f2230160e70 2023-11-28T11:09:46.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.287+0000 7f2235bd1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f223006e400 0x7f2230153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.287+0000 7f2235bd1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f223006e400 0x7f2230153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59014/0 (socket says 172.21.15.125:59014) 2023-11-28T11:09:46.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.287+0000 7f2235bd1700 1 -- 172.21.15.125:0/1841096028 learned_addr learned my addr 172.21.15.125:0/1841096028 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:46.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f2235bd1700 1 -- 172.21.15.125:0/1841096028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2230160e70 msgr2=0x7f2230159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f22363d2700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2230160e70 0x7f2230159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f22353d0700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22300d0c60 0x7f223015e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f2235bd1700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2230160e70 0x7f2230159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f2235bd1700 1 -- 172.21.15.125:0/1841096028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22300d0c60 msgr2=0x7f223015e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f2235bd1700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22300d0c60 0x7f223015e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f2235bd1700 1 -- 172.21.15.125:0/1841096028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200094a0 con 0x7f223006e400 2023-11-28T11:09:46.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f2235bd1700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f223006e400 0x7f2230153460 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f222c0011e0 tx=0x7f222c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:46.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f22267fc700 1 -- 172.21.15.125:0/1841096028 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c007560 con 0x7f223006e400 2023-11-28T11:09:46.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f22267fc700 1 -- 172.21.15.125:0/1841096028 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c0076c0 con 0x7f223006e400 2023-11-28T11:09:46.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f2237e35700 1 -- 172.21.15.125:0/1841096028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2228009a70 con 0x7f223006e400 2023-11-28T11:09:46.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f22267fc700 1 -- 172.21.15.125:0/1841096028 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c004a90 con 0x7f223006e400 2023-11-28T11:09:46.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.288+0000 7f2237e35700 1 -- 172.21.15.125:0/1841096028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223015ceb0 con 0x7f223006e400 2023-11-28T11:09:46.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.289+0000 7f2237e35700 1 -- 172.21.15.125:0/1841096028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22300d0740 con 0x7f223006e400 2023-11-28T11:09:46.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.289+0000 7f22267fc700 1 -- 172.21.15.125:0/1841096028 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f222c01a030 con 0x7f223006e400 2023-11-28T11:09:46.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.290+0000 7f22267fc700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22140682f0 0x7f221406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.290+0000 7f22267fc700 1 -- 172.21.15.125:0/1841096028 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f222c084dd0 con 0x7f223006e400 2023-11-28T11:09:46.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.290+0000 7f22353d0700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22140682f0 0x7f221406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.290+0000 7f22353d0700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22140682f0 0x7f221406a7a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2230156540 tx=0x7f2220008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:46.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.294+0000 7f22267fc700 1 -- 172.21.15.125:0/1841096028 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f222c051980 con 0x7f223006e400 2023-11-28T11:09:46.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.478+0000 7f2237e35700 1 -- 172.21.15.125:0/1841096028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f223015d040 con 0x7f223006e400 2023-11-28T11:09:46.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.478+0000 7f22267fc700 1 -- 172.21.15.125:0/1841096028 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7f222c018090 con 0x7f223006e400 2023-11-28T11:09:46.479 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:46.479 INFO:teuthology.orchestra.run.smithi125.stdout:[ 2023-11-28T11:09:46.479 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:46.479 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 1, 2023-11-28T11:09:46.479 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": ".mgr" 2023-11-28T11:09:46.480 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:46.480 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:09:46.480 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 2, 2023-11-28T11:09:46.480 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": "rbd" 2023-11-28T11:09:46.480 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:46.480 INFO:teuthology.orchestra.run.smithi125.stdout:] 2023-11-28T11:09:46.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 -- 172.21.15.125:0/1841096028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22140682f0 msgr2=0x7f221406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22140682f0 0x7f221406a7a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2230156540 tx=0x7f2220008040 comp rx=0 tx=0).stop 2023-11-28T11:09:46.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 -- 172.21.15.125:0/1841096028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f223006e400 msgr2=0x7f2230153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f223006e400 0x7f2230153460 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f222c0011e0 tx=0x7f222c00cb00 comp rx=0 tx=0).stop 2023-11-28T11:09:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 -- 172.21.15.125:0/1841096028 shutdown_connections 2023-11-28T11:09:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f22140682f0 0x7f221406a7a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2230160e70 0x7f2230159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f223006e400 0x7f2230153460 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 --2- 172.21.15.125:0/1841096028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22300d0c60 0x7f223015e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 -- 172.21.15.125:0/1841096028 >> 172.21.15.125:0/1841096028 conn(0x7f223006a270 msgr2=0x7f223006cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:46.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 -- 172.21.15.125:0/1841096028 shutdown_connections 2023-11-28T11:09:46.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.480+0000 7f2237e35700 1 -- 172.21.15.125:0/1841096028 wait complete. 2023-11-28T11:09:46.493 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:09:46.493 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:09:46.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.617+0000 7f198e111700 1 Processor -- start 2023-11-28T11:09:46.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.617+0000 7f198e111700 1 -- start start 2023-11-28T11:09:46.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.618+0000 7f198e111700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19880d0cb0 0x7f19880d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.618+0000 7f198e111700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f19880ccef0 0x7f198806ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.618+0000 7f198e111700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19880d15c0 con 0x7f198815c8f0 2023-11-28T11:09:46.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.618+0000 7f198e111700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19880cbe50 con 0x7f19880ccef0 2023-11-28T11:09:46.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.618+0000 7f198e111700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19880cc130 con 0x7f19880d0cb0 2023-11-28T11:09:46.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.618+0000 7f1986ffd700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f198815c8f0 0x7f198806b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:45950/0 (socket says 172.21.15.125:45950) 2023-11-28T11:09:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.618+0000 7f1986ffd700 1 -- 172.21.15.125:0/3009718722 learned_addr learned my addr 172.21.15.125:0/3009718722 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.618+0000 7f19877fe700 1 --2- 172.21.15.125:0/3009718722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19880d0cb0 0x7f19880d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.618+0000 7f1987fff700 1 --2- 172.21.15.125:0/3009718722 >> v2:172.21.15.167:3300/0 conn(0x7f19880ccef0 0x7f198806ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.619+0000 7f19867fc700 1 -- 172.21.15.125:0/3009718722 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127460042 0 0) 0x7f19880d15c0 con 0x7f198815c8f0 2023-11-28T11:09:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.619+0000 7f19867fc700 1 -- 172.21.15.125:0/3009718722 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19700035b0 con 0x7f198815c8f0 2023-11-28T11:09:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.619+0000 7f19877fe700 1 -- 172.21.15.125:0/3009718722 >> v2:172.21.15.167:3300/0 conn(0x7f19880ccef0 msgr2=0x7f198806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.619+0000 7f19877fe700 1 --2- 172.21.15.125:0/3009718722 >> v2:172.21.15.167:3300/0 conn(0x7f19880ccef0 0x7f198806ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.619+0000 7f19877fe700 1 -- 172.21.15.125:0/3009718722 >> v1:172.21.15.167:6789/0 conn(0x7f198815c8f0 legacy=0x7f198806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.619+0000 7f19877fe700 1 -- 172.21.15.125:0/3009718722 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19880cc410 con 0x7f19880d0cb0 2023-11-28T11:09:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.619+0000 7f19877fe700 1 --2- 172.21.15.125:0/3009718722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19880d0cb0 0x7f19880d1080 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f197c009820 tx=0x7f197c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ea01a2b87acd842 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.619+0000 7f19867fc700 1 -- 172.21.15.125:0/3009718722 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c005e30 con 0x7f19880d0cb0 2023-11-28T11:09:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.619+0000 7f19867fc700 1 -- 172.21.15.125:0/3009718722 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c006030 con 0x7f19880d0cb0 2023-11-28T11:09:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.619+0000 7f19867fc700 1 -- 172.21.15.125:0/3009718722 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0063c0 con 0x7f19880d0cb0 2023-11-28T11:09:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.620+0000 7f198e111700 1 -- 172.21.15.125:0/3009718722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19880d0cb0 msgr2=0x7f19880d1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.620+0000 7f198e111700 1 --2- 172.21.15.125:0/3009718722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19880d0cb0 0x7f19880d1080 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f197c009820 tx=0x7f197c009b30 comp rx=0 tx=0).stop 2023-11-28T11:09:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.620+0000 7f198e111700 1 -- 172.21.15.125:0/3009718722 shutdown_connections 2023-11-28T11:09:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.620+0000 7f198e111700 1 --2- 172.21.15.125:0/3009718722 >> v2:172.21.15.167:3300/0 conn(0x7f19880ccef0 0x7f198806ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.620+0000 7f198e111700 1 --2- 172.21.15.125:0/3009718722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19880d0cb0 0x7f19880d1080 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.620+0000 7f198e111700 1 -- 172.21.15.125:0/3009718722 >> 172.21.15.125:0/3009718722 conn(0x7f198806ab90 msgr2=0x7f1988099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.620+0000 7f198e111700 1 -- 172.21.15.125:0/3009718722 shutdown_connections 2023-11-28T11:09:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.620+0000 7f198e111700 1 -- 172.21.15.125:0/3009718722 wait complete. 2023-11-28T11:09:46.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.621+0000 7f198e111700 1 Processor -- start 2023-11-28T11:09:46.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.621+0000 7f198e111700 1 -- start start 2023-11-28T11:09:46.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f198e111700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19880ccef0 0x7f1988150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f198e111700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d0cb0 0x7f19880c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f198e111700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f198815c8f0 0x7f19881e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f198e111700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19880c50e0 con 0x7f19880d0cb0 2023-11-28T11:09:46.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f198e111700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19880b15d0 con 0x7f19880ccef0 2023-11-28T11:09:46.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f198e111700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19880b1b90 con 0x7f198815c8f0 2023-11-28T11:09:46.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f1986ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d0cb0 0x7f19880c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f1986ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d0cb0 0x7f19880c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59030/0 (socket says 172.21.15.125:59030) 2023-11-28T11:09:46.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f1986ffd700 1 -- 172.21.15.125:0/733526945 learned_addr learned my addr 172.21.15.125:0/733526945 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:46.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f19877fe700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19880ccef0 0x7f1988150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f1987fff700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f198815c8f0 0x7f19881e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f1986ffd700 1 -- 172.21.15.125:0/733526945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f198815c8f0 msgr2=0x7f19881e5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f1986ffd700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f198815c8f0 0x7f19881e5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f1986ffd700 1 -- 172.21.15.125:0/733526945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19880ccef0 msgr2=0x7f1988150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:46.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f1986ffd700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19880ccef0 0x7f1988150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:46.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f1986ffd700 1 -- 172.21.15.125:0/733526945 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c009430 con 0x7f19880d0cb0 2023-11-28T11:09:46.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f1986ffd700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d0cb0 0x7f19880c7000 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f197800c400 tx=0x7f197800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:46.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f196ffff700 1 -- 172.21.15.125:0/733526945 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978005b40 con 0x7f19880d0cb0 2023-11-28T11:09:46.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f196ffff700 1 -- 172.21.15.125:0/733526945 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978005ca0 con 0x7f19880d0cb0 2023-11-28T11:09:46.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f198e111700 1 -- 172.21.15.125:0/733526945 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19880cc9d0 con 0x7f19880d0cb0 2023-11-28T11:09:46.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.622+0000 7f196ffff700 1 -- 172.21.15.125:0/733526945 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978007310 con 0x7f19880d0cb0 2023-11-28T11:09:46.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.623+0000 7f198e111700 1 -- 172.21.15.125:0/733526945 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19880cc6f0 con 0x7f19880d0cb0 2023-11-28T11:09:46.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.623+0000 7f198e111700 1 -- 172.21.15.125:0/733526945 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19880ad980 con 0x7f19880d0cb0 2023-11-28T11:09:46.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.624+0000 7f196ffff700 1 -- 172.21.15.125:0/733526945 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1978019030 con 0x7f19880d0cb0 2023-11-28T11:09:46.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.624+0000 7f196ffff700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19740682f0 0x7f197406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:46.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.624+0000 7f196ffff700 1 -- 172.21.15.125:0/733526945 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1978084af0 con 0x7f19880d0cb0 2023-11-28T11:09:46.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.624+0000 7f19877fe700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19740682f0 0x7f197406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:46.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.625+0000 7f19877fe700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19740682f0 0x7f197406a7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f197c000c00 tx=0x7f197c008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:46.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.628+0000 7f196ffff700 1 -- 172.21.15.125:0/733526945 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1978051760 con 0x7f19880d0cb0 2023-11-28T11:09:46.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:46.813+0000 7f198e111700 1 -- 172.21.15.125:0/733526945 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f19880743f0 con 0x7f19880d0cb0 2023-11-28T11:09:47.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.162+0000 7f196ffff700 1 -- 172.21.15.125:0/733526945 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1978017020 con 0x7f19880d0cb0 2023-11-28T11:09:47.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 -- 172.21.15.125:0/733526945 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19740682f0 msgr2=0x7f197406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:47.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19740682f0 0x7f197406a7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f197c000c00 tx=0x7f197c008070 comp rx=0 tx=0).stop 2023-11-28T11:09:47.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 -- 172.21.15.125:0/733526945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d0cb0 msgr2=0x7f19880c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:47.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d0cb0 0x7f19880c7000 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f197800c400 tx=0x7f197800c710 comp rx=0 tx=0).stop 2023-11-28T11:09:47.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 -- 172.21.15.125:0/733526945 shutdown_connections 2023-11-28T11:09:47.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19740682f0 0x7f197406a7a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:47.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f198815c8f0 0x7f19881e5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:47.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19880ccef0 0x7f1988150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:47.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 --2- 172.21.15.125:0/733526945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d0cb0 0x7f19880c7000 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:47.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 -- 172.21.15.125:0/733526945 >> 172.21.15.125:0/733526945 conn(0x7f198806ab90 msgr2=0x7f19880adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:47.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 -- 172.21.15.125:0/733526945 shutdown_connections 2023-11-28T11:09:47.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.165+0000 7f198e111700 1 -- 172.21.15.125:0/733526945 wait complete. 2023-11-28T11:09:47.167 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' created 2023-11-28T11:09:47.180 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:09:47.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.306+0000 7f122d7d9700 1 Processor -- start 2023-11-28T11:09:47.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.306+0000 7f122d7d9700 1 -- start start 2023-11-28T11:09:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.307+0000 7f122d7d9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f122815c810 0x7f1228160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.307+0000 7f122d7d9700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f122806a270 0x7f122806a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.307+0000 7f122d7d9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122806ac10 con 0x7f12280718e0 2023-11-28T11:09:47.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.307+0000 7f122d7d9700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122815cbe0 con 0x7f122806a270 2023-11-28T11:09:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.307+0000 7f122d7d9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12281607a0 con 0x7f122815c810 2023-11-28T11:09:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.307+0000 7f12267fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f12280718e0 0x7f122806c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43162/0 (socket says 172.21.15.125:43162) 2023-11-28T11:09:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.307+0000 7f12267fc700 1 -- 172.21.15.125:0/2126174436 learned_addr learned my addr 172.21.15.125:0/2126174436 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646678975 0 0) 0x7f122806ac10 con 0x7f12280718e0 2023-11-28T11:09:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12100035b0 con 0x7f12280718e0 2023-11-28T11:09:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f12277fe700 1 --2- 172.21.15.125:0/2126174436 >> v2:172.21.15.167:3300/0 conn(0x7f122806a270 0x7f122806a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:47.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1226ffd700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f122815c810 0x7f1228160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934808949 0 0) 0x7f12100035b0 con 0x7f12280718e0 2023-11-28T11:09:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f122815c810 msgr2=0x7f1228160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f122815c810 0x7f1228160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 >> v2:172.21.15.167:3300/0 conn(0x7f122806a270 msgr2=0x7f122806a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 --2- 172.21.15.125:0/2126174436 >> v2:172.21.15.167:3300/0 conn(0x7f122806a270 0x7f122806a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228160a50 con 0x7f12280718e0 2023-11-28T11:09:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f1218001670 con 0x7f12280718e0 2023-11-28T11:09:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f12277fe700 1 --2- 172.21.15.125:0/2126174436 >> v2:172.21.15.167:3300/0 conn(0x7f122806a270 0x7f122806a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:47.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 >> v1:172.21.15.125:6789/0 conn(0x7f12280718e0 legacy=0x7f122806c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1210003a00 0x7f1210003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1210004850 0x7f1210004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1210005200 0x7f121000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122815cbe0 con 0x7f1210005200 2023-11-28T11:09:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12281607a0 con 0x7f1210003a00 2023-11-28T11:09:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121000c000 con 0x7f1210004850 2023-11-28T11:09:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1226ffd700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f122815c810 0x7f1228160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f12277fe700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1210005200 0x7f121000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f12267fc700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1210004850 0x7f1210004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f1226ffd700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1210003a00 0x7f1210003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:47.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f12277fe700 1 -- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1210004850 msgr2=0x7f1210004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f12277fe700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1210004850 0x7f1210004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f12277fe700 1 -- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1210003a00 msgr2=0x7f1210003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f12277fe700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1210003a00 0x7f1210003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f12277fe700 1 -- 172.21.15.125:0/2126174436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100035b0 con 0x7f1210005200 2023-11-28T11:09:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.308+0000 7f12277fe700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1210005200 0x7f121000ba10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f12200073e0 tx=0x7f1210005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cf5375ada4f53e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.309+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220014400 con 0x7f1210005200 2023-11-28T11:09:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.309+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1220014560 con 0x7f1210005200 2023-11-28T11:09:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.309+0000 7f1225ffb700 1 -- 172.21.15.125:0/2126174436 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12200148d0 con 0x7f1210005200 2023-11-28T11:09:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.309+0000 7f122d7d9700 1 -- 172.21.15.125:0/2126174436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1210005200 msgr2=0x7f121000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.309+0000 7f122d7d9700 1 --2- 172.21.15.125:0/2126174436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1210005200 0x7f121000ba10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f12200073e0 tx=0x7f1210005880 comp rx=0 tx=0).stop 2023-11-28T11:09:47.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.309+0000 7f12277fe700 1 -- 172.21.15.125:0/2126174436 reap_dead start 2023-11-28T11:09:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.309+0000 7f122d7d9700 1 -- 172.21.15.125:0/2126174436 shutdown_connections 2023-11-28T11:09:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.309+0000 7f122d7d9700 1 -- 172.21.15.125:0/2126174436 >> 172.21.15.125:0/2126174436 conn(0x7f122806c010 msgr2=0x7f12280cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.309+0000 7f122d7d9700 1 -- 172.21.15.125:0/2126174436 shutdown_connections 2023-11-28T11:09:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.309+0000 7f122d7d9700 1 -- 172.21.15.125:0/2126174436 wait complete. 2023-11-28T11:09:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.310+0000 7f122d7d9700 1 Processor -- start 2023-11-28T11:09:47.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.311+0000 7f122d7d9700 1 -- start start 2023-11-28T11:09:47.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.311+0000 7f122d7d9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12280c5360 0x7f12280b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:47.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.311+0000 7f122d7d9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12280c5730 0x7f12280c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:47.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.311+0000 7f122d7d9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12280c40f0 0x7f12280c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:47.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.311+0000 7f122d7d9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122815c0c0 con 0x7f12280c5730 2023-11-28T11:09:47.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.311+0000 7f122d7d9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12280c4ad0 con 0x7f12280c40f0 2023-11-28T11:09:47.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.311+0000 7f122d7d9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12280c63b0 con 0x7f12280c5360 2023-11-28T11:09:47.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.311+0000 7f12267fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12280c5730 0x7f12280c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:47.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.311+0000 7f12267fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12280c5730 0x7f12280c3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59050/0 (socket says 172.21.15.125:59050) 2023-11-28T11:09:47.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.311+0000 7f12267fc700 1 -- 172.21.15.125:0/2569302309 learned_addr learned my addr 172.21.15.125:0/2569302309 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:47.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f1226ffd700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12280c5360 0x7f12280b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f12277fe700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12280c40f0 0x7f12280c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f12267fc700 1 -- 172.21.15.125:0/2569302309 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12280c5360 msgr2=0x7f12280b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f12267fc700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12280c5360 0x7f12280b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f12267fc700 1 -- 172.21.15.125:0/2569302309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12280c40f0 msgr2=0x7f12280c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f12267fc700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12280c40f0 0x7f12280c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f12267fc700 1 -- 172.21.15.125:0/2569302309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228161010 con 0x7f12280c5730 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f12277fe700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12280c40f0 0x7f12280c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f1226ffd700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12280c5360 0x7f12280b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f12267fc700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12280c5730 0x7f12280c3bb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f12180017a0 tx=0x7f12180076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f120f7fe700 1 -- 172.21.15.125:0/2569302309 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121800f870 con 0x7f12280c5730 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f120f7fe700 1 -- 172.21.15.125:0/2569302309 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121800f9f0 con 0x7f12280c5730 2023-11-28T11:09:47.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f122d7d9700 1 -- 172.21.15.125:0/2569302309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1228160d30 con 0x7f12280c5730 2023-11-28T11:09:47.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f120f7fe700 1 -- 172.21.15.125:0/2569302309 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121800fda0 con 0x7f12280c5730 2023-11-28T11:09:47.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.312+0000 7f122d7d9700 1 -- 172.21.15.125:0/2569302309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12280ceb20 con 0x7f12280c5730 2023-11-28T11:09:47.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.313+0000 7f122d7d9700 1 -- 172.21.15.125:0/2569302309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122806a640 con 0x7f12280c5730 2023-11-28T11:09:47.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.313+0000 7f120f7fe700 1 -- 172.21.15.125:0/2569302309 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f121801d460 con 0x7f12280c5730 2023-11-28T11:09:47.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.314+0000 7f120f7fe700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12140682f0 0x7f121406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:47.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.314+0000 7f1226ffd700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12140682f0 0x7f121406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:47.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.314+0000 7f120f7fe700 1 -- 172.21.15.125:0/2569302309 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f1218085c90 con 0x7f12280c5730 2023-11-28T11:09:47.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.314+0000 7f1226ffd700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12140682f0 0x7f121406a7a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f12280b57b0 tx=0x7f121c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:47.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.318+0000 7f120f7fe700 1 -- 172.21.15.125:0/2569302309 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1218052670 con 0x7f12280c5730 2023-11-28T11:09:47.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-28T11:09:47.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:47.500+0000 7f122d7d9700 1 -- 172.21.15.125:0/2569302309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f12280743f0 con 0x7f12280c5730 2023-11-28T11:09:48.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.169+0000 7f120f7fe700 1 -- 172.21.15.125:0/2569302309 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1218055c90 con 0x7f12280c5730 2023-11-28T11:09:48.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.173+0000 7f122d7d9700 1 -- 172.21.15.125:0/2569302309 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12140682f0 msgr2=0x7f121406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.173+0000 7f122d7d9700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12140682f0 0x7f121406a7a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f12280b57b0 tx=0x7f121c008040 comp rx=0 tx=0).stop 2023-11-28T11:09:48.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.173+0000 7f122d7d9700 1 -- 172.21.15.125:0/2569302309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12280c5730 msgr2=0x7f12280c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.173+0000 7f122d7d9700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12280c5730 0x7f12280c3bb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f12180017a0 tx=0x7f12180076a0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.174+0000 7f122d7d9700 1 -- 172.21.15.125:0/2569302309 shutdown_connections 2023-11-28T11:09:48.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.174+0000 7f122d7d9700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12280c40f0 0x7f12280c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.174+0000 7f122d7d9700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f12140682f0 0x7f121406a7a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.174+0000 7f122d7d9700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12280c5360 0x7f12280b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.174+0000 7f122d7d9700 1 --2- 172.21.15.125:0/2569302309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12280c5730 0x7f12280c3bb0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.174+0000 7f122d7d9700 1 -- 172.21.15.125:0/2569302309 >> 172.21.15.125:0/2569302309 conn(0x7f122806c010 msgr2=0x7f12280d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:48.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.179+0000 7f122d7d9700 1 -- 172.21.15.125:0/2569302309 shutdown_connections 2023-11-28T11:09:48.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.179+0000 7f122d7d9700 1 -- 172.21.15.125:0/2569302309 wait complete. 2023-11-28T11:09:48.185 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' created 2023-11-28T11:09:48.197 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:09:48.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.321+0000 7f45d6f5b700 1 Processor -- start 2023-11-28T11:09:48.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.321+0000 7f45d6f5b700 1 -- start start 2023-11-28T11:09:48.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.321+0000 7f45d6f5b700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f45d0158e10 0x7f45d00cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.321+0000 7f45d6f5b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f45d00ae850 0x7f45d006c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45d6f5b700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d006cda0 con 0x7f45d006c980 2023-11-28T11:09:48.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45d6f5b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d006ac30 con 0x7f45d00ae850 2023-11-28T11:09:48.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45d6f5b700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d00ca140 con 0x7f45d0158e10 2023-11-28T11:09:48.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45cffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f45d00ae850 0x7f45d006c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:48.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45cffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f45d00ae850 0x7f45d006c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59058/0 (socket says 172.21.15.125:59058) 2023-11-28T11:09:48.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45cffff700 1 -- 172.21.15.125:0/3051312033 learned_addr learned my addr 172.21.15.125:0/3051312033 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:48.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45cffff700 1 -- 172.21.15.125:0/3051312033 >> v2:172.21.15.167:3300/0 conn(0x7f45d0158e10 msgr2=0x7f45d00cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:48.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45cffff700 1 --2- 172.21.15.125:0/3051312033 >> v2:172.21.15.167:3300/0 conn(0x7f45d0158e10 0x7f45d00cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45cffff700 1 -- 172.21.15.125:0/3051312033 >> v1:172.21.15.167:6789/0 conn(0x7f45d006c980 legacy=0x7f45d015c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:48.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45cffff700 1 -- 172.21.15.125:0/3051312033 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d0071380 con 0x7f45d00ae850 2023-11-28T11:09:48.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45cffff700 1 --2- 172.21.15.125:0/3051312033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d00ae850 0x7f45d006c440 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f45d006fb70 tx=0x7f45bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc98be5a4d92765e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:48.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45cf7fe700 1 -- 172.21.15.125:0/3051312033 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc004230 con 0x7f45d00ae850 2023-11-28T11:09:48.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45cf7fe700 1 -- 172.21.15.125:0/3051312033 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc004390 con 0x7f45d00ae850 2023-11-28T11:09:48.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.322+0000 7f45cf7fe700 1 -- 172.21.15.125:0/3051312033 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0036a0 con 0x7f45d00ae850 2023-11-28T11:09:48.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.323+0000 7f45d6f5b700 1 -- 172.21.15.125:0/3051312033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d00ae850 msgr2=0x7f45d006c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.323+0000 7f45d6f5b700 1 --2- 172.21.15.125:0/3051312033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d00ae850 0x7f45d006c440 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f45d006fb70 tx=0x7f45bc009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.323+0000 7f45d6f5b700 1 -- 172.21.15.125:0/3051312033 shutdown_connections 2023-11-28T11:09:48.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.323+0000 7f45d6f5b700 1 --2- 172.21.15.125:0/3051312033 >> v2:172.21.15.167:3300/0 conn(0x7f45d0158e10 0x7f45d00cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.323+0000 7f45d6f5b700 1 --2- 172.21.15.125:0/3051312033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d00ae850 0x7f45d006c440 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.323+0000 7f45d6f5b700 1 -- 172.21.15.125:0/3051312033 >> 172.21.15.125:0/3051312033 conn(0x7f45d00cf400 msgr2=0x7f45d00cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:48.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.323+0000 7f45d6f5b700 1 -- 172.21.15.125:0/3051312033 shutdown_connections 2023-11-28T11:09:48.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.323+0000 7f45d6f5b700 1 -- 172.21.15.125:0/3051312033 wait complete. 2023-11-28T11:09:48.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.324+0000 7f45d6f5b700 1 Processor -- start 2023-11-28T11:09:48.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.324+0000 7f45d6f5b700 1 -- start start 2023-11-28T11:09:48.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.325+0000 7f45d6f5b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006c980 0x7f45d0159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.325+0000 7f45d6f5b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d00ae850 0x7f45d0159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d6f5b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d0158e10 0x7f45d01f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d6f5b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00c5bf0 con 0x7f45d0158e10 2023-11-28T11:09:48.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d6f5b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d0156f40 con 0x7f45d006c980 2023-11-28T11:09:48.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d6f5b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d0157cc0 con 0x7f45d00ae850 2023-11-28T11:09:48.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d54f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d0158e10 0x7f45d01f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:48.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d54f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d0158e10 0x7f45d01f3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59066/0 (socket says 172.21.15.125:59066) 2023-11-28T11:09:48.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d54f8700 1 -- 172.21.15.125:0/550815905 learned_addr learned my addr 172.21.15.125:0/550815905 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:48.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d4cf7700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006c980 0x7f45d0159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:48.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d54f8700 1 -- 172.21.15.125:0/550815905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d00ae850 msgr2=0x7f45d0159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d54f8700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d00ae850 0x7f45d0159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d54f8700 1 -- 172.21.15.125:0/550815905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006c980 msgr2=0x7f45d0159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d54f8700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006c980 0x7f45d0159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d54f8700 1 -- 172.21.15.125:0/550815905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc009550 con 0x7f45d0158e10 2023-11-28T11:09:48.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d4cf7700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006c980 0x7f45d0159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:48.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d54f8700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d0158e10 0x7f45d01f3d50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f45c800c7a0 tx=0x7f45c800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:48.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45cd7fa700 1 -- 172.21.15.125:0/550815905 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c8003e10 con 0x7f45d0158e10 2023-11-28T11:09:48.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45cd7fa700 1 -- 172.21.15.125:0/550815905 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c8005070 con 0x7f45d0158e10 2023-11-28T11:09:48.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d6f5b700 1 -- 172.21.15.125:0/550815905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d00c9e60 con 0x7f45d0158e10 2023-11-28T11:09:48.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45cd7fa700 1 -- 172.21.15.125:0/550815905 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c8005420 con 0x7f45d0158e10 2023-11-28T11:09:48.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.326+0000 7f45d6f5b700 1 -- 172.21.15.125:0/550815905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d00c9b80 con 0x7f45d0158e10 2023-11-28T11:09:48.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.327+0000 7f45d6f5b700 1 -- 172.21.15.125:0/550815905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d006ae20 con 0x7f45d0158e10 2023-11-28T11:09:48.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.328+0000 7f45cd7fa700 1 -- 172.21.15.125:0/550815905 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f45c8019030 con 0x7f45d0158e10 2023-11-28T11:09:48.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.328+0000 7f45cd7fa700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45b40682f0 0x7f45b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.328+0000 7f45cd7fa700 1 -- 172.21.15.125:0/550815905 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f45c80852b0 con 0x7f45d0158e10 2023-11-28T11:09:48.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.328+0000 7f45d4cf7700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45b40682f0 0x7f45b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:48.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.329+0000 7f45d4cf7700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45b40682f0 0x7f45b406a7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f45d014a220 tx=0x7f45c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:48.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.332+0000 7f45cd7fa700 1 -- 172.21.15.125:0/550815905 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f45c8051a80 con 0x7f45d0158e10 2023-11-28T11:09:48.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.559+0000 7f45d6f5b700 1 -- 172.21.15.125:0/550815905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f45d00743f0 con 0x7f45d0158e10 2023-11-28T11:09:48.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.566+0000 7f45cd7fa700 1 -- 172.21.15.125:0/550815905 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f45c80170c0 con 0x7f45d0158e10 2023-11-28T11:09:48.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.573+0000 7f45d6f5b700 1 -- 172.21.15.125:0/550815905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45b40682f0 msgr2=0x7f45b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.573+0000 7f45d6f5b700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45b40682f0 0x7f45b406a7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f45d014a220 tx=0x7f45c4008040 comp rx=0 tx=0).stop 2023-11-28T11:09:48.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.573+0000 7f45d6f5b700 1 -- 172.21.15.125:0/550815905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d0158e10 msgr2=0x7f45d01f3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.573+0000 7f45d6f5b700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d0158e10 0x7f45d01f3d50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f45c800c7a0 tx=0x7f45c800cb60 comp rx=0 tx=0).stop 2023-11-28T11:09:48.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.573+0000 7f45d6f5b700 1 -- 172.21.15.125:0/550815905 shutdown_connections 2023-11-28T11:09:48.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.573+0000 7f45d6f5b700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d0158e10 0x7f45d01f3d50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.573+0000 7f45d6f5b700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006c980 0x7f45d0159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.573+0000 7f45d6f5b700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f45b40682f0 0x7f45b406a7a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.573+0000 7f45d6f5b700 1 --2- 172.21.15.125:0/550815905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d00ae850 0x7f45d0159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.573+0000 7f45d6f5b700 1 -- 172.21.15.125:0/550815905 >> 172.21.15.125:0/550815905 conn(0x7f45d00cf400 msgr2=0x7f45d00cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:48.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.575+0000 7f45d6f5b700 1 -- 172.21.15.125:0/550815905 shutdown_connections 2023-11-28T11:09:48.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.575+0000 7f45d6f5b700 1 -- 172.21.15.125:0/550815905 wait complete. 2023-11-28T11:09:48.580 INFO:teuthology.orchestra.run.smithi125.stderr:new fs with metadata pool 5 and data pool 6 2023-11-28T11:09:48.597 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:48.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.717+0000 7f194a147700 1 Processor -- start 2023-11-28T11:09:48.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.717+0000 7f194a147700 1 -- start start 2023-11-28T11:09:48.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f194a147700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f194406a270 0x7f194406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f194a147700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f194415cc80 0x7f194406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f194a147700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194406ab80 con 0x7f194406e3a0 2023-11-28T11:09:48.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f194a147700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19440b2490 con 0x7f194406a270 2023-11-28T11:09:48.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f194a147700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19440b1810 con 0x7f194415cc80 2023-11-28T11:09:48.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f19437fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f194406a270 0x7f194406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:48.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f19437fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f194406a270 0x7f194406a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59086/0 (socket says 172.21.15.125:59086) 2023-11-28T11:09:48.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f19437fe700 1 -- 172.21.15.125:0/1991956300 learned_addr learned my addr 172.21.15.125:0/1991956300 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:48.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f1942ffd700 1 --2- 172.21.15.125:0/1991956300 >> v2:172.21.15.167:3300/0 conn(0x7f194415cc80 0x7f194406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:48.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f19437fe700 1 -- 172.21.15.125:0/1991956300 >> v2:172.21.15.167:3300/0 conn(0x7f194415cc80 msgr2=0x7f194406de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:48.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f19437fe700 1 --2- 172.21.15.125:0/1991956300 >> v2:172.21.15.167:3300/0 conn(0x7f194415cc80 0x7f194406de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f19437fe700 1 -- 172.21.15.125:0/1991956300 >> v1:172.21.15.167:6789/0 conn(0x7f194406e3a0 legacy=0x7f194406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:48.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.718+0000 7f19437fe700 1 -- 172.21.15.125:0/1991956300 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19440b1af0 con 0x7f194406a270 2023-11-28T11:09:48.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f19437fe700 1 --2- 172.21.15.125:0/1991956300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f194406a270 0x7f194406a640 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f194406c6c0 tx=0x7f192c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68586ca36928c50a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f19427fc700 1 -- 172.21.15.125:0/1991956300 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c004230 con 0x7f194406a270 2023-11-28T11:09:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f19427fc700 1 -- 172.21.15.125:0/1991956300 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c004390 con 0x7f194406a270 2023-11-28T11:09:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f19427fc700 1 -- 172.21.15.125:0/1991956300 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0036a0 con 0x7f194406a270 2023-11-28T11:09:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f194a147700 1 -- 172.21.15.125:0/1991956300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f194406a270 msgr2=0x7f194406a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f194a147700 1 --2- 172.21.15.125:0/1991956300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f194406a270 0x7f194406a640 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f194406c6c0 tx=0x7f192c009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f194a147700 1 -- 172.21.15.125:0/1991956300 shutdown_connections 2023-11-28T11:09:48.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f194a147700 1 --2- 172.21.15.125:0/1991956300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f194406a270 0x7f194406a640 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f194a147700 1 --2- 172.21.15.125:0/1991956300 >> v2:172.21.15.167:3300/0 conn(0x7f194415cc80 0x7f194406de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f194a147700 1 -- 172.21.15.125:0/1991956300 >> 172.21.15.125:0/1991956300 conn(0x7f194406c010 msgr2=0x7f19440cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:48.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f194a147700 1 -- 172.21.15.125:0/1991956300 shutdown_connections 2023-11-28T11:09:48.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.719+0000 7f194a147700 1 -- 172.21.15.125:0/1991956300 wait complete. 2023-11-28T11:09:48.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.721+0000 7f194a147700 1 Processor -- start 2023-11-28T11:09:48.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.721+0000 7f194a147700 1 -- start start 2023-11-28T11:09:48.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.721+0000 7f194a147700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f194406a270 0x7f1944153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.721+0000 7f194a147700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f194406e3a0 0x7f19441f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.721+0000 7f194a147700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194415cc80 0x7f19441e5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.721+0000 7f194a147700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19441f6020 con 0x7f194406a270 2023-11-28T11:09:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.721+0000 7f194a147700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19441f6300 con 0x7f194415cc80 2023-11-28T11:09:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.721+0000 7f194a147700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19441f3360 con 0x7f194406e3a0 2023-11-28T11:09:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f19437fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f194406a270 0x7f1944153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f19437fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f194406a270 0x7f1944153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59092/0 (socket says 172.21.15.125:59092) 2023-11-28T11:09:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f19437fe700 1 -- 172.21.15.125:0/748861097 learned_addr learned my addr 172.21.15.125:0/748861097 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f1942ffd700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f194406e3a0 0x7f19441f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:48.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f1943fff700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194415cc80 0x7f19441e5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f19437fe700 1 -- 172.21.15.125:0/748861097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f194406e3a0 msgr2=0x7f19441f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f19437fe700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f194406e3a0 0x7f19441f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f19437fe700 1 -- 172.21.15.125:0/748861097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194415cc80 msgr2=0x7f19441e5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f19437fe700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194415cc80 0x7f19441e5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f19437fe700 1 -- 172.21.15.125:0/748861097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c009550 con 0x7f194406a270 2023-11-28T11:09:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f1943fff700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194415cc80 0x7f19441e5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f19437fe700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f194406a270 0x7f1944153070 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1944067450 tx=0x7f192c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f193bfff700 1 -- 172.21.15.125:0/748861097 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c011630 con 0x7f194406a270 2023-11-28T11:09:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f193bfff700 1 -- 172.21.15.125:0/748861097 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c011790 con 0x7f194406a270 2023-11-28T11:09:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f194a147700 1 -- 172.21.15.125:0/748861097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19440b20b0 con 0x7f194406a270 2023-11-28T11:09:48.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f193bfff700 1 -- 172.21.15.125:0/748861097 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c011b40 con 0x7f194406a270 2023-11-28T11:09:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.722+0000 7f194a147700 1 -- 172.21.15.125:0/748861097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19440b1dd0 con 0x7f194406a270 2023-11-28T11:09:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.723+0000 7f194a147700 1 -- 172.21.15.125:0/748861097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194406e7c0 con 0x7f194406a270 2023-11-28T11:09:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.724+0000 7f193bfff700 1 -- 172.21.15.125:0/748861097 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f192c017020 con 0x7f194406a270 2023-11-28T11:09:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.724+0000 7f193bfff700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19240682f0 0x7f192406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.724+0000 7f193bfff700 1 -- 172.21.15.125:0/748861097 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f192c087190 con 0x7f194406a270 2023-11-28T11:09:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.724+0000 7f1942ffd700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19240682f0 0x7f192406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.724+0000 7f1942ffd700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19240682f0 0x7f192406a7a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1944153970 tx=0x7f1934008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:48.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.728+0000 7f193bfff700 1 -- 172.21.15.125:0/748861097 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f192c0539f0 con 0x7f194406a270 2023-11-28T11:09:48.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.914+0000 7f194a147700 1 -- 172.21.15.125:0/748861097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19441f31a0 con 0x7f194406a270 2023-11-28T11:09:48.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.915+0000 7f193bfff700 1 -- 172.21.15.125:0/748861097 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18040 (secure 0 0 0) 0x7f192c057010 con 0x7f194406a270 2023-11-28T11:09:48.916 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:48.916 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":37,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:48.560502+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:09:46.832058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T11:09:47.518555+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:48.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 -- 172.21.15.125:0/748861097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19240682f0 msgr2=0x7f192406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19240682f0 0x7f192406a7a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1944153970 tx=0x7f1934008040 comp rx=0 tx=0).stop 2023-11-28T11:09:48.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 -- 172.21.15.125:0/748861097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f194406a270 msgr2=0x7f1944153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:48.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f194406a270 0x7f1944153070 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1944067450 tx=0x7f192c004750 comp rx=0 tx=0).stop 2023-11-28T11:09:48.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 -- 172.21.15.125:0/748861097 shutdown_connections 2023-11-28T11:09:48.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194415cc80 0x7f19441e5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f194406a270 0x7f1944153070 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19240682f0 0x7f192406a7a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 --2- 172.21.15.125:0/748861097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f194406e3a0 0x7f19441f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:48.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 -- 172.21.15.125:0/748861097 >> 172.21.15.125:0/748861097 conn(0x7f194406c010 msgr2=0x7f19440b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:48.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 -- 172.21.15.125:0/748861097 shutdown_connections 2023-11-28T11:09:48.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:48.917+0000 7f194a147700 1 -- 172.21.15.125:0/748861097 wait complete. 2023-11-28T11:09:48.930 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:49.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.049+0000 7f7bc6ba0700 1 Processor -- start 2023-11-28T11:09:49.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.049+0000 7f7bc6ba0700 1 -- start start 2023-11-28T11:09:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bc6ba0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc015cc80 0x7f7bc006de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bc6ba0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc00b1810 con 0x7f7bc006a270 2023-11-28T11:09:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bc6ba0700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc00b1af0 con 0x7f7bc006e3a0 2023-11-28T11:09:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bc6ba0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00b2490 con 0x7f7bc015cc80 2023-11-28T11:09:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bc493c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7bc006a270 0x7f7bc006a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43224/0 (socket says 172.21.15.125:43224) 2023-11-28T11:09:49.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bc493c700 1 -- 172.21.15.125:0/4128816894 learned_addr learned my addr 172.21.15.125:0/4128816894 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815998919 0 0) 0x7f7bc00b1810 con 0x7f7bc006a270 2023-11-28T11:09:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb00035b0 con 0x7f7bc006a270 2023-11-28T11:09:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bbffff700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc015cc80 0x7f7bc006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2405786814 0 0) 0x7f7bb00035b0 con 0x7f7bc006a270 2023-11-28T11:09:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc015cc80 msgr2=0x7f7bc006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bbf7fe700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc015cc80 0x7f7bc006de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 >> v1:172.21.15.167:6789/0 conn(0x7f7bc006e3a0 legacy=0x7f7bc0070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00b1dd0 con 0x7f7bc006a270 2023-11-28T11:09:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f7bb4001670 con 0x7f7bc006a270 2023-11-28T11:09:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.050+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 >> v1:172.21.15.125:6789/0 conn(0x7f7bc006a270 legacy=0x7f7bc006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bbf7fe700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc015cc80 0x7f7bb0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bbf7fe700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb0004060 0x7f7bb0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bbf7fe700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bb0004de0 0x7f7bb0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00b2490 con 0x7f7bb0004de0 2023-11-28T11:09:49.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb000bcc0 con 0x7f7bb0004060 2023-11-28T11:09:49.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb000be80 con 0x7f7bc015cc80 2023-11-28T11:09:49.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bc513d700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bb0004de0 0x7f7bb0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bc493c700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc015cc80 0x7f7bb0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bbffff700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb0004060 0x7f7bb0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bc513d700 1 -- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc015cc80 msgr2=0x7f7bb0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:49.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bc513d700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc015cc80 0x7f7bb0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bc513d700 1 -- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb0004060 msgr2=0x7f7bb0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:49.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bc513d700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb0004060 0x7f7bb0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bc513d700 1 -- 172.21.15.125:0/4128816894 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb00035b0 con 0x7f7bb0004de0 2023-11-28T11:09:49.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bbffff700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb0004060 0x7f7bb0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:49.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bc513d700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bb0004de0 0x7f7bb0005230 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800c240 tx=0x7f7bb0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afb449640bbe8de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:49.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8001df0 con 0x7f7bb0004de0 2023-11-28T11:09:49.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb800cda0 con 0x7f7bb0004de0 2023-11-28T11:09:49.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.051+0000 7f7bbf7fe700 1 -- 172.21.15.125:0/4128816894 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8003c40 con 0x7f7bb0004de0 2023-11-28T11:09:49.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.052+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/4128816894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bb0004de0 msgr2=0x7f7bb0005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.052+0000 7f7bc6ba0700 1 --2- 172.21.15.125:0/4128816894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bb0004de0 0x7f7bb0005230 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800c240 tx=0x7f7bb0005880 comp rx=0 tx=0).stop 2023-11-28T11:09:49.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.052+0000 7f7bc513d700 1 -- 172.21.15.125:0/4128816894 reap_dead start 2023-11-28T11:09:49.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.052+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/4128816894 shutdown_connections 2023-11-28T11:09:49.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.052+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/4128816894 >> 172.21.15.125:0/4128816894 conn(0x7f7bc006c010 msgr2=0x7f7bc00cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:49.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.052+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/4128816894 shutdown_connections 2023-11-28T11:09:49.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.052+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/4128816894 wait complete. 2023-11-28T11:09:49.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.053+0000 7f7bc6ba0700 1 Processor -- start 2023-11-28T11:09:49.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.053+0000 7f7bc6ba0700 1 -- start start 2023-11-28T11:09:49.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc6ba0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bc01e89b0 0x7f7bc015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc6ba0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc00b3530 0x7f7bc00cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc6ba0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc00b3fc0 0x7f7bc00b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc6ba0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00b4970 con 0x7f7bc01e89b0 2023-11-28T11:09:49.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc6ba0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00cc280 con 0x7f7bc00b3fc0 2023-11-28T11:09:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc6ba0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00cb970 con 0x7f7bc00b3530 2023-11-28T11:09:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc493c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bc01e89b0 0x7f7bc015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc493c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bc01e89b0 0x7f7bc015c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59112/0 (socket says 172.21.15.125:59112) 2023-11-28T11:09:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc493c700 1 -- 172.21.15.125:0/2594912706 learned_addr learned my addr 172.21.15.125:0/2594912706 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc513d700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc00b3fc0 0x7f7bc00b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bbffff700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc00b3530 0x7f7bc00cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc493c700 1 -- 172.21.15.125:0/2594912706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc00b3530 msgr2=0x7f7bc00cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc493c700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc00b3530 0x7f7bc00cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc493c700 1 -- 172.21.15.125:0/2594912706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc00b3fc0 msgr2=0x7f7bc00b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc493c700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc00b3fc0 0x7f7bc00b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc493c700 1 -- 172.21.15.125:0/2594912706 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc006e7e0 con 0x7f7bc01e89b0 2023-11-28T11:09:49.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.054+0000 7f7bc493c700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bc01e89b0 0x7f7bc015c0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4007300 tx=0x7f7bb4007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:49.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.055+0000 7f7bbd7fa700 1 -- 172.21.15.125:0/2594912706 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4001470 con 0x7f7bc01e89b0 2023-11-28T11:09:49.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.055+0000 7f7bbd7fa700 1 -- 172.21.15.125:0/2594912706 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb400f610 con 0x7f7bc01e89b0 2023-11-28T11:09:49.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.055+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/2594912706 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc00b20b0 con 0x7f7bc01e89b0 2023-11-28T11:09:49.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.055+0000 7f7bbd7fa700 1 -- 172.21.15.125:0/2594912706 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400f9a0 con 0x7f7bc01e89b0 2023-11-28T11:09:49.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.055+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/2594912706 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc015daa0 con 0x7f7bc01e89b0 2023-11-28T11:09:49.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.056+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/2594912706 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc00cc560 con 0x7f7bc01e89b0 2023-11-28T11:09:49.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.056+0000 7f7bbd7fa700 1 -- 172.21.15.125:0/2594912706 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7bb400fb00 con 0x7f7bc01e89b0 2023-11-28T11:09:49.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.056+0000 7f7bbd7fa700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7ba40682f0 0x7f7ba406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.056+0000 7f7bbd7fa700 1 -- 172.21.15.125:0/2594912706 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7bb4085df0 con 0x7f7bc01e89b0 2023-11-28T11:09:49.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.056+0000 7f7bbffff700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7ba40682f0 0x7f7ba406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.057+0000 7f7bbffff700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7ba40682f0 0x7f7ba406a7a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00cb3e0 tx=0x7f7bac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:49.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.061+0000 7f7bbd7fa700 1 -- 172.21.15.125:0/2594912706 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7bb40525c0 con 0x7f7bc01e89b0 2023-11-28T11:09:49.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.246+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/2594912706 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bc00743f0 con 0x7f7bc01e89b0 2023-11-28T11:09:49.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.247+0000 7f7bbd7fa700 1 -- 172.21.15.125:0/2594912706 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18040 (secure 0 0 0) 0x7f7bb4055be0 con 0x7f7bc01e89b0 2023-11-28T11:09:49.248 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:49.248 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":37,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:48.560502+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:09:46.832058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T11:09:47.518555+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:49.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/2594912706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7ba40682f0 msgr2=0x7f7ba406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7ba40682f0 0x7f7ba406a7a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00cb3e0 tx=0x7f7bac008040 comp rx=0 tx=0).stop 2023-11-28T11:09:49.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/2594912706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bc01e89b0 msgr2=0x7f7bc015c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bc01e89b0 0x7f7bc015c0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4007300 tx=0x7f7bb4007610 comp rx=0 tx=0).stop 2023-11-28T11:09:49.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/2594912706 shutdown_connections 2023-11-28T11:09:49.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc00b3fc0 0x7f7bc00b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bc01e89b0 0x7f7bc015c0c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7ba40682f0 0x7f7ba406a7a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 --2- 172.21.15.125:0/2594912706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bc00b3530 0x7f7bc00cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/2594912706 >> 172.21.15.125:0/2594912706 conn(0x7f7bc006c010 msgr2=0x7f7bc006d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:49.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/2594912706 shutdown_connections 2023-11-28T11:09:49.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.249+0000 7f7bc6ba0700 1 -- 172.21.15.125:0/2594912706 wait complete. 2023-11-28T11:09:49.262 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:09:49.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.385+0000 7f7934b56700 1 Processor -- start 2023-11-28T11:09:49.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.385+0000 7f7934b56700 1 -- start start 2023-11-28T11:09:49.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f7934b56700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7930071890 0x7f79300ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f7934b56700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793015cc10 con 0x7f793006a980 2023-11-28T11:09:49.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f7934b56700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793006c9b0 con 0x7f79300cf710 2023-11-28T11:09:49.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f7934b56700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793006cc90 con 0x7f7930071890 2023-11-28T11:09:49.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792dd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f793006a980 0x7f7930160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43246/0 (socket says 172.21.15.125:43246) 2023-11-28T11:09:49.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792dd9b700 1 -- 172.21.15.125:0/2937223121 learned_addr learned my addr 172.21.15.125:0/2937223121 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:49.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944263771 0 0) 0x7f793015cc10 con 0x7f793006a980 2023-11-28T11:09:49.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79180035b0 con 0x7f793006a980 2023-11-28T11:09:49.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792ed9d700 1 --2- 172.21.15.125:0/2937223121 >> v2:172.21.15.167:3300/0 conn(0x7f7930071890 0x7f79300ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3205017349 0 0) 0x7f79180035b0 con 0x7f793006a980 2023-11-28T11:09:49.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 >> v2:172.21.15.167:3300/0 conn(0x7f7930071890 msgr2=0x7f79300ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:49.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 --2- 172.21.15.125:0/2937223121 >> v2:172.21.15.167:3300/0 conn(0x7f7930071890 0x7f79300ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 >> v1:172.21.15.167:6789/0 conn(0x7f79300cf710 legacy=0x7f793006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793006cf70 con 0x7f793006a980 2023-11-28T11:09:49.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f7924001670 con 0x7f793006a980 2023-11-28T11:09:49.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 >> v1:172.21.15.125:6789/0 conn(0x7f793006a980 legacy=0x7f7930160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 --2- 172.21.15.125:0/2937223121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7918003a00 0x7f7918003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 --2- 172.21.15.125:0/2937223121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7918004850 0x7f7918004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 --2- 172.21.15.125:0/2937223121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7918005320 0x7f791800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793006cc90 con 0x7f7918004850 2023-11-28T11:09:49.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791800c1e0 con 0x7f7918005320 2023-11-28T11:09:49.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.386+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791800c3a0 con 0x7f7918003a00 2023-11-28T11:09:49.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792dd9b700 1 --2- 172.21.15.125:0/2937223121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7918004850 0x7f7918004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792ed9d700 1 --2- 172.21.15.125:0/2937223121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7918005320 0x7f791800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792e59c700 1 --2- 172.21.15.125:0/2937223121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7918003a00 0x7f7918003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792dd9b700 1 -- 172.21.15.125:0/2937223121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7918003a00 msgr2=0x7f7918003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:49.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792dd9b700 1 --2- 172.21.15.125:0/2937223121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7918003a00 0x7f7918003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792dd9b700 1 -- 172.21.15.125:0/2937223121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7918005320 msgr2=0x7f791800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:49.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792dd9b700 1 --2- 172.21.15.125:0/2937223121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7918005320 0x7f791800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792ed9d700 1 -- 172.21.15.125:0/2937223121 reap_dead start 2023-11-28T11:09:49.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792dd9b700 1 -- 172.21.15.125:0/2937223121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79180035b0 con 0x7f7918004850 2023-11-28T11:09:49.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792dd9b700 1 --2- 172.21.15.125:0/2937223121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7918004850 0x7f7918004cc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f792400c240 tx=0x7f7918005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed09db0c902ef44 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:49.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924007c10 con 0x7f7918004850 2023-11-28T11:09:49.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792400cda0 con 0x7f7918004850 2023-11-28T11:09:49.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.387+0000 7f792d59a700 1 -- 172.21.15.125:0/2937223121 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924005ba0 con 0x7f7918004850 2023-11-28T11:09:49.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.388+0000 7f7934b56700 1 -- 172.21.15.125:0/2937223121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7918004850 msgr2=0x7f7918004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.388+0000 7f7934b56700 1 --2- 172.21.15.125:0/2937223121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7918004850 0x7f7918004cc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f792400c240 tx=0x7f7918005880 comp rx=0 tx=0).stop 2023-11-28T11:09:49.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.388+0000 7f7934b56700 1 -- 172.21.15.125:0/2937223121 shutdown_connections 2023-11-28T11:09:49.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.388+0000 7f7934b56700 1 --2- 172.21.15.125:0/2937223121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7918004850 0x7f7918004cc0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.388+0000 7f7934b56700 1 -- 172.21.15.125:0/2937223121 >> 172.21.15.125:0/2937223121 conn(0x7f793006c010 msgr2=0x7f79300cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:49.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.388+0000 7f7934b56700 1 -- 172.21.15.125:0/2937223121 shutdown_connections 2023-11-28T11:09:49.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.388+0000 7f7934b56700 1 -- 172.21.15.125:0/2937223121 wait complete. 2023-11-28T11:09:49.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.389+0000 7f7934b56700 1 Processor -- start 2023-11-28T11:09:49.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.389+0000 7f7934b56700 1 -- start start 2023-11-28T11:09:49.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f7934b56700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7918004850 0x7f79301f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f7934b56700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7930156980 0x7f79301ef740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f7934b56700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7930158890 0x7f7930158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f7934b56700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7930159250 con 0x7f7930156980 2023-11-28T11:09:49.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f7934b56700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79301f3360 con 0x7f7918004850 2023-11-28T11:09:49.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f7934b56700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7930156f40 con 0x7f7930158890 2023-11-28T11:09:49.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f792dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7930156980 0x7f79301ef740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f792dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7930156980 0x7f79301ef740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59134/0 (socket says 172.21.15.125:59134) 2023-11-28T11:09:49.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f792dd9b700 1 -- 172.21.15.125:0/3033683176 learned_addr learned my addr 172.21.15.125:0/3033683176 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:49.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f792e59c700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7918004850 0x7f79301f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f792ed9d700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7930158890 0x7f7930158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f792dd9b700 1 -- 172.21.15.125:0/3033683176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7930158890 msgr2=0x7f7930158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f792dd9b700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7930158890 0x7f7930158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f792dd9b700 1 -- 172.21.15.125:0/3033683176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7918004850 msgr2=0x7f79301f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:49.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f792dd9b700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7918004850 0x7f79301f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:49.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f792dd9b700 1 -- 172.21.15.125:0/3033683176 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793006d530 con 0x7f7930156980 2023-11-28T11:09:49.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.390+0000 7f792dd9b700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7930156980 0x7f79301ef740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f791800c1b0 tx=0x7f7924001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:49.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.391+0000 7f791effd700 1 -- 172.21.15.125:0/3033683176 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924000ed0 con 0x7f7930156980 2023-11-28T11:09:49.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.391+0000 7f791effd700 1 -- 172.21.15.125:0/3033683176 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7924005e40 con 0x7f7930156980 2023-11-28T11:09:49.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.391+0000 7f7934b56700 1 -- 172.21.15.125:0/3033683176 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793006d250 con 0x7f7930156980 2023-11-28T11:09:49.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.391+0000 7f791effd700 1 -- 172.21.15.125:0/3033683176 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924007310 con 0x7f7930156980 2023-11-28T11:09:49.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.391+0000 7f7934b56700 1 -- 172.21.15.125:0/3033683176 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79300ce740 con 0x7f7930156980 2023-11-28T11:09:49.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.391+0000 7f7934b56700 1 -- 172.21.15.125:0/3033683176 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79300743f0 con 0x7f7930156980 2023-11-28T11:09:49.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.392+0000 7f791effd700 1 -- 172.21.15.125:0/3033683176 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7924024070 con 0x7f7930156980 2023-11-28T11:09:49.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.392+0000 7f791effd700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79100682f0 0x7f791006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:49.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.392+0000 7f791effd700 1 -- 172.21.15.125:0/3033683176 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7924086960 con 0x7f7930156980 2023-11-28T11:09:49.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.392+0000 7f792e59c700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79100682f0 0x7f791006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:49.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.393+0000 7f792e59c700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79100682f0 0x7f791006a7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f79300aecb0 tx=0x7f7920009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:49.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.396+0000 7f791effd700 1 -- 172.21.15.125:0/3033683176 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f79240531c0 con 0x7f7930156980 2023-11-28T11:09:49.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:49.627+0000 7f7934b56700 1 -- 172.21.15.125:0/3033683176 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f79300cee00 con 0x7f7930156980 2023-11-28T11:09:50.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.581+0000 7f791effd700 1 -- 172.21.15.125:0/3033683176 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f79240170b0 con 0x7f7930156980 2023-11-28T11:09:50.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 -- 172.21.15.125:0/3033683176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79100682f0 msgr2=0x7f791006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:50.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79100682f0 0x7f791006a7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f79300aecb0 tx=0x7f7920009040 comp rx=0 tx=0).stop 2023-11-28T11:09:50.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 -- 172.21.15.125:0/3033683176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7930156980 msgr2=0x7f79301ef740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:50.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7930156980 0x7f79301ef740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f791800c1b0 tx=0x7f7924001a00 comp rx=0 tx=0).stop 2023-11-28T11:09:50.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 -- 172.21.15.125:0/3033683176 shutdown_connections 2023-11-28T11:09:50.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f79100682f0 0x7f791006a7a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:50.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7930158890 0x7f7930158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:50.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7918004850 0x7f79301f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:50.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 --2- 172.21.15.125:0/3033683176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7930156980 0x7f79301ef740 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:50.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 -- 172.21.15.125:0/3033683176 >> 172.21.15.125:0/3033683176 conn(0x7f793006c010 msgr2=0x7f793015c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:50.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 -- 172.21.15.125:0/3033683176 shutdown_connections 2023-11-28T11:09:50.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.584+0000 7f7934b56700 1 -- 172.21.15.125:0/3033683176 wait complete. 2023-11-28T11:09:50.600 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T11:09:50.600 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:09:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.729+0000 7f3f2dc4e700 1 Processor -- start 2023-11-28T11:09:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.729+0000 7f3f2dc4e700 1 -- start start 2023-11-28T11:09:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.729+0000 7f3f2dc4e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f2815a5f0 0x7f3f280d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.729+0000 7f3f2dc4e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2815a9c0 con 0x7f3f280cc200 2023-11-28T11:09:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.729+0000 7f3f2dc4e700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f280c7b80 con 0x7f3f280b2ee0 2023-11-28T11:09:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.729+0000 7f3f2dc4e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280cc990 con 0x7f3f2815a5f0 2023-11-28T11:09:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.729+0000 7f3f26ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3f280cc200 0x7f3f280b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43266/0 (socket says 172.21.15.125:43266) 2023-11-28T11:09:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.729+0000 7f3f26ffd700 1 -- 172.21.15.125:0/2933209502 learned_addr learned my addr 172.21.15.125:0/2933209502 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:50.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f277fe700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f2815a5f0 0x7f3f280d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876094840 0 0) 0x7f3f2815a9c0 con 0x7f3f280cc200 2023-11-28T11:09:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f140035b0 con 0x7f3f280cc200 2023-11-28T11:09:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254084242 0 0) 0x7f3f140035b0 con 0x7f3f280cc200 2023-11-28T11:09:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f2815a5f0 msgr2=0x7f3f280d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f2815a5f0 0x7f3f280d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 >> v1:172.21.15.167:6789/0 conn(0x7f3f280b2ee0 legacy=0x7f3f280ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280ccc70 con 0x7f3f280cc200 2023-11-28T11:09:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f3f18001670 con 0x7f3f280cc200 2023-11-28T11:09:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 >> v1:172.21.15.125:6789/0 conn(0x7f3f280cc200 legacy=0x7f3f280b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:50.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f14003a30 0x7f3f14003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140043d0 0x7f3f14004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f2815a5f0 0x7f3f140050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280cc990 con 0x7f3f14003a30 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1400ba10 con 0x7f3f140043d0 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1400bba0 con 0x7f3f2815a5f0 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f277fe700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f14003a30 0x7f3f14003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f26ffd700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140043d0 0x7f3f14004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f27fff700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f2815a5f0 0x7f3f140050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f277fe700 1 -- 172.21.15.125:0/2933209502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f2815a5f0 msgr2=0x7f3f140050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f277fe700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f2815a5f0 0x7f3f140050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f277fe700 1 -- 172.21.15.125:0/2933209502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140043d0 msgr2=0x7f3f14004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:50.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f277fe700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140043d0 0x7f3f14004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.730+0000 7f3f277fe700 1 -- 172.21.15.125:0/2933209502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f140035b0 con 0x7f3f14003a30 2023-11-28T11:09:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.731+0000 7f3f277fe700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f14003a30 0x7f3f14003e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009b60 tx=0x7f3f14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af278d09de9da3bf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.731+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000e6c0 con 0x7f3f14003a30 2023-11-28T11:09:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.731+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1000e820 con 0x7f3f14003a30 2023-11-28T11:09:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.731+0000 7f3f267fc700 1 -- 172.21.15.125:0/2933209502 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000eb90 con 0x7f3f14003a30 2023-11-28T11:09:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.731+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/2933209502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f14003a30 msgr2=0x7f3f14003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.731+0000 7f3f2dc4e700 1 --2- 172.21.15.125:0/2933209502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f14003a30 0x7f3f14003e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009b60 tx=0x7f3f14005880 comp rx=0 tx=0).stop 2023-11-28T11:09:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.731+0000 7f3f27fff700 1 -- 172.21.15.125:0/2933209502 reap_dead start 2023-11-28T11:09:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.731+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/2933209502 shutdown_connections 2023-11-28T11:09:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.731+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/2933209502 >> 172.21.15.125:0/2933209502 conn(0x7f3f2806ea80 msgr2=0x7f3f2806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:50.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.731+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/2933209502 shutdown_connections 2023-11-28T11:09:50.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.731+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/2933209502 wait complete. 2023-11-28T11:09:50.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.732+0000 7f3f2dc4e700 1 Processor -- start 2023-11-28T11:09:50.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.733+0000 7f3f2dc4e700 1 -- start start 2023-11-28T11:09:50.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.733+0000 7f3f2dc4e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f14003a30 0x7f3f28144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:50.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.733+0000 7f3f2dc4e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f281546e0 0x7f3f28154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:50.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.733+0000 7f3f2dc4e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f280ca070 0x7f3f280ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:50.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.733+0000 7f3f2dc4e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28155090 con 0x7f3f281546e0 2023-11-28T11:09:50.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.733+0000 7f3f2dc4e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2814f920 con 0x7f3f280ca070 2023-11-28T11:09:50.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.733+0000 7f3f2dc4e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2814ed10 con 0x7f3f14003a30 2023-11-28T11:09:50.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.733+0000 7f3f26ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f281546e0 0x7f3f28154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:50.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.733+0000 7f3f26ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f281546e0 0x7f3f28154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59154/0 (socket says 172.21.15.125:59154) 2023-11-28T11:09:50.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.733+0000 7f3f26ffd700 1 -- 172.21.15.125:0/624082427 learned_addr learned my addr 172.21.15.125:0/624082427 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:50.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f26ffd700 1 -- 172.21.15.125:0/624082427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f14003a30 msgr2=0x7f3f28144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:50.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f277fe700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f14003a30 0x7f3f28144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:50.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f26ffd700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f14003a30 0x7f3f28144000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:50.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f27fff700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f280ca070 0x7f3f280ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:50.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f26ffd700 1 -- 172.21.15.125:0/624082427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f280ca070 msgr2=0x7f3f280ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:50.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f26ffd700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f280ca070 0x7f3f280ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f26ffd700 1 -- 172.21.15.125:0/624082427 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280cd230 con 0x7f3f281546e0 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f26ffd700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f281546e0 0x7f3f28154b50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3f18007290 tx=0x7f3f180075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f1ffff700 1 -- 172.21.15.125:0/624082427 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18007780 con 0x7f3f281546e0 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f1ffff700 1 -- 172.21.15.125:0/624082427 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1800f8d0 con 0x7f3f281546e0 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/624082427 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f280ccf50 con 0x7f3f281546e0 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f1ffff700 1 -- 172.21.15.125:0/624082427 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800fc80 con 0x7f3f281546e0 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.734+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/624082427 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f280cd510 con 0x7f3f281546e0 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.735+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/624082427 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2814fab0 con 0x7f3f281546e0 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.735+0000 7f3f1ffff700 1 -- 172.21.15.125:0/624082427 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3f1801d460 con 0x7f3f281546e0 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.736+0000 7f3f1ffff700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3f080682f0 0x7f3f0806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.736+0000 7f3f1ffff700 1 -- 172.21.15.125:0/624082427 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f18085e30 con 0x7f3f281546e0 2023-11-28T11:09:50.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.736+0000 7f3f277fe700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3f080682f0 0x7f3f0806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:50.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.736+0000 7f3f277fe700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3f080682f0 0x7f3f0806a7a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f100090b0 tx=0x7f3f10008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:50.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.740+0000 7f3f1ffff700 1 -- 172.21.15.125:0/624082427 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3f18052630 con 0x7f3f281546e0 2023-11-28T11:09:50.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:50.969+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/624082427 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3f280743f0 con 0x7f3f281546e0 2023-11-28T11:09:51.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.584+0000 7f3f1ffff700 1 -- 172.21.15.125:0/624082427 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3f18055c50 con 0x7f3f281546e0 2023-11-28T11:09:51.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/624082427 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3f080682f0 msgr2=0x7f3f0806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:51.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3f080682f0 0x7f3f0806a7a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f100090b0 tx=0x7f3f10008030 comp rx=0 tx=0).stop 2023-11-28T11:09:51.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/624082427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f281546e0 msgr2=0x7f3f28154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:51.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f281546e0 0x7f3f28154b50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3f18007290 tx=0x7f3f180075a0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/624082427 shutdown_connections 2023-11-28T11:09:51.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f280ca070 0x7f3f280ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3f080682f0 0x7f3f0806a7a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f14003a30 0x7f3f28144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 --2- 172.21.15.125:0/624082427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f281546e0 0x7f3f28154b50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/624082427 >> 172.21.15.125:0/624082427 conn(0x7f3f2806ea80 msgr2=0x7f3f280d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:51.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/624082427 shutdown_connections 2023-11-28T11:09:51.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.586+0000 7f3f2dc4e700 1 -- 172.21.15.125:0/624082427 wait complete. 2023-11-28T11:09:51.601 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:09:51.601 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:09:51.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.726+0000 7f519483c700 1 Processor -- start 2023-11-28T11:09:51.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.726+0000 7f519483c700 1 -- start start 2023-11-28T11:09:51.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f519483c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51900cff90 0x7f519015f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:51.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f519483c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51900cfb00 con 0x7f5190071f70 2023-11-28T11:09:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f519483c700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519015aa20 con 0x7f51900b4660 2023-11-28T11:09:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f519483c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51900cf4d0 con 0x7f51900cff90 2023-11-28T11:09:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f518ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51900cff90 0x7f519015f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f518ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f51900cff90 0x7f519015f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59164/0 (socket says 172.21.15.125:59164) 2023-11-28T11:09:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f518dd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5190071f70 0x7f51900b4a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43286/0 (socket says 172.21.15.125:43286) 2023-11-28T11:09:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f518ed9d700 1 -- 172.21.15.125:0/4153491636 learned_addr learned my addr 172.21.15.125:0/4153491636 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f518ed9d700 1 -- 172.21.15.125:0/4153491636 >> v1:172.21.15.167:6789/0 conn(0x7f51900b4660 legacy=0x7f519006b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f518ed9d700 1 -- 172.21.15.125:0/4153491636 >> v1:172.21.15.125:6789/0 conn(0x7f5190071f70 legacy=0x7f51900b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f518ed9d700 1 -- 172.21.15.125:0/4153491636 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5190072550 con 0x7f51900cff90 2023-11-28T11:09:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f518d59a700 1 -- 172.21.15.125:0/4153491636 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301231828 0 0) 0x7f51900cfb00 con 0x7f5190071f70 2023-11-28T11:09:51.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f518ed9d700 1 --2- 172.21.15.125:0/4153491636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51900cff90 0x7f519015f170 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5188009e50 tx=0x7f518800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8e080303283adc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f518d59a700 1 -- 172.21.15.125:0/4153491636 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518800e070 con 0x7f51900cff90 2023-11-28T11:09:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.727+0000 7f518d59a700 1 -- 172.21.15.125:0/4153491636 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188003a20 con 0x7f51900cff90 2023-11-28T11:09:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.728+0000 7f518d59a700 1 -- 172.21.15.125:0/4153491636 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188003dd0 con 0x7f51900cff90 2023-11-28T11:09:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.728+0000 7f519483c700 1 -- 172.21.15.125:0/4153491636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51900cff90 msgr2=0x7f519015f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.728+0000 7f519483c700 1 --2- 172.21.15.125:0/4153491636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51900cff90 0x7f519015f170 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5188009e50 tx=0x7f518800b330 comp rx=0 tx=0).stop 2023-11-28T11:09:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.728+0000 7f519483c700 1 -- 172.21.15.125:0/4153491636 shutdown_connections 2023-11-28T11:09:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.728+0000 7f519483c700 1 --2- 172.21.15.125:0/4153491636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51900cff90 0x7f519015f170 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.728+0000 7f519483c700 1 -- 172.21.15.125:0/4153491636 >> 172.21.15.125:0/4153491636 conn(0x7f51900b2fc0 msgr2=0x7f5190071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.728+0000 7f519483c700 1 -- 172.21.15.125:0/4153491636 shutdown_connections 2023-11-28T11:09:51.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.728+0000 7f519483c700 1 -- 172.21.15.125:0/4153491636 wait complete. 2023-11-28T11:09:51.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.729+0000 7f519483c700 1 Processor -- start 2023-11-28T11:09:51.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.729+0000 7f519483c700 1 -- start start 2023-11-28T11:09:51.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.730+0000 7f519483c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5190071f70 0x7f51901491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:51.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.730+0000 7f519483c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51900b4660 0x7f51900ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:51.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.730+0000 7f519483c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51900cff90 0x7f51900ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:51.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.730+0000 7f519483c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51901496e0 con 0x7f5190071f70 2023-11-28T11:09:51.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.730+0000 7f519483c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51900c3df0 con 0x7f51900b4660 2023-11-28T11:09:51.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.730+0000 7f519483c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519015d7a0 con 0x7f51900cff90 2023-11-28T11:09:51.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.730+0000 7f518e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5190071f70 0x7f51901491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:51.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.730+0000 7f518e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5190071f70 0x7f51901491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59166/0 (socket says 172.21.15.125:59166) 2023-11-28T11:09:51.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.730+0000 7f518e59c700 1 -- 172.21.15.125:0/3933619637 learned_addr learned my addr 172.21.15.125:0/3933619637 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:51.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.730+0000 7f518dd9b700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51900b4660 0x7f51900ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:51.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f518e59c700 1 -- 172.21.15.125:0/3933619637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51900cff90 msgr2=0x7f51900ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:51.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f518e59c700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51900cff90 0x7f51900ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f518e59c700 1 -- 172.21.15.125:0/3933619637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51900b4660 msgr2=0x7f51900ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:51.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f518e59c700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51900b4660 0x7f51900ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f518e59c700 1 -- 172.21.15.125:0/3933619637 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5188009b30 con 0x7f5190071f70 2023-11-28T11:09:51.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f518dd9b700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51900b4660 0x7f51900ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:51.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f518e59c700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5190071f70 0x7f51901491a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f518000c4d0 tx=0x7f518000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:51.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f517effd700 1 -- 172.21.15.125:0/3933619637 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180011790 con 0x7f5190071f70 2023-11-28T11:09:51.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f517effd700 1 -- 172.21.15.125:0/3933619637 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51800118f0 con 0x7f5190071f70 2023-11-28T11:09:51.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f519483c700 1 -- 172.21.15.125:0/3933619637 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51900b5140 con 0x7f5190071f70 2023-11-28T11:09:51.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f517effd700 1 -- 172.21.15.125:0/3933619637 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180011ca0 con 0x7f5190071f70 2023-11-28T11:09:51.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.731+0000 7f519483c700 1 -- 172.21.15.125:0/3933619637 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51900cf790 con 0x7f5190071f70 2023-11-28T11:09:51.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.732+0000 7f519483c700 1 -- 172.21.15.125:0/3933619637 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519015f6b0 con 0x7f5190071f70 2023-11-28T11:09:51.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.732+0000 7f517effd700 1 -- 172.21.15.125:0/3933619637 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5180010050 con 0x7f5190071f70 2023-11-28T11:09:51.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.733+0000 7f517effd700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51700682f0 0x7f517006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:51.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.733+0000 7f517effd700 1 -- 172.21.15.125:0/3933619637 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5180085980 con 0x7f5190071f70 2023-11-28T11:09:51.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.733+0000 7f518dd9b700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51700682f0 0x7f517006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:51.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.733+0000 7f518dd9b700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51700682f0 0x7f517006a7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f51900c5af0 tx=0x7f5184009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:51.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.737+0000 7f517effd700 1 -- 172.21.15.125:0/3933619637 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f51800521e0 con 0x7f5190071f70 2023-11-28T11:09:51.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.963+0000 7f519483c700 1 -- 172.21.15.125:0/3933619637 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51900743f0 con 0x7f5190071f70 2023-11-28T11:09:51.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.964+0000 7f517effd700 1 -- 172.21.15.125:0/3933619637 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f5180085020 con 0x7f5190071f70 2023-11-28T11:09:51.965 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:51.965 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1240521006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1240521006},{"type":"v1","addr":"172.21.15.167:6834","nonce":1240521006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2122606110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2122606110},{"type":"v1","addr":"172.21.15.167:6835","nonce":2122606110}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5280,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/888812458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":888812458},{"type":"v1","addr":"172.21.15.125:6835","nonce":888812458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:09:48.560821+0000","modified":"2023-11-28T11:09:51.580459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/2632892245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2632892245},{"type":"v1","addr":"172.21.15.125:6837","nonce":2632892245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:09:51.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 -- 172.21.15.125:0/3933619637 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51700682f0 msgr2=0x7f517006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:51.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51700682f0 0x7f517006a7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f51900c5af0 tx=0x7f5184009040 comp rx=0 tx=0).stop 2023-11-28T11:09:51.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 -- 172.21.15.125:0/3933619637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5190071f70 msgr2=0x7f51901491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:51.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5190071f70 0x7f51901491a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f518000c4d0 tx=0x7f518000c890 comp rx=0 tx=0).stop 2023-11-28T11:09:51.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 -- 172.21.15.125:0/3933619637 shutdown_connections 2023-11-28T11:09:51.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f51700682f0 0x7f517006a7a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51900cff90 0x7f51900ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5190071f70 0x7f51901491a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 --2- 172.21.15.125:0/3933619637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51900b4660 0x7f51900ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:51.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 -- 172.21.15.125:0/3933619637 >> 172.21.15.125:0/3933619637 conn(0x7f51900b2fc0 msgr2=0x7f51900b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:51.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 -- 172.21.15.125:0/3933619637 shutdown_connections 2023-11-28T11:09:51.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:51.966+0000 7f519483c700 1 -- 172.21.15.125:0/3933619637 wait complete. 2023-11-28T11:09:51.968 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 16 2023-11-28T11:09:51.979 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:52.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.098+0000 7fc8cc04a700 1 Processor -- start 2023-11-28T11:09:52.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.098+0000 7fc8cc04a700 1 -- start start 2023-11-28T11:09:52.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8cc04a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc8c40d15f0 0x7fc8c415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8cc04a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8c415e010 0x7fc8c40ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8cc04a700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c415af30 con 0x7fc8c406e400 2023-11-28T11:09:52.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8cc04a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c415a9d0 con 0x7fc8c40d15f0 2023-11-28T11:09:52.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8cc04a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c41584e0 con 0x7fc8c415e010 2023-11-28T11:09:52.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8c95e5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc8c40d15f0 0x7fc8c415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8c95e5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc8c40d15f0 0x7fc8c415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59176/0 (socket says 172.21.15.125:59176) 2023-11-28T11:09:52.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8c95e5700 1 -- 172.21.15.125:0/2556189496 learned_addr learned my addr 172.21.15.125:0/2556189496 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:52.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8ca5e7700 1 --2- 172.21.15.125:0/2556189496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8c415e010 0x7fc8c40ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8c95e5700 1 -- 172.21.15.125:0/2556189496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8c415e010 msgr2=0x7fc8c40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:52.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8c95e5700 1 --2- 172.21.15.125:0/2556189496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8c415e010 0x7fc8c40ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8c95e5700 1 -- 172.21.15.125:0/2556189496 >> v1:172.21.15.167:6789/0 conn(0x7fc8c406e400 legacy=0x7fc8c406e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8c95e5700 1 -- 172.21.15.125:0/2556189496 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c415ef40 con 0x7fc8c40d15f0 2023-11-28T11:09:52.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8c95e5700 1 --2- 172.21.15.125:0/2556189496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c40d15f0 0x7fc8c415b3c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000dd10 tx=0x7fc8c000f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e1c3a9f2665763 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:52.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8c8de4700 1 -- 172.21.15.125:0/2556189496 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0012070 con 0x7fc8c40d15f0 2023-11-28T11:09:52.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8c8de4700 1 -- 172.21.15.125:0/2556189496 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c000d2e0 con 0x7fc8c40d15f0 2023-11-28T11:09:52.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.099+0000 7fc8c8de4700 1 -- 172.21.15.125:0/2556189496 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000fbc0 con 0x7fc8c40d15f0 2023-11-28T11:09:52.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.100+0000 7fc8cc04a700 1 -- 172.21.15.125:0/2556189496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c40d15f0 msgr2=0x7fc8c415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.100+0000 7fc8cc04a700 1 --2- 172.21.15.125:0/2556189496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c40d15f0 0x7fc8c415b3c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000dd10 tx=0x7fc8c000f330 comp rx=0 tx=0).stop 2023-11-28T11:09:52.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.100+0000 7fc8cc04a700 1 -- 172.21.15.125:0/2556189496 shutdown_connections 2023-11-28T11:09:52.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.100+0000 7fc8cc04a700 1 --2- 172.21.15.125:0/2556189496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8c415e010 0x7fc8c40ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.100+0000 7fc8cc04a700 1 --2- 172.21.15.125:0/2556189496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c40d15f0 0x7fc8c415b3c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.100+0000 7fc8cc04a700 1 -- 172.21.15.125:0/2556189496 >> 172.21.15.125:0/2556189496 conn(0x7fc8c406a270 msgr2=0x7fc8c406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:52.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.100+0000 7fc8cc04a700 1 -- 172.21.15.125:0/2556189496 shutdown_connections 2023-11-28T11:09:52.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.100+0000 7fc8cc04a700 1 -- 172.21.15.125:0/2556189496 wait complete. 2023-11-28T11:09:52.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.101+0000 7fc8cc04a700 1 Processor -- start 2023-11-28T11:09:52.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.101+0000 7fc8cc04a700 1 -- start start 2023-11-28T11:09:52.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8cc04a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c406e400 0x7fc8c41491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8cc04a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c40d15f0 0x7fc8c4152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8cc04a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8c415e010 0x7fc8c4153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8cc04a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40d1450 con 0x7fc8c40d15f0 2023-11-28T11:09:52.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8cc04a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40b33c0 con 0x7fc8c406e400 2023-11-28T11:09:52.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8cc04a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40d0690 con 0x7fc8c415e010 2023-11-28T11:09:52.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8c95e5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c40d15f0 0x7fc8c4152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8c95e5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c40d15f0 0x7fc8c4152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59182/0 (socket says 172.21.15.125:59182) 2023-11-28T11:09:52.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8c95e5700 1 -- 172.21.15.125:0/3194647081 learned_addr learned my addr 172.21.15.125:0/3194647081 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:52.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8c9de6700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c406e400 0x7fc8c41491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8ca5e7700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8c415e010 0x7fc8c4153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8c95e5700 1 -- 172.21.15.125:0/3194647081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8c415e010 msgr2=0x7fc8c4153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8c95e5700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8c415e010 0x7fc8c4153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8c95e5700 1 -- 172.21.15.125:0/3194647081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c406e400 msgr2=0x7fc8c41491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8c95e5700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c406e400 0x7fc8c41491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8c95e5700 1 -- 172.21.15.125:0/3194647081 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c000d9f0 con 0x7fc8c40d15f0 2023-11-28T11:09:52.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.102+0000 7fc8c9de6700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c406e400 0x7fc8c41491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:52.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.103+0000 7fc8c95e5700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c40d15f0 0x7fc8c4152ce0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000f370 tx=0x7fc8c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:52.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.103+0000 7fc8b67fc700 1 -- 172.21.15.125:0/3194647081 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00036a0 con 0x7fc8c40d15f0 2023-11-28T11:09:52.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.103+0000 7fc8b67fc700 1 -- 172.21.15.125:0/3194647081 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c0003800 con 0x7fc8c40d15f0 2023-11-28T11:09:52.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.103+0000 7fc8b67fc700 1 -- 172.21.15.125:0/3194647081 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0003b90 con 0x7fc8c40d15f0 2023-11-28T11:09:52.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.103+0000 7fc8cc04a700 1 -- 172.21.15.125:0/3194647081 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c415ec60 con 0x7fc8c40d15f0 2023-11-28T11:09:52.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.103+0000 7fc8cc04a700 1 -- 172.21.15.125:0/3194647081 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c415e980 con 0x7fc8c40d15f0 2023-11-28T11:09:52.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.104+0000 7fc8cc04a700 1 -- 172.21.15.125:0/3194647081 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c415abc0 con 0x7fc8c40d15f0 2023-11-28T11:09:52.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.104+0000 7fc8b67fc700 1 -- 172.21.15.125:0/3194647081 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc8c0003cf0 con 0x7fc8c40d15f0 2023-11-28T11:09:52.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.105+0000 7fc8b67fc700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc8a80682f0 0x7fc8a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.105+0000 7fc8c9de6700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc8a80682f0 0x7fc8a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.105+0000 7fc8b67fc700 1 -- 172.21.15.125:0/3194647081 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8c008b400 con 0x7fc8c40d15f0 2023-11-28T11:09:52.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.105+0000 7fc8c9de6700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc8a80682f0 0x7fc8a806a7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8000f60 tx=0x7fc8b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:52.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.109+0000 7fc8b67fc700 1 -- 172.21.15.125:0/3194647081 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc8c0057be0 con 0x7fc8c40d15f0 2023-11-28T11:09:52.153 INFO:tasks.ceph.mds.a.smithi125.stderr:2023-11-28T11:09:52.152+0000 7fa62231d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:09:52.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.295+0000 7fc8cc04a700 1 -- 172.21.15.125:0/3194647081 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8c40743f0 con 0x7fc8c40d15f0 2023-11-28T11:09:52.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.297+0000 7fc8b67fc700 1 -- 172.21.15.125:0/3194647081 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18027 (secure 0 0 0) 0x7fc8c005b200 con 0x7fc8c40d15f0 2023-11-28T11:09:52.297 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:52.297 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":38,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:49.562761+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:09:46.832058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T11:09:47.518555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:52.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.298+0000 7fc8cc04a700 1 -- 172.21.15.125:0/3194647081 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc8a80682f0 msgr2=0x7fc8a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.298+0000 7fc8cc04a700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc8a80682f0 0x7fc8a806a7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8000f60 tx=0x7fc8b8009040 comp rx=0 tx=0).stop 2023-11-28T11:09:52.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.298+0000 7fc8cc04a700 1 -- 172.21.15.125:0/3194647081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c40d15f0 msgr2=0x7fc8c4152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.298+0000 7fc8cc04a700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c40d15f0 0x7fc8c4152ce0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000f370 tx=0x7fc8c0004750 comp rx=0 tx=0).stop 2023-11-28T11:09:52.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.298+0000 7fc8cc04a700 1 -- 172.21.15.125:0/3194647081 shutdown_connections 2023-11-28T11:09:52.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.298+0000 7fc8cc04a700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc8a80682f0 0x7fc8a806a7a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.298+0000 7fc8cc04a700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8c415e010 0x7fc8c4153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.298+0000 7fc8cc04a700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8c406e400 0x7fc8c41491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.298+0000 7fc8cc04a700 1 --2- 172.21.15.125:0/3194647081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8c40d15f0 0x7fc8c4152ce0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.298+0000 7fc8cc04a700 1 -- 172.21.15.125:0/3194647081 >> 172.21.15.125:0/3194647081 conn(0x7fc8c406a270 msgr2=0x7fc8c41599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:52.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.299+0000 7fc8cc04a700 1 -- 172.21.15.125:0/3194647081 shutdown_connections 2023-11-28T11:09:52.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.299+0000 7fc8cc04a700 1 -- 172.21.15.125:0/3194647081 wait complete. 2023-11-28T11:09:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:09:52.311 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:09:52.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.431+0000 7fbc5cd97700 1 Processor -- start 2023-11-28T11:09:52.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.431+0000 7fbc5cd97700 1 -- start start 2023-11-28T11:09:52.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.432+0000 7fbc5cd97700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbc580ce040 0x7fbc5815d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.432+0000 7fbc5cd97700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbc580b1770 0x7fbc580b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.432+0000 7fbc5cd97700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5813fc90 con 0x7fbc58142db0 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.432+0000 7fbc5cd97700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5813f480 con 0x7fbc580ce040 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.432+0000 7fbc5cd97700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc580b20d0 con 0x7fbc580b1770 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.432+0000 7fbc5659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbc580ce040 0x7fbc5815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.432+0000 7fbc5659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbc580ce040 0x7fbc5815d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59188/0 (socket says 172.21.15.125:59188) 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.432+0000 7fbc5659c700 1 -- 172.21.15.125:0/1196428155 learned_addr learned my addr 172.21.15.125:0/1196428155 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.432+0000 7fbc56d9d700 1 --2- 172.21.15.125:0/1196428155 >> v2:172.21.15.167:3300/0 conn(0x7fbc580b1770 0x7fbc580b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.433+0000 7fbc5659c700 1 -- 172.21.15.125:0/1196428155 >> v2:172.21.15.167:3300/0 conn(0x7fbc580b1770 msgr2=0x7fbc580b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.433+0000 7fbc5659c700 1 --2- 172.21.15.125:0/1196428155 >> v2:172.21.15.167:3300/0 conn(0x7fbc580b1770 0x7fbc580b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.433+0000 7fbc5659c700 1 -- 172.21.15.125:0/1196428155 >> v1:172.21.15.167:6789/0 conn(0x7fbc58142db0 legacy=0x7fbc5813ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.433+0000 7fbc5659c700 1 -- 172.21.15.125:0/1196428155 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5813f6d0 con 0x7fbc580ce040 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.433+0000 7fbc5659c700 1 --2- 172.21.15.125:0/1196428155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc580ce040 0x7fbc5815d900 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbc58142cd0 tx=0x7fbc4c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffaa981633295fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:52.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.433+0000 7fbc5559a700 1 -- 172.21.15.125:0/1196428155 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00dd30 con 0x7fbc580ce040 2023-11-28T11:09:52.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.433+0000 7fbc5559a700 1 -- 172.21.15.125:0/1196428155 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c00de90 con 0x7fbc580ce040 2023-11-28T11:09:52.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.433+0000 7fbc5559a700 1 -- 172.21.15.125:0/1196428155 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c010690 con 0x7fbc580ce040 2023-11-28T11:09:52.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.433+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1196428155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc580ce040 msgr2=0x7fbc5815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.433+0000 7fbc5cd97700 1 --2- 172.21.15.125:0/1196428155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc580ce040 0x7fbc5815d900 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbc58142cd0 tx=0x7fbc4c00be70 comp rx=0 tx=0).stop 2023-11-28T11:09:52.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.434+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1196428155 shutdown_connections 2023-11-28T11:09:52.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.434+0000 7fbc5cd97700 1 --2- 172.21.15.125:0/1196428155 >> v2:172.21.15.167:3300/0 conn(0x7fbc580b1770 0x7fbc580b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.434+0000 7fbc5cd97700 1 --2- 172.21.15.125:0/1196428155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc580ce040 0x7fbc5815d900 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.434+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1196428155 >> 172.21.15.125:0/1196428155 conn(0x7fbc5806c010 msgr2=0x7fbc580cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:52.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.434+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1196428155 shutdown_connections 2023-11-28T11:09:52.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.434+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1196428155 wait complete. 2023-11-28T11:09:52.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.435+0000 7fbc5cd97700 1 Processor -- start 2023-11-28T11:09:52.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.435+0000 7fbc5cd97700 1 -- start start 2023-11-28T11:09:52.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5cd97700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc580b1770 0x7fbc580b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5cd97700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc580ce040 0x7fbc58139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5cd97700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc58142db0 0x7fbc581efd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5cd97700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc581f02c0 con 0x7fbc580b1770 2023-11-28T11:09:52.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5cd97700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc580b4150 con 0x7fbc580ce040 2023-11-28T11:09:52.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5cd97700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc580b4430 con 0x7fbc58142db0 2023-11-28T11:09:52.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc580b1770 0x7fbc580b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc580b1770 0x7fbc580b3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59194/0 (socket says 172.21.15.125:59194) 2023-11-28T11:09:52.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5659c700 1 -- 172.21.15.125:0/1232260953 learned_addr learned my addr 172.21.15.125:0/1232260953 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:52.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5659c700 1 -- 172.21.15.125:0/1232260953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc58142db0 msgr2=0x7fbc581efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5659c700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc58142db0 0x7fbc581efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5659c700 1 -- 172.21.15.125:0/1232260953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc580ce040 msgr2=0x7fbc58139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc55d9b700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc580ce040 0x7fbc58139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5659c700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc580ce040 0x7fbc58139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5659c700 1 -- 172.21.15.125:0/1232260953 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c00b7f0 con 0x7fbc580b1770 2023-11-28T11:09:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc55d9b700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc580ce040 0x7fbc58139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5659c700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc580b1770 0x7fbc580b3b70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c000c00 tx=0x7fbc4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc46ffd700 1 -- 172.21.15.125:0/1232260953 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c003da0 con 0x7fbc580b1770 2023-11-28T11:09:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc46ffd700 1 -- 172.21.15.125:0/1232260953 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c010470 con 0x7fbc580b1770 2023-11-28T11:09:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1232260953 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5815d100 con 0x7fbc580b1770 2023-11-28T11:09:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.436+0000 7fbc46ffd700 1 -- 172.21.15.125:0/1232260953 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c010820 con 0x7fbc580b1770 2023-11-28T11:09:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.437+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1232260953 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5813f9b0 con 0x7fbc580b1770 2023-11-28T11:09:52.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.437+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1232260953 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5815d3e0 con 0x7fbc580b1770 2023-11-28T11:09:52.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.438+0000 7fbc46ffd700 1 -- 172.21.15.125:0/1232260953 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbc4c019400 con 0x7fbc580b1770 2023-11-28T11:09:52.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.438+0000 7fbc46ffd700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbc380682f0 0x7fbc3806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.438+0000 7fbc46ffd700 1 -- 172.21.15.125:0/1232260953 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc4c0872c0 con 0x7fbc580b1770 2023-11-28T11:09:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.438+0000 7fbc55d9b700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbc380682f0 0x7fbc3806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.439+0000 7fbc55d9b700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbc380682f0 0x7fbc3806a7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc58140e20 tx=0x7fbc48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:52.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.442+0000 7fbc46ffd700 1 -- 172.21.15.125:0/1232260953 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbc4c053ac0 con 0x7fbc580b1770 2023-11-28T11:09:52.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.622+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1232260953 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc580743f0 con 0x7fbc380682f0 2023-11-28T11:09:52.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.630+0000 7fbc46ffd700 1 -- 172.21.15.125:0/1232260953 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310805 (secure 0 0 0) 0x7fbc580743f0 con 0x7fbc380682f0 2023-11-28T11:09:52.635 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:52.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1232260953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbc380682f0 msgr2=0x7fbc3806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbc380682f0 0x7fbc3806a7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc58140e20 tx=0x7fbc48009040 comp rx=0 tx=0).stop 2023-11-28T11:09:52.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1232260953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc580b1770 msgr2=0x7fbc580b3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc580b1770 0x7fbc580b3b70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c000c00 tx=0x7fbc4c004750 comp rx=0 tx=0).stop 2023-11-28T11:09:52.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1232260953 shutdown_connections 2023-11-28T11:09:52.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbc380682f0 0x7fbc3806a7a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc58142db0 0x7fbc581efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc580b1770 0x7fbc580b3b70 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 --2- 172.21.15.125:0/1232260953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc580ce040 0x7fbc58139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1232260953 >> 172.21.15.125:0/1232260953 conn(0x7fbc5806c010 msgr2=0x7fbc5813ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:52.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1232260953 shutdown_connections 2023-11-28T11:09:52.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.634+0000 7fbc5cd97700 1 -- 172.21.15.125:0/1232260953 wait complete. 2023-11-28T11:09:52.638 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:09:52.647 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-11-28T11:09:51.637012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70120,"kb_used_data":4520,"kb_used_omap":0,"kb_used_meta":65536,"kb_avail":754904600,"statfs":{"total":773094113280,"available":773022310400,"internally_reserved":0,"allocated":4628480,"data_stored":2572644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67108864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.476138"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.587267+0000","last_change":"2023-11-28T11:09:48.580257+0000","last_active":"2023-11-28T11:09:48.587267+0000","last_peered":"2023-11-28T11:09:48.587267+0000","last_clean":"2023-11-28T11:09:48.587267+0000","last_became_active":"2023-11-28T11:09:48.579973+0000","last_became_peered":"2023-11-28T11:09:48.579973+0000","last_unstale":"2023-11-28T11:09:48.587267+0000","last_undegraded":"2023-11-28T11:09:48.587267+0000","last_fullsized":"2023-11-28T11:09:48.587267+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:50.325791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.589288+0000","last_change":"2023-11-28T11:09:48.580645+0000","last_active":"2023-11-28T11:09:48.589288+0000","last_peered":"2023-11-28T11:09:48.589288+0000","last_clean":"2023-11-28T11:09:48.589288+0000","last_became_active":"2023-11-28T11:09:48.580391+0000","last_became_peered":"2023-11-28T11:09:48.580391+0000","last_unstale":"2023-11-28T11:09:48.589288+0000","last_undegraded":"2023-11-28T11:09:48.589288+0000","last_fullsized":"2023-11-28T11:09:48.589288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:28.967311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573642+0000","last_change":"2023-11-28T11:09:48.576951+0000","last_active":"2023-11-28T11:09:49.573642+0000","last_peered":"2023-11-28T11:09:49.573642+0000","last_clean":"2023-11-28T11:09:49.573642+0000","last_became_active":"2023-11-28T11:09:48.576707+0000","last_became_peered":"2023-11-28T11:09:48.576707+0000","last_unstale":"2023-11-28T11:09:49.573642+0000","last_undegraded":"2023-11-28T11:09:49.573642+0000","last_fullsized":"2023-11-28T11:09:49.573642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:08:36.534645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.598420+0000","last_change":"2023-11-28T11:09:48.593390+0000","last_active":"2023-11-28T11:09:48.598420+0000","last_peered":"2023-11-28T11:09:48.598420+0000","last_clean":"2023-11-28T11:09:48.598420+0000","last_became_active":"2023-11-28T11:09:48.593102+0000","last_became_peered":"2023-11-28T11:09:48.593102+0000","last_unstale":"2023-11-28T11:09:48.598420+0000","last_undegraded":"2023-11-28T11:09:48.598420+0000","last_fullsized":"2023-11-28T11:09:48.598420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:54.735354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.587965+0000","last_change":"2023-11-28T11:09:48.585732+0000","last_active":"2023-11-28T11:09:48.587965+0000","last_peered":"2023-11-28T11:09:48.587965+0000","last_clean":"2023-11-28T11:09:48.587965+0000","last_became_active":"2023-11-28T11:09:48.585458+0000","last_became_peered":"2023-11-28T11:09:48.585458+0000","last_unstale":"2023-11-28T11:09:48.587965+0000","last_undegraded":"2023-11-28T11:09:48.587965+0000","last_fullsized":"2023-11-28T11:09:48.587965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:53.096028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.583305+0000","last_change":"2023-11-28T11:09:48.580552+0000","last_active":"2023-11-28T11:09:48.583305+0000","last_peered":"2023-11-28T11:09:48.583305+0000","last_clean":"2023-11-28T11:09:48.583305+0000","last_became_active":"2023-11-28T11:09:48.580256+0000","last_became_peered":"2023-11-28T11:09:48.580256+0000","last_unstale":"2023-11-28T11:09:48.583305+0000","last_undegraded":"2023-11-28T11:09:48.583305+0000","last_fullsized":"2023-11-28T11:09:48.583305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:56:44.281252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578383+0000","last_change":"2023-11-28T11:09:48.586694+0000","last_active":"2023-11-28T11:09:49.578383+0000","last_peered":"2023-11-28T11:09:49.578383+0000","last_clean":"2023-11-28T11:09:49.578383+0000","last_became_active":"2023-11-28T11:09:48.586400+0000","last_became_peered":"2023-11-28T11:09:48.586400+0000","last_unstale":"2023-11-28T11:09:49.578383+0000","last_undegraded":"2023-11-28T11:09:49.578383+0000","last_fullsized":"2023-11-28T11:09:49.578383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:04.796156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588071+0000","last_change":"2023-11-28T11:09:48.581735+0000","last_active":"2023-11-28T11:09:48.588071+0000","last_peered":"2023-11-28T11:09:48.588071+0000","last_clean":"2023-11-28T11:09:48.588071+0000","last_became_active":"2023-11-28T11:09:48.581473+0000","last_became_peered":"2023-11-28T11:09:48.581473+0000","last_unstale":"2023-11-28T11:09:48.588071+0000","last_undegraded":"2023-11-28T11:09:48.588071+0000","last_fullsized":"2023-11-28T11:09:48.588071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:21.386929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573750+0000","last_change":"2023-11-28T11:09:48.576937+0000","last_active":"2023-11-28T11:09:49.573750+0000","last_peered":"2023-11-28T11:09:49.573750+0000","last_clean":"2023-11-28T11:09:49.573750+0000","last_became_active":"2023-11-28T11:09:48.576652+0000","last_became_peered":"2023-11-28T11:09:48.576652+0000","last_unstale":"2023-11-28T11:09:49.573750+0000","last_undegraded":"2023-11-28T11:09:49.573750+0000","last_fullsized":"2023-11-28T11:09:49.573750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:02:19.387894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578994+0000","last_change":"2023-11-28T11:09:48.575353+0000","last_active":"2023-11-28T11:09:49.578994+0000","last_peered":"2023-11-28T11:09:49.578994+0000","last_clean":"2023-11-28T11:09:49.578994+0000","last_became_active":"2023-11-28T11:09:48.574415+0000","last_became_peered":"2023-11-28T11:09:48.574415+0000","last_unstale":"2023-11-28T11:09:49.578994+0000","last_undegraded":"2023-11-28T11:09:49.578994+0000","last_fullsized":"2023-11-28T11:09:49.578994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:45:34.838658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578813+0000","last_change":"2023-11-28T11:09:48.579813+0000","last_active":"2023-11-28T11:09:49.578813+0000","last_peered":"2023-11-28T11:09:49.578813+0000","last_clean":"2023-11-28T11:09:49.578813+0000","last_became_active":"2023-11-28T11:09:48.579536+0000","last_became_peered":"2023-11-28T11:09:48.579536+0000","last_unstale":"2023-11-28T11:09:49.578813+0000","last_undegraded":"2023-11-28T11:09:49.578813+0000","last_fullsized":"2023-11-28T11:09:49.578813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:02:19.387894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573211+0000","last_change":"2023-11-28T11:09:48.574659+0000","last_active":"2023-11-28T11:09:49.573211+0000","last_peered":"2023-11-28T11:09:49.573211+0000","last_clean":"2023-11-28T11:09:49.573211+0000","last_became_active":"2023-11-28T11:09:48.574438+0000","last_became_peered":"2023-11-28T11:09:48.574438+0000","last_unstale":"2023-11-28T11:09:49.573211+0000","last_undegraded":"2023-11-28T11:09:49.573211+0000","last_fullsized":"2023-11-28T11:09:49.573211+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:28.967311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578388+0000","last_change":"2023-11-28T11:09:48.570067+0000","last_active":"2023-11-28T11:09:49.578388+0000","last_peered":"2023-11-28T11:09:49.578388+0000","last_clean":"2023-11-28T11:09:49.578388+0000","last_became_active":"2023-11-28T11:09:48.569761+0000","last_became_peered":"2023-11-28T11:09:48.569761+0000","last_unstale":"2023-11-28T11:09:49.578388+0000","last_undegraded":"2023-11-28T11:09:49.578388+0000","last_fullsized":"2023-11-28T11:09:49.578388+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:21.386929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595842+0000","last_change":"2023-11-28T11:09:48.590172+0000","last_active":"2023-11-28T11:09:48.595842+0000","last_peered":"2023-11-28T11:09:48.595842+0000","last_clean":"2023-11-28T11:09:48.595842+0000","last_became_active":"2023-11-28T11:09:48.586854+0000","last_became_peered":"2023-11-28T11:09:48.586854+0000","last_unstale":"2023-11-28T11:09:48.595842+0000","last_undegraded":"2023-11-28T11:09:48.595842+0000","last_fullsized":"2023-11-28T11:09:48.595842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:38.819892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578243+0000","last_change":"2023-11-28T11:09:48.579123+0000","last_active":"2023-11-28T11:09:49.578243+0000","last_peered":"2023-11-28T11:09:49.578243+0000","last_clean":"2023-11-28T11:09:49.578243+0000","last_became_active":"2023-11-28T11:09:48.578217+0000","last_became_peered":"2023-11-28T11:09:48.578217+0000","last_unstale":"2023-11-28T11:09:49.578243+0000","last_undegraded":"2023-11-28T11:09:49.578243+0000","last_fullsized":"2023-11-28T11:09:49.578243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:53.865630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579125+0000","last_change":"2023-11-28T11:09:48.575619+0000","last_active":"2023-11-28T11:09:49.579125+0000","last_peered":"2023-11-28T11:09:49.579125+0000","last_clean":"2023-11-28T11:09:49.579125+0000","last_became_active":"2023-11-28T11:09:48.574999+0000","last_became_peered":"2023-11-28T11:09:48.574999+0000","last_unstale":"2023-11-28T11:09:49.579125+0000","last_undegraded":"2023-11-28T11:09:49.579125+0000","last_fullsized":"2023-11-28T11:09:49.579125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:35.559374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579825+0000","last_change":"2023-11-28T11:09:48.575364+0000","last_active":"2023-11-28T11:09:49.579825+0000","last_peered":"2023-11-28T11:09:49.579825+0000","last_clean":"2023-11-28T11:09:49.579825+0000","last_became_active":"2023-11-28T11:09:48.575081+0000","last_became_peered":"2023-11-28T11:09:48.575081+0000","last_unstale":"2023-11-28T11:09:49.579825+0000","last_undegraded":"2023-11-28T11:09:49.579825+0000","last_fullsized":"2023-11-28T11:09:49.579825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:41:44.292385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.587623+0000","last_change":"2023-11-28T11:09:48.584777+0000","last_active":"2023-11-28T11:09:48.587623+0000","last_peered":"2023-11-28T11:09:48.587623+0000","last_clean":"2023-11-28T11:09:48.587623+0000","last_became_active":"2023-11-28T11:09:48.584432+0000","last_became_peered":"2023-11-28T11:09:48.584432+0000","last_unstale":"2023-11-28T11:09:48.587623+0000","last_undegraded":"2023-11-28T11:09:48.587623+0000","last_fullsized":"2023-11-28T11:09:48.587623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:54.735354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.583596+0000","last_change":"2023-11-28T11:09:48.582394+0000","last_active":"2023-11-28T11:09:48.583596+0000","last_peered":"2023-11-28T11:09:48.583596+0000","last_clean":"2023-11-28T11:09:48.583596+0000","last_became_active":"2023-11-28T11:09:48.582135+0000","last_became_peered":"2023-11-28T11:09:48.582135+0000","last_unstale":"2023-11-28T11:09:48.583596+0000","last_undegraded":"2023-11-28T11:09:48.583596+0000","last_fullsized":"2023-11-28T11:09:48.583596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:16.422480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588763+0000","last_change":"2023-11-28T11:09:48.584318+0000","last_active":"2023-11-28T11:09:48.588763+0000","last_peered":"2023-11-28T11:09:48.588763+0000","last_clean":"2023-11-28T11:09:48.588763+0000","last_became_active":"2023-11-28T11:09:48.584049+0000","last_became_peered":"2023-11-28T11:09:48.584049+0000","last_unstale":"2023-11-28T11:09:48.588763+0000","last_undegraded":"2023-11-28T11:09:48.588763+0000","last_fullsized":"2023-11-28T11:09:48.588763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:15.682288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578565+0000","last_change":"2023-11-28T11:09:48.582600+0000","last_active":"2023-11-28T11:09:49.578565+0000","last_peered":"2023-11-28T11:09:49.578565+0000","last_clean":"2023-11-28T11:09:49.578565+0000","last_became_active":"2023-11-28T11:09:48.582307+0000","last_became_peered":"2023-11-28T11:09:48.582307+0000","last_unstale":"2023-11-28T11:09:49.578565+0000","last_undegraded":"2023-11-28T11:09:49.578565+0000","last_fullsized":"2023-11-28T11:09:49.578565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:08:36.534645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595864+0000","last_change":"2023-11-28T11:09:48.590565+0000","last_active":"2023-11-28T11:09:48.595864+0000","last_peered":"2023-11-28T11:09:48.595864+0000","last_clean":"2023-11-28T11:09:48.595864+0000","last_became_active":"2023-11-28T11:09:48.590338+0000","last_became_peered":"2023-11-28T11:09:48.590338+0000","last_unstale":"2023-11-28T11:09:48.595864+0000","last_undegraded":"2023-11-28T11:09:48.595864+0000","last_fullsized":"2023-11-28T11:09:48.595864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:21.386929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579800+0000","last_change":"2023-11-28T11:09:48.576367+0000","last_active":"2023-11-28T11:09:49.579800+0000","last_peered":"2023-11-28T11:09:49.579800+0000","last_clean":"2023-11-28T11:09:49.579800+0000","last_became_active":"2023-11-28T11:09:48.576110+0000","last_became_peered":"2023-11-28T11:09:48.576110+0000","last_unstale":"2023-11-28T11:09:49.579800+0000","last_undegraded":"2023-11-28T11:09:49.579800+0000","last_fullsized":"2023-11-28T11:09:49.579800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:42.584394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.580589+0000","last_change":"2023-11-28T11:09:48.579169+0000","last_active":"2023-11-28T11:09:48.580589+0000","last_peered":"2023-11-28T11:09:48.580589+0000","last_clean":"2023-11-28T11:09:48.580589+0000","last_became_active":"2023-11-28T11:09:48.578950+0000","last_became_peered":"2023-11-28T11:09:48.578950+0000","last_unstale":"2023-11-28T11:09:48.580589+0000","last_undegraded":"2023-11-28T11:09:48.580589+0000","last_fullsized":"2023-11-28T11:09:48.580589+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:55.255473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588167+0000","last_change":"2023-11-28T11:09:48.585893+0000","last_active":"2023-11-28T11:09:48.588167+0000","last_peered":"2023-11-28T11:09:48.588167+0000","last_clean":"2023-11-28T11:09:48.588167+0000","last_became_active":"2023-11-28T11:09:48.585611+0000","last_became_peered":"2023-11-28T11:09:48.585611+0000","last_unstale":"2023-11-28T11:09:48.588167+0000","last_undegraded":"2023-11-28T11:09:48.588167+0000","last_fullsized":"2023-11-28T11:09:48.588167+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:22.638706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.582852+0000","last_change":"2023-11-28T11:09:48.579721+0000","last_active":"2023-11-28T11:09:48.582852+0000","last_peered":"2023-11-28T11:09:48.582852+0000","last_clean":"2023-11-28T11:09:48.582852+0000","last_became_active":"2023-11-28T11:09:48.578285+0000","last_became_peered":"2023-11-28T11:09:48.578285+0000","last_unstale":"2023-11-28T11:09:48.582852+0000","last_undegraded":"2023-11-28T11:09:48.582852+0000","last_fullsized":"2023-11-28T11:09:48.582852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:28.967311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.587692+0000","last_change":"2023-11-28T11:09:48.585801+0000","last_active":"2023-11-28T11:09:48.587692+0000","last_peered":"2023-11-28T11:09:48.587692+0000","last_clean":"2023-11-28T11:09:48.587692+0000","last_became_active":"2023-11-28T11:09:48.585522+0000","last_became_peered":"2023-11-28T11:09:48.585522+0000","last_unstale":"2023-11-28T11:09:48.587692+0000","last_undegraded":"2023-11-28T11:09:48.587692+0000","last_fullsized":"2023-11-28T11:09:48.587692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:40.403209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578770+0000","last_change":"2023-11-28T11:09:48.586716+0000","last_active":"2023-11-28T11:09:49.578770+0000","last_peered":"2023-11-28T11:09:49.578770+0000","last_clean":"2023-11-28T11:09:49.578770+0000","last_became_active":"2023-11-28T11:09:48.586459+0000","last_became_peered":"2023-11-28T11:09:48.586459+0000","last_unstale":"2023-11-28T11:09:49.578770+0000","last_undegraded":"2023-11-28T11:09:49.578770+0000","last_fullsized":"2023-11-28T11:09:49.578770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:12.293411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.587667+0000","last_change":"2023-11-28T11:09:48.584639+0000","last_active":"2023-11-28T11:09:48.587667+0000","last_peered":"2023-11-28T11:09:48.587667+0000","last_clean":"2023-11-28T11:09:48.587667+0000","last_became_active":"2023-11-28T11:09:48.584162+0000","last_became_peered":"2023-11-28T11:09:48.584162+0000","last_unstale":"2023-11-28T11:09:48.587667+0000","last_undegraded":"2023-11-28T11:09:48.587667+0000","last_fullsized":"2023-11-28T11:09:48.587667+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:53.096028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588031+0000","last_change":"2023-11-28T11:09:48.586230+0000","last_active":"2023-11-28T11:09:48.588031+0000","last_peered":"2023-11-28T11:09:48.588031+0000","last_clean":"2023-11-28T11:09:48.588031+0000","last_became_active":"2023-11-28T11:09:48.585860+0000","last_became_peered":"2023-11-28T11:09:48.585860+0000","last_unstale":"2023-11-28T11:09:48.588031+0000","last_undegraded":"2023-11-28T11:09:48.588031+0000","last_fullsized":"2023-11-28T11:09:48.588031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:06:16.029524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579773+0000","last_change":"2023-11-28T11:09:48.576955+0000","last_active":"2023-11-28T11:09:49.579773+0000","last_peered":"2023-11-28T11:09:49.579773+0000","last_clean":"2023-11-28T11:09:49.579773+0000","last_became_active":"2023-11-28T11:09:48.576675+0000","last_became_peered":"2023-11-28T11:09:48.576675+0000","last_unstale":"2023-11-28T11:09:49.579773+0000","last_undegraded":"2023-11-28T11:09:49.579773+0000","last_fullsized":"2023-11-28T11:09:49.579773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:28.967311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.582885+0000","last_change":"2023-11-28T11:09:48.580529+0000","last_active":"2023-11-28T11:09:48.582885+0000","last_peered":"2023-11-28T11:09:48.582885+0000","last_clean":"2023-11-28T11:09:48.582885+0000","last_became_active":"2023-11-28T11:09:48.580195+0000","last_became_peered":"2023-11-28T11:09:48.580195+0000","last_unstale":"2023-11-28T11:09:48.582885+0000","last_undegraded":"2023-11-28T11:09:48.582885+0000","last_fullsized":"2023-11-28T11:09:48.582885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:35.559374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579479+0000","last_change":"2023-11-28T11:09:48.570259+0000","last_active":"2023-11-28T11:09:49.579479+0000","last_peered":"2023-11-28T11:09:49.579479+0000","last_clean":"2023-11-28T11:09:49.579479+0000","last_became_active":"2023-11-28T11:09:48.569964+0000","last_became_peered":"2023-11-28T11:09:48.569964+0000","last_unstale":"2023-11-28T11:09:49.579479+0000","last_undegraded":"2023-11-28T11:09:49.579479+0000","last_fullsized":"2023-11-28T11:09:49.579479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:12.293411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.593166+0000","last_change":"2023-11-28T11:09:48.186986+0000","last_active":"2023-11-28T11:09:48.593166+0000","last_peered":"2023-11-28T11:09:48.593166+0000","last_clean":"2023-11-28T11:09:48.593166+0000","last_became_active":"2023-11-28T11:09:48.186705+0000","last_became_peered":"2023-11-28T11:09:48.186705+0000","last_unstale":"2023-11-28T11:09:48.593166+0000","last_undegraded":"2023-11-28T11:09:48.593166+0000","last_fullsized":"2023-11-28T11:09:48.593166+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:14:41.128749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.583476+0000","last_change":"2023-11-28T11:09:48.581697+0000","last_active":"2023-11-28T11:09:48.583476+0000","last_peered":"2023-11-28T11:09:48.583476+0000","last_clean":"2023-11-28T11:09:48.583476+0000","last_became_active":"2023-11-28T11:09:48.581343+0000","last_became_peered":"2023-11-28T11:09:48.581343+0000","last_unstale":"2023-11-28T11:09:48.583476+0000","last_undegraded":"2023-11-28T11:09:48.583476+0000","last_fullsized":"2023-11-28T11:09:48.583476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:13.729772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573687+0000","last_change":"2023-11-28T11:09:48.173331+0000","last_active":"2023-11-28T11:09:49.573687+0000","last_peered":"2023-11-28T11:09:49.573687+0000","last_clean":"2023-11-28T11:09:49.573687+0000","last_became_active":"2023-11-28T11:09:48.172867+0000","last_became_peered":"2023-11-28T11:09:48.172867+0000","last_unstale":"2023-11-28T11:09:49.573687+0000","last_undegraded":"2023-11-28T11:09:49.573687+0000","last_fullsized":"2023-11-28T11:09:49.573687+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:56.240523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595931+0000","last_change":"2023-11-28T11:09:48.590843+0000","last_active":"2023-11-28T11:09:48.595931+0000","last_peered":"2023-11-28T11:09:48.595931+0000","last_clean":"2023-11-28T11:09:48.595931+0000","last_became_active":"2023-11-28T11:09:48.590651+0000","last_became_peered":"2023-11-28T11:09:48.590651+0000","last_unstale":"2023-11-28T11:09:48.595931+0000","last_undegraded":"2023-11-28T11:09:48.595931+0000","last_fullsized":"2023-11-28T11:09:48.595931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:05:03.543741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.585737+0000","last_change":"2023-11-28T11:09:48.186510+0000","last_active":"2023-11-28T11:09:48.585737+0000","last_peered":"2023-11-28T11:09:48.585737+0000","last_clean":"2023-11-28T11:09:48.585737+0000","last_became_active":"2023-11-28T11:09:48.185833+0000","last_became_peered":"2023-11-28T11:09:48.185833+0000","last_unstale":"2023-11-28T11:09:48.585737+0000","last_undegraded":"2023-11-28T11:09:48.585737+0000","last_fullsized":"2023-11-28T11:09:48.585737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:56.240523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.590752+0000","last_change":"2023-11-28T11:09:48.587352+0000","last_active":"2023-11-28T11:09:48.590752+0000","last_peered":"2023-11-28T11:09:48.590752+0000","last_clean":"2023-11-28T11:09:48.590752+0000","last_became_active":"2023-11-28T11:09:48.587086+0000","last_became_peered":"2023-11-28T11:09:48.587086+0000","last_unstale":"2023-11-28T11:09:48.590752+0000","last_undegraded":"2023-11-28T11:09:48.590752+0000","last_fullsized":"2023-11-28T11:09:48.590752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:04.796156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.592862+0000","last_change":"2023-11-28T11:09:48.188695+0000","last_active":"2023-11-28T11:09:48.592862+0000","last_peered":"2023-11-28T11:09:48.592862+0000","last_clean":"2023-11-28T11:09:48.592862+0000","last_became_active":"2023-11-28T11:09:48.188394+0000","last_became_peered":"2023-11-28T11:09:48.188394+0000","last_unstale":"2023-11-28T11:09:48.592862+0000","last_undegraded":"2023-11-28T11:09:48.592862+0000","last_fullsized":"2023-11-28T11:09:48.592862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:12.725511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573099+0000","last_change":"2023-11-28T11:09:48.582343+0000","last_active":"2023-11-28T11:09:49.573099+0000","last_peered":"2023-11-28T11:09:49.573099+0000","last_clean":"2023-11-28T11:09:49.573099+0000","last_became_active":"2023-11-28T11:09:48.582106+0000","last_became_peered":"2023-11-28T11:09:48.582106+0000","last_unstale":"2023-11-28T11:09:49.573099+0000","last_undegraded":"2023-11-28T11:09:49.573099+0000","last_fullsized":"2023-11-28T11:09:49.573099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:41:44.292385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578674+0000","last_change":"2023-11-28T11:09:48.186163+0000","last_active":"2023-11-28T11:09:49.578674+0000","last_peered":"2023-11-28T11:09:49.578674+0000","last_clean":"2023-11-28T11:09:49.578674+0000","last_became_active":"2023-11-28T11:09:48.185771+0000","last_became_peered":"2023-11-28T11:09:48.185771+0000","last_unstale":"2023-11-28T11:09:49.578674+0000","last_undegraded":"2023-11-28T11:09:49.578674+0000","last_fullsized":"2023-11-28T11:09:49.578674+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:30.483746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578395+0000","last_change":"2023-11-28T11:09:48.579557+0000","last_active":"2023-11-28T11:09:49.578395+0000","last_peered":"2023-11-28T11:09:49.578395+0000","last_clean":"2023-11-28T11:09:49.578395+0000","last_became_active":"2023-11-28T11:09:48.579264+0000","last_became_peered":"2023-11-28T11:09:48.579264+0000","last_unstale":"2023-11-28T11:09:49.578395+0000","last_undegraded":"2023-11-28T11:09:49.578395+0000","last_fullsized":"2023-11-28T11:09:49.578395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:50.325791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579466+0000","last_change":"2023-11-28T11:09:48.187190+0000","last_active":"2023-11-28T11:09:49.579466+0000","last_peered":"2023-11-28T11:09:49.579466+0000","last_clean":"2023-11-28T11:09:49.579466+0000","last_became_active":"2023-11-28T11:09:48.186887+0000","last_became_peered":"2023-11-28T11:09:48.186887+0000","last_unstale":"2023-11-28T11:09:49.579466+0000","last_undegraded":"2023-11-28T11:09:49.579466+0000","last_fullsized":"2023-11-28T11:09:49.579466+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:14.678027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.585209+0000","last_change":"2023-11-28T11:09:48.581590+0000","last_active":"2023-11-28T11:09:48.585209+0000","last_peered":"2023-11-28T11:09:48.585209+0000","last_clean":"2023-11-28T11:09:48.585209+0000","last_became_active":"2023-11-28T11:09:48.581286+0000","last_became_peered":"2023-11-28T11:09:48.581286+0000","last_unstale":"2023-11-28T11:09:48.585209+0000","last_undegraded":"2023-11-28T11:09:48.585209+0000","last_fullsized":"2023-11-28T11:09:48.585209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:46:25.333000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.570154+0000","last_change":"2023-11-28T11:09:48.186362+0000","last_active":"2023-11-28T11:09:48.570154+0000","last_peered":"2023-11-28T11:09:48.570154+0000","last_clean":"2023-11-28T11:09:48.570154+0000","last_became_active":"2023-11-28T11:09:48.186079+0000","last_became_peered":"2023-11-28T11:09:48.186079+0000","last_unstale":"2023-11-28T11:09:48.570154+0000","last_undegraded":"2023-11-28T11:09:48.570154+0000","last_fullsized":"2023-11-28T11:09:48.570154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:37.651050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588095+0000","last_change":"2023-11-28T11:09:48.582098+0000","last_active":"2023-11-28T11:09:48.588095+0000","last_peered":"2023-11-28T11:09:48.588095+0000","last_clean":"2023-11-28T11:09:48.588095+0000","last_became_active":"2023-11-28T11:09:48.581482+0000","last_became_peered":"2023-11-28T11:09:48.581482+0000","last_unstale":"2023-11-28T11:09:48.588095+0000","last_undegraded":"2023-11-28T11:09:48.588095+0000","last_fullsized":"2023-11-28T11:09:48.588095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:08:36.534645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.576064+0000","last_change":"2023-11-28T11:09:48.183492+0000","last_active":"2023-11-28T11:09:48.576064+0000","last_peered":"2023-11-28T11:09:48.576064+0000","last_clean":"2023-11-28T11:09:48.576064+0000","last_became_active":"2023-11-28T11:09:48.183201+0000","last_became_peered":"2023-11-28T11:09:48.183201+0000","last_unstale":"2023-11-28T11:09:48.576064+0000","last_undegraded":"2023-11-28T11:09:48.576064+0000","last_fullsized":"2023-11-28T11:09:48.576064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:56:43.276991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.590819+0000","last_change":"2023-11-28T11:09:48.588303+0000","last_active":"2023-11-28T11:09:48.590819+0000","last_peered":"2023-11-28T11:09:48.590819+0000","last_clean":"2023-11-28T11:09:48.590819+0000","last_became_active":"2023-11-28T11:09:48.587699+0000","last_became_peered":"2023-11-28T11:09:48.587699+0000","last_unstale":"2023-11-28T11:09:48.590819+0000","last_undegraded":"2023-11-28T11:09:48.590819+0000","last_fullsized":"2023-11-28T11:09:48.590819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:22.638706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.576969+0000","last_change":"2023-11-28T11:09:48.186485+0000","last_active":"2023-11-28T11:09:48.576969+0000","last_peered":"2023-11-28T11:09:48.576969+0000","last_clean":"2023-11-28T11:09:48.576969+0000","last_became_active":"2023-11-28T11:09:48.186193+0000","last_became_peered":"2023-11-28T11:09:48.186193+0000","last_unstale":"2023-11-28T11:09:48.576969+0000","last_undegraded":"2023-11-28T11:09:48.576969+0000","last_fullsized":"2023-11-28T11:09:48.576969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:29.841541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579643+0000","last_change":"2023-11-28T11:09:48.587872+0000","last_active":"2023-11-28T11:09:49.579643+0000","last_peered":"2023-11-28T11:09:49.579643+0000","last_clean":"2023-11-28T11:09:49.579643+0000","last_became_active":"2023-11-28T11:09:48.587582+0000","last_became_peered":"2023-11-28T11:09:48.587582+0000","last_unstale":"2023-11-28T11:09:49.579643+0000","last_undegraded":"2023-11-28T11:09:49.579643+0000","last_fullsized":"2023-11-28T11:09:49.579643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:41.892385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579140+0000","last_change":"2023-11-28T11:09:48.189395+0000","last_active":"2023-11-28T11:09:49.579140+0000","last_peered":"2023-11-28T11:09:49.579140+0000","last_clean":"2023-11-28T11:09:49.579140+0000","last_became_active":"2023-11-28T11:09:48.189096+0000","last_became_peered":"2023-11-28T11:09:48.189096+0000","last_unstale":"2023-11-28T11:09:49.579140+0000","last_undegraded":"2023-11-28T11:09:49.579140+0000","last_fullsized":"2023-11-28T11:09:49.579140+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:29.841541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573680+0000","last_change":"2023-11-28T11:09:48.570961+0000","last_active":"2023-11-28T11:09:49.573680+0000","last_peered":"2023-11-28T11:09:49.573680+0000","last_clean":"2023-11-28T11:09:49.573680+0000","last_became_active":"2023-11-28T11:09:48.570711+0000","last_became_peered":"2023-11-28T11:09:48.570711+0000","last_unstale":"2023-11-28T11:09:49.573680+0000","last_undegraded":"2023-11-28T11:09:49.573680+0000","last_fullsized":"2023-11-28T11:09:49.573680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.816348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578845+0000","last_change":"2023-11-28T11:09:48.185294+0000","last_active":"2023-11-28T11:09:49.578845+0000","last_peered":"2023-11-28T11:09:49.578845+0000","last_clean":"2023-11-28T11:09:49.578845+0000","last_became_active":"2023-11-28T11:09:48.185000+0000","last_became_peered":"2023-11-28T11:09:48.185000+0000","last_unstale":"2023-11-28T11:09:49.578845+0000","last_undegraded":"2023-11-28T11:09:49.578845+0000","last_fullsized":"2023-11-28T11:09:49.578845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:37.870879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595873+0000","last_change":"2023-11-28T11:09:48.590505+0000","last_active":"2023-11-28T11:09:48.595873+0000","last_peered":"2023-11-28T11:09:48.595873+0000","last_clean":"2023-11-28T11:09:48.595873+0000","last_became_active":"2023-11-28T11:09:48.590239+0000","last_became_peered":"2023-11-28T11:09:48.590239+0000","last_unstale":"2023-11-28T11:09:48.595873+0000","last_undegraded":"2023-11-28T11:09:48.595873+0000","last_fullsized":"2023-11-28T11:09:48.595873+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:06:32.664710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.596718+0000","last_change":"2023-11-28T11:09:48.183694+0000","last_active":"2023-11-28T11:09:48.596718+0000","last_peered":"2023-11-28T11:09:48.596718+0000","last_clean":"2023-11-28T11:09:48.596718+0000","last_became_active":"2023-11-28T11:09:48.183436+0000","last_became_peered":"2023-11-28T11:09:48.183436+0000","last_unstale":"2023-11-28T11:09:48.596718+0000","last_undegraded":"2023-11-28T11:09:48.596718+0000","last_fullsized":"2023-11-28T11:09:48.596718+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:45.854239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573208+0000","last_change":"2023-11-28T11:09:48.577766+0000","last_active":"2023-11-28T11:09:49.573208+0000","last_peered":"2023-11-28T11:09:49.573208+0000","last_clean":"2023-11-28T11:09:49.573208+0000","last_became_active":"2023-11-28T11:09:48.576062+0000","last_became_peered":"2023-11-28T11:09:48.576062+0000","last_unstale":"2023-11-28T11:09:49.573208+0000","last_undegraded":"2023-11-28T11:09:49.573208+0000","last_fullsized":"2023-11-28T11:09:49.573208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:13.729772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.589934+0000","last_change":"2023-11-28T11:09:48.183392+0000","last_active":"2023-11-28T11:09:48.589934+0000","last_peered":"2023-11-28T11:09:48.589934+0000","last_clean":"2023-11-28T11:09:48.589934+0000","last_became_active":"2023-11-28T11:09:48.183154+0000","last_became_peered":"2023-11-28T11:09:48.183154+0000","last_unstale":"2023-11-28T11:09:48.589934+0000","last_undegraded":"2023-11-28T11:09:48.589934+0000","last_fullsized":"2023-11-28T11:09:48.589934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:30.483746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.590945+0000","last_change":"2023-11-28T11:09:48.588389+0000","last_active":"2023-11-28T11:09:48.590945+0000","last_peered":"2023-11-28T11:09:48.590945+0000","last_clean":"2023-11-28T11:09:48.590945+0000","last_became_active":"2023-11-28T11:09:48.588137+0000","last_became_peered":"2023-11-28T11:09:48.588137+0000","last_unstale":"2023-11-28T11:09:48.590945+0000","last_undegraded":"2023-11-28T11:09:48.590945+0000","last_fullsized":"2023-11-28T11:09:48.590945+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:18.375105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.571630+0000","last_change":"2023-11-28T11:09:48.184842+0000","last_active":"2023-11-28T11:09:48.571630+0000","last_peered":"2023-11-28T11:09:48.571630+0000","last_clean":"2023-11-28T11:09:48.571630+0000","last_became_active":"2023-11-28T11:09:48.184594+0000","last_became_peered":"2023-11-28T11:09:48.184594+0000","last_unstale":"2023-11-28T11:09:48.571630+0000","last_undegraded":"2023-11-28T11:09:48.571630+0000","last_fullsized":"2023-11-28T11:09:48.571630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:37.870879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579361+0000","last_change":"2023-11-28T11:09:48.574611+0000","last_active":"2023-11-28T11:09:49.579361+0000","last_peered":"2023-11-28T11:09:49.579361+0000","last_clean":"2023-11-28T11:09:49.579361+0000","last_became_active":"2023-11-28T11:09:48.574323+0000","last_became_peered":"2023-11-28T11:09:48.574323+0000","last_unstale":"2023-11-28T11:09:49.579361+0000","last_undegraded":"2023-11-28T11:09:49.579361+0000","last_fullsized":"2023-11-28T11:09:49.579361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:50.309211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.571650+0000","last_change":"2023-11-28T11:09:48.182536+0000","last_active":"2023-11-28T11:09:48.571650+0000","last_peered":"2023-11-28T11:09:48.571650+0000","last_clean":"2023-11-28T11:09:48.571650+0000","last_became_active":"2023-11-28T11:09:48.182198+0000","last_became_peered":"2023-11-28T11:09:48.182198+0000","last_unstale":"2023-11-28T11:09:48.571650+0000","last_undegraded":"2023-11-28T11:09:48.571650+0000","last_fullsized":"2023-11-28T11:09:48.571650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:02:46.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.589145+0000","last_change":"2023-11-28T11:09:48.583320+0000","last_active":"2023-11-28T11:09:48.589145+0000","last_peered":"2023-11-28T11:09:48.589145+0000","last_clean":"2023-11-28T11:09:48.589145+0000","last_became_active":"2023-11-28T11:09:48.582996+0000","last_became_peered":"2023-11-28T11:09:48.582996+0000","last_unstale":"2023-11-28T11:09:48.589145+0000","last_undegraded":"2023-11-28T11:09:48.589145+0000","last_fullsized":"2023-11-28T11:09:48.589145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:06:32.664710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579228+0000","last_change":"2023-11-28T11:09:48.186395+0000","last_active":"2023-11-28T11:09:49.579228+0000","last_peered":"2023-11-28T11:09:49.579228+0000","last_clean":"2023-11-28T11:09:49.579228+0000","last_became_active":"2023-11-28T11:09:48.186128+0000","last_became_peered":"2023-11-28T11:09:48.186128+0000","last_unstale":"2023-11-28T11:09:49.579228+0000","last_undegraded":"2023-11-28T11:09:49.579228+0000","last_fullsized":"2023-11-28T11:09:49.579228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:53.731093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.590865+0000","last_change":"2023-11-28T11:09:48.587579+0000","last_active":"2023-11-28T11:09:48.590865+0000","last_peered":"2023-11-28T11:09:48.590865+0000","last_clean":"2023-11-28T11:09:48.590865+0000","last_became_active":"2023-11-28T11:09:48.587327+0000","last_became_peered":"2023-11-28T11:09:48.587327+0000","last_unstale":"2023-11-28T11:09:48.590865+0000","last_undegraded":"2023-11-28T11:09:48.590865+0000","last_fullsized":"2023-11-28T11:09:48.590865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:53.865630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579088+0000","last_change":"2023-11-28T11:09:48.187036+0000","last_active":"2023-11-28T11:09:49.579088+0000","last_peered":"2023-11-28T11:09:49.579088+0000","last_clean":"2023-11-28T11:09:49.579088+0000","last_became_active":"2023-11-28T11:09:48.186729+0000","last_became_peered":"2023-11-28T11:09:48.186729+0000","last_unstale":"2023-11-28T11:09:49.579088+0000","last_undegraded":"2023-11-28T11:09:49.579088+0000","last_fullsized":"2023-11-28T11:09:49.579088+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:45.854239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578746+0000","last_change":"2023-11-28T11:09:48.583484+0000","last_active":"2023-11-28T11:09:49.578746+0000","last_peered":"2023-11-28T11:09:49.578746+0000","last_clean":"2023-11-28T11:09:49.578746+0000","last_became_active":"2023-11-28T11:09:48.582801+0000","last_became_peered":"2023-11-28T11:09:48.582801+0000","last_unstale":"2023-11-28T11:09:49.578746+0000","last_undegraded":"2023-11-28T11:09:49.578746+0000","last_fullsized":"2023-11-28T11:09:49.578746+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:06:32.664710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595663+0000","last_change":"2023-11-28T11:09:48.187964+0000","last_active":"2023-11-28T11:09:48.595663+0000","last_peered":"2023-11-28T11:09:48.595663+0000","last_clean":"2023-11-28T11:09:48.595663+0000","last_became_active":"2023-11-28T11:09:48.187700+0000","last_became_peered":"2023-11-28T11:09:48.187700+0000","last_unstale":"2023-11-28T11:09:48.595663+0000","last_undegraded":"2023-11-28T11:09:48.595663+0000","last_fullsized":"2023-11-28T11:09:48.595663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:40.888124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.592838+0000","last_change":"2023-11-28T11:09:48.583723+0000","last_active":"2023-11-28T11:09:48.592838+0000","last_peered":"2023-11-28T11:09:48.592838+0000","last_clean":"2023-11-28T11:09:48.592838+0000","last_became_active":"2023-11-28T11:09:48.581991+0000","last_became_peered":"2023-11-28T11:09:48.581991+0000","last_unstale":"2023-11-28T11:09:48.592838+0000","last_undegraded":"2023-11-28T11:09:48.592838+0000","last_fullsized":"2023-11-28T11:09:48.592838+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:04.796156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.585049+0000","last_change":"2023-11-28T11:09:48.177893+0000","last_active":"2023-11-28T11:09:48.585049+0000","last_peered":"2023-11-28T11:09:48.585049+0000","last_clean":"2023-11-28T11:09:48.585049+0000","last_became_active":"2023-11-28T11:09:48.177627+0000","last_became_peered":"2023-11-28T11:09:48.177627+0000","last_unstale":"2023-11-28T11:09:48.585049+0000","last_undegraded":"2023-11-28T11:09:48.585049+0000","last_fullsized":"2023-11-28T11:09:48.585049+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:29.918395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.583880+0000","last_change":"2023-11-28T11:09:48.581947+0000","last_active":"2023-11-28T11:09:48.583880+0000","last_peered":"2023-11-28T11:09:48.583880+0000","last_clean":"2023-11-28T11:09:48.583880+0000","last_became_active":"2023-11-28T11:09:48.581716+0000","last_became_peered":"2023-11-28T11:09:48.581716+0000","last_unstale":"2023-11-28T11:09:48.583880+0000","last_undegraded":"2023-11-28T11:09:48.583880+0000","last_fullsized":"2023-11-28T11:09:48.583880+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:06:16.029524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.569835+0000","last_change":"2023-11-28T11:09:48.189399+0000","last_active":"2023-11-28T11:09:48.569835+0000","last_peered":"2023-11-28T11:09:48.569835+0000","last_clean":"2023-11-28T11:09:48.569835+0000","last_became_active":"2023-11-28T11:09:48.189109+0000","last_became_peered":"2023-11-28T11:09:48.189109+0000","last_unstale":"2023-11-28T11:09:48.569835+0000","last_undegraded":"2023-11-28T11:09:48.569835+0000","last_fullsized":"2023-11-28T11:09:48.569835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:30.483746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579210+0000","last_change":"2023-11-28T11:09:48.577364+0000","last_active":"2023-11-28T11:09:49.579210+0000","last_peered":"2023-11-28T11:09:49.579210+0000","last_clean":"2023-11-28T11:09:49.579210+0000","last_became_active":"2023-11-28T11:09:48.577058+0000","last_became_peered":"2023-11-28T11:09:48.577058+0000","last_unstale":"2023-11-28T11:09:49.579210+0000","last_undegraded":"2023-11-28T11:09:49.579210+0000","last_fullsized":"2023-11-28T11:09:49.579210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:18.375105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.589555+0000","last_change":"2023-11-28T11:09:48.176345+0000","last_active":"2023-11-28T11:09:48.589555+0000","last_peered":"2023-11-28T11:09:48.589555+0000","last_clean":"2023-11-28T11:09:48.589555+0000","last_became_active":"2023-11-28T11:09:48.176072+0000","last_became_peered":"2023-11-28T11:09:48.176072+0000","last_unstale":"2023-11-28T11:09:48.589555+0000","last_undegraded":"2023-11-28T11:09:48.589555+0000","last_fullsized":"2023-11-28T11:09:48.589555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:20.106711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573224+0000","last_change":"2023-11-28T11:09:48.569364+0000","last_active":"2023-11-28T11:09:49.573224+0000","last_peered":"2023-11-28T11:09:49.573224+0000","last_clean":"2023-11-28T11:09:49.573224+0000","last_became_active":"2023-11-28T11:09:48.569051+0000","last_became_peered":"2023-11-28T11:09:48.569051+0000","last_unstale":"2023-11-28T11:09:49.573224+0000","last_undegraded":"2023-11-28T11:09:49.573224+0000","last_fullsized":"2023-11-28T11:09:49.573224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:50.309211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.574769+0000","last_change":"2023-11-28T11:09:48.187261+0000","last_active":"2023-11-28T11:09:48.574769+0000","last_peered":"2023-11-28T11:09:48.574769+0000","last_clean":"2023-11-28T11:09:48.574769+0000","last_became_active":"2023-11-28T11:09:48.186906+0000","last_became_peered":"2023-11-28T11:09:48.186906+0000","last_unstale":"2023-11-28T11:09:48.574769+0000","last_undegraded":"2023-11-28T11:09:48.574769+0000","last_fullsized":"2023-11-28T11:09:48.574769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:56:32.632348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578383+0000","last_change":"2023-11-28T11:09:48.587167+0000","last_active":"2023-11-28T11:09:49.578383+0000","last_peered":"2023-11-28T11:09:49.578383+0000","last_clean":"2023-11-28T11:09:49.578383+0000","last_became_active":"2023-11-28T11:09:48.586436+0000","last_became_peered":"2023-11-28T11:09:48.586436+0000","last_unstale":"2023-11-28T11:09:49.578383+0000","last_undegraded":"2023-11-28T11:09:49.578383+0000","last_fullsized":"2023-11-28T11:09:49.578383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:41:44.292385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579883+0000","last_change":"2023-11-28T11:09:48.181176+0000","last_active":"2023-11-28T11:09:49.579883+0000","last_peered":"2023-11-28T11:09:49.579883+0000","last_clean":"2023-11-28T11:09:49.579883+0000","last_became_active":"2023-11-28T11:09:48.180887+0000","last_became_peered":"2023-11-28T11:09:48.180887+0000","last_unstale":"2023-11-28T11:09:49.579883+0000","last_undegraded":"2023-11-28T11:09:49.579883+0000","last_fullsized":"2023-11-28T11:09:49.579883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:06:15.025263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588111+0000","last_change":"2023-11-28T11:09:48.582262+0000","last_active":"2023-11-28T11:09:48.588111+0000","last_peered":"2023-11-28T11:09:48.588111+0000","last_clean":"2023-11-28T11:09:48.588111+0000","last_became_active":"2023-11-28T11:09:48.581815+0000","last_became_peered":"2023-11-28T11:09:48.581815+0000","last_unstale":"2023-11-28T11:09:48.588111+0000","last_undegraded":"2023-11-28T11:09:48.588111+0000","last_fullsized":"2023-11-28T11:09:48.588111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:02:19.387894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.574619+0000","last_change":"2023-11-28T11:09:48.179765+0000","last_active":"2023-11-28T11:09:48.574619+0000","last_peered":"2023-11-28T11:09:48.574619+0000","last_clean":"2023-11-28T11:09:48.574619+0000","last_became_active":"2023-11-28T11:09:48.179489+0000","last_became_peered":"2023-11-28T11:09:48.179489+0000","last_unstale":"2023-11-28T11:09:48.574619+0000","last_undegraded":"2023-11-28T11:09:48.574619+0000","last_fullsized":"2023-11-28T11:09:48.574619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:58:13.419681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573169+0000","last_change":"2023-11-28T11:09:48.587078+0000","last_active":"2023-11-28T11:09:49.573169+0000","last_peered":"2023-11-28T11:09:49.573169+0000","last_clean":"2023-11-28T11:09:49.573169+0000","last_became_active":"2023-11-28T11:09:48.586829+0000","last_became_peered":"2023-11-28T11:09:48.586829+0000","last_unstale":"2023-11-28T11:09:49.573169+0000","last_undegraded":"2023-11-28T11:09:49.573169+0000","last_fullsized":"2023-11-28T11:09:49.573169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:12.293411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573501+0000","last_change":"2023-11-28T11:09:48.181403+0000","last_active":"2023-11-28T11:09:49.573501+0000","last_peered":"2023-11-28T11:09:49.573501+0000","last_clean":"2023-11-28T11:09:49.573501+0000","last_became_active":"2023-11-28T11:09:48.181105+0000","last_became_peered":"2023-11-28T11:09:48.181105+0000","last_unstale":"2023-11-28T11:09:49.573501+0000","last_undegraded":"2023-11-28T11:09:49.573501+0000","last_fullsized":"2023-11-28T11:09:49.573501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:30.483746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.176936+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:09:48.176936+0000","last_peered":"2023-11-28T11:09:48.176936+0000","last_clean":"2023-11-28T11:09:48.176936+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:09:48.176936+0000","last_undegraded":"2023-11-28T11:09:48.176936+0000","last_fullsized":"2023-11-28T11:09:48.176936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.598444+0000","last_change":"2023-11-28T11:09:48.593574+0000","last_active":"2023-11-28T11:09:48.598444+0000","last_peered":"2023-11-28T11:09:48.598444+0000","last_clean":"2023-11-28T11:09:48.598444+0000","last_became_active":"2023-11-28T11:09:48.593306+0000","last_became_peered":"2023-11-28T11:09:48.593306+0000","last_unstale":"2023-11-28T11:09:48.598444+0000","last_undegraded":"2023-11-28T11:09:48.598444+0000","last_fullsized":"2023-11-28T11:09:48.598444+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:16:43.751386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573692+0000","last_change":"2023-11-28T11:09:48.179690+0000","last_active":"2023-11-28T11:09:49.573692+0000","last_peered":"2023-11-28T11:09:49.573692+0000","last_clean":"2023-11-28T11:09:49.573692+0000","last_became_active":"2023-11-28T11:09:48.179243+0000","last_became_peered":"2023-11-28T11:09:48.179243+0000","last_unstale":"2023-11-28T11:09:49.573692+0000","last_undegraded":"2023-11-28T11:09:49.573692+0000","last_fullsized":"2023-11-28T11:09:49.573692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:45.854239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.567551+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:09:48.567551+0000","last_peered":"2023-11-28T11:09:48.567551+0000","last_clean":"2023-11-28T11:09:48.567551+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:09:48.567551+0000","last_undegraded":"2023-11-28T11:09:48.567551+0000","last_fullsized":"2023-11-28T11:09:48.567551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579629+0000","last_change":"2023-11-28T11:09:48.586002+0000","last_active":"2023-11-28T11:09:49.579629+0000","last_peered":"2023-11-28T11:09:49.579629+0000","last_clean":"2023-11-28T11:09:49.579629+0000","last_became_active":"2023-11-28T11:09:48.585744+0000","last_became_peered":"2023-11-28T11:09:48.585744+0000","last_unstale":"2023-11-28T11:09:49.579629+0000","last_undegraded":"2023-11-28T11:09:49.579629+0000","last_fullsized":"2023-11-28T11:09:49.579629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:56:44.281252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.575847+0000","last_change":"2023-11-28T11:09:48.183576+0000","last_active":"2023-11-28T11:09:48.575847+0000","last_peered":"2023-11-28T11:09:48.575847+0000","last_clean":"2023-11-28T11:09:48.575847+0000","last_became_active":"2023-11-28T11:09:48.183304+0000","last_became_peered":"2023-11-28T11:09:48.183304+0000","last_unstale":"2023-11-28T11:09:48.575847+0000","last_undegraded":"2023-11-28T11:09:48.575847+0000","last_fullsized":"2023-11-28T11:09:48.575847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:04.340957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.168857+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:09:48.168857+0000","last_peered":"2023-11-28T11:09:48.168857+0000","last_clean":"2023-11-28T11:09:48.168857+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:09:48.168857+0000","last_undegraded":"2023-11-28T11:09:48.168857+0000","last_fullsized":"2023-11-28T11:09:48.168857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578985+0000","last_change":"2023-11-28T11:09:48.582275+0000","last_active":"2023-11-28T11:09:49.578985+0000","last_peered":"2023-11-28T11:09:49.578985+0000","last_clean":"2023-11-28T11:09:49.578985+0000","last_became_active":"2023-11-28T11:09:48.581991+0000","last_became_peered":"2023-11-28T11:09:48.581991+0000","last_unstale":"2023-11-28T11:09:49.578985+0000","last_undegraded":"2023-11-28T11:09:49.578985+0000","last_fullsized":"2023-11-28T11:09:49.578985+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:16:43.751386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579545+0000","last_change":"2023-11-28T11:09:48.180023+0000","last_active":"2023-11-28T11:09:49.579545+0000","last_peered":"2023-11-28T11:09:49.579545+0000","last_clean":"2023-11-28T11:09:49.579545+0000","last_became_active":"2023-11-28T11:09:48.179695+0000","last_became_peered":"2023-11-28T11:09:48.179695+0000","last_unstale":"2023-11-28T11:09:49.579545+0000","last_undegraded":"2023-11-28T11:09:49.579545+0000","last_fullsized":"2023-11-28T11:09:49.579545+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:21.634445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.566532+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:09:48.566532+0000","last_peered":"2023-11-28T11:09:48.566532+0000","last_clean":"2023-11-28T11:09:48.566532+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:09:48.566532+0000","last_undegraded":"2023-11-28T11:09:48.566532+0000","last_fullsized":"2023-11-28T11:09:48.566532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.566343+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:09:48.566343+0000","last_peered":"2023-11-28T11:09:48.566343+0000","last_clean":"2023-11-28T11:09:48.566343+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:09:48.566343+0000","last_undegraded":"2023-11-28T11:09:48.566343+0000","last_fullsized":"2023-11-28T11:09:48.566343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.582777+0000","last_change":"2023-11-28T11:09:48.578880+0000","last_active":"2023-11-28T11:09:48.582777+0000","last_peered":"2023-11-28T11:09:48.582777+0000","last_clean":"2023-11-28T11:09:48.582777+0000","last_became_active":"2023-11-28T11:09:48.578638+0000","last_became_peered":"2023-11-28T11:09:48.578638+0000","last_unstale":"2023-11-28T11:09:48.582777+0000","last_undegraded":"2023-11-28T11:09:48.582777+0000","last_fullsized":"2023-11-28T11:09:48.582777+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:41.892385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579186+0000","last_change":"2023-11-28T11:09:48.184700+0000","last_active":"2023-11-28T11:09:49.579186+0000","last_peered":"2023-11-28T11:09:49.579186+0000","last_clean":"2023-11-28T11:09:49.579186+0000","last_became_active":"2023-11-28T11:09:48.184370+0000","last_became_peered":"2023-11-28T11:09:48.184370+0000","last_unstale":"2023-11-28T11:09:49.579186+0000","last_undegraded":"2023-11-28T11:09:49.579186+0000","last_fullsized":"2023-11-28T11:09:49.579186+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:56.240523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.566431+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:09:48.566431+0000","last_peered":"2023-11-28T11:09:48.566431+0000","last_clean":"2023-11-28T11:09:48.566431+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:09:48.566431+0000","last_undegraded":"2023-11-28T11:09:48.566431+0000","last_fullsized":"2023-11-28T11:09:48.566431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588469+0000","last_change":"2023-11-28T11:09:48.586441+0000","last_active":"2023-11-28T11:09:48.588469+0000","last_peered":"2023-11-28T11:09:48.588469+0000","last_clean":"2023-11-28T11:09:48.588469+0000","last_became_active":"2023-11-28T11:09:48.585841+0000","last_became_peered":"2023-11-28T11:09:48.585841+0000","last_unstale":"2023-11-28T11:09:48.588469+0000","last_undegraded":"2023-11-28T11:09:48.588469+0000","last_fullsized":"2023-11-28T11:09:48.588469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:42.584394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.576050+0000","last_change":"2023-11-28T11:09:48.181640+0000","last_active":"2023-11-28T11:09:48.576050+0000","last_peered":"2023-11-28T11:09:48.576050+0000","last_clean":"2023-11-28T11:09:48.576050+0000","last_became_active":"2023-11-28T11:09:48.181312+0000","last_became_peered":"2023-11-28T11:09:48.181312+0000","last_unstale":"2023-11-28T11:09:48.576050+0000","last_undegraded":"2023-11-28T11:09:48.576050+0000","last_fullsized":"2023-11-28T11:09:48.576050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:04.340957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.566599+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:09:48.566599+0000","last_peered":"2023-11-28T11:09:48.566599+0000","last_clean":"2023-11-28T11:09:48.566599+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:09:48.566599+0000","last_undegraded":"2023-11-28T11:09:48.566599+0000","last_fullsized":"2023-11-28T11:09:48.566599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595925+0000","last_change":"2023-11-28T11:09:48.591219+0000","last_active":"2023-11-28T11:09:48.595925+0000","last_peered":"2023-11-28T11:09:48.595925+0000","last_clean":"2023-11-28T11:09:48.595925+0000","last_became_active":"2023-11-28T11:09:48.591005+0000","last_became_peered":"2023-11-28T11:09:48.591005+0000","last_unstale":"2023-11-28T11:09:48.595925+0000","last_undegraded":"2023-11-28T11:09:48.595925+0000","last_fullsized":"2023-11-28T11:09:48.595925+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:45:34.838658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.572737+0000","last_change":"2023-11-28T11:09:48.186758+0000","last_active":"2023-11-28T11:09:48.572737+0000","last_peered":"2023-11-28T11:09:48.572737+0000","last_clean":"2023-11-28T11:09:48.572737+0000","last_became_active":"2023-11-28T11:09:48.186491+0000","last_became_peered":"2023-11-28T11:09:48.186491+0000","last_unstale":"2023-11-28T11:09:48.572737+0000","last_undegraded":"2023-11-28T11:09:48.572737+0000","last_fullsized":"2023-11-28T11:09:48.572737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:27.963049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.176952+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:09:48.176952+0000","last_peered":"2023-11-28T11:09:48.176952+0000","last_clean":"2023-11-28T11:09:48.176952+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:09:48.176952+0000","last_undegraded":"2023-11-28T11:09:48.176952+0000","last_fullsized":"2023-11-28T11:09:48.176952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579599+0000","last_change":"2023-11-28T11:09:48.587823+0000","last_active":"2023-11-28T11:09:49.579599+0000","last_peered":"2023-11-28T11:09:49.579599+0000","last_clean":"2023-11-28T11:09:49.579599+0000","last_became_active":"2023-11-28T11:09:48.587617+0000","last_became_peered":"2023-11-28T11:09:48.587617+0000","last_unstale":"2023-11-28T11:09:49.579599+0000","last_undegraded":"2023-11-28T11:09:49.579599+0000","last_fullsized":"2023-11-28T11:09:49.579599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:13.729772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.576911+0000","last_change":"2023-11-28T11:09:48.183285+0000","last_active":"2023-11-28T11:09:48.576911+0000","last_peered":"2023-11-28T11:09:48.576911+0000","last_clean":"2023-11-28T11:09:48.576911+0000","last_became_active":"2023-11-28T11:09:48.183021+0000","last_became_peered":"2023-11-28T11:09:48.183021+0000","last_unstale":"2023-11-28T11:09:48.576911+0000","last_undegraded":"2023-11-28T11:09:48.576911+0000","last_fullsized":"2023-11-28T11:09:48.576911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:44:44.420862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.176598+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:09:48.176598+0000","last_peered":"2023-11-28T11:09:48.176598+0000","last_clean":"2023-11-28T11:09:48.176598+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:09:48.176598+0000","last_undegraded":"2023-11-28T11:09:48.176598+0000","last_fullsized":"2023-11-28T11:09:48.176598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9656,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362184,"statfs":{"total":96636764160,"available":96626876416,"internally_reserved":0,"allocated":1032192,"data_stored":765392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.6420000000000003,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.72799999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.61899999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.532,"5min":5.532,"15min":5.532},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55100000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58599999999999997}]},{"osd":6,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":425984,"data_stored":173972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.7939999999999996,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.55500000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":5.7210000000000001,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":5.6970000000000001,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.8289999999999997,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.54100000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.69399999999999995}]},{"osd":5,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8488,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363352,"statfs":{"total":96636764160,"available":96628072448,"internally_reserved":0,"allocated":425984,"data_stored":173496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.308}]},{"osd":3,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.28499999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.439},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.42699999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.48099999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.41899999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.501}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9580,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362260,"statfs":{"total":96636764160,"available":96626954240,"internally_reserved":0,"allocated":1019904,"data_stored":763808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.31},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.29599999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.34000000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.32800000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.45100000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45900000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.298,"5min":3.298,"15min":3.298},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.47499999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.499},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.41099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8424,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363416,"statfs":{"total":96636764160,"available":96628137984,"internally_reserved":0,"allocated":425984,"data_stored":173476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35999999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.378},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.43099999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.41499999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.67400000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.75600000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.70899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8500,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363340,"statfs":{"total":96636764160,"available":96628060160,"internally_reserved":0,"allocated":438272,"data_stored":174988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.27100000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":13.016999999999999,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.28199999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.298}]},{"osd":4,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":10.938000000000001,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":12.967000000000001,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.39700000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":12.994,"5min":12.994,"15min":12.994},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.371}]},{"osd":6,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":11.007999999999999,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":12.932,"5min":12.932,"15min":12.932},"last":0.443}]},{"osd":7,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":10.976000000000001,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.48699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":430080,"data_stored":173994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38300000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.504},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59999999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.434}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8492,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363348,"statfs":{"total":96636764160,"available":96628068352,"internally_reserved":0,"allocated":430080,"data_stored":173518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.45100000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":0.65100000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.0179999999999998,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.57399999999999995}]},{"osd":7,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:09:52.653 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:09:52.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.807+0000 7f58598c6700 1 Processor -- start 2023-11-28T11:09:52.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.807+0000 7f58598c6700 1 -- start start 2023-11-28T11:09:52.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.807+0000 7f58598c6700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f585406ab10 0x7f585406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.807+0000 7f58598c6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58540cd5a0 0x7f5854160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58598c6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f58540b22a0 0x7f5854160840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58598c6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58540d1ee0 con 0x7f58540b22a0 2023-11-28T11:09:52.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58598c6700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585406b420 con 0x7f585406ab10 2023-11-28T11:09:52.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58598c6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58540cdb10 con 0x7f58540cd5a0 2023-11-28T11:09:52.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58537fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f58540b22a0 0x7f5854160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58537fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f58540b22a0 0x7f5854160840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59206/0 (socket says 172.21.15.125:59206) 2023-11-28T11:09:52.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58537fe700 1 -- 172.21.15.125:0/152228671 learned_addr learned my addr 172.21.15.125:0/152228671 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:52.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f5852ffd700 1 --2- 172.21.15.125:0/152228671 >> v2:172.21.15.167:3300/0 conn(0x7f585406ab10 0x7f585406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58537fe700 1 -- 172.21.15.125:0/152228671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58540cd5a0 msgr2=0x7f5854160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:52.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58527fc700 1 --2- 172.21.15.125:0/152228671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58540cd5a0 0x7f5854160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58537fe700 1 --2- 172.21.15.125:0/152228671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58540cd5a0 0x7f5854160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58537fe700 1 -- 172.21.15.125:0/152228671 >> v2:172.21.15.167:3300/0 conn(0x7f585406ab10 msgr2=0x7f585406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:52.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58537fe700 1 --2- 172.21.15.125:0/152228671 >> v2:172.21.15.167:3300/0 conn(0x7f585406ab10 0x7f585406aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58537fe700 1 -- 172.21.15.125:0/152228671 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58540d1890 con 0x7f58540b22a0 2023-11-28T11:09:52.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f5852ffd700 1 --2- 172.21.15.125:0/152228671 >> v2:172.21.15.167:3300/0 conn(0x7f585406ab10 0x7f585406aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:52.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58527fc700 1 --2- 172.21.15.125:0/152228671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58540cd5a0 0x7f5854160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:52.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f58537fe700 1 --2- 172.21.15.125:0/152228671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58540b22a0 0x7f5854160840 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f58540d0cb0 tx=0x7f584c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab6ffabfdbca16d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:52.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f5851ffb700 1 -- 172.21.15.125:0/152228671 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c00e070 con 0x7f58540b22a0 2023-11-28T11:09:52.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f5851ffb700 1 -- 172.21.15.125:0/152228671 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c00b9c0 con 0x7f58540b22a0 2023-11-28T11:09:52.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.808+0000 7f5851ffb700 1 -- 172.21.15.125:0/152228671 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c00bd70 con 0x7f58540b22a0 2023-11-28T11:09:52.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.809+0000 7f58598c6700 1 -- 172.21.15.125:0/152228671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58540b22a0 msgr2=0x7f5854160840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.809+0000 7f58598c6700 1 --2- 172.21.15.125:0/152228671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58540b22a0 0x7f5854160840 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f58540d0cb0 tx=0x7f584c00b330 comp rx=0 tx=0).stop 2023-11-28T11:09:52.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.809+0000 7f58598c6700 1 -- 172.21.15.125:0/152228671 shutdown_connections 2023-11-28T11:09:52.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.809+0000 7f58598c6700 1 --2- 172.21.15.125:0/152228671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58540b22a0 0x7f5854160840 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.809+0000 7f58598c6700 1 --2- 172.21.15.125:0/152228671 >> v2:172.21.15.167:3300/0 conn(0x7f585406ab10 0x7f585406aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.809+0000 7f58598c6700 1 --2- 172.21.15.125:0/152228671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58540cd5a0 0x7f5854160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.809+0000 7f58598c6700 1 -- 172.21.15.125:0/152228671 >> 172.21.15.125:0/152228671 conn(0x7f585406c520 msgr2=0x7f585406c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:52.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.809+0000 7f58598c6700 1 -- 172.21.15.125:0/152228671 shutdown_connections 2023-11-28T11:09:52.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.809+0000 7f58598c6700 1 -- 172.21.15.125:0/152228671 wait complete. 2023-11-28T11:09:52.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.810+0000 7f58598c6700 1 Processor -- start 2023-11-28T11:09:52.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.811+0000 7f58598c6700 1 -- start start 2023-11-28T11:09:52.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58598c6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f585406ab10 0x7f58540c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58598c6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58540b22a0 0x7f58540cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58598c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58540cd5a0 0x7f58540b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58598c6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58540cbaf0 con 0x7f58540cd5a0 2023-11-28T11:09:52.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58598c6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58540cbdd0 con 0x7f58540b22a0 2023-11-28T11:09:52.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58598c6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58540cc0b0 con 0x7f585406ab10 2023-11-28T11:09:52.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58537fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58540cd5a0 0x7f58540b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58537fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58540cd5a0 0x7f58540b29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59212/0 (socket says 172.21.15.125:59212) 2023-11-28T11:09:52.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58537fe700 1 -- 172.21.15.125:0/521132844 learned_addr learned my addr 172.21.15.125:0/521132844 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:52.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58527fc700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58540b22a0 0x7f58540cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f5852ffd700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f585406ab10 0x7f58540c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58537fe700 1 -- 172.21.15.125:0/521132844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f585406ab10 msgr2=0x7f58540c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58537fe700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f585406ab10 0x7f58540c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58537fe700 1 -- 172.21.15.125:0/521132844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58540b22a0 msgr2=0x7f58540cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:52.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58537fe700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58540b22a0 0x7f58540cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:52.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58537fe700 1 -- 172.21.15.125:0/521132844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c009b30 con 0x7f58540cd5a0 2023-11-28T11:09:52.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58537fe700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58540cd5a0 0x7f58540b29b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f584c00b370 tx=0x7f584c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:52.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f583bfff700 1 -- 172.21.15.125:0/521132844 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c004310 con 0x7f58540cd5a0 2023-11-28T11:09:52.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f583bfff700 1 -- 172.21.15.125:0/521132844 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c004470 con 0x7f58540cd5a0 2023-11-28T11:09:52.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58598c6700 1 -- 172.21.15.125:0/521132844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585415cad0 con 0x7f58540cd5a0 2023-11-28T11:09:52.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f583bfff700 1 -- 172.21.15.125:0/521132844 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c004820 con 0x7f58540cd5a0 2023-11-28T11:09:52.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.812+0000 7f58598c6700 1 -- 172.21.15.125:0/521132844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58540d1b70 con 0x7f58540cd5a0 2023-11-28T11:09:52.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.813+0000 7f58598c6700 1 -- 172.21.15.125:0/521132844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58540b1ec0 con 0x7f58540cd5a0 2023-11-28T11:09:52.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.814+0000 7f583bfff700 1 -- 172.21.15.125:0/521132844 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f584c01c440 con 0x7f58540cd5a0 2023-11-28T11:09:52.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.814+0000 7f583bfff700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f58400682f0 0x7f584006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:52.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.814+0000 7f583bfff700 1 -- 172.21.15.125:0/521132844 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f584c087440 con 0x7f58540cd5a0 2023-11-28T11:09:52.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.814+0000 7f5852ffd700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f58400682f0 0x7f584006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:52.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.814+0000 7f5852ffd700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f58400682f0 0x7f584006a7a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5844006fd0 tx=0x7f5844008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:52.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.818+0000 7f583bfff700 1 -- 172.21.15.125:0/521132844 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f584c053c40 con 0x7f58540cd5a0 2023-11-28T11:09:52.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:52.995+0000 7f58598c6700 1 -- 172.21.15.125:0/521132844 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58540743f0 con 0x7f58400682f0 2023-11-28T11:09:53.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.003+0000 7f583bfff700 1 -- 172.21.15.125:0/521132844 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310805 (secure 0 0 0) 0x7f58540743f0 con 0x7f58400682f0 2023-11-28T11:09:53.008 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:53.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.006+0000 7f58598c6700 1 -- 172.21.15.125:0/521132844 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f58400682f0 msgr2=0x7f584006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.006+0000 7f58598c6700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f58400682f0 0x7f584006a7a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5844006fd0 tx=0x7f5844008040 comp rx=0 tx=0).stop 2023-11-28T11:09:53.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.006+0000 7f58598c6700 1 -- 172.21.15.125:0/521132844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58540cd5a0 msgr2=0x7f58540b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.006+0000 7f58598c6700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58540cd5a0 0x7f58540b29b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f584c00b370 tx=0x7f584c004ad0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.006+0000 7f58598c6700 1 -- 172.21.15.125:0/521132844 shutdown_connections 2023-11-28T11:09:53.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.006+0000 7f58598c6700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58540cd5a0 0x7f58540b29b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.006+0000 7f58598c6700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f58400682f0 0x7f584006a7a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.006+0000 7f58598c6700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f585406ab10 0x7f58540c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.006+0000 7f58598c6700 1 --2- 172.21.15.125:0/521132844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58540b22a0 0x7f58540cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.007+0000 7f58598c6700 1 -- 172.21.15.125:0/521132844 >> 172.21.15.125:0/521132844 conn(0x7f585406c520 msgr2=0x7f58540b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:53.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.007+0000 7f58598c6700 1 -- 172.21.15.125:0/521132844 shutdown_connections 2023-11-28T11:09:53.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.007+0000 7f58598c6700 1 -- 172.21.15.125:0/521132844 wait complete. 2023-11-28T11:09:53.012 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:09:53.019 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-11-28T11:09:51.637012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70120,"kb_used_data":4520,"kb_used_omap":0,"kb_used_meta":65536,"kb_avail":754904600,"statfs":{"total":773094113280,"available":773022310400,"internally_reserved":0,"allocated":4628480,"data_stored":2572644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67108864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.476138"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.587267+0000","last_change":"2023-11-28T11:09:48.580257+0000","last_active":"2023-11-28T11:09:48.587267+0000","last_peered":"2023-11-28T11:09:48.587267+0000","last_clean":"2023-11-28T11:09:48.587267+0000","last_became_active":"2023-11-28T11:09:48.579973+0000","last_became_peered":"2023-11-28T11:09:48.579973+0000","last_unstale":"2023-11-28T11:09:48.587267+0000","last_undegraded":"2023-11-28T11:09:48.587267+0000","last_fullsized":"2023-11-28T11:09:48.587267+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:50.325791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.589288+0000","last_change":"2023-11-28T11:09:48.580645+0000","last_active":"2023-11-28T11:09:48.589288+0000","last_peered":"2023-11-28T11:09:48.589288+0000","last_clean":"2023-11-28T11:09:48.589288+0000","last_became_active":"2023-11-28T11:09:48.580391+0000","last_became_peered":"2023-11-28T11:09:48.580391+0000","last_unstale":"2023-11-28T11:09:48.589288+0000","last_undegraded":"2023-11-28T11:09:48.589288+0000","last_fullsized":"2023-11-28T11:09:48.589288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:28.967311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573642+0000","last_change":"2023-11-28T11:09:48.576951+0000","last_active":"2023-11-28T11:09:49.573642+0000","last_peered":"2023-11-28T11:09:49.573642+0000","last_clean":"2023-11-28T11:09:49.573642+0000","last_became_active":"2023-11-28T11:09:48.576707+0000","last_became_peered":"2023-11-28T11:09:48.576707+0000","last_unstale":"2023-11-28T11:09:49.573642+0000","last_undegraded":"2023-11-28T11:09:49.573642+0000","last_fullsized":"2023-11-28T11:09:49.573642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:08:36.534645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.598420+0000","last_change":"2023-11-28T11:09:48.593390+0000","last_active":"2023-11-28T11:09:48.598420+0000","last_peered":"2023-11-28T11:09:48.598420+0000","last_clean":"2023-11-28T11:09:48.598420+0000","last_became_active":"2023-11-28T11:09:48.593102+0000","last_became_peered":"2023-11-28T11:09:48.593102+0000","last_unstale":"2023-11-28T11:09:48.598420+0000","last_undegraded":"2023-11-28T11:09:48.598420+0000","last_fullsized":"2023-11-28T11:09:48.598420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:54.735354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.587965+0000","last_change":"2023-11-28T11:09:48.585732+0000","last_active":"2023-11-28T11:09:48.587965+0000","last_peered":"2023-11-28T11:09:48.587965+0000","last_clean":"2023-11-28T11:09:48.587965+0000","last_became_active":"2023-11-28T11:09:48.585458+0000","last_became_peered":"2023-11-28T11:09:48.585458+0000","last_unstale":"2023-11-28T11:09:48.587965+0000","last_undegraded":"2023-11-28T11:09:48.587965+0000","last_fullsized":"2023-11-28T11:09:48.587965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:53.096028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.583305+0000","last_change":"2023-11-28T11:09:48.580552+0000","last_active":"2023-11-28T11:09:48.583305+0000","last_peered":"2023-11-28T11:09:48.583305+0000","last_clean":"2023-11-28T11:09:48.583305+0000","last_became_active":"2023-11-28T11:09:48.580256+0000","last_became_peered":"2023-11-28T11:09:48.580256+0000","last_unstale":"2023-11-28T11:09:48.583305+0000","last_undegraded":"2023-11-28T11:09:48.583305+0000","last_fullsized":"2023-11-28T11:09:48.583305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:56:44.281252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578383+0000","last_change":"2023-11-28T11:09:48.586694+0000","last_active":"2023-11-28T11:09:49.578383+0000","last_peered":"2023-11-28T11:09:49.578383+0000","last_clean":"2023-11-28T11:09:49.578383+0000","last_became_active":"2023-11-28T11:09:48.586400+0000","last_became_peered":"2023-11-28T11:09:48.586400+0000","last_unstale":"2023-11-28T11:09:49.578383+0000","last_undegraded":"2023-11-28T11:09:49.578383+0000","last_fullsized":"2023-11-28T11:09:49.578383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:04.796156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588071+0000","last_change":"2023-11-28T11:09:48.581735+0000","last_active":"2023-11-28T11:09:48.588071+0000","last_peered":"2023-11-28T11:09:48.588071+0000","last_clean":"2023-11-28T11:09:48.588071+0000","last_became_active":"2023-11-28T11:09:48.581473+0000","last_became_peered":"2023-11-28T11:09:48.581473+0000","last_unstale":"2023-11-28T11:09:48.588071+0000","last_undegraded":"2023-11-28T11:09:48.588071+0000","last_fullsized":"2023-11-28T11:09:48.588071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:21.386929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573750+0000","last_change":"2023-11-28T11:09:48.576937+0000","last_active":"2023-11-28T11:09:49.573750+0000","last_peered":"2023-11-28T11:09:49.573750+0000","last_clean":"2023-11-28T11:09:49.573750+0000","last_became_active":"2023-11-28T11:09:48.576652+0000","last_became_peered":"2023-11-28T11:09:48.576652+0000","last_unstale":"2023-11-28T11:09:49.573750+0000","last_undegraded":"2023-11-28T11:09:49.573750+0000","last_fullsized":"2023-11-28T11:09:49.573750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:02:19.387894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578994+0000","last_change":"2023-11-28T11:09:48.575353+0000","last_active":"2023-11-28T11:09:49.578994+0000","last_peered":"2023-11-28T11:09:49.578994+0000","last_clean":"2023-11-28T11:09:49.578994+0000","last_became_active":"2023-11-28T11:09:48.574415+0000","last_became_peered":"2023-11-28T11:09:48.574415+0000","last_unstale":"2023-11-28T11:09:49.578994+0000","last_undegraded":"2023-11-28T11:09:49.578994+0000","last_fullsized":"2023-11-28T11:09:49.578994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:45:34.838658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578813+0000","last_change":"2023-11-28T11:09:48.579813+0000","last_active":"2023-11-28T11:09:49.578813+0000","last_peered":"2023-11-28T11:09:49.578813+0000","last_clean":"2023-11-28T11:09:49.578813+0000","last_became_active":"2023-11-28T11:09:48.579536+0000","last_became_peered":"2023-11-28T11:09:48.579536+0000","last_unstale":"2023-11-28T11:09:49.578813+0000","last_undegraded":"2023-11-28T11:09:49.578813+0000","last_fullsized":"2023-11-28T11:09:49.578813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:02:19.387894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573211+0000","last_change":"2023-11-28T11:09:48.574659+0000","last_active":"2023-11-28T11:09:49.573211+0000","last_peered":"2023-11-28T11:09:49.573211+0000","last_clean":"2023-11-28T11:09:49.573211+0000","last_became_active":"2023-11-28T11:09:48.574438+0000","last_became_peered":"2023-11-28T11:09:48.574438+0000","last_unstale":"2023-11-28T11:09:49.573211+0000","last_undegraded":"2023-11-28T11:09:49.573211+0000","last_fullsized":"2023-11-28T11:09:49.573211+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:28.967311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578388+0000","last_change":"2023-11-28T11:09:48.570067+0000","last_active":"2023-11-28T11:09:49.578388+0000","last_peered":"2023-11-28T11:09:49.578388+0000","last_clean":"2023-11-28T11:09:49.578388+0000","last_became_active":"2023-11-28T11:09:48.569761+0000","last_became_peered":"2023-11-28T11:09:48.569761+0000","last_unstale":"2023-11-28T11:09:49.578388+0000","last_undegraded":"2023-11-28T11:09:49.578388+0000","last_fullsized":"2023-11-28T11:09:49.578388+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:21.386929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595842+0000","last_change":"2023-11-28T11:09:48.590172+0000","last_active":"2023-11-28T11:09:48.595842+0000","last_peered":"2023-11-28T11:09:48.595842+0000","last_clean":"2023-11-28T11:09:48.595842+0000","last_became_active":"2023-11-28T11:09:48.586854+0000","last_became_peered":"2023-11-28T11:09:48.586854+0000","last_unstale":"2023-11-28T11:09:48.595842+0000","last_undegraded":"2023-11-28T11:09:48.595842+0000","last_fullsized":"2023-11-28T11:09:48.595842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:38.819892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578243+0000","last_change":"2023-11-28T11:09:48.579123+0000","last_active":"2023-11-28T11:09:49.578243+0000","last_peered":"2023-11-28T11:09:49.578243+0000","last_clean":"2023-11-28T11:09:49.578243+0000","last_became_active":"2023-11-28T11:09:48.578217+0000","last_became_peered":"2023-11-28T11:09:48.578217+0000","last_unstale":"2023-11-28T11:09:49.578243+0000","last_undegraded":"2023-11-28T11:09:49.578243+0000","last_fullsized":"2023-11-28T11:09:49.578243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:53.865630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579125+0000","last_change":"2023-11-28T11:09:48.575619+0000","last_active":"2023-11-28T11:09:49.579125+0000","last_peered":"2023-11-28T11:09:49.579125+0000","last_clean":"2023-11-28T11:09:49.579125+0000","last_became_active":"2023-11-28T11:09:48.574999+0000","last_became_peered":"2023-11-28T11:09:48.574999+0000","last_unstale":"2023-11-28T11:09:49.579125+0000","last_undegraded":"2023-11-28T11:09:49.579125+0000","last_fullsized":"2023-11-28T11:09:49.579125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:35.559374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579825+0000","last_change":"2023-11-28T11:09:48.575364+0000","last_active":"2023-11-28T11:09:49.579825+0000","last_peered":"2023-11-28T11:09:49.579825+0000","last_clean":"2023-11-28T11:09:49.579825+0000","last_became_active":"2023-11-28T11:09:48.575081+0000","last_became_peered":"2023-11-28T11:09:48.575081+0000","last_unstale":"2023-11-28T11:09:49.579825+0000","last_undegraded":"2023-11-28T11:09:49.579825+0000","last_fullsized":"2023-11-28T11:09:49.579825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:41:44.292385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.587623+0000","last_change":"2023-11-28T11:09:48.584777+0000","last_active":"2023-11-28T11:09:48.587623+0000","last_peered":"2023-11-28T11:09:48.587623+0000","last_clean":"2023-11-28T11:09:48.587623+0000","last_became_active":"2023-11-28T11:09:48.584432+0000","last_became_peered":"2023-11-28T11:09:48.584432+0000","last_unstale":"2023-11-28T11:09:48.587623+0000","last_undegraded":"2023-11-28T11:09:48.587623+0000","last_fullsized":"2023-11-28T11:09:48.587623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:54.735354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.583596+0000","last_change":"2023-11-28T11:09:48.582394+0000","last_active":"2023-11-28T11:09:48.583596+0000","last_peered":"2023-11-28T11:09:48.583596+0000","last_clean":"2023-11-28T11:09:48.583596+0000","last_became_active":"2023-11-28T11:09:48.582135+0000","last_became_peered":"2023-11-28T11:09:48.582135+0000","last_unstale":"2023-11-28T11:09:48.583596+0000","last_undegraded":"2023-11-28T11:09:48.583596+0000","last_fullsized":"2023-11-28T11:09:48.583596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:16.422480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588763+0000","last_change":"2023-11-28T11:09:48.584318+0000","last_active":"2023-11-28T11:09:48.588763+0000","last_peered":"2023-11-28T11:09:48.588763+0000","last_clean":"2023-11-28T11:09:48.588763+0000","last_became_active":"2023-11-28T11:09:48.584049+0000","last_became_peered":"2023-11-28T11:09:48.584049+0000","last_unstale":"2023-11-28T11:09:48.588763+0000","last_undegraded":"2023-11-28T11:09:48.588763+0000","last_fullsized":"2023-11-28T11:09:48.588763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:15.682288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578565+0000","last_change":"2023-11-28T11:09:48.582600+0000","last_active":"2023-11-28T11:09:49.578565+0000","last_peered":"2023-11-28T11:09:49.578565+0000","last_clean":"2023-11-28T11:09:49.578565+0000","last_became_active":"2023-11-28T11:09:48.582307+0000","last_became_peered":"2023-11-28T11:09:48.582307+0000","last_unstale":"2023-11-28T11:09:49.578565+0000","last_undegraded":"2023-11-28T11:09:49.578565+0000","last_fullsized":"2023-11-28T11:09:49.578565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:08:36.534645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595864+0000","last_change":"2023-11-28T11:09:48.590565+0000","last_active":"2023-11-28T11:09:48.595864+0000","last_peered":"2023-11-28T11:09:48.595864+0000","last_clean":"2023-11-28T11:09:48.595864+0000","last_became_active":"2023-11-28T11:09:48.590338+0000","last_became_peered":"2023-11-28T11:09:48.590338+0000","last_unstale":"2023-11-28T11:09:48.595864+0000","last_undegraded":"2023-11-28T11:09:48.595864+0000","last_fullsized":"2023-11-28T11:09:48.595864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:21.386929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579800+0000","last_change":"2023-11-28T11:09:48.576367+0000","last_active":"2023-11-28T11:09:49.579800+0000","last_peered":"2023-11-28T11:09:49.579800+0000","last_clean":"2023-11-28T11:09:49.579800+0000","last_became_active":"2023-11-28T11:09:48.576110+0000","last_became_peered":"2023-11-28T11:09:48.576110+0000","last_unstale":"2023-11-28T11:09:49.579800+0000","last_undegraded":"2023-11-28T11:09:49.579800+0000","last_fullsized":"2023-11-28T11:09:49.579800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:42.584394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.580589+0000","last_change":"2023-11-28T11:09:48.579169+0000","last_active":"2023-11-28T11:09:48.580589+0000","last_peered":"2023-11-28T11:09:48.580589+0000","last_clean":"2023-11-28T11:09:48.580589+0000","last_became_active":"2023-11-28T11:09:48.578950+0000","last_became_peered":"2023-11-28T11:09:48.578950+0000","last_unstale":"2023-11-28T11:09:48.580589+0000","last_undegraded":"2023-11-28T11:09:48.580589+0000","last_fullsized":"2023-11-28T11:09:48.580589+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:55.255473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588167+0000","last_change":"2023-11-28T11:09:48.585893+0000","last_active":"2023-11-28T11:09:48.588167+0000","last_peered":"2023-11-28T11:09:48.588167+0000","last_clean":"2023-11-28T11:09:48.588167+0000","last_became_active":"2023-11-28T11:09:48.585611+0000","last_became_peered":"2023-11-28T11:09:48.585611+0000","last_unstale":"2023-11-28T11:09:48.588167+0000","last_undegraded":"2023-11-28T11:09:48.588167+0000","last_fullsized":"2023-11-28T11:09:48.588167+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:22.638706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.582852+0000","last_change":"2023-11-28T11:09:48.579721+0000","last_active":"2023-11-28T11:09:48.582852+0000","last_peered":"2023-11-28T11:09:48.582852+0000","last_clean":"2023-11-28T11:09:48.582852+0000","last_became_active":"2023-11-28T11:09:48.578285+0000","last_became_peered":"2023-11-28T11:09:48.578285+0000","last_unstale":"2023-11-28T11:09:48.582852+0000","last_undegraded":"2023-11-28T11:09:48.582852+0000","last_fullsized":"2023-11-28T11:09:48.582852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:28.967311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.587692+0000","last_change":"2023-11-28T11:09:48.585801+0000","last_active":"2023-11-28T11:09:48.587692+0000","last_peered":"2023-11-28T11:09:48.587692+0000","last_clean":"2023-11-28T11:09:48.587692+0000","last_became_active":"2023-11-28T11:09:48.585522+0000","last_became_peered":"2023-11-28T11:09:48.585522+0000","last_unstale":"2023-11-28T11:09:48.587692+0000","last_undegraded":"2023-11-28T11:09:48.587692+0000","last_fullsized":"2023-11-28T11:09:48.587692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:40.403209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578770+0000","last_change":"2023-11-28T11:09:48.586716+0000","last_active":"2023-11-28T11:09:49.578770+0000","last_peered":"2023-11-28T11:09:49.578770+0000","last_clean":"2023-11-28T11:09:49.578770+0000","last_became_active":"2023-11-28T11:09:48.586459+0000","last_became_peered":"2023-11-28T11:09:48.586459+0000","last_unstale":"2023-11-28T11:09:49.578770+0000","last_undegraded":"2023-11-28T11:09:49.578770+0000","last_fullsized":"2023-11-28T11:09:49.578770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:12.293411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.587667+0000","last_change":"2023-11-28T11:09:48.584639+0000","last_active":"2023-11-28T11:09:48.587667+0000","last_peered":"2023-11-28T11:09:48.587667+0000","last_clean":"2023-11-28T11:09:48.587667+0000","last_became_active":"2023-11-28T11:09:48.584162+0000","last_became_peered":"2023-11-28T11:09:48.584162+0000","last_unstale":"2023-11-28T11:09:48.587667+0000","last_undegraded":"2023-11-28T11:09:48.587667+0000","last_fullsized":"2023-11-28T11:09:48.587667+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:53.096028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588031+0000","last_change":"2023-11-28T11:09:48.586230+0000","last_active":"2023-11-28T11:09:48.588031+0000","last_peered":"2023-11-28T11:09:48.588031+0000","last_clean":"2023-11-28T11:09:48.588031+0000","last_became_active":"2023-11-28T11:09:48.585860+0000","last_became_peered":"2023-11-28T11:09:48.585860+0000","last_unstale":"2023-11-28T11:09:48.588031+0000","last_undegraded":"2023-11-28T11:09:48.588031+0000","last_fullsized":"2023-11-28T11:09:48.588031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:06:16.029524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579773+0000","last_change":"2023-11-28T11:09:48.576955+0000","last_active":"2023-11-28T11:09:49.579773+0000","last_peered":"2023-11-28T11:09:49.579773+0000","last_clean":"2023-11-28T11:09:49.579773+0000","last_became_active":"2023-11-28T11:09:48.576675+0000","last_became_peered":"2023-11-28T11:09:48.576675+0000","last_unstale":"2023-11-28T11:09:49.579773+0000","last_undegraded":"2023-11-28T11:09:49.579773+0000","last_fullsized":"2023-11-28T11:09:49.579773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:28.967311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.582885+0000","last_change":"2023-11-28T11:09:48.580529+0000","last_active":"2023-11-28T11:09:48.582885+0000","last_peered":"2023-11-28T11:09:48.582885+0000","last_clean":"2023-11-28T11:09:48.582885+0000","last_became_active":"2023-11-28T11:09:48.580195+0000","last_became_peered":"2023-11-28T11:09:48.580195+0000","last_unstale":"2023-11-28T11:09:48.582885+0000","last_undegraded":"2023-11-28T11:09:48.582885+0000","last_fullsized":"2023-11-28T11:09:48.582885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:35.559374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579479+0000","last_change":"2023-11-28T11:09:48.570259+0000","last_active":"2023-11-28T11:09:49.579479+0000","last_peered":"2023-11-28T11:09:49.579479+0000","last_clean":"2023-11-28T11:09:49.579479+0000","last_became_active":"2023-11-28T11:09:48.569964+0000","last_became_peered":"2023-11-28T11:09:48.569964+0000","last_unstale":"2023-11-28T11:09:49.579479+0000","last_undegraded":"2023-11-28T11:09:49.579479+0000","last_fullsized":"2023-11-28T11:09:49.579479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:12.293411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.593166+0000","last_change":"2023-11-28T11:09:48.186986+0000","last_active":"2023-11-28T11:09:48.593166+0000","last_peered":"2023-11-28T11:09:48.593166+0000","last_clean":"2023-11-28T11:09:48.593166+0000","last_became_active":"2023-11-28T11:09:48.186705+0000","last_became_peered":"2023-11-28T11:09:48.186705+0000","last_unstale":"2023-11-28T11:09:48.593166+0000","last_undegraded":"2023-11-28T11:09:48.593166+0000","last_fullsized":"2023-11-28T11:09:48.593166+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:14:41.128749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.583476+0000","last_change":"2023-11-28T11:09:48.581697+0000","last_active":"2023-11-28T11:09:48.583476+0000","last_peered":"2023-11-28T11:09:48.583476+0000","last_clean":"2023-11-28T11:09:48.583476+0000","last_became_active":"2023-11-28T11:09:48.581343+0000","last_became_peered":"2023-11-28T11:09:48.581343+0000","last_unstale":"2023-11-28T11:09:48.583476+0000","last_undegraded":"2023-11-28T11:09:48.583476+0000","last_fullsized":"2023-11-28T11:09:48.583476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:13.729772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573687+0000","last_change":"2023-11-28T11:09:48.173331+0000","last_active":"2023-11-28T11:09:49.573687+0000","last_peered":"2023-11-28T11:09:49.573687+0000","last_clean":"2023-11-28T11:09:49.573687+0000","last_became_active":"2023-11-28T11:09:48.172867+0000","last_became_peered":"2023-11-28T11:09:48.172867+0000","last_unstale":"2023-11-28T11:09:49.573687+0000","last_undegraded":"2023-11-28T11:09:49.573687+0000","last_fullsized":"2023-11-28T11:09:49.573687+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:56.240523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595931+0000","last_change":"2023-11-28T11:09:48.590843+0000","last_active":"2023-11-28T11:09:48.595931+0000","last_peered":"2023-11-28T11:09:48.595931+0000","last_clean":"2023-11-28T11:09:48.595931+0000","last_became_active":"2023-11-28T11:09:48.590651+0000","last_became_peered":"2023-11-28T11:09:48.590651+0000","last_unstale":"2023-11-28T11:09:48.595931+0000","last_undegraded":"2023-11-28T11:09:48.595931+0000","last_fullsized":"2023-11-28T11:09:48.595931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:05:03.543741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.585737+0000","last_change":"2023-11-28T11:09:48.186510+0000","last_active":"2023-11-28T11:09:48.585737+0000","last_peered":"2023-11-28T11:09:48.585737+0000","last_clean":"2023-11-28T11:09:48.585737+0000","last_became_active":"2023-11-28T11:09:48.185833+0000","last_became_peered":"2023-11-28T11:09:48.185833+0000","last_unstale":"2023-11-28T11:09:48.585737+0000","last_undegraded":"2023-11-28T11:09:48.585737+0000","last_fullsized":"2023-11-28T11:09:48.585737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:56.240523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.590752+0000","last_change":"2023-11-28T11:09:48.587352+0000","last_active":"2023-11-28T11:09:48.590752+0000","last_peered":"2023-11-28T11:09:48.590752+0000","last_clean":"2023-11-28T11:09:48.590752+0000","last_became_active":"2023-11-28T11:09:48.587086+0000","last_became_peered":"2023-11-28T11:09:48.587086+0000","last_unstale":"2023-11-28T11:09:48.590752+0000","last_undegraded":"2023-11-28T11:09:48.590752+0000","last_fullsized":"2023-11-28T11:09:48.590752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:04.796156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.592862+0000","last_change":"2023-11-28T11:09:48.188695+0000","last_active":"2023-11-28T11:09:48.592862+0000","last_peered":"2023-11-28T11:09:48.592862+0000","last_clean":"2023-11-28T11:09:48.592862+0000","last_became_active":"2023-11-28T11:09:48.188394+0000","last_became_peered":"2023-11-28T11:09:48.188394+0000","last_unstale":"2023-11-28T11:09:48.592862+0000","last_undegraded":"2023-11-28T11:09:48.592862+0000","last_fullsized":"2023-11-28T11:09:48.592862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:12.725511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573099+0000","last_change":"2023-11-28T11:09:48.582343+0000","last_active":"2023-11-28T11:09:49.573099+0000","last_peered":"2023-11-28T11:09:49.573099+0000","last_clean":"2023-11-28T11:09:49.573099+0000","last_became_active":"2023-11-28T11:09:48.582106+0000","last_became_peered":"2023-11-28T11:09:48.582106+0000","last_unstale":"2023-11-28T11:09:49.573099+0000","last_undegraded":"2023-11-28T11:09:49.573099+0000","last_fullsized":"2023-11-28T11:09:49.573099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:41:44.292385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578674+0000","last_change":"2023-11-28T11:09:48.186163+0000","last_active":"2023-11-28T11:09:49.578674+0000","last_peered":"2023-11-28T11:09:49.578674+0000","last_clean":"2023-11-28T11:09:49.578674+0000","last_became_active":"2023-11-28T11:09:48.185771+0000","last_became_peered":"2023-11-28T11:09:48.185771+0000","last_unstale":"2023-11-28T11:09:49.578674+0000","last_undegraded":"2023-11-28T11:09:49.578674+0000","last_fullsized":"2023-11-28T11:09:49.578674+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:30.483746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578395+0000","last_change":"2023-11-28T11:09:48.579557+0000","last_active":"2023-11-28T11:09:49.578395+0000","last_peered":"2023-11-28T11:09:49.578395+0000","last_clean":"2023-11-28T11:09:49.578395+0000","last_became_active":"2023-11-28T11:09:48.579264+0000","last_became_peered":"2023-11-28T11:09:48.579264+0000","last_unstale":"2023-11-28T11:09:49.578395+0000","last_undegraded":"2023-11-28T11:09:49.578395+0000","last_fullsized":"2023-11-28T11:09:49.578395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:50.325791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579466+0000","last_change":"2023-11-28T11:09:48.187190+0000","last_active":"2023-11-28T11:09:49.579466+0000","last_peered":"2023-11-28T11:09:49.579466+0000","last_clean":"2023-11-28T11:09:49.579466+0000","last_became_active":"2023-11-28T11:09:48.186887+0000","last_became_peered":"2023-11-28T11:09:48.186887+0000","last_unstale":"2023-11-28T11:09:49.579466+0000","last_undegraded":"2023-11-28T11:09:49.579466+0000","last_fullsized":"2023-11-28T11:09:49.579466+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:14.678027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.585209+0000","last_change":"2023-11-28T11:09:48.581590+0000","last_active":"2023-11-28T11:09:48.585209+0000","last_peered":"2023-11-28T11:09:48.585209+0000","last_clean":"2023-11-28T11:09:48.585209+0000","last_became_active":"2023-11-28T11:09:48.581286+0000","last_became_peered":"2023-11-28T11:09:48.581286+0000","last_unstale":"2023-11-28T11:09:48.585209+0000","last_undegraded":"2023-11-28T11:09:48.585209+0000","last_fullsized":"2023-11-28T11:09:48.585209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:46:25.333000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.570154+0000","last_change":"2023-11-28T11:09:48.186362+0000","last_active":"2023-11-28T11:09:48.570154+0000","last_peered":"2023-11-28T11:09:48.570154+0000","last_clean":"2023-11-28T11:09:48.570154+0000","last_became_active":"2023-11-28T11:09:48.186079+0000","last_became_peered":"2023-11-28T11:09:48.186079+0000","last_unstale":"2023-11-28T11:09:48.570154+0000","last_undegraded":"2023-11-28T11:09:48.570154+0000","last_fullsized":"2023-11-28T11:09:48.570154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:37.651050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588095+0000","last_change":"2023-11-28T11:09:48.582098+0000","last_active":"2023-11-28T11:09:48.588095+0000","last_peered":"2023-11-28T11:09:48.588095+0000","last_clean":"2023-11-28T11:09:48.588095+0000","last_became_active":"2023-11-28T11:09:48.581482+0000","last_became_peered":"2023-11-28T11:09:48.581482+0000","last_unstale":"2023-11-28T11:09:48.588095+0000","last_undegraded":"2023-11-28T11:09:48.588095+0000","last_fullsized":"2023-11-28T11:09:48.588095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:08:36.534645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.576064+0000","last_change":"2023-11-28T11:09:48.183492+0000","last_active":"2023-11-28T11:09:48.576064+0000","last_peered":"2023-11-28T11:09:48.576064+0000","last_clean":"2023-11-28T11:09:48.576064+0000","last_became_active":"2023-11-28T11:09:48.183201+0000","last_became_peered":"2023-11-28T11:09:48.183201+0000","last_unstale":"2023-11-28T11:09:48.576064+0000","last_undegraded":"2023-11-28T11:09:48.576064+0000","last_fullsized":"2023-11-28T11:09:48.576064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:56:43.276991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.590819+0000","last_change":"2023-11-28T11:09:48.588303+0000","last_active":"2023-11-28T11:09:48.590819+0000","last_peered":"2023-11-28T11:09:48.590819+0000","last_clean":"2023-11-28T11:09:48.590819+0000","last_became_active":"2023-11-28T11:09:48.587699+0000","last_became_peered":"2023-11-28T11:09:48.587699+0000","last_unstale":"2023-11-28T11:09:48.590819+0000","last_undegraded":"2023-11-28T11:09:48.590819+0000","last_fullsized":"2023-11-28T11:09:48.590819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:22.638706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.576969+0000","last_change":"2023-11-28T11:09:48.186485+0000","last_active":"2023-11-28T11:09:48.576969+0000","last_peered":"2023-11-28T11:09:48.576969+0000","last_clean":"2023-11-28T11:09:48.576969+0000","last_became_active":"2023-11-28T11:09:48.186193+0000","last_became_peered":"2023-11-28T11:09:48.186193+0000","last_unstale":"2023-11-28T11:09:48.576969+0000","last_undegraded":"2023-11-28T11:09:48.576969+0000","last_fullsized":"2023-11-28T11:09:48.576969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:29.841541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579643+0000","last_change":"2023-11-28T11:09:48.587872+0000","last_active":"2023-11-28T11:09:49.579643+0000","last_peered":"2023-11-28T11:09:49.579643+0000","last_clean":"2023-11-28T11:09:49.579643+0000","last_became_active":"2023-11-28T11:09:48.587582+0000","last_became_peered":"2023-11-28T11:09:48.587582+0000","last_unstale":"2023-11-28T11:09:49.579643+0000","last_undegraded":"2023-11-28T11:09:49.579643+0000","last_fullsized":"2023-11-28T11:09:49.579643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:41.892385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579140+0000","last_change":"2023-11-28T11:09:48.189395+0000","last_active":"2023-11-28T11:09:49.579140+0000","last_peered":"2023-11-28T11:09:49.579140+0000","last_clean":"2023-11-28T11:09:49.579140+0000","last_became_active":"2023-11-28T11:09:48.189096+0000","last_became_peered":"2023-11-28T11:09:48.189096+0000","last_unstale":"2023-11-28T11:09:49.579140+0000","last_undegraded":"2023-11-28T11:09:49.579140+0000","last_fullsized":"2023-11-28T11:09:49.579140+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:29.841541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573680+0000","last_change":"2023-11-28T11:09:48.570961+0000","last_active":"2023-11-28T11:09:49.573680+0000","last_peered":"2023-11-28T11:09:49.573680+0000","last_clean":"2023-11-28T11:09:49.573680+0000","last_became_active":"2023-11-28T11:09:48.570711+0000","last_became_peered":"2023-11-28T11:09:48.570711+0000","last_unstale":"2023-11-28T11:09:49.573680+0000","last_undegraded":"2023-11-28T11:09:49.573680+0000","last_fullsized":"2023-11-28T11:09:49.573680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.816348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578845+0000","last_change":"2023-11-28T11:09:48.185294+0000","last_active":"2023-11-28T11:09:49.578845+0000","last_peered":"2023-11-28T11:09:49.578845+0000","last_clean":"2023-11-28T11:09:49.578845+0000","last_became_active":"2023-11-28T11:09:48.185000+0000","last_became_peered":"2023-11-28T11:09:48.185000+0000","last_unstale":"2023-11-28T11:09:49.578845+0000","last_undegraded":"2023-11-28T11:09:49.578845+0000","last_fullsized":"2023-11-28T11:09:49.578845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:37.870879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595873+0000","last_change":"2023-11-28T11:09:48.590505+0000","last_active":"2023-11-28T11:09:48.595873+0000","last_peered":"2023-11-28T11:09:48.595873+0000","last_clean":"2023-11-28T11:09:48.595873+0000","last_became_active":"2023-11-28T11:09:48.590239+0000","last_became_peered":"2023-11-28T11:09:48.590239+0000","last_unstale":"2023-11-28T11:09:48.595873+0000","last_undegraded":"2023-11-28T11:09:48.595873+0000","last_fullsized":"2023-11-28T11:09:48.595873+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:06:32.664710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.596718+0000","last_change":"2023-11-28T11:09:48.183694+0000","last_active":"2023-11-28T11:09:48.596718+0000","last_peered":"2023-11-28T11:09:48.596718+0000","last_clean":"2023-11-28T11:09:48.596718+0000","last_became_active":"2023-11-28T11:09:48.183436+0000","last_became_peered":"2023-11-28T11:09:48.183436+0000","last_unstale":"2023-11-28T11:09:48.596718+0000","last_undegraded":"2023-11-28T11:09:48.596718+0000","last_fullsized":"2023-11-28T11:09:48.596718+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:45.854239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573208+0000","last_change":"2023-11-28T11:09:48.577766+0000","last_active":"2023-11-28T11:09:49.573208+0000","last_peered":"2023-11-28T11:09:49.573208+0000","last_clean":"2023-11-28T11:09:49.573208+0000","last_became_active":"2023-11-28T11:09:48.576062+0000","last_became_peered":"2023-11-28T11:09:48.576062+0000","last_unstale":"2023-11-28T11:09:49.573208+0000","last_undegraded":"2023-11-28T11:09:49.573208+0000","last_fullsized":"2023-11-28T11:09:49.573208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:13.729772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.589934+0000","last_change":"2023-11-28T11:09:48.183392+0000","last_active":"2023-11-28T11:09:48.589934+0000","last_peered":"2023-11-28T11:09:48.589934+0000","last_clean":"2023-11-28T11:09:48.589934+0000","last_became_active":"2023-11-28T11:09:48.183154+0000","last_became_peered":"2023-11-28T11:09:48.183154+0000","last_unstale":"2023-11-28T11:09:48.589934+0000","last_undegraded":"2023-11-28T11:09:48.589934+0000","last_fullsized":"2023-11-28T11:09:48.589934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:30.483746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.590945+0000","last_change":"2023-11-28T11:09:48.588389+0000","last_active":"2023-11-28T11:09:48.590945+0000","last_peered":"2023-11-28T11:09:48.590945+0000","last_clean":"2023-11-28T11:09:48.590945+0000","last_became_active":"2023-11-28T11:09:48.588137+0000","last_became_peered":"2023-11-28T11:09:48.588137+0000","last_unstale":"2023-11-28T11:09:48.590945+0000","last_undegraded":"2023-11-28T11:09:48.590945+0000","last_fullsized":"2023-11-28T11:09:48.590945+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:18.375105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.571630+0000","last_change":"2023-11-28T11:09:48.184842+0000","last_active":"2023-11-28T11:09:48.571630+0000","last_peered":"2023-11-28T11:09:48.571630+0000","last_clean":"2023-11-28T11:09:48.571630+0000","last_became_active":"2023-11-28T11:09:48.184594+0000","last_became_peered":"2023-11-28T11:09:48.184594+0000","last_unstale":"2023-11-28T11:09:48.571630+0000","last_undegraded":"2023-11-28T11:09:48.571630+0000","last_fullsized":"2023-11-28T11:09:48.571630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:37.870879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579361+0000","last_change":"2023-11-28T11:09:48.574611+0000","last_active":"2023-11-28T11:09:49.579361+0000","last_peered":"2023-11-28T11:09:49.579361+0000","last_clean":"2023-11-28T11:09:49.579361+0000","last_became_active":"2023-11-28T11:09:48.574323+0000","last_became_peered":"2023-11-28T11:09:48.574323+0000","last_unstale":"2023-11-28T11:09:49.579361+0000","last_undegraded":"2023-11-28T11:09:49.579361+0000","last_fullsized":"2023-11-28T11:09:49.579361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:50.309211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.571650+0000","last_change":"2023-11-28T11:09:48.182536+0000","last_active":"2023-11-28T11:09:48.571650+0000","last_peered":"2023-11-28T11:09:48.571650+0000","last_clean":"2023-11-28T11:09:48.571650+0000","last_became_active":"2023-11-28T11:09:48.182198+0000","last_became_peered":"2023-11-28T11:09:48.182198+0000","last_unstale":"2023-11-28T11:09:48.571650+0000","last_undegraded":"2023-11-28T11:09:48.571650+0000","last_fullsized":"2023-11-28T11:09:48.571650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:02:46.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.589145+0000","last_change":"2023-11-28T11:09:48.583320+0000","last_active":"2023-11-28T11:09:48.589145+0000","last_peered":"2023-11-28T11:09:48.589145+0000","last_clean":"2023-11-28T11:09:48.589145+0000","last_became_active":"2023-11-28T11:09:48.582996+0000","last_became_peered":"2023-11-28T11:09:48.582996+0000","last_unstale":"2023-11-28T11:09:48.589145+0000","last_undegraded":"2023-11-28T11:09:48.589145+0000","last_fullsized":"2023-11-28T11:09:48.589145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:06:32.664710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579228+0000","last_change":"2023-11-28T11:09:48.186395+0000","last_active":"2023-11-28T11:09:49.579228+0000","last_peered":"2023-11-28T11:09:49.579228+0000","last_clean":"2023-11-28T11:09:49.579228+0000","last_became_active":"2023-11-28T11:09:48.186128+0000","last_became_peered":"2023-11-28T11:09:48.186128+0000","last_unstale":"2023-11-28T11:09:49.579228+0000","last_undegraded":"2023-11-28T11:09:49.579228+0000","last_fullsized":"2023-11-28T11:09:49.579228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:53.731093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.590865+0000","last_change":"2023-11-28T11:09:48.587579+0000","last_active":"2023-11-28T11:09:48.590865+0000","last_peered":"2023-11-28T11:09:48.590865+0000","last_clean":"2023-11-28T11:09:48.590865+0000","last_became_active":"2023-11-28T11:09:48.587327+0000","last_became_peered":"2023-11-28T11:09:48.587327+0000","last_unstale":"2023-11-28T11:09:48.590865+0000","last_undegraded":"2023-11-28T11:09:48.590865+0000","last_fullsized":"2023-11-28T11:09:48.590865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:53.865630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579088+0000","last_change":"2023-11-28T11:09:48.187036+0000","last_active":"2023-11-28T11:09:49.579088+0000","last_peered":"2023-11-28T11:09:49.579088+0000","last_clean":"2023-11-28T11:09:49.579088+0000","last_became_active":"2023-11-28T11:09:48.186729+0000","last_became_peered":"2023-11-28T11:09:48.186729+0000","last_unstale":"2023-11-28T11:09:49.579088+0000","last_undegraded":"2023-11-28T11:09:49.579088+0000","last_fullsized":"2023-11-28T11:09:49.579088+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:45.854239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578746+0000","last_change":"2023-11-28T11:09:48.583484+0000","last_active":"2023-11-28T11:09:49.578746+0000","last_peered":"2023-11-28T11:09:49.578746+0000","last_clean":"2023-11-28T11:09:49.578746+0000","last_became_active":"2023-11-28T11:09:48.582801+0000","last_became_peered":"2023-11-28T11:09:48.582801+0000","last_unstale":"2023-11-28T11:09:49.578746+0000","last_undegraded":"2023-11-28T11:09:49.578746+0000","last_fullsized":"2023-11-28T11:09:49.578746+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:06:32.664710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595663+0000","last_change":"2023-11-28T11:09:48.187964+0000","last_active":"2023-11-28T11:09:48.595663+0000","last_peered":"2023-11-28T11:09:48.595663+0000","last_clean":"2023-11-28T11:09:48.595663+0000","last_became_active":"2023-11-28T11:09:48.187700+0000","last_became_peered":"2023-11-28T11:09:48.187700+0000","last_unstale":"2023-11-28T11:09:48.595663+0000","last_undegraded":"2023-11-28T11:09:48.595663+0000","last_fullsized":"2023-11-28T11:09:48.595663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:40.888124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.592838+0000","last_change":"2023-11-28T11:09:48.583723+0000","last_active":"2023-11-28T11:09:48.592838+0000","last_peered":"2023-11-28T11:09:48.592838+0000","last_clean":"2023-11-28T11:09:48.592838+0000","last_became_active":"2023-11-28T11:09:48.581991+0000","last_became_peered":"2023-11-28T11:09:48.581991+0000","last_unstale":"2023-11-28T11:09:48.592838+0000","last_undegraded":"2023-11-28T11:09:48.592838+0000","last_fullsized":"2023-11-28T11:09:48.592838+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:04.796156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.585049+0000","last_change":"2023-11-28T11:09:48.177893+0000","last_active":"2023-11-28T11:09:48.585049+0000","last_peered":"2023-11-28T11:09:48.585049+0000","last_clean":"2023-11-28T11:09:48.585049+0000","last_became_active":"2023-11-28T11:09:48.177627+0000","last_became_peered":"2023-11-28T11:09:48.177627+0000","last_unstale":"2023-11-28T11:09:48.585049+0000","last_undegraded":"2023-11-28T11:09:48.585049+0000","last_fullsized":"2023-11-28T11:09:48.585049+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:29.918395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.583880+0000","last_change":"2023-11-28T11:09:48.581947+0000","last_active":"2023-11-28T11:09:48.583880+0000","last_peered":"2023-11-28T11:09:48.583880+0000","last_clean":"2023-11-28T11:09:48.583880+0000","last_became_active":"2023-11-28T11:09:48.581716+0000","last_became_peered":"2023-11-28T11:09:48.581716+0000","last_unstale":"2023-11-28T11:09:48.583880+0000","last_undegraded":"2023-11-28T11:09:48.583880+0000","last_fullsized":"2023-11-28T11:09:48.583880+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:06:16.029524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.569835+0000","last_change":"2023-11-28T11:09:48.189399+0000","last_active":"2023-11-28T11:09:48.569835+0000","last_peered":"2023-11-28T11:09:48.569835+0000","last_clean":"2023-11-28T11:09:48.569835+0000","last_became_active":"2023-11-28T11:09:48.189109+0000","last_became_peered":"2023-11-28T11:09:48.189109+0000","last_unstale":"2023-11-28T11:09:48.569835+0000","last_undegraded":"2023-11-28T11:09:48.569835+0000","last_fullsized":"2023-11-28T11:09:48.569835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:30.483746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579210+0000","last_change":"2023-11-28T11:09:48.577364+0000","last_active":"2023-11-28T11:09:49.579210+0000","last_peered":"2023-11-28T11:09:49.579210+0000","last_clean":"2023-11-28T11:09:49.579210+0000","last_became_active":"2023-11-28T11:09:48.577058+0000","last_became_peered":"2023-11-28T11:09:48.577058+0000","last_unstale":"2023-11-28T11:09:49.579210+0000","last_undegraded":"2023-11-28T11:09:49.579210+0000","last_fullsized":"2023-11-28T11:09:49.579210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:18.375105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.589555+0000","last_change":"2023-11-28T11:09:48.176345+0000","last_active":"2023-11-28T11:09:48.589555+0000","last_peered":"2023-11-28T11:09:48.589555+0000","last_clean":"2023-11-28T11:09:48.589555+0000","last_became_active":"2023-11-28T11:09:48.176072+0000","last_became_peered":"2023-11-28T11:09:48.176072+0000","last_unstale":"2023-11-28T11:09:48.589555+0000","last_undegraded":"2023-11-28T11:09:48.589555+0000","last_fullsized":"2023-11-28T11:09:48.589555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:20.106711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573224+0000","last_change":"2023-11-28T11:09:48.569364+0000","last_active":"2023-11-28T11:09:49.573224+0000","last_peered":"2023-11-28T11:09:49.573224+0000","last_clean":"2023-11-28T11:09:49.573224+0000","last_became_active":"2023-11-28T11:09:48.569051+0000","last_became_peered":"2023-11-28T11:09:48.569051+0000","last_unstale":"2023-11-28T11:09:49.573224+0000","last_undegraded":"2023-11-28T11:09:49.573224+0000","last_fullsized":"2023-11-28T11:09:49.573224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:50.309211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.574769+0000","last_change":"2023-11-28T11:09:48.187261+0000","last_active":"2023-11-28T11:09:48.574769+0000","last_peered":"2023-11-28T11:09:48.574769+0000","last_clean":"2023-11-28T11:09:48.574769+0000","last_became_active":"2023-11-28T11:09:48.186906+0000","last_became_peered":"2023-11-28T11:09:48.186906+0000","last_unstale":"2023-11-28T11:09:48.574769+0000","last_undegraded":"2023-11-28T11:09:48.574769+0000","last_fullsized":"2023-11-28T11:09:48.574769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:56:32.632348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578383+0000","last_change":"2023-11-28T11:09:48.587167+0000","last_active":"2023-11-28T11:09:49.578383+0000","last_peered":"2023-11-28T11:09:49.578383+0000","last_clean":"2023-11-28T11:09:49.578383+0000","last_became_active":"2023-11-28T11:09:48.586436+0000","last_became_peered":"2023-11-28T11:09:48.586436+0000","last_unstale":"2023-11-28T11:09:49.578383+0000","last_undegraded":"2023-11-28T11:09:49.578383+0000","last_fullsized":"2023-11-28T11:09:49.578383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:41:44.292385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579883+0000","last_change":"2023-11-28T11:09:48.181176+0000","last_active":"2023-11-28T11:09:49.579883+0000","last_peered":"2023-11-28T11:09:49.579883+0000","last_clean":"2023-11-28T11:09:49.579883+0000","last_became_active":"2023-11-28T11:09:48.180887+0000","last_became_peered":"2023-11-28T11:09:48.180887+0000","last_unstale":"2023-11-28T11:09:49.579883+0000","last_undegraded":"2023-11-28T11:09:49.579883+0000","last_fullsized":"2023-11-28T11:09:49.579883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:06:15.025263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588111+0000","last_change":"2023-11-28T11:09:48.582262+0000","last_active":"2023-11-28T11:09:48.588111+0000","last_peered":"2023-11-28T11:09:48.588111+0000","last_clean":"2023-11-28T11:09:48.588111+0000","last_became_active":"2023-11-28T11:09:48.581815+0000","last_became_peered":"2023-11-28T11:09:48.581815+0000","last_unstale":"2023-11-28T11:09:48.588111+0000","last_undegraded":"2023-11-28T11:09:48.588111+0000","last_fullsized":"2023-11-28T11:09:48.588111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:02:19.387894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.574619+0000","last_change":"2023-11-28T11:09:48.179765+0000","last_active":"2023-11-28T11:09:48.574619+0000","last_peered":"2023-11-28T11:09:48.574619+0000","last_clean":"2023-11-28T11:09:48.574619+0000","last_became_active":"2023-11-28T11:09:48.179489+0000","last_became_peered":"2023-11-28T11:09:48.179489+0000","last_unstale":"2023-11-28T11:09:48.574619+0000","last_undegraded":"2023-11-28T11:09:48.574619+0000","last_fullsized":"2023-11-28T11:09:48.574619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:58:13.419681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573169+0000","last_change":"2023-11-28T11:09:48.587078+0000","last_active":"2023-11-28T11:09:49.573169+0000","last_peered":"2023-11-28T11:09:49.573169+0000","last_clean":"2023-11-28T11:09:49.573169+0000","last_became_active":"2023-11-28T11:09:48.586829+0000","last_became_peered":"2023-11-28T11:09:48.586829+0000","last_unstale":"2023-11-28T11:09:49.573169+0000","last_undegraded":"2023-11-28T11:09:49.573169+0000","last_fullsized":"2023-11-28T11:09:49.573169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:12.293411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573501+0000","last_change":"2023-11-28T11:09:48.181403+0000","last_active":"2023-11-28T11:09:49.573501+0000","last_peered":"2023-11-28T11:09:49.573501+0000","last_clean":"2023-11-28T11:09:49.573501+0000","last_became_active":"2023-11-28T11:09:48.181105+0000","last_became_peered":"2023-11-28T11:09:48.181105+0000","last_unstale":"2023-11-28T11:09:49.573501+0000","last_undegraded":"2023-11-28T11:09:49.573501+0000","last_fullsized":"2023-11-28T11:09:49.573501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:30.483746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.176936+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:09:48.176936+0000","last_peered":"2023-11-28T11:09:48.176936+0000","last_clean":"2023-11-28T11:09:48.176936+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:09:48.176936+0000","last_undegraded":"2023-11-28T11:09:48.176936+0000","last_fullsized":"2023-11-28T11:09:48.176936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.598444+0000","last_change":"2023-11-28T11:09:48.593574+0000","last_active":"2023-11-28T11:09:48.598444+0000","last_peered":"2023-11-28T11:09:48.598444+0000","last_clean":"2023-11-28T11:09:48.598444+0000","last_became_active":"2023-11-28T11:09:48.593306+0000","last_became_peered":"2023-11-28T11:09:48.593306+0000","last_unstale":"2023-11-28T11:09:48.598444+0000","last_undegraded":"2023-11-28T11:09:48.598444+0000","last_fullsized":"2023-11-28T11:09:48.598444+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:16:43.751386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.573692+0000","last_change":"2023-11-28T11:09:48.179690+0000","last_active":"2023-11-28T11:09:49.573692+0000","last_peered":"2023-11-28T11:09:49.573692+0000","last_clean":"2023-11-28T11:09:49.573692+0000","last_became_active":"2023-11-28T11:09:48.179243+0000","last_became_peered":"2023-11-28T11:09:48.179243+0000","last_unstale":"2023-11-28T11:09:49.573692+0000","last_undegraded":"2023-11-28T11:09:49.573692+0000","last_fullsized":"2023-11-28T11:09:49.573692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:45.854239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.567551+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:09:48.567551+0000","last_peered":"2023-11-28T11:09:48.567551+0000","last_clean":"2023-11-28T11:09:48.567551+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:09:48.567551+0000","last_undegraded":"2023-11-28T11:09:48.567551+0000","last_fullsized":"2023-11-28T11:09:48.567551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579629+0000","last_change":"2023-11-28T11:09:48.586002+0000","last_active":"2023-11-28T11:09:49.579629+0000","last_peered":"2023-11-28T11:09:49.579629+0000","last_clean":"2023-11-28T11:09:49.579629+0000","last_became_active":"2023-11-28T11:09:48.585744+0000","last_became_peered":"2023-11-28T11:09:48.585744+0000","last_unstale":"2023-11-28T11:09:49.579629+0000","last_undegraded":"2023-11-28T11:09:49.579629+0000","last_fullsized":"2023-11-28T11:09:49.579629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:56:44.281252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.575847+0000","last_change":"2023-11-28T11:09:48.183576+0000","last_active":"2023-11-28T11:09:48.575847+0000","last_peered":"2023-11-28T11:09:48.575847+0000","last_clean":"2023-11-28T11:09:48.575847+0000","last_became_active":"2023-11-28T11:09:48.183304+0000","last_became_peered":"2023-11-28T11:09:48.183304+0000","last_unstale":"2023-11-28T11:09:48.575847+0000","last_undegraded":"2023-11-28T11:09:48.575847+0000","last_fullsized":"2023-11-28T11:09:48.575847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:04.340957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.168857+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:09:48.168857+0000","last_peered":"2023-11-28T11:09:48.168857+0000","last_clean":"2023-11-28T11:09:48.168857+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:09:48.168857+0000","last_undegraded":"2023-11-28T11:09:48.168857+0000","last_fullsized":"2023-11-28T11:09:48.168857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.578985+0000","last_change":"2023-11-28T11:09:48.582275+0000","last_active":"2023-11-28T11:09:49.578985+0000","last_peered":"2023-11-28T11:09:49.578985+0000","last_clean":"2023-11-28T11:09:49.578985+0000","last_became_active":"2023-11-28T11:09:48.581991+0000","last_became_peered":"2023-11-28T11:09:48.581991+0000","last_unstale":"2023-11-28T11:09:49.578985+0000","last_undegraded":"2023-11-28T11:09:49.578985+0000","last_fullsized":"2023-11-28T11:09:49.578985+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:16:43.751386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579545+0000","last_change":"2023-11-28T11:09:48.180023+0000","last_active":"2023-11-28T11:09:49.579545+0000","last_peered":"2023-11-28T11:09:49.579545+0000","last_clean":"2023-11-28T11:09:49.579545+0000","last_became_active":"2023-11-28T11:09:48.179695+0000","last_became_peered":"2023-11-28T11:09:48.179695+0000","last_unstale":"2023-11-28T11:09:49.579545+0000","last_undegraded":"2023-11-28T11:09:49.579545+0000","last_fullsized":"2023-11-28T11:09:49.579545+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:21.634445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.566532+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:09:48.566532+0000","last_peered":"2023-11-28T11:09:48.566532+0000","last_clean":"2023-11-28T11:09:48.566532+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:09:48.566532+0000","last_undegraded":"2023-11-28T11:09:48.566532+0000","last_fullsized":"2023-11-28T11:09:48.566532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.566343+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:09:48.566343+0000","last_peered":"2023-11-28T11:09:48.566343+0000","last_clean":"2023-11-28T11:09:48.566343+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:09:48.566343+0000","last_undegraded":"2023-11-28T11:09:48.566343+0000","last_fullsized":"2023-11-28T11:09:48.566343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.582777+0000","last_change":"2023-11-28T11:09:48.578880+0000","last_active":"2023-11-28T11:09:48.582777+0000","last_peered":"2023-11-28T11:09:48.582777+0000","last_clean":"2023-11-28T11:09:48.582777+0000","last_became_active":"2023-11-28T11:09:48.578638+0000","last_became_peered":"2023-11-28T11:09:48.578638+0000","last_unstale":"2023-11-28T11:09:48.582777+0000","last_undegraded":"2023-11-28T11:09:48.582777+0000","last_fullsized":"2023-11-28T11:09:48.582777+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:41.892385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579186+0000","last_change":"2023-11-28T11:09:48.184700+0000","last_active":"2023-11-28T11:09:49.579186+0000","last_peered":"2023-11-28T11:09:49.579186+0000","last_clean":"2023-11-28T11:09:49.579186+0000","last_became_active":"2023-11-28T11:09:48.184370+0000","last_became_peered":"2023-11-28T11:09:48.184370+0000","last_unstale":"2023-11-28T11:09:49.579186+0000","last_undegraded":"2023-11-28T11:09:49.579186+0000","last_fullsized":"2023-11-28T11:09:49.579186+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:03:56.240523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.566431+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:09:48.566431+0000","last_peered":"2023-11-28T11:09:48.566431+0000","last_clean":"2023-11-28T11:09:48.566431+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:09:48.566431+0000","last_undegraded":"2023-11-28T11:09:48.566431+0000","last_fullsized":"2023-11-28T11:09:48.566431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.588469+0000","last_change":"2023-11-28T11:09:48.586441+0000","last_active":"2023-11-28T11:09:48.588469+0000","last_peered":"2023-11-28T11:09:48.588469+0000","last_clean":"2023-11-28T11:09:48.588469+0000","last_became_active":"2023-11-28T11:09:48.585841+0000","last_became_peered":"2023-11-28T11:09:48.585841+0000","last_unstale":"2023-11-28T11:09:48.588469+0000","last_undegraded":"2023-11-28T11:09:48.588469+0000","last_fullsized":"2023-11-28T11:09:48.588469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:42.584394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.576050+0000","last_change":"2023-11-28T11:09:48.181640+0000","last_active":"2023-11-28T11:09:48.576050+0000","last_peered":"2023-11-28T11:09:48.576050+0000","last_clean":"2023-11-28T11:09:48.576050+0000","last_became_active":"2023-11-28T11:09:48.181312+0000","last_became_peered":"2023-11-28T11:09:48.181312+0000","last_unstale":"2023-11-28T11:09:48.576050+0000","last_undegraded":"2023-11-28T11:09:48.576050+0000","last_fullsized":"2023-11-28T11:09:48.576050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:04.340957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.566599+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:09:48.566599+0000","last_peered":"2023-11-28T11:09:48.566599+0000","last_clean":"2023-11-28T11:09:48.566599+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:09:48.566599+0000","last_undegraded":"2023-11-28T11:09:48.566599+0000","last_fullsized":"2023-11-28T11:09:48.566599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.595925+0000","last_change":"2023-11-28T11:09:48.591219+0000","last_active":"2023-11-28T11:09:48.595925+0000","last_peered":"2023-11-28T11:09:48.595925+0000","last_clean":"2023-11-28T11:09:48.595925+0000","last_became_active":"2023-11-28T11:09:48.591005+0000","last_became_peered":"2023-11-28T11:09:48.591005+0000","last_unstale":"2023-11-28T11:09:48.595925+0000","last_undegraded":"2023-11-28T11:09:48.595925+0000","last_fullsized":"2023-11-28T11:09:48.595925+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:45:34.838658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.572737+0000","last_change":"2023-11-28T11:09:48.186758+0000","last_active":"2023-11-28T11:09:48.572737+0000","last_peered":"2023-11-28T11:09:48.572737+0000","last_clean":"2023-11-28T11:09:48.572737+0000","last_became_active":"2023-11-28T11:09:48.186491+0000","last_became_peered":"2023-11-28T11:09:48.186491+0000","last_unstale":"2023-11-28T11:09:48.572737+0000","last_undegraded":"2023-11-28T11:09:48.572737+0000","last_fullsized":"2023-11-28T11:09:48.572737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:27.963049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.176952+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:09:48.176952+0000","last_peered":"2023-11-28T11:09:48.176952+0000","last_clean":"2023-11-28T11:09:48.176952+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:09:48.176952+0000","last_undegraded":"2023-11-28T11:09:48.176952+0000","last_fullsized":"2023-11-28T11:09:48.176952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:09:49.579599+0000","last_change":"2023-11-28T11:09:48.587823+0000","last_active":"2023-11-28T11:09:49.579599+0000","last_peered":"2023-11-28T11:09:49.579599+0000","last_clean":"2023-11-28T11:09:49.579599+0000","last_became_active":"2023-11-28T11:09:48.587617+0000","last_became_peered":"2023-11-28T11:09:48.587617+0000","last_unstale":"2023-11-28T11:09:49.579599+0000","last_undegraded":"2023-11-28T11:09:49.579599+0000","last_fullsized":"2023-11-28T11:09:49.579599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:48.160970+0000","last_clean_scrub_stamp":"2023-11-28T11:09:48.160970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:13.729772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.576911+0000","last_change":"2023-11-28T11:09:48.183285+0000","last_active":"2023-11-28T11:09:48.576911+0000","last_peered":"2023-11-28T11:09:48.576911+0000","last_clean":"2023-11-28T11:09:48.576911+0000","last_became_active":"2023-11-28T11:09:48.183021+0000","last_became_peered":"2023-11-28T11:09:48.183021+0000","last_unstale":"2023-11-28T11:09:48.576911+0000","last_undegraded":"2023-11-28T11:09:48.576911+0000","last_fullsized":"2023-11-28T11:09:48.576911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:09:47.156708+0000","last_clean_scrub_stamp":"2023-11-28T11:09:47.156708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:44:44.420862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T11:09:48.176598+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:09:48.176598+0000","last_peered":"2023-11-28T11:09:48.176598+0000","last_clean":"2023-11-28T11:09:48.176598+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:09:48.176598+0000","last_undegraded":"2023-11-28T11:09:48.176598+0000","last_fullsized":"2023-11-28T11:09:48.176598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9656,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362184,"statfs":{"total":96636764160,"available":96626876416,"internally_reserved":0,"allocated":1032192,"data_stored":765392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.6420000000000003,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.72799999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.61899999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.532,"5min":5.532,"15min":5.532},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55100000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58599999999999997}]},{"osd":6,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":425984,"data_stored":173972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.7939999999999996,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.55500000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":5.7210000000000001,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":5.6970000000000001,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.8289999999999997,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.54100000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.69399999999999995}]},{"osd":5,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8488,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363352,"statfs":{"total":96636764160,"available":96628072448,"internally_reserved":0,"allocated":425984,"data_stored":173496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.308}]},{"osd":3,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.28499999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.439},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.42699999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.48099999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.41899999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.501}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9580,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362260,"statfs":{"total":96636764160,"available":96626954240,"internally_reserved":0,"allocated":1019904,"data_stored":763808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.31},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.29599999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.34000000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.32800000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.45100000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45900000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.298,"5min":3.298,"15min":3.298},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.47499999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.499},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.41099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8424,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363416,"statfs":{"total":96636764160,"available":96628137984,"internally_reserved":0,"allocated":425984,"data_stored":173476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35999999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.378},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.43099999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.41499999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.67400000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.75600000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.70899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8500,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363340,"statfs":{"total":96636764160,"available":96628060160,"internally_reserved":0,"allocated":438272,"data_stored":174988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.27100000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":13.016999999999999,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.28199999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.298}]},{"osd":4,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":10.938000000000001,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":12.967000000000001,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.39700000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":12.994,"5min":12.994,"15min":12.994},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.371}]},{"osd":6,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":11.007999999999999,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":12.932,"5min":12.932,"15min":12.932},"last":0.443}]},{"osd":7,"last update":"Tue Nov 28 11:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":10.976000000000001,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.48699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":430080,"data_stored":173994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38300000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.504},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59999999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.434}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8492,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363348,"statfs":{"total":96636764160,"available":96628068352,"internally_reserved":0,"allocated":430080,"data_stored":173518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.45100000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":0.65100000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.0179999999999998,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.57399999999999995}]},{"osd":7,"last update":"Tue Nov 28 11:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:09:53.024 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:09:53.024 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T11:09:53.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.186+0000 7fbea9c86700 1 Processor -- start 2023-11-28T11:09:53.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.186+0000 7fbea9c86700 1 -- start start 2023-11-28T11:09:53.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea9c86700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbea415c810 0x7fbea4160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea9c86700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbea40718e0 0x7fbea406c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea9c86700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea41607a0 con 0x7fbea406cdc0 2023-11-28T11:09:53.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea9c86700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea415cbe0 con 0x7fbea40718e0 2023-11-28T11:09:53.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea9c86700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea4160a50 con 0x7fbea415c810 2023-11-28T11:09:53.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbea40718e0 0x7fbea406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbea406cdc0 0x7fbea406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43344/0 (socket says 172.21.15.125:43344) 2023-11-28T11:09:53.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea3fff700 1 -- 172.21.15.125:0/1948756923 learned_addr learned my addr 172.21.15.125:0/1948756923 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:53.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea37fe700 1 --2- 172.21.15.125:0/1948756923 >> v2:172.21.15.167:3300/0 conn(0x7fbea415c810 0x7fbea4160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea2ffd700 1 -- 172.21.15.125:0/1948756923 >> v2:172.21.15.167:3300/0 conn(0x7fbea415c810 msgr2=0x7fbea4160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:53.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea2ffd700 1 --2- 172.21.15.125:0/1948756923 >> v2:172.21.15.167:3300/0 conn(0x7fbea415c810 0x7fbea4160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea2ffd700 1 -- 172.21.15.125:0/1948756923 >> v1:172.21.15.125:6789/0 conn(0x7fbea406cdc0 legacy=0x7fbea406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea2ffd700 1 -- 172.21.15.125:0/1948756923 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4160d30 con 0x7fbea40718e0 2023-11-28T11:09:53.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea27fc700 1 -- 172.21.15.125:0/1948756923 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118117220 0 0) 0x7fbea41607a0 con 0x7fbea406cdc0 2023-11-28T11:09:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea37fe700 1 --2- 172.21.15.125:0/1948756923 >> v2:172.21.15.167:3300/0 conn(0x7fbea415c810 0x7fbea4160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.187+0000 7fbea2ffd700 1 --2- 172.21.15.125:0/1948756923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea40718e0 0x7fbea406c880 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbea40b27c0 tx=0x7fbe94009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f27a58e2b5af86 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.188+0000 7fbea27fc700 1 -- 172.21.15.125:0/1948756923 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94011830 con 0x7fbea40718e0 2023-11-28T11:09:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.188+0000 7fbea27fc700 1 -- 172.21.15.125:0/1948756923 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe94011990 con 0x7fbea40718e0 2023-11-28T11:09:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.188+0000 7fbea27fc700 1 -- 172.21.15.125:0/1948756923 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94011d20 con 0x7fbea40718e0 2023-11-28T11:09:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.188+0000 7fbea9c86700 1 -- 172.21.15.125:0/1948756923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea40718e0 msgr2=0x7fbea406c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.188+0000 7fbea9c86700 1 --2- 172.21.15.125:0/1948756923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea40718e0 0x7fbea406c880 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbea40b27c0 tx=0x7fbe94009b20 comp rx=0 tx=0).stop 2023-11-28T11:09:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.188+0000 7fbea9c86700 1 -- 172.21.15.125:0/1948756923 shutdown_connections 2023-11-28T11:09:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.188+0000 7fbea9c86700 1 --2- 172.21.15.125:0/1948756923 >> v2:172.21.15.167:3300/0 conn(0x7fbea415c810 0x7fbea4160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.188+0000 7fbea9c86700 1 --2- 172.21.15.125:0/1948756923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea40718e0 0x7fbea406c880 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.188+0000 7fbea9c86700 1 -- 172.21.15.125:0/1948756923 >> 172.21.15.125:0/1948756923 conn(0x7fbea406c010 msgr2=0x7fbea40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.188+0000 7fbea9c86700 1 -- 172.21.15.125:0/1948756923 shutdown_connections 2023-11-28T11:09:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.188+0000 7fbea9c86700 1 -- 172.21.15.125:0/1948756923 wait complete. 2023-11-28T11:09:53.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.189+0000 7fbea9c86700 1 Processor -- start 2023-11-28T11:09:53.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.190+0000 7fbea9c86700 1 -- start start 2023-11-28T11:09:53.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.190+0000 7fbea9c86700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbea406cdc0 0x7fbea414dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.190+0000 7fbea9c86700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea40718e0 0x7fbea415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.190+0000 7fbea9c86700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbea415c810 0x7fbea415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.190+0000 7fbea9c86700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea414e1d0 con 0x7fbea40718e0 2023-11-28T11:09:53.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.190+0000 7fbea9c86700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea40b4510 con 0x7fbea406cdc0 2023-11-28T11:09:53.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.190+0000 7fbea9c86700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea40b47f0 con 0x7fbea415c810 2023-11-28T11:09:53.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.190+0000 7fbea2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea40718e0 0x7fbea415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea40718e0 0x7fbea415a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59224/0 (socket says 172.21.15.125:59224) 2023-11-28T11:09:53.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea2ffd700 1 -- 172.21.15.125:0/2897249070 learned_addr learned my addr 172.21.15.125:0/2897249070 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:53.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea37fe700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbea406cdc0 0x7fbea414dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea3fff700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbea415c810 0x7fbea415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea2ffd700 1 -- 172.21.15.125:0/2897249070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbea415c810 msgr2=0x7fbea415b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea2ffd700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbea415c810 0x7fbea415b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea2ffd700 1 -- 172.21.15.125:0/2897249070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbea406cdc0 msgr2=0x7fbea414dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea2ffd700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbea406cdc0 0x7fbea414dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea2ffd700 1 -- 172.21.15.125:0/2897249070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe940094a0 con 0x7fbea40718e0 2023-11-28T11:09:53.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea2ffd700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea40718e0 0x7fbea415a7e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbe94000c00 tx=0x7fbe94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbe8bfff700 1 -- 172.21.15.125:0/2897249070 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe940045d0 con 0x7fbea40718e0 2023-11-28T11:09:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbe8bfff700 1 -- 172.21.15.125:0/2897249070 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9401f070 con 0x7fbea40718e0 2023-11-28T11:09:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea9c86700 1 -- 172.21.15.125:0/2897249070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea40ceb20 con 0x7fbea40718e0 2023-11-28T11:09:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbe8bfff700 1 -- 172.21.15.125:0/2897249070 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe940038c0 con 0x7fbea40718e0 2023-11-28T11:09:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.191+0000 7fbea9c86700 1 -- 172.21.15.125:0/2897249070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea4161010 con 0x7fbea40718e0 2023-11-28T11:09:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.192+0000 7fbea9c86700 1 -- 172.21.15.125:0/2897249070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea40ce740 con 0x7fbea40718e0 2023-11-28T11:09:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.192+0000 7fbe8bfff700 1 -- 172.21.15.125:0/2897249070 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbe9400f050 con 0x7fbea40718e0 2023-11-28T11:09:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.193+0000 7fbe8bfff700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe900682f0 0x7fbe9006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.193+0000 7fbe8bfff700 1 -- 172.21.15.125:0/2897249070 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe94021070 con 0x7fbea40718e0 2023-11-28T11:09:53.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.193+0000 7fbea37fe700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe900682f0 0x7fbe9006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.193+0000 7fbea37fe700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe900682f0 0x7fbe9006a7a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbe98006fd0 tx=0x7fbe98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:53.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.197+0000 7fbe8bfff700 1 -- 172.21.15.125:0/2897249070 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbe94053e70 con 0x7fbea40718e0 2023-11-28T11:09:53.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.454+0000 7fbea9c86700 1 -- 172.21.15.125:0/2897249070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fbea40743f0 con 0x7fbea40718e0 2023-11-28T11:09:53.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.457+0000 7fbe8bfff700 1 -- 172.21.15.125:0/2897249070 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbe940150e0 con 0x7fbea40718e0 2023-11-28T11:09:53.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.459+0000 7fbea9c86700 1 -- 172.21.15.125:0/2897249070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe900682f0 msgr2=0x7fbe9006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.459+0000 7fbea9c86700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe900682f0 0x7fbe9006a7a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbe98006fd0 tx=0x7fbe98008040 comp rx=0 tx=0).stop 2023-11-28T11:09:53.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.459+0000 7fbea9c86700 1 -- 172.21.15.125:0/2897249070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea40718e0 msgr2=0x7fbea415a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.459+0000 7fbea9c86700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea40718e0 0x7fbea415a7e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbe94000c00 tx=0x7fbe94004750 comp rx=0 tx=0).stop 2023-11-28T11:09:53.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.459+0000 7fbea9c86700 1 -- 172.21.15.125:0/2897249070 shutdown_connections 2023-11-28T11:09:53.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.459+0000 7fbea9c86700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe900682f0 0x7fbe9006a7a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.459+0000 7fbea9c86700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbea415c810 0x7fbea415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.459+0000 7fbea9c86700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbea406cdc0 0x7fbea414dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.459+0000 7fbea9c86700 1 --2- 172.21.15.125:0/2897249070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea40718e0 0x7fbea415a7e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.459+0000 7fbea9c86700 1 -- 172.21.15.125:0/2897249070 >> 172.21.15.125:0/2897249070 conn(0x7fbea406c010 msgr2=0x7fbea4155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:53.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.460+0000 7fbea9c86700 1 -- 172.21.15.125:0/2897249070 shutdown_connections 2023-11-28T11:09:53.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.460+0000 7fbea9c86700 1 -- 172.21.15.125:0/2897249070 wait complete. 2023-11-28T11:09:53.462 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-11-28T11:09:53.472 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:09:53.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.591+0000 7f281c2ef700 1 Processor -- start 2023-11-28T11:09:53.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.591+0000 7f281c2ef700 1 -- start start 2023-11-28T11:09:53.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.592+0000 7f281c2ef700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28140d0c60 0x7f28140b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.592+0000 7f281c2ef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f281406e400 0x7f28140d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.592+0000 7f281c2ef700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2814160e70 0x7f281406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.592+0000 7f281c2ef700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28140d1570 con 0x7f281406e400 2023-11-28T11:09:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.592+0000 7f281c2ef700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281406e900 con 0x7f2814160e70 2023-11-28T11:09:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.592+0000 7f281c2ef700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2814160390 con 0x7f28140d0c60 2023-11-28T11:09:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.592+0000 7f281988a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f281406e400 0x7f28140d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.592+0000 7f281988a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f281406e400 0x7f28140d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59232/0 (socket says 172.21.15.125:59232) 2023-11-28T11:09:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.592+0000 7f281988a700 1 -- 172.21.15.125:0/85442978 learned_addr learned my addr 172.21.15.125:0/85442978 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.592+0000 7f281a08b700 1 --2- 172.21.15.125:0/85442978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28140d0c60 0x7f28140b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.592+0000 7f281a88c700 1 --2- 172.21.15.125:0/85442978 >> v2:172.21.15.167:3300/0 conn(0x7f2814160e70 0x7f281406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.593+0000 7f281988a700 1 -- 172.21.15.125:0/85442978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28140d0c60 msgr2=0x7f28140b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.593+0000 7f281988a700 1 --2- 172.21.15.125:0/85442978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28140d0c60 0x7f28140b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.593+0000 7f281988a700 1 -- 172.21.15.125:0/85442978 >> v2:172.21.15.167:3300/0 conn(0x7f2814160e70 msgr2=0x7f281406f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.593+0000 7f281988a700 1 --2- 172.21.15.125:0/85442978 >> v2:172.21.15.167:3300/0 conn(0x7f2814160e70 0x7f281406f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.593+0000 7f281988a700 1 -- 172.21.15.125:0/85442978 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814160670 con 0x7f281406e400 2023-11-28T11:09:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.593+0000 7f281988a700 1 --2- 172.21.15.125:0/85442978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f281406e400 0x7f28140d1030 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2814160130 tx=0x7f2804009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3f249583fbe306 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.593+0000 7f2819089700 1 -- 172.21.15.125:0/85442978 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804011830 con 0x7f281406e400 2023-11-28T11:09:53.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.593+0000 7f2819089700 1 -- 172.21.15.125:0/85442978 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2804011990 con 0x7f281406e400 2023-11-28T11:09:53.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.593+0000 7f2819089700 1 -- 172.21.15.125:0/85442978 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804011d20 con 0x7f281406e400 2023-11-28T11:09:53.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.594+0000 7f281c2ef700 1 -- 172.21.15.125:0/85442978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f281406e400 msgr2=0x7f28140d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.594+0000 7f281c2ef700 1 --2- 172.21.15.125:0/85442978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f281406e400 0x7f28140d1030 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2814160130 tx=0x7f2804009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.594+0000 7f281c2ef700 1 -- 172.21.15.125:0/85442978 shutdown_connections 2023-11-28T11:09:53.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.594+0000 7f281c2ef700 1 --2- 172.21.15.125:0/85442978 >> v2:172.21.15.167:3300/0 conn(0x7f2814160e70 0x7f281406f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.594+0000 7f281c2ef700 1 --2- 172.21.15.125:0/85442978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28140d0c60 0x7f28140b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.594+0000 7f281c2ef700 1 --2- 172.21.15.125:0/85442978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f281406e400 0x7f28140d1030 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.594+0000 7f281c2ef700 1 -- 172.21.15.125:0/85442978 >> 172.21.15.125:0/85442978 conn(0x7f281406a270 msgr2=0x7f281406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:53.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.594+0000 7f281c2ef700 1 -- 172.21.15.125:0/85442978 shutdown_connections 2023-11-28T11:09:53.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.594+0000 7f281c2ef700 1 -- 172.21.15.125:0/85442978 wait complete. 2023-11-28T11:09:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.595+0000 7f281c2ef700 1 Processor -- start 2023-11-28T11:09:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.595+0000 7f281c2ef700 1 -- start start 2023-11-28T11:09:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281c2ef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f281406e400 0x7f2814153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281c2ef700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28140d0c60 0x7f28141e7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281c2ef700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2814160e70 0x7f28141505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281c2ef700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28141e78d0 con 0x7f281406e400 2023-11-28T11:09:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281c2ef700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28141e7bb0 con 0x7f2814160e70 2023-11-28T11:09:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281c2ef700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28141e7e90 con 0x7f28140d0c60 2023-11-28T11:09:53.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281a08b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f281406e400 0x7f2814153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281a08b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f281406e400 0x7f2814153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59236/0 (socket says 172.21.15.125:59236) 2023-11-28T11:09:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281a08b700 1 -- 172.21.15.125:0/1903932014 learned_addr learned my addr 172.21.15.125:0/1903932014 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281a88c700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2814160e70 0x7f28141505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281988a700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28140d0c60 0x7f28141e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281a08b700 1 -- 172.21.15.125:0/1903932014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28140d0c60 msgr2=0x7f28141e7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281a08b700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28140d0c60 0x7f28141e7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281a08b700 1 -- 172.21.15.125:0/1903932014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2814160e70 msgr2=0x7f28141505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281a08b700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2814160e70 0x7f28141505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281a08b700 1 -- 172.21.15.125:0/1903932014 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2804009550 con 0x7f281406e400 2023-11-28T11:09:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281988a700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28140d0c60 0x7f28141e7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281a88c700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2814160e70 0x7f28141505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281a08b700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f281406e400 0x7f2814153540 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f281000e930 tx=0x7f281000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f280affd700 1 -- 172.21.15.125:0/1903932014 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810009690 con 0x7f281406e400 2023-11-28T11:09:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f280affd700 1 -- 172.21.15.125:0/1903932014 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281000c850 con 0x7f281406e400 2023-11-28T11:09:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281c2ef700 1 -- 172.21.15.125:0/1903932014 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28140d0740 con 0x7f281406e400 2023-11-28T11:09:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f280affd700 1 -- 172.21.15.125:0/1903932014 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000cbe0 con 0x7f281406e400 2023-11-28T11:09:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.596+0000 7f281c2ef700 1 -- 172.21.15.125:0/1903932014 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2814160950 con 0x7f281406e400 2023-11-28T11:09:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.597+0000 7f281c2ef700 1 -- 172.21.15.125:0/1903932014 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281406fbf0 con 0x7f281406e400 2023-11-28T11:09:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.598+0000 7f280affd700 1 -- 172.21.15.125:0/1903932014 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2810019030 con 0x7f281406e400 2023-11-28T11:09:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.598+0000 7f280affd700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f27f80682f0 0x7f27f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.598+0000 7f280affd700 1 -- 172.21.15.125:0/1903932014 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2810085c10 con 0x7f281406e400 2023-11-28T11:09:53.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.598+0000 7f281988a700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f27f80682f0 0x7f27f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:53.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.599+0000 7f281988a700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f27f80682f0 0x7f27f806a7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f281406e830 tx=0x7f2804008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:53.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.603+0000 7f280affd700 1 -- 172.21.15.125:0/1903932014 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2810052470 con 0x7f281406e400 2023-11-28T11:09:53.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.828+0000 7f281c2ef700 1 -- 172.21.15.125:0/1903932014 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28140743f0 con 0x7f281406e400 2023-11-28T11:09:53.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.829+0000 7f280affd700 1 -- 172.21.15.125:0/1903932014 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f2810017090 con 0x7f281406e400 2023-11-28T11:09:53.830 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:53.830 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1240521006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1240521006},{"type":"v1","addr":"172.21.15.167:6834","nonce":1240521006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2122606110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2122606110},{"type":"v1","addr":"172.21.15.167:6835","nonce":2122606110}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5280,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/888812458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":888812458},{"type":"v1","addr":"172.21.15.125:6835","nonce":888812458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:09:48.560821+0000","modified":"2023-11-28T11:09:51.580459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/2632892245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2632892245},{"type":"v1","addr":"172.21.15.125:6837","nonce":2632892245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:09:53.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 -- 172.21.15.125:0/1903932014 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f27f80682f0 msgr2=0x7f27f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f27f80682f0 0x7f27f806a7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f281406e830 tx=0x7f2804008030 comp rx=0 tx=0).stop 2023-11-28T11:09:53.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 -- 172.21.15.125:0/1903932014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f281406e400 msgr2=0x7f2814153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:53.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f281406e400 0x7f2814153540 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f281000e930 tx=0x7f281000ecf0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 -- 172.21.15.125:0/1903932014 shutdown_connections 2023-11-28T11:09:53.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2814160e70 0x7f28141505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f281406e400 0x7f2814153540 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f27f80682f0 0x7f27f806a7a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 --2- 172.21.15.125:0/1903932014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28140d0c60 0x7f28141e7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:53.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 -- 172.21.15.125:0/1903932014 >> 172.21.15.125:0/1903932014 conn(0x7f281406a270 msgr2=0x7f28140b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:53.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 -- 172.21.15.125:0/1903932014 shutdown_connections 2023-11-28T11:09:53.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:53.831+0000 7f281c2ef700 1 -- 172.21.15.125:0/1903932014 wait complete. 2023-11-28T11:09:53.833 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 16 2023-11-28T11:09:54.249 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:09:48.560821+0000', 'modified': '2023-11-28T11:09:51.580459+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5298}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5298': {'gid': 5298, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6837/2632892245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6836', 'nonce': 2632892245}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 2632892245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:09:54.249 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:09:54.250 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T11:09:54.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.371+0000 7f24e8ef3700 1 Processor -- start 2023-11-28T11:09:54.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.371+0000 7f24e8ef3700 1 -- start start 2023-11-28T11:09:54.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.372+0000 7f24e8ef3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24e40b2ee0 0x7f24e40d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.372+0000 7f24e8ef3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e40cc200 0x7f24e40ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.372+0000 7f24e8ef3700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e415a9c0 con 0x7f24e415a5f0 2023-11-28T11:09:54.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.372+0000 7f24e8ef3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e40c7b80 con 0x7f24e40b2ee0 2023-11-28T11:09:54.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.372+0000 7f24e8ef3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e40cc990 con 0x7f24e40cc200 2023-11-28T11:09:54.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.372+0000 7f24e1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24e40b2ee0 0x7f24e40d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.372+0000 7f24e1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24e40b2ee0 0x7f24e40d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59246/0 (socket says 172.21.15.125:59246) 2023-11-28T11:09:54.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.372+0000 7f24e1d9b700 1 -- 172.21.15.125:0/2134938592 learned_addr learned my addr 172.21.15.125:0/2134938592 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.372+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/2134938592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e40cc200 0x7f24e40ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e1d9b700 1 -- 172.21.15.125:0/2134938592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e40cc200 msgr2=0x7f24e40ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/2134938592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e40cc200 0x7f24e40ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e1d9b700 1 -- 172.21.15.125:0/2134938592 >> v1:172.21.15.167:6789/0 conn(0x7f24e415a5f0 legacy=0x7f24e40b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e1d9b700 1 -- 172.21.15.125:0/2134938592 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e40ccc70 con 0x7f24e40b2ee0 2023-11-28T11:09:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/2134938592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e40b2ee0 0x7f24e40d0ad0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f24d40098f0 tx=0x7f24d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48ba397a54a23 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e159a700 1 -- 172.21.15.125:0/2134938592 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400b8a0 con 0x7f24e40b2ee0 2023-11-28T11:09:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e159a700 1 -- 172.21.15.125:0/2134938592 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d400ba00 con 0x7f24e40b2ee0 2023-11-28T11:09:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e159a700 1 -- 172.21.15.125:0/2134938592 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400bd90 con 0x7f24e40b2ee0 2023-11-28T11:09:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2134938592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e40b2ee0 msgr2=0x7f24e40d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e8ef3700 1 --2- 172.21.15.125:0/2134938592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e40b2ee0 0x7f24e40d0ad0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f24d40098f0 tx=0x7f24d4009c00 comp rx=0 tx=0).stop 2023-11-28T11:09:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2134938592 shutdown_connections 2023-11-28T11:09:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e8ef3700 1 --2- 172.21.15.125:0/2134938592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e40cc200 0x7f24e40ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e8ef3700 1 --2- 172.21.15.125:0/2134938592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e40b2ee0 0x7f24e40d0ad0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.373+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2134938592 >> 172.21.15.125:0/2134938592 conn(0x7f24e406ea80 msgr2=0x7f24e406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.374+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2134938592 shutdown_connections 2023-11-28T11:09:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.374+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2134938592 wait complete. 2023-11-28T11:09:54.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.375+0000 7f24e8ef3700 1 Processor -- start 2023-11-28T11:09:54.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.375+0000 7f24e8ef3700 1 -- start start 2023-11-28T11:09:54.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e8ef3700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40b2ee0 0x7f24e40c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e8ef3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e40cc200 0x7f24e40ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e8ef3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e415a5f0 0x7f24e4146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e8ef3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41e5b30 con 0x7f24e40cc200 2023-11-28T11:09:54.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e8ef3700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41e4a90 con 0x7f24e40b2ee0 2023-11-28T11:09:54.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e8ef3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41e4d70 con 0x7f24e415a5f0 2023-11-28T11:09:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e1d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e40cc200 0x7f24e40ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e1d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e40cc200 0x7f24e40ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59252/0 (socket says 172.21.15.125:59252) 2023-11-28T11:09:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e1d9b700 1 -- 172.21.15.125:0/2927260828 learned_addr learned my addr 172.21.15.125:0/2927260828 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e259c700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40b2ee0 0x7f24e40c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e415a5f0 0x7f24e4146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e1d9b700 1 -- 172.21.15.125:0/2927260828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e415a5f0 msgr2=0x7f24e4146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e415a5f0 0x7f24e4146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e1d9b700 1 -- 172.21.15.125:0/2927260828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40b2ee0 msgr2=0x7f24e40c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40b2ee0 0x7f24e40c5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e1d9b700 1 -- 172.21.15.125:0/2927260828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d4009550 con 0x7f24e40cc200 2023-11-28T11:09:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e40cc200 0x7f24e40ceea0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009c40 tx=0x7f24d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24d2ffd700 1 -- 172.21.15.125:0/2927260828 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d40036a0 con 0x7f24e40cc200 2023-11-28T11:09:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24d2ffd700 1 -- 172.21.15.125:0/2927260828 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d401e070 con 0x7f24e40cc200 2023-11-28T11:09:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2927260828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e40cd230 con 0x7f24e40cc200 2023-11-28T11:09:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24d2ffd700 1 -- 172.21.15.125:0/2927260828 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4003a60 con 0x7f24e40cc200 2023-11-28T11:09:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.376+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2927260828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e40ccf50 con 0x7f24e40cc200 2023-11-28T11:09:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.378+0000 7f24d2ffd700 1 -- 172.21.15.125:0/2927260828 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f24d400f050 con 0x7f24e40cc200 2023-11-28T11:09:54.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.378+0000 7f24d2ffd700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c40682f0 0x7f24c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.378+0000 7f24d2ffd700 1 -- 172.21.15.125:0/2927260828 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24d4020070 con 0x7f24e40cc200 2023-11-28T11:09:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.378+0000 7f24e259c700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c40682f0 0x7f24c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.379+0000 7f24e259c700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c40682f0 0x7f24c406a7a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f24d8000f60 tx=0x7f24d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.380+0000 7f24f507cb80 1 Processor -- start 2023-11-28T11:09:54.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.380+0000 7f24f507cb80 1 -- start start 2023-11-28T11:09:54.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.381+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bef810 0x565178bc5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.381+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bed130 0x565178befbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.381+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bf0120 0x565178c0b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.381+0000 7f24f507cb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x565178aafbc0 con 0x565178bef810 2023-11-28T11:09:54.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.381+0000 7f24f507cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x565178b1e350 con 0x565178bed130 2023-11-28T11:09:54.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.381+0000 7f24f507cb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x565178b17880 con 0x565178bf0120 2023-11-28T11:09:54.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.381+0000 7f24e259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bef810 0x565178bc5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.381+0000 7f24e259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bef810 0x565178bc5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59258/0 (socket says 172.21.15.125:59258) 2023-11-28T11:09:54.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.381+0000 7f24e259c700 1 -- 172.21.15.125:0/4097988651 learned_addr learned my addr 172.21.15.125:0/4097988651 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.381+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/4097988651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bf0120 0x565178c0b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.381+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/4097988651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bed130 0x565178befbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24e259c700 1 -- 172.21.15.125:0/4097988651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bf0120 msgr2=0x565178c0b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24e259c700 1 --2- 172.21.15.125:0/4097988651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bf0120 0x565178c0b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24e259c700 1 -- 172.21.15.125:0/4097988651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bed130 msgr2=0x565178befbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24e259c700 1 --2- 172.21.15.125:0/4097988651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bed130 0x565178befbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24e259c700 1 -- 172.21.15.125:0/4097988651 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651789995e0 con 0x565178bef810 2023-11-28T11:09:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/4097988651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bed130 0x565178befbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24e259c700 1 --2- 172.21.15.125:0/4097988651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bef810 0x565178bc5a20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f24d8005360 tx=0x7f24d8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2315306cfbe86dcb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24c3fff700 1 -- 172.21.15.125:0/4097988651 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d80050d0 con 0x565178bef810 2023-11-28T11:09:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24c3fff700 1 -- 172.21.15.125:0/4097988651 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d8003da0 con 0x565178bef810 2023-11-28T11:09:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24c3fff700 1 -- 172.21.15.125:0/4097988651 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8021650 con 0x565178bef810 2023-11-28T11:09:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24f507cb80 1 -- 172.21.15.125:0/4097988651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bef810 msgr2=0x565178bc5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24f507cb80 1 --2- 172.21.15.125:0/4097988651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bef810 0x565178bc5a20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f24d8005360 tx=0x7f24d8011000 comp rx=0 tx=0).stop 2023-11-28T11:09:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24f507cb80 1 -- 172.21.15.125:0/4097988651 shutdown_connections 2023-11-28T11:09:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24f507cb80 1 --2- 172.21.15.125:0/4097988651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bf0120 0x565178c0b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24f507cb80 1 --2- 172.21.15.125:0/4097988651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bef810 0x565178bc5a20 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24f507cb80 1 --2- 172.21.15.125:0/4097988651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bed130 0x565178befbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.382+0000 7f24f507cb80 1 -- 172.21.15.125:0/4097988651 >> 172.21.15.125:0/4097988651 conn(0x565178bc2d60 msgr2=0x565178bc36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:54.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.383+0000 7f24f507cb80 1 -- 172.21.15.125:0/4097988651 shutdown_connections 2023-11-28T11:09:54.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.383+0000 7f24f507cb80 1 -- 172.21.15.125:0/4097988651 wait complete. 2023-11-28T11:09:54.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.383+0000 7f24f507cb80 1 -- start start 2023-11-28T11:09:54.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.383+0000 7f24f507cb80 1 Processor -- start 2023-11-28T11:09:54.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178be0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178be2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 0x565178be2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24f507cb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517899b8d0 con 0x565178bed130 2023-11-28T11:09:54.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24f507cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x565178be08c0 con 0x565178bf0120 2023-11-28T11:09:54.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24f507cb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x565178be15c0 con 0x565178bef810 2023-11-28T11:09:54.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24f507cb80 10 client.0 _ll_register_callbacks cb 0x5651789bd240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:09:54.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24e259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178be0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24e259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178be0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59264/0 (socket says 172.21.15.125:59264) 2023-11-28T11:09:54.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24e259c700 1 -- 172.21.15.125:0/3701464258 learned_addr learned my addr 172.21.15.125:0/3701464258 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:54.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 0x565178be2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.384+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178be2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24e259c700 1 -- 172.21.15.125:0/3701464258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 msgr2=0x565178be2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:54.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24e259c700 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178be2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24e259c700 1 -- 172.21.15.125:0/3701464258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 msgr2=0x565178be2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:54.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24e259c700 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 0x565178be2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24e259c700 1 -- 172.21.15.125:0/3701464258 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d800f040 con 0x565178bed130 2023-11-28T11:09:54.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 0x565178be2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:54.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24e259c700 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178be0380 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x565178bc10d0 tx=0x7f24d8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b63f06d2eecfce8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:54.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:09:54.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24c17fa700 1 -- 172.21.15.125:0/3701464258 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8028070 con 0x565178bed130 2023-11-28T11:09:54.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24c17fa700 1 -- 172.21.15.125:0/3701464258 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24d8021950 con 0x565178bed130 2023-11-28T11:09:54.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24f507cb80 1 -- 172.21.15.125:0/3701464258 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565178ae5140 con 0x565178bed130 2023-11-28T11:09:54.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24c17fa700 1 -- 172.21.15.125:0/3701464258 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24d8021b30 con 0x565178bed130 2023-11-28T11:09:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24f507cb80 10 client.5463 fetch_fsmap learned FSMap version 16 2023-11-28T11:09:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24f507cb80 1 -- 172.21.15.125:0/3701464258 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x565178945d90 con 0x565178bed130 2023-11-28T11:09:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24c17fa700 1 -- 172.21.15.125:0/3701464258 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565178ae5140 con 0x565178bed130 2023-11-28T11:09:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24c17fa700 1 -- 172.21.15.125:0/3701464258 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f24d8021c90 con 0x565178bed130 2023-11-28T11:09:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24f507cb80 10 client.5463 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T11:09:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24f507cb80 10 client.5463 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:09:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24f507cb80 20 client.5463 populate_metadata read hostname 'smithi125' 2023-11-28T11:09:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.125:6836/2632892245,v1:172.21.15.125:6837/2632892245] conn(0x565178be2530 0x565178be54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24f507cb80 4 client.5463 mds_command: new command op to 5298 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:09:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24f507cb80 1 -- 172.21.15.125:0/3701464258 --> [v2:172.21.15.125:6836/2632892245,v1:172.21.15.125:6837/2632892245] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56517899bf10 con 0x565178be2530 2023-11-28T11:09:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.385+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.125:6836/2632892245,v1:172.21.15.125:6837/2632892245] conn(0x565178be2530 0x565178be54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.386+0000 7f24c17fa700 10 client.5463 ms_handle_connect on v2:172.21.15.125:6836/2632892245 2023-11-28T11:09:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.386+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.125:6836/2632892245,v1:172.21.15.125:6837/2632892245] conn(0x565178be2530 0x565178be54f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e39e197bb2d1321 server_cookie=a7a0cb6bbc9588b5 in_seq=0 out_seq=0 2023-11-28T11:09:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.386+0000 7f24c17fa700 1 -- 172.21.15.125:0/3701464258 <== mds.0 v2:172.21.15.125:6836/2632892245 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x56517899bf10 con 0x565178be2530 2023-11-28T11:09:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.386+0000 7f24c17fa700 10 client.5463 handle_command_reply: tid=0 2023-11-28T11:09:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.386+0000 7f24f507cb80 1 client.5463 shutdown 2023-11-28T11:09:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.386+0000 7f24f507cb80 1 -- 172.21.15.125:0/3701464258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 msgr2=0x565178be0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.386+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178be0380 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x565178bc10d0 tx=0x7f24d8013000 comp rx=0 tx=0).stop 2023-11-28T11:09:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.387+0000 7f24f507cb80 1 -- 172.21.15.125:0/3701464258 shutdown_connections 2023-11-28T11:09:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.387+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.125:6836/2632892245,v1:172.21.15.125:6837/2632892245] conn(0x565178be2530 0x565178be54f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.387+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 0x565178be2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.387+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178be0380 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.387+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3701464258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178be2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.387+0000 7f24c17fa700 0 client.5463 ms_handle_reset on v2:172.21.15.125:6836/2632892245 2023-11-28T11:09:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.387+0000 7f24f507cb80 1 -- 172.21.15.125:0/3701464258 >> 172.21.15.125:0/3701464258 conn(0x565178bc2d60 msgr2=0x565178bc5010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.387+0000 7f24f507cb80 1 -- 172.21.15.125:0/3701464258 shutdown_connections 2023-11-28T11:09:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.387+0000 7f24f507cb80 1 -- 172.21.15.125:0/3701464258 wait complete. 2023-11-28T11:09:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.387+0000 7f24f507cb80 20 client.5463 trim_cache size 0 max 16384 2023-11-28T11:09:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.404+0000 7f24f507cb80 1 Processor -- start 2023-11-28T11:09:54.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.404+0000 7f24f507cb80 1 -- start start 2023-11-28T11:09:54.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178befbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178be6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 0x565178c0df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24f507cb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x565178becc70 con 0x565178bed130 2023-11-28T11:09:54.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24f507cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x565178bbf8b0 con 0x565178bf0120 2023-11-28T11:09:54.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24f507cb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x565178c0e4d0 con 0x565178bef810 2023-11-28T11:09:54.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178befbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178befbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59272/0 (socket says 172.21.15.125:59272) 2023-11-28T11:09:54.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e259c700 1 -- 172.21.15.125:0/4182935337 learned_addr learned my addr 172.21.15.125:0/4182935337 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:54.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/4182935337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 0x565178c0df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/4182935337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178be6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e259c700 1 -- 172.21.15.125:0/4182935337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 msgr2=0x565178be6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:54.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e259c700 1 --2- 172.21.15.125:0/4182935337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178be6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e259c700 1 -- 172.21.15.125:0/4182935337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 msgr2=0x565178c0df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:54.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e259c700 1 --2- 172.21.15.125:0/4182935337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 0x565178c0df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e259c700 1 -- 172.21.15.125:0/4182935337 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565178ade140 con 0x565178bed130 2023-11-28T11:09:54.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/4182935337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 0x565178c0df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:54.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/4182935337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178be6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:54.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24e259c700 1 --2- 172.21.15.125:0/4182935337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178befbe0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f24d8003fd0 tx=0x7f24d801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf366ee8c098471 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:54.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24d0ff9700 1 -- 172.21.15.125:0/4182935337 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8013600 con 0x565178bed130 2023-11-28T11:09:54.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24d0ff9700 1 -- 172.21.15.125:0/4182935337 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d8019040 con 0x565178bed130 2023-11-28T11:09:54.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.405+0000 7f24d0ff9700 1 -- 172.21.15.125:0/4182935337 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8021b90 con 0x565178bed130 2023-11-28T11:09:54.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.406+0000 7f24f507cb80 1 -- 172.21.15.125:0/4182935337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 msgr2=0x565178befbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.406+0000 7f24f507cb80 1 --2- 172.21.15.125:0/4182935337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178befbe0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f24d8003fd0 tx=0x7f24d801d000 comp rx=0 tx=0).stop 2023-11-28T11:09:54.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.406+0000 7f24f507cb80 1 -- 172.21.15.125:0/4182935337 shutdown_connections 2023-11-28T11:09:54.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.406+0000 7f24f507cb80 1 --2- 172.21.15.125:0/4182935337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bf0120 0x565178c0df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.406+0000 7f24f507cb80 1 --2- 172.21.15.125:0/4182935337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bed130 0x565178befbe0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.406+0000 7f24f507cb80 1 --2- 172.21.15.125:0/4182935337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178be6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.406+0000 7f24f507cb80 1 -- 172.21.15.125:0/4182935337 >> 172.21.15.125:0/4182935337 conn(0x565178bc2d60 msgr2=0x565178bc1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:54.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.406+0000 7f24f507cb80 1 -- 172.21.15.125:0/4182935337 shutdown_connections 2023-11-28T11:09:54.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.406+0000 7f24f507cb80 1 -- 172.21.15.125:0/4182935337 wait complete. 2023-11-28T11:09:54.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.406+0000 7f24f507cb80 1 -- start start 2023-11-28T11:09:54.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.407+0000 7f24f507cb80 1 Processor -- start 2023-11-28T11:09:54.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bed130 0x565178bf29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178c733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24f507cb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bf0120 0x565178bedc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24f507cb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x565178bc60b0 con 0x565178bf0120 2023-11-28T11:09:54.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24f507cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x565178bc06e0 con 0x565178bed130 2023-11-28T11:09:54.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24f507cb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x565178c03bd0 con 0x565178bef810 2023-11-28T11:09:54.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24f507cb80 10 client.0 _ll_register_callbacks cb 0x5651789bd240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:09:54.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24e2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bf0120 0x565178bedc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24e2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bf0120 0x565178bedc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59282/0 (socket says 172.21.15.125:59282) 2023-11-28T11:09:54.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24e2d9d700 1 -- 172.21.15.125:0/3748728281 learned_addr learned my addr 172.21.15.125:0/3748728281 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:54.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24e1d9b700 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178c733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24e259c700 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bed130 0x565178bf29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24e2d9d700 1 -- 172.21.15.125:0/3748728281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 msgr2=0x565178c733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:54.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178c733e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24e2d9d700 1 -- 172.21.15.125:0/3748728281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bed130 msgr2=0x565178bf29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:54.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bed130 0x565178bf29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24e2d9d700 1 -- 172.21.15.125:0/3748728281 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565178945d90 con 0x565178bf0120 2023-11-28T11:09:54.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24e2d9d700 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bf0120 0x565178bedc10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f24dc007950 tx=0x7f24dc007980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2569459bb21078 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:54.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.408+0000 7f24c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:09:54.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24c17fa700 1 -- 172.21.15.125:0/3748728281 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc016640 con 0x565178bf0120 2023-11-28T11:09:54.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24c17fa700 1 -- 172.21.15.125:0/3748728281 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24dc0167a0 con 0x565178bf0120 2023-11-28T11:09:54.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24f507cb80 1 -- 172.21.15.125:0/3748728281 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565178ad5160 con 0x565178bf0120 2023-11-28T11:09:54.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24c17fa700 1 -- 172.21.15.125:0/3748728281 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24dc016960 con 0x565178bf0120 2023-11-28T11:09:54.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24f507cb80 10 client.5469 fetch_fsmap learned FSMap version 16 2023-11-28T11:09:54.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24f507cb80 1 -- 172.21.15.125:0/3748728281 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56517896c200 con 0x565178bf0120 2023-11-28T11:09:54.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24c17fa700 1 -- 172.21.15.125:0/3748728281 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565178ad5160 con 0x565178bf0120 2023-11-28T11:09:54.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24c17fa700 1 -- 172.21.15.125:0/3748728281 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f24dc016ac0 con 0x565178bf0120 2023-11-28T11:09:54.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24f507cb80 10 client.5469 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T11:09:54.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24f507cb80 10 client.5469 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:09:54.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24f507cb80 20 client.5469 populate_metadata read hostname 'smithi125' 2023-11-28T11:09:54.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.125:6836/2632892245,v1:172.21.15.125:6837/2632892245] conn(0x565178be2960 0x565178be2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24f507cb80 4 client.5469 mds_command: new command op to 5298 tid=0[{"prefix": "status"}] 2023-11-28T11:09:54.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24f507cb80 1 -- 172.21.15.125:0/3748728281 --> [v2:172.21.15.125:6836/2632892245,v1:172.21.15.125:6837/2632892245] -- command(tid 0: {"prefix": "status"}) v1 -- 0x565178abf170 con 0x565178be2960 2023-11-28T11:09:54.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24e259c700 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.125:6836/2632892245,v1:172.21.15.125:6837/2632892245] conn(0x565178be2960 0x565178be2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24c17fa700 10 client.5469 ms_handle_connect on v2:172.21.15.125:6836/2632892245 2023-11-28T11:09:54.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.409+0000 7f24e259c700 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.125:6836/2632892245,v1:172.21.15.125:6837/2632892245] conn(0x565178be2960 0x565178be2d30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=152ba6e375070ce server_cookie=9b58fe5271e0263d in_seq=0 out_seq=0 2023-11-28T11:09:54.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24c17fa700 1 -- 172.21.15.125:0/3748728281 <== mds.0 v2:172.21.15.125:6836/2632892245 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x565178abf170 con 0x565178be2960 2023-11-28T11:09:54.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24c17fa700 10 client.5469 handle_command_reply: tid=0 2023-11-28T11:09:54.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 1 client.5469 shutdown 2023-11-28T11:09:54.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 1 -- 172.21.15.125:0/3748728281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bf0120 msgr2=0x565178bedc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bf0120 0x565178bedc10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f24dc007950 tx=0x7f24dc007980 comp rx=0 tx=0).stop 2023-11-28T11:09:54.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 1 -- 172.21.15.125:0/3748728281 shutdown_connections 2023-11-28T11:09:54.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.125:6836/2632892245,v1:172.21.15.125:6837/2632892245] conn(0x565178be2960 0x565178be2d30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565178bf0120 0x565178bedc10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565178bed130 0x565178bf29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 1 --2- 172.21.15.125:0/3748728281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565178bef810 0x565178c733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24c17fa700 0 client.5469 ms_handle_reset on v2:172.21.15.125:6836/2632892245 2023-11-28T11:09:54.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 1 -- 172.21.15.125:0/3748728281 >> 172.21.15.125:0/3748728281 conn(0x565178bc2d60 msgr2=0x565178bbf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:54.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 1 -- 172.21.15.125:0/3748728281 shutdown_connections 2023-11-28T11:09:54.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 1 -- 172.21.15.125:0/3748728281 wait complete. 2023-11-28T11:09:54.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24f507cb80 20 client.5469 trim_cache size 0 max 16384 2023-11-28T11:09:54.423 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:09:54.423 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea", 2023-11-28T11:09:54.423 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-11-28T11:09:54.423 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5298, 2023-11-28T11:09:54.423 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-11-28T11:09:54.423 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-11-28T11:09:54.423 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-11-28T11:09:54.423 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 5.8476808980000001, 2023-11-28T11:09:54.423 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 16, 2023-11-28T11:09:54.423 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 38, 2023-11-28T11:09:54.424 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 38, 2023-11-28T11:09:54.424 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 13.153696854 2023-11-28T11:09:54.424 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:09:54.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2927260828 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c40682f0 msgr2=0x7f24c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24e8ef3700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c40682f0 0x7f24c406a7a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f24d8000f60 tx=0x7f24d8009040 comp rx=0 tx=0).stop 2023-11-28T11:09:54.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2927260828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e40cc200 msgr2=0x7f24e40ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.410+0000 7f24e8ef3700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e40cc200 0x7f24e40ceea0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009c40 tx=0x7f24d4004750 comp rx=0 tx=0).stop 2023-11-28T11:09:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.411+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2927260828 shutdown_connections 2023-11-28T11:09:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.411+0000 7f24e8ef3700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24c40682f0 0x7f24c406a7a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.411+0000 7f24e8ef3700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e415a5f0 0x7f24e4146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.411+0000 7f24e8ef3700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40b2ee0 0x7f24e40c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.411+0000 7f24e8ef3700 1 --2- 172.21.15.125:0/2927260828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24e40cc200 0x7f24e40ceea0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.411+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2927260828 >> 172.21.15.125:0/2927260828 conn(0x7f24e406ea80 msgr2=0x7f24e40d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:54.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.411+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2927260828 shutdown_connections 2023-11-28T11:09:54.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.411+0000 7f24e8ef3700 1 -- 172.21.15.125:0/2927260828 wait complete. 2023-11-28T11:09:54.427 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:09:54.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.547+0000 7fcad5d34700 1 Processor -- start 2023-11-28T11:09:54.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.547+0000 7fcad5d34700 1 -- start start 2023-11-28T11:09:54.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.547+0000 7fcad5d34700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcad006a270 0x7fcad006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.547+0000 7fcad5d34700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcad015cc80 0x7fcad006de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.547+0000 7fcad5d34700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006e3a0 0x7fcad006ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.547+0000 7fcad5d34700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad00b2490 con 0x7fcad015cc80 2023-11-28T11:09:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcad5d34700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad006ab80 con 0x7fcad006a270 2023-11-28T11:09:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcad5d34700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00b1810 con 0x7fcad006e3a0 2023-11-28T11:09:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcaceffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcad015cc80 0x7fcad006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcaceffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcad015cc80 0x7fcad006de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59288/0 (socket says 172.21.15.125:59288) 2023-11-28T11:09:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcaceffd700 1 -- 172.21.15.125:0/2605109570 learned_addr learned my addr 172.21.15.125:0/2605109570 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcacf7fe700 1 --2- 172.21.15.125:0/2605109570 >> v2:172.21.15.167:3300/0 conn(0x7fcad006a270 0x7fcad006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcacffff700 1 --2- 172.21.15.125:0/2605109570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006e3a0 0x7fcad006ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcaceffd700 1 -- 172.21.15.125:0/2605109570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006e3a0 msgr2=0x7fcad006ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcaceffd700 1 --2- 172.21.15.125:0/2605109570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006e3a0 0x7fcad006ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcaceffd700 1 -- 172.21.15.125:0/2605109570 >> v2:172.21.15.167:3300/0 conn(0x7fcad006a270 msgr2=0x7fcad006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcaceffd700 1 --2- 172.21.15.125:0/2605109570 >> v2:172.21.15.167:3300/0 conn(0x7fcad006a270 0x7fcad006a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcaceffd700 1 -- 172.21.15.125:0/2605109570 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad00b1af0 con 0x7fcad015cc80 2023-11-28T11:09:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcacf7fe700 1 --2- 172.21.15.125:0/2605109570 >> v2:172.21.15.167:3300/0 conn(0x7fcad006a270 0x7fcad006a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcaceffd700 1 --2- 172.21.15.125:0/2605109570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad015cc80 0x7fcad006de60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcad0067380 tx=0x7fcac0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5794c9f074950e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcace7fc700 1 -- 172.21.15.125:0/2605109570 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000b870 con 0x7fcad015cc80 2023-11-28T11:09:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcace7fc700 1 -- 172.21.15.125:0/2605109570 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac000b9d0 con 0x7fcad015cc80 2023-11-28T11:09:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.548+0000 7fcace7fc700 1 -- 172.21.15.125:0/2605109570 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000bd60 con 0x7fcad015cc80 2023-11-28T11:09:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.549+0000 7fcad5d34700 1 -- 172.21.15.125:0/2605109570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad015cc80 msgr2=0x7fcad006de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.549+0000 7fcad5d34700 1 --2- 172.21.15.125:0/2605109570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad015cc80 0x7fcad006de60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcad0067380 tx=0x7fcac0009bd0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.549+0000 7fcad5d34700 1 -- 172.21.15.125:0/2605109570 shutdown_connections 2023-11-28T11:09:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.549+0000 7fcad5d34700 1 --2- 172.21.15.125:0/2605109570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006e3a0 0x7fcad006ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.549+0000 7fcad5d34700 1 --2- 172.21.15.125:0/2605109570 >> v2:172.21.15.167:3300/0 conn(0x7fcad006a270 0x7fcad006a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.549+0000 7fcad5d34700 1 --2- 172.21.15.125:0/2605109570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad015cc80 0x7fcad006de60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.549+0000 7fcad5d34700 1 -- 172.21.15.125:0/2605109570 >> 172.21.15.125:0/2605109570 conn(0x7fcad006c010 msgr2=0x7fcad00cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.549+0000 7fcad5d34700 1 -- 172.21.15.125:0/2605109570 shutdown_connections 2023-11-28T11:09:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.549+0000 7fcad5d34700 1 -- 172.21.15.125:0/2605109570 wait complete. 2023-11-28T11:09:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.550+0000 7fcad5d34700 1 Processor -- start 2023-11-28T11:09:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.550+0000 7fcad5d34700 1 -- start start 2023-11-28T11:09:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcad5d34700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006a270 0x7fcad01523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcad5d34700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad006e3a0 0x7fcad00b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcad5d34700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcad015cc80 0x7fcad015b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcad5d34700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00b3170 con 0x7fcad006e3a0 2023-11-28T11:09:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcad5d34700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0152910 con 0x7fcad015cc80 2023-11-28T11:09:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcad5d34700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad015f380 con 0x7fcad006a270 2023-11-28T11:09:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcaceffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad006e3a0 0x7fcad00b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcaceffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad006e3a0 0x7fcad00b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59294/0 (socket says 172.21.15.125:59294) 2023-11-28T11:09:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcaceffd700 1 -- 172.21.15.125:0/1463630200 learned_addr learned my addr 172.21.15.125:0/1463630200 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcacf7fe700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006a270 0x7fcad01523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcaceffd700 1 -- 172.21.15.125:0/1463630200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006a270 msgr2=0x7fcad01523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcaceffd700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006a270 0x7fcad01523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcaceffd700 1 -- 172.21.15.125:0/1463630200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcad015cc80 msgr2=0x7fcad015b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcaceffd700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcad015cc80 0x7fcad015b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcaceffd700 1 -- 172.21.15.125:0/1463630200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0009550 con 0x7fcad006e3a0 2023-11-28T11:09:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.551+0000 7fcaceffd700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad006e3a0 0x7fcad00b3600 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcac0014040 tx=0x7fcac0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.552+0000 7fcac7fff700 1 -- 172.21.15.125:0/1463630200 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0004310 con 0x7fcad006e3a0 2023-11-28T11:09:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.552+0000 7fcac7fff700 1 -- 172.21.15.125:0/1463630200 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac001f070 con 0x7fcad006e3a0 2023-11-28T11:09:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.552+0000 7fcac7fff700 1 -- 172.21.15.125:0/1463630200 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00036a0 con 0x7fcad006e3a0 2023-11-28T11:09:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.552+0000 7fcad5d34700 1 -- 172.21.15.125:0/1463630200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad00b20b0 con 0x7fcad006e3a0 2023-11-28T11:09:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.552+0000 7fcad5d34700 1 -- 172.21.15.125:0/1463630200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad00b1dd0 con 0x7fcad006e3a0 2023-11-28T11:09:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.552+0000 7fcad5d34700 1 -- 172.21.15.125:0/1463630200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad006e800 con 0x7fcad006e3a0 2023-11-28T11:09:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.553+0000 7fcac7fff700 1 -- 172.21.15.125:0/1463630200 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcac000f050 con 0x7fcad006e3a0 2023-11-28T11:09:54.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.553+0000 7fcac7fff700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcab0068320 0x7fcab006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:54.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.553+0000 7fcacf7fe700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcab0068320 0x7fcab006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:54.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.553+0000 7fcac7fff700 1 -- 172.21.15.125:0/1463630200 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcac00870f0 con 0x7fcad006e3a0 2023-11-28T11:09:54.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.554+0000 7fcacf7fe700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcab0068320 0x7fcab006a7d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcab8006fd0 tx=0x7fcab8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:54.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.558+0000 7fcac7fff700 1 -- 172.21.15.125:0/1463630200 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fcac0053950 con 0x7fcad006e3a0 2023-11-28T11:09:54.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.784+0000 7fcad5d34700 1 -- 172.21.15.125:0/1463630200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcad0160130 con 0x7fcad006e3a0 2023-11-28T11:09:54.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.785+0000 7fcac7fff700 1 -- 172.21.15.125:0/1463630200 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcac0056f70 con 0x7fcad006e3a0 2023-11-28T11:09:54.785 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:09:54.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 -- 172.21.15.125:0/1463630200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcab0068320 msgr2=0x7fcab006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcab0068320 0x7fcab006a7d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcab8006fd0 tx=0x7fcab8008040 comp rx=0 tx=0).stop 2023-11-28T11:09:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 -- 172.21.15.125:0/1463630200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad006e3a0 msgr2=0x7fcad00b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad006e3a0 0x7fcad00b3600 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcac0014040 tx=0x7fcac0004750 comp rx=0 tx=0).stop 2023-11-28T11:09:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 -- 172.21.15.125:0/1463630200 shutdown_connections 2023-11-28T11:09:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcad015cc80 0x7fcad015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcab0068320 0x7fcab006a7d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006a270 0x7fcad01523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 --2- 172.21.15.125:0/1463630200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcad006e3a0 0x7fcad00b3600 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 -- 172.21.15.125:0/1463630200 >> 172.21.15.125:0/1463630200 conn(0x7fcad006c010 msgr2=0x7fcad006dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:54.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 -- 172.21.15.125:0/1463630200 shutdown_connections 2023-11-28T11:09:54.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:54.787+0000 7fcad5d34700 1 -- 172.21.15.125:0/1463630200 wait complete. 2023-11-28T11:09:54.799 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:09:54.799 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:09:54.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-11-28T11:09:54.800 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:09:54.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:09:54.800 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:09:54.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T11:09:54.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:09:54.800 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:09:54.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:54.800 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-11-28T11:09:54.817 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:09:54.817 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:09:54.818 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:09:54.818 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:54.818 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-11-28T11:09:54.818 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:54.818 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:09:54.818 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:09:54.818 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:09:54.818 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:09:54.818 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:09:54.818 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:09:54.818 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:09:54.819 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:09:54.819 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-28T11:09:54.819 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42276sec preferred_lft 42276sec 2023-11-28T11:09:54.819 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::af9c:3934:f827:ab8e/64 scope link noprefixroute 2023-11-28T11:09:54.819 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:54.819 INFO:teuthology.orchestra.run.smithi125.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:09:54.819 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 1e:0c:6e:81:a9:77 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:09:54.819 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:09:54.819 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:54.819 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::2847:a7ff:fe7f:fad9/64 scope link 2023-11-28T11:09:54.819 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:54.820 INFO:teuthology.orchestra.run.smithi125.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:09:54.820 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 8a:65:01:86:2c:a8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:09:54.820 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::8865:1ff:fe86:2ca8/64 scope link 2023-11-28T11:09:54.820 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:54.820 INFO:teuthology.orchestra.run.smithi125.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:09:54.820 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 1e:0c:6e:81:a9:77 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:09:54.820 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::1c0c:6eff:fe81:a977/64 scope link 2023-11-28T11:09:54.820 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:09:54.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:54.821 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:09:54.883 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-11-28T11:09:54.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:54.885 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-11-28T11:09:54.944 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-11-28T11:09:54.944 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:09:54.944 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T11:09:54.944 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T11:09:54.944 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:09:54.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:54.944 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:09:54.945 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:09:54.945 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T11:09:54.945 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T11:09:54.945 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T11:09:54.945 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:09:55.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:55.048 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-11-28T11:09:55.065 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T11:09:55.065 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:09:55.065 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:09:55.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:55.066 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-11-28T11:09:55.132 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T11:09:55.132 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:09:55.132 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:09:55.188 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:09:55.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:09:55.188 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:09:55.244 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-11-28T11:09:55.311 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:09:55.311 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:09:55.377 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:09:55.377 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:09:55.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:55.378 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-28T11:09:55.435 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:09:55.435 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T11:09:55.477 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-11-28T11:09:55.503 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:09:55.503 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:09:55.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2023-11-28T11:09:55.564+0000 7f28116ca5c0 -1 init, newargv = 0x55fa142f2f90 newargc=15 2023-11-28T11:09:55.565 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[119628]: starting ceph client 2023-11-28T11:09:55.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[119628]: starting fuse 2023-11-28T11:09:55.572 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:09:55.573 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:09:55.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:55.574 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-28T11:09:55.631 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-11-28T11:09:55.632 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-11-28T11:09:55.632 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:09:55.632 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-11-28T11:09:55.632 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-11-28T11:09:55.633 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:09:55.633 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-11-28T11:09:55.633 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:09:55.633 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-11-28T11:09:55.633 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T11:09:55.633 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-11-28T11:09:55.633 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T11:09:55.634 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:09:55.634 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-11-28T11:09:55.634 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-11-28T11:09:55.634 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-11-28T11:09:55.634 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-11-28T11:09:55.634 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:09:55.634 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-11-28T11:09:55.634 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:09:55.635 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:09:55.635 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:09:55.635 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-11-28T11:09:55.635 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-11-28T11:09:55.635 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-11-28T11:09:55.635 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:09:55.635 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:09:55.635 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.0")) 2023-11-28T11:09:55.635 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:09:55.755 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.119628.asok 2023-11-28T11:09:55.937 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.119628.asok 2023-11-28T11:09:55.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:55.937 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.119628.asok status 2023-11-28T11:09:56.093 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:09:56.094 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-11-28T11:09:56.094 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:09:56.094 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:09:56.094 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2023-11-28T11:09:56.094 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-11-28T11:09:56.094 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T11:09:56.094 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "119628", 2023-11-28T11:09:56.094 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-11-28T11:09:56.094 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:56.094 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-11-28T11:09:56.095 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-11-28T11:09:56.095 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5484, 2023-11-28T11:09:56.095 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-11-28T11:09:56.095 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-11-28T11:09:56.095 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-11-28T11:09:56.095 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5484 2023-11-28T11:09:56.095 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:56.095 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-28T11:09:56.095 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-28T11:09:56.095 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 4095687257 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 4095687257 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5484 192.168.0.1:0/4095687257", 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/4095687257", 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-11-28T11:09:56.096 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 16, 2023-11-28T11:09:56.097 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 38, 2023-11-28T11:09:56.097 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:09:56.097 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-11-28T11:09:56.097 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-11-28T11:09:56.097 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:09:56.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:56.104 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-11-28T11:09:56.104 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T11:09:56.122 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-11-28T11:09:56.122 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T11:09:56.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:56.122 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:09:56.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:56.191 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2023-11-28T11:09:56.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:56.253 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2023-11-28T11:09:56.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:56.311 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2023-11-28T11:09:56.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:56.370 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2023-11-28T11:09:56.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:56.432 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2023-11-28T11:09:56.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:09:56.491 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-11-28T11:09:56.556 INFO:teuthology.orchestra.run.smithi125.stdout:./ 2023-11-28T11:09:56.557 INFO:teuthology.orchestra.run.smithi125.stdout:./rfile 2023-11-28T11:09:56.557 INFO:teuthology.orchestra.run.smithi125.stdout:./parentdir 2023-11-28T11:09:56.557 INFO:teuthology.orchestra.run.smithi125.stdout:./parentdir/pfile 2023-11-28T11:09:56.557 INFO:teuthology.orchestra.run.smithi125.stdout:./parentdir/childdir 2023-11-28T11:09:56.557 INFO:teuthology.orchestra.run.smithi125.stdout:./parentdir/childdir/cfile 2023-11-28T11:09:56.558 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:09:56.558 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:09:56.558 DEBUG:teuthology.orchestra.run.smithi125:> import stat 2023-11-28T11:09:56.558 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:09:56.558 DEBUG:teuthology.orchestra.run.smithi125:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-11-28T11:09:56.559 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:09:56.663 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-11-28T11:09:56.852 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:09:56.852 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:09:56.852 DEBUG:teuthology.orchestra.run.smithi125:> import stat 2023-11-28T11:09:56.852 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:09:56.852 DEBUG:teuthology.orchestra.run.smithi125:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2023-11-28T11:09:56.852 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:09:56.959 INFO:teuthology.orchestra.run.smithi125.stdout:1099511627778 2023-11-28T11:09:57.148 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:09:57.149 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:09:57.149 DEBUG:teuthology.orchestra.run.smithi125:> import stat 2023-11-28T11:09:57.149 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:09:57.149 DEBUG:teuthology.orchestra.run.smithi125:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2023-11-28T11:09:57.149 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:09:57.254 INFO:teuthology.orchestra.run.smithi125.stdout:1099511627776 2023-11-28T11:09:57.442 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:09:57.443 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:09:57.443 DEBUG:teuthology.orchestra.run.smithi125:> import stat 2023-11-28T11:09:57.443 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:09:57.443 DEBUG:teuthology.orchestra.run.smithi125:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2023-11-28T11:09:57.443 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:09:57.551 INFO:teuthology.orchestra.run.smithi125.stdout:1099511628279 2023-11-28T11:09:57.739 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:09:57.739 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:09:57.740 DEBUG:teuthology.orchestra.run.smithi125:> import stat 2023-11-28T11:09:57.740 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:09:57.740 DEBUG:teuthology.orchestra.run.smithi125:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2023-11-28T11:09:57.740 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:09:57.846 INFO:teuthology.orchestra.run.smithi125.stdout:1099511627777 2023-11-28T11:09:58.035 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:09:58.035 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:09:58.035 DEBUG:teuthology.orchestra.run.smithi125:> import stat 2023-11-28T11:09:58.035 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:09:58.035 DEBUG:teuthology.orchestra.run.smithi125:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2023-11-28T11:09:58.036 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:09:58.142 INFO:teuthology.orchestra.run.smithi125.stdout:1099511628280 2023-11-28T11:09:58.331 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:09:58.331 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:09:58.389 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:09:58.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.549+0000 7ff39b1f0700 1 Processor -- start 2023-11-28T11:09:58.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.549+0000 7ff39b1f0700 1 -- start start 2023-11-28T11:09:58.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff39b1f0700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff394070d90 0x7ff3940711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff39b1f0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff39415e0b0 0x7ff39415e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff39b1f0700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff394151a50 con 0x7ff39406a270 2023-11-28T11:09:58.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff39b1f0700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39415b440 con 0x7ff394070d90 2023-11-28T11:09:58.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff39b1f0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff394071ac0 con 0x7ff39415e0b0 2023-11-28T11:09:58.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff39978d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff39415e0b0 0x7ff39415e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff393fff700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff394070d90 0x7ff3940711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff398f8c700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff39406a270 0x7ff39406a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:46240/0 (socket says 172.21.15.125:46240) 2023-11-28T11:09:58.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff39978d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff39415e0b0 0x7ff39415e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:54326/0 (socket says 172.21.15.125:54326) 2023-11-28T11:09:58.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff398f8c700 1 -- 172.21.15.125:0/2093198751 learned_addr learned my addr 172.21.15.125:0/2093198751 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:58.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff39978d700 1 -- 172.21.15.125:0/2093198751 >> v2:172.21.15.167:3300/0 conn(0x7ff394070d90 msgr2=0x7ff3940711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:58.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff39978d700 1 --2- 172.21.15.125:0/2093198751 >> v2:172.21.15.167:3300/0 conn(0x7ff394070d90 0x7ff3940711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff39978d700 1 -- 172.21.15.125:0/2093198751 >> v1:172.21.15.167:6789/0 conn(0x7ff39406a270 legacy=0x7ff39406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:58.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff39978d700 1 -- 172.21.15.125:0/2093198751 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39415adf0 con 0x7ff39415e0b0 2023-11-28T11:09:58.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.550+0000 7ff393fff700 1 --2- 172.21.15.125:0/2093198751 >> v2:172.21.15.167:3300/0 conn(0x7ff394070d90 0x7ff3940711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:58.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff39978d700 1 --2- 172.21.15.125:0/2093198751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff39415e0b0 0x7ff39415e530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d90 tx=0x7ff38c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37d1874e5af32e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:58.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff3937fe700 1 -- 172.21.15.125:0/2093198751 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00e070 con 0x7ff39415e0b0 2023-11-28T11:09:58.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff3937fe700 1 -- 172.21.15.125:0/2093198751 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c00bb20 con 0x7ff39415e0b0 2023-11-28T11:09:58.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff3937fe700 1 -- 172.21.15.125:0/2093198751 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c012430 con 0x7ff39415e0b0 2023-11-28T11:09:58.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2093198751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff39415e0b0 msgr2=0x7ff39415e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:58.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff39b1f0700 1 --2- 172.21.15.125:0/2093198751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff39415e0b0 0x7ff39415e530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d90 tx=0x7ff38c00b330 comp rx=0 tx=0).stop 2023-11-28T11:09:58.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2093198751 shutdown_connections 2023-11-28T11:09:58.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff39b1f0700 1 --2- 172.21.15.125:0/2093198751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff39415e0b0 0x7ff39415e530 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff39b1f0700 1 --2- 172.21.15.125:0/2093198751 >> v2:172.21.15.167:3300/0 conn(0x7ff394070d90 0x7ff3940711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2093198751 >> 172.21.15.125:0/2093198751 conn(0x7ff39406c010 msgr2=0x7ff3940cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:58.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2093198751 shutdown_connections 2023-11-28T11:09:58.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.551+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2093198751 wait complete. 2023-11-28T11:09:58.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.552+0000 7ff39b1f0700 1 Processor -- start 2023-11-28T11:09:58.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.553+0000 7ff39b1f0700 1 -- start start 2023-11-28T11:09:58.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.553+0000 7ff39b1f0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff39406a270 0x7ff394159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.553+0000 7ff39b1f0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff394070d90 0x7ff394159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.553+0000 7ff39b1f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39415e0b0 0x7ff3940c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.553+0000 7ff39b1f0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940c6790 con 0x7ff39415e0b0 2023-11-28T11:09:58.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.553+0000 7ff39b1f0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff394151770 con 0x7ff39406a270 2023-11-28T11:09:58.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.553+0000 7ff39b1f0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940c5b10 con 0x7ff394070d90 2023-11-28T11:09:58.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff39978d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39415e0b0 0x7ff3940c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff39978d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39415e0b0 0x7ff3940c4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59324/0 (socket says 172.21.15.125:59324) 2023-11-28T11:09:58.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff39978d700 1 -- 172.21.15.125:0/2387020223 learned_addr learned my addr 172.21.15.125:0/2387020223 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:58.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff393fff700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff394070d90 0x7ff394159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff398f8c700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff39406a270 0x7ff394159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff39978d700 1 -- 172.21.15.125:0/2387020223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff394070d90 msgr2=0x7ff394159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:58.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff39978d700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff394070d90 0x7ff394159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff39978d700 1 -- 172.21.15.125:0/2387020223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff39406a270 msgr2=0x7ff394159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:58.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff39978d700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff39406a270 0x7ff394159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff39978d700 1 -- 172.21.15.125:0/2387020223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3800094a0 con 0x7ff39415e0b0 2023-11-28T11:09:58.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff393fff700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff394070d90 0x7ff394159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:58.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff39978d700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39415e0b0 0x7ff3940c4e00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff38c014040 tx=0x7ff38c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:58.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff3917fa700 1 -- 172.21.15.125:0/2387020223 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c012430 con 0x7ff39415e0b0 2023-11-28T11:09:58.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff3917fa700 1 -- 172.21.15.125:0/2387020223 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c020070 con 0x7ff39415e0b0 2023-11-28T11:09:58.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2387020223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c009a70 con 0x7ff39415e0b0 2023-11-28T11:09:58.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff3917fa700 1 -- 172.21.15.125:0/2387020223 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c003ea0 con 0x7ff39415e0b0 2023-11-28T11:09:58.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.554+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2387020223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39415aac0 con 0x7ff39415e0b0 2023-11-28T11:09:58.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.555+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2387020223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39415b0d0 con 0x7ff39415e0b0 2023-11-28T11:09:58.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.556+0000 7ff3917fa700 1 -- 172.21.15.125:0/2387020223 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff38c004040 con 0x7ff39415e0b0 2023-11-28T11:09:58.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.556+0000 7ff3917fa700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3780682f0 0x7ff37806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.556+0000 7ff3917fa700 1 -- 172.21.15.125:0/2387020223 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff38c022070 con 0x7ff39415e0b0 2023-11-28T11:09:58.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.556+0000 7ff398f8c700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3780682f0 0x7ff37806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.556+0000 7ff398f8c700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3780682f0 0x7ff37806a7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff388005910 tx=0x7ff388009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:58.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.560+0000 7ff3917fa700 1 -- 172.21.15.125:0/2387020223 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff38c054830 con 0x7ff39415e0b0 2023-11-28T11:09:58.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.745+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2387020223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3940743f0 con 0x7ff39415e0b0 2023-11-28T11:09:58.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.747+0000 7ff3917fa700 1 -- 172.21.15.125:0/2387020223 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18027 (secure 0 0 0) 0x7ff38c057e50 con 0x7ff39415e0b0 2023-11-28T11:09:58.747 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:09:58.748 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":38,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:49.562761+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:09:46.832058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T11:09:47.518555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:09:58.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2387020223 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3780682f0 msgr2=0x7ff37806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:58.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3780682f0 0x7ff37806a7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff388005910 tx=0x7ff388009040 comp rx=0 tx=0).stop 2023-11-28T11:09:58.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2387020223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39415e0b0 msgr2=0x7ff3940c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:58.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39415e0b0 0x7ff3940c4e00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff38c014040 tx=0x7ff38c004ad0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2387020223 shutdown_connections 2023-11-28T11:09:58.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39415e0b0 0x7ff3940c4e00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff39406a270 0x7ff394159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3780682f0 0x7ff37806a7a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 --2- 172.21.15.125:0/2387020223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff394070d90 0x7ff394159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2387020223 >> 172.21.15.125:0/2387020223 conn(0x7ff39406c010 msgr2=0x7ff3940cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:58.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2387020223 shutdown_connections 2023-11-28T11:09:58.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.749+0000 7ff39b1f0700 1 -- 172.21.15.125:0/2387020223 wait complete. 2023-11-28T11:09:58.761 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:09:46.832058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:09:47.518555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:09:58.762 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:09:58.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.884+0000 7f2dd6d20700 1 Processor -- start 2023-11-28T11:09:58.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.884+0000 7f2dd6d20700 1 -- start start 2023-11-28T11:09:58.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.884+0000 7f2dd6d20700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2dd0158fc0 0x7f2dd006b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd6d20700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2dd00cc630 0x7f2dd00cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd6d20700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd015db90 con 0x7f2dd015cbf0 2023-11-28T11:09:58.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd6d20700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd00cd4f0 con 0x7f2dd0158fc0 2023-11-28T11:09:58.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd6d20700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd015d090 con 0x7f2dd00cc630 2023-11-28T11:09:58.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd4abc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2dd0158fc0 0x7f2dd006b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dcffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2dd015cbf0 0x7f2dd00cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43454/0 (socket says 172.21.15.125:43454) 2023-11-28T11:09:58.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dcffff700 1 -- 172.21.15.125:0/3044196850 learned_addr learned my addr 172.21.15.125:0/3044196850 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:58.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd4abc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2dd0158fc0 0x7f2dd006b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59328/0 (socket says 172.21.15.125:59328) 2023-11-28T11:09:58.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd52bd700 1 --2- 172.21.15.125:0/3044196850 >> v2:172.21.15.167:3300/0 conn(0x7f2dd00cc630 0x7f2dd00cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd4abc700 1 -- 172.21.15.125:0/3044196850 >> v2:172.21.15.167:3300/0 conn(0x7f2dd00cc630 msgr2=0x7f2dd00cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:58.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd4abc700 1 --2- 172.21.15.125:0/3044196850 >> v2:172.21.15.167:3300/0 conn(0x7f2dd00cc630 0x7f2dd00cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd4abc700 1 -- 172.21.15.125:0/3044196850 >> v1:172.21.15.125:6789/0 conn(0x7f2dd015cbf0 legacy=0x7f2dd00cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:58.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dcf7fe700 1 -- 172.21.15.125:0/3044196850 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732779478 0 0) 0x7f2dd015db90 con 0x7f2dd015cbf0 2023-11-28T11:09:58.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd4abc700 1 -- 172.21.15.125:0/3044196850 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd00703b0 con 0x7f2dd0158fc0 2023-11-28T11:09:58.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dd4abc700 1 --2- 172.21.15.125:0/3044196850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd0158fc0 0x7f2dd006b490 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2dd006bd60 tx=0x7f2dc400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31739320efb32090 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:58.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dcf7fe700 1 -- 172.21.15.125:0/3044196850 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc400dc70 con 0x7f2dd0158fc0 2023-11-28T11:09:58.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dcf7fe700 1 -- 172.21.15.125:0/3044196850 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc400ddd0 con 0x7f2dd0158fc0 2023-11-28T11:09:58.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.885+0000 7f2dcf7fe700 1 -- 172.21.15.125:0/3044196850 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4010690 con 0x7f2dd0158fc0 2023-11-28T11:09:58.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.886+0000 7f2dd6d20700 1 -- 172.21.15.125:0/3044196850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd0158fc0 msgr2=0x7f2dd006b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:58.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.886+0000 7f2dd6d20700 1 --2- 172.21.15.125:0/3044196850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd0158fc0 0x7f2dd006b490 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2dd006bd60 tx=0x7f2dc400bdc0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.886+0000 7f2dd6d20700 1 -- 172.21.15.125:0/3044196850 shutdown_connections 2023-11-28T11:09:58.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.886+0000 7f2dd6d20700 1 --2- 172.21.15.125:0/3044196850 >> v2:172.21.15.167:3300/0 conn(0x7f2dd00cc630 0x7f2dd00cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.886+0000 7f2dd6d20700 1 --2- 172.21.15.125:0/3044196850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd0158fc0 0x7f2dd006b490 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.886+0000 7f2dd6d20700 1 -- 172.21.15.125:0/3044196850 >> 172.21.15.125:0/3044196850 conn(0x7f2dd006c470 msgr2=0x7f2dd006c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:58.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.886+0000 7f2dd6d20700 1 -- 172.21.15.125:0/3044196850 shutdown_connections 2023-11-28T11:09:58.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.886+0000 7f2dd6d20700 1 -- 172.21.15.125:0/3044196850 wait complete. 2023-11-28T11:09:58.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.887+0000 7f2dd6d20700 1 Processor -- start 2023-11-28T11:09:58.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.887+0000 7f2dd6d20700 1 -- start start 2023-11-28T11:09:58.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd6d20700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd00cc630 0x7f2dd00b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd6d20700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dd0158fc0 0x7f2dd01f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd6d20700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd015cbf0 0x7f2dd01f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd6d20700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00b4920 con 0x7f2dd00cc630 2023-11-28T11:09:58.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd6d20700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd01f3660 con 0x7f2dd0158fc0 2023-11-28T11:09:58.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd6d20700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd01f3940 con 0x7f2dd015cbf0 2023-11-28T11:09:58.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd4abc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd00cc630 0x7f2dd00b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd4abc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd00cc630 0x7f2dd00b26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59334/0 (socket says 172.21.15.125:59334) 2023-11-28T11:09:58.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd4abc700 1 -- 172.21.15.125:0/976216796 learned_addr learned my addr 172.21.15.125:0/976216796 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:58.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dcffff700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dd0158fc0 0x7f2dd01f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd52bd700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd015cbf0 0x7f2dd01f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd4abc700 1 -- 172.21.15.125:0/976216796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd015cbf0 msgr2=0x7f2dd01f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:58.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd4abc700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd015cbf0 0x7f2dd01f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd4abc700 1 -- 172.21.15.125:0/976216796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dd0158fc0 msgr2=0x7f2dd01f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:58.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd4abc700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dd0158fc0 0x7f2dd01f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:58.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.888+0000 7f2dd4abc700 1 -- 172.21.15.125:0/976216796 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc400b740 con 0x7f2dd00cc630 2023-11-28T11:09:58.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.889+0000 7f2dd4abc700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd00cc630 0x7f2dd00b26a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400b2c0 tx=0x7f2dc4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:58.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.889+0000 7f2dcd7fa700 1 -- 172.21.15.125:0/976216796 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc401d070 con 0x7f2dd00cc630 2023-11-28T11:09:58.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.889+0000 7f2dcd7fa700 1 -- 172.21.15.125:0/976216796 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc4010630 con 0x7f2dd00cc630 2023-11-28T11:09:58.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.889+0000 7f2dcd7fa700 1 -- 172.21.15.125:0/976216796 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4010c90 con 0x7f2dd00cc630 2023-11-28T11:09:58.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.889+0000 7f2dd6d20700 1 -- 172.21.15.125:0/976216796 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd015d5d0 con 0x7f2dd00cc630 2023-11-28T11:09:58.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.889+0000 7f2dd6d20700 1 -- 172.21.15.125:0/976216796 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd015d2f0 con 0x7f2dd00cc630 2023-11-28T11:09:58.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.890+0000 7f2dd6d20700 1 -- 172.21.15.125:0/976216796 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd015d8b0 con 0x7f2dd00cc630 2023-11-28T11:09:58.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.890+0000 7f2dcd7fa700 1 -- 172.21.15.125:0/976216796 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2dc40036a0 con 0x7f2dd00cc630 2023-11-28T11:09:58.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.891+0000 7f2dcd7fa700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db40682f0 0x7f2db406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:58.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.891+0000 7f2dcffff700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db40682f0 0x7f2db406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:58.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.891+0000 7f2dcd7fa700 1 -- 172.21.15.125:0/976216796 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2dc40873b0 con 0x7f2dd00cc630 2023-11-28T11:09:58.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.891+0000 7f2dcffff700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db40682f0 0x7f2db406a7a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000f60 tx=0x7f2dbc007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:58.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:58.895+0000 7f2dcd7fa700 1 -- 172.21.15.125:0/976216796 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2dc4053cc0 con 0x7f2dd00cc630 2023-11-28T11:09:59.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.075+0000 7f2dd6d20700 1 -- 172.21.15.125:0/976216796 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2dd00cc010 con 0x7f2dd00cc630 2023-11-28T11:09:59.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.076+0000 7f2dcd7fa700 1 -- 172.21.15.125:0/976216796 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2dc40572e0 con 0x7f2dd00cc630 2023-11-28T11:09:59.077 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:09:59.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.077+0000 7f2dd6d20700 1 -- 172.21.15.125:0/976216796 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db40682f0 msgr2=0x7f2db406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.077+0000 7f2dd6d20700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db40682f0 0x7f2db406a7a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000f60 tx=0x7f2dbc007c90 comp rx=0 tx=0).stop 2023-11-28T11:09:59.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.077+0000 7f2dd6d20700 1 -- 172.21.15.125:0/976216796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd00cc630 msgr2=0x7f2dd00b26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.077+0000 7f2dd6d20700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd00cc630 0x7f2dd00b26a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400b2c0 tx=0x7f2dc4004750 comp rx=0 tx=0).stop 2023-11-28T11:09:59.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.078+0000 7f2dd6d20700 1 -- 172.21.15.125:0/976216796 shutdown_connections 2023-11-28T11:09:59.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.078+0000 7f2dd6d20700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2db40682f0 0x7f2db406a7a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.078+0000 7f2dd6d20700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dd015cbf0 0x7f2dd01f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.078+0000 7f2dd6d20700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd00cc630 0x7f2dd00b26a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.078+0000 7f2dd6d20700 1 --2- 172.21.15.125:0/976216796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dd0158fc0 0x7f2dd01f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.078+0000 7f2dd6d20700 1 -- 172.21.15.125:0/976216796 >> 172.21.15.125:0/976216796 conn(0x7f2dd006c470 msgr2=0x7f2dd00cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:59.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.078+0000 7f2dd6d20700 1 -- 172.21.15.125:0/976216796 shutdown_connections 2023-11-28T11:09:59.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.078+0000 7f2dd6d20700 1 -- 172.21.15.125:0/976216796 wait complete. 2023-11-28T11:09:59.091 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:09:59.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.212+0000 7f3512ae2700 1 Processor -- start 2023-11-28T11:09:59.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.212+0000 7f3512ae2700 1 -- start start 2023-11-28T11:09:59.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f3512ae2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f350c160cb0 0x7f350c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f3512ae2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350c0d2d30 con 0x7f350c15c8c0 2023-11-28T11:09:59.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f3512ae2700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350c0d0b40 con 0x7f350c06b050 2023-11-28T11:09:59.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f3512ae2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c06b490 con 0x7f350c160cb0 2023-11-28T11:09:59.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f351087e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f350c15c8c0 0x7f350c0b5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43466/0 (socket says 172.21.15.125:43466) 2023-11-28T11:09:59.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f351087e700 1 -- 172.21.15.125:0/2534295218 learned_addr learned my addr 172.21.15.125:0/2534295218 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:59.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f350bfff700 1 --2- 172.21.15.125:0/2534295218 >> v2:172.21.15.125:3300/0 conn(0x7f350c160cb0 0x7f350c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f350b7fe700 1 -- 172.21.15.125:0/2534295218 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779855970 0 0) 0x7f3500001110 con 0x7f350c15c8c0 2023-11-28T11:09:59.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f350b7fe700 1 -- 172.21.15.125:0/2534295218 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34fc0035b0 con 0x7f350c15c8c0 2023-11-28T11:09:59.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f350bfff700 1 -- 172.21.15.125:0/2534295218 >> v1:172.21.15.167:6789/0 conn(0x7f350c06b050 legacy=0x7f350c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:59.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f350bfff700 1 -- 172.21.15.125:0/2534295218 >> v1:172.21.15.125:6789/0 conn(0x7f350c15c8c0 legacy=0x7f350c0b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.213+0000 7f350bfff700 1 -- 172.21.15.125:0/2534295218 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c0d2a50 con 0x7f350c160cb0 2023-11-28T11:09:59.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.214+0000 7f350bfff700 1 --2- 172.21.15.125:0/2534295218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c160cb0 0x7f350c06ab10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009840 tx=0x7f34f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47b40351d7f6ad2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:59.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.214+0000 7f350b7fe700 1 -- 172.21.15.125:0/2534295218 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8004230 con 0x7f350c160cb0 2023-11-28T11:09:59.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.214+0000 7f350b7fe700 1 -- 172.21.15.125:0/2534295218 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f8004390 con 0x7f350c160cb0 2023-11-28T11:09:59.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.214+0000 7f350b7fe700 1 -- 172.21.15.125:0/2534295218 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80036a0 con 0x7f350c160cb0 2023-11-28T11:09:59.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.214+0000 7f3512ae2700 1 -- 172.21.15.125:0/2534295218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c160cb0 msgr2=0x7f350c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.214+0000 7f3512ae2700 1 --2- 172.21.15.125:0/2534295218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c160cb0 0x7f350c06ab10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009840 tx=0x7f34f8009b50 comp rx=0 tx=0).stop 2023-11-28T11:09:59.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.214+0000 7f3512ae2700 1 -- 172.21.15.125:0/2534295218 shutdown_connections 2023-11-28T11:09:59.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.214+0000 7f3512ae2700 1 --2- 172.21.15.125:0/2534295218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c160cb0 0x7f350c06ab10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.214+0000 7f3512ae2700 1 -- 172.21.15.125:0/2534295218 >> 172.21.15.125:0/2534295218 conn(0x7f350c06c520 msgr2=0x7f350c06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:59.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.214+0000 7f3512ae2700 1 -- 172.21.15.125:0/2534295218 shutdown_connections 2023-11-28T11:09:59.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.214+0000 7f3512ae2700 1 -- 172.21.15.125:0/2534295218 wait complete. 2023-11-28T11:09:59.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.216+0000 7f3512ae2700 1 Processor -- start 2023-11-28T11:09:59.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.216+0000 7f3512ae2700 1 -- start start 2023-11-28T11:09:59.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.216+0000 7f3512ae2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06b050 0x7f350c0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.216+0000 7f3512ae2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f350c15c8c0 0x7f350c0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.216+0000 7f3512ae2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f350c160cb0 0x7f350c0ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.216+0000 7f3512ae2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0caac0 con 0x7f350c06b050 2023-11-28T11:09:59.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.216+0000 7f3512ae2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0cacc0 con 0x7f350c15c8c0 2023-11-28T11:09:59.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.216+0000 7f3512ae2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0cafa0 con 0x7f350c160cb0 2023-11-28T11:09:59.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f351087e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06b050 0x7f350c0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f351087e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06b050 0x7f350c0b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59348/0 (socket says 172.21.15.125:59348) 2023-11-28T11:09:59.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f351087e700 1 -- 172.21.15.125:0/933234752 learned_addr learned my addr 172.21.15.125:0/933234752 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:59.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f350bfff700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f350c15c8c0 0x7f350c0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f351107f700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f350c160cb0 0x7f350c0ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f351087e700 1 -- 172.21.15.125:0/933234752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f350c160cb0 msgr2=0x7f350c0ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f351087e700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f350c160cb0 0x7f350c0ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f351087e700 1 -- 172.21.15.125:0/933234752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f350c15c8c0 msgr2=0x7f350c0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f351087e700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f350c15c8c0 0x7f350c0ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f351087e700 1 -- 172.21.15.125:0/933234752 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f80094a0 con 0x7f350c06b050 2023-11-28T11:09:59.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f350bfff700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f350c15c8c0 0x7f350c0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:59.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f351087e700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06b050 0x7f350c0b3e40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3500007fd0 tx=0x7f350000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:59.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f35097fa700 1 -- 172.21.15.125:0/933234752 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500005d70 con 0x7f350c06b050 2023-11-28T11:09:59.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f35097fa700 1 -- 172.21.15.125:0/933234752 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35000070d0 con 0x7f350c06b050 2023-11-28T11:09:59.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f35097fa700 1 -- 172.21.15.125:0/933234752 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500007460 con 0x7f350c06b050 2023-11-28T11:09:59.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f3512ae2700 1 -- 172.21.15.125:0/933234752 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c0cda40 con 0x7f350c06b050 2023-11-28T11:09:59.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.217+0000 7f3512ae2700 1 -- 172.21.15.125:0/933234752 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c0cd760 con 0x7f350c06b050 2023-11-28T11:09:59.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.218+0000 7f3512ae2700 1 -- 172.21.15.125:0/933234752 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c161120 con 0x7f350c06b050 2023-11-28T11:09:59.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.219+0000 7f35097fa700 1 -- 172.21.15.125:0/933234752 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3500019030 con 0x7f350c06b050 2023-11-28T11:09:59.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.219+0000 7f35097fa700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34f00682f0 0x7f34f006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.219+0000 7f35097fa700 1 -- 172.21.15.125:0/933234752 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3500084f70 con 0x7f350c06b050 2023-11-28T11:09:59.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.219+0000 7f350bfff700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34f00682f0 0x7f34f006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.219+0000 7f350bfff700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34f00682f0 0x7f34f006a7a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009840 tx=0x7f34f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:59.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.223+0000 7f35097fa700 1 -- 172.21.15.125:0/933234752 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f35000517d0 con 0x7f350c06b050 2023-11-28T11:09:59.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.405+0000 7f3512ae2700 1 -- 172.21.15.125:0/933234752 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f350c067d70 con 0x7f350c06b050 2023-11-28T11:09:59.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.405+0000 7f35097fa700 1 -- 172.21.15.125:0/933234752 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3500007e30 con 0x7f350c06b050 2023-11-28T11:09:59.407 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:09:59.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 -- 172.21.15.125:0/933234752 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34f00682f0 msgr2=0x7f34f006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34f00682f0 0x7f34f006a7a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009840 tx=0x7f34f8008030 comp rx=0 tx=0).stop 2023-11-28T11:09:59.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 -- 172.21.15.125:0/933234752 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06b050 msgr2=0x7f350c0b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06b050 0x7f350c0b3e40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3500007fd0 tx=0x7f350000ca90 comp rx=0 tx=0).stop 2023-11-28T11:09:59.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 -- 172.21.15.125:0/933234752 shutdown_connections 2023-11-28T11:09:59.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f34f00682f0 0x7f34f006a7a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f350c160cb0 0x7f350c0ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06b050 0x7f350c0b3e40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 --2- 172.21.15.125:0/933234752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f350c15c8c0 0x7f350c0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 -- 172.21.15.125:0/933234752 >> 172.21.15.125:0/933234752 conn(0x7f350c06c520 msgr2=0x7f350c1564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:59.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 -- 172.21.15.125:0/933234752 shutdown_connections 2023-11-28T11:09:59.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.407+0000 7f3512ae2700 1 -- 172.21.15.125:0/933234752 wait complete. 2023-11-28T11:09:59.420 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:09:59.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.542+0000 7fc38d3ec700 1 Processor -- start 2023-11-28T11:09:59.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.542+0000 7fc38d3ec700 1 -- start start 2023-11-28T11:09:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc38d3ec700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc38815fe50 0x7fc38806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc38d3ec700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc388161370 con 0x7fc3880b3b80 2023-11-28T11:09:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc38d3ec700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3880cf700 con 0x7fc3880b27d0 2023-11-28T11:09:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc38d3ec700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc388160220 con 0x7fc38815fe50 2023-11-28T11:09:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc3867fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc3880b3b80 0x7fc388160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43480/0 (socket says 172.21.15.125:43480) 2023-11-28T11:09:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc3867fc700 1 -- 172.21.15.125:0/4081634304 learned_addr learned my addr 172.21.15.125:0/4081634304 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265594208 0 0) 0x7fc388161370 con 0x7fc3880b3b80 2023-11-28T11:09:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc386ffd700 1 --2- 172.21.15.125:0/4081634304 >> v2:172.21.15.167:3300/0 conn(0x7fc38815fe50 0x7fc38806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3700035b0 con 0x7fc3880b3b80 2023-11-28T11:09:59.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1258694557 0 0) 0x7fc3700035b0 con 0x7fc3880b3b80 2023-11-28T11:09:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 >> v2:172.21.15.167:3300/0 conn(0x7fc38815fe50 msgr2=0x7fc38806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 --2- 172.21.15.125:0/4081634304 >> v2:172.21.15.167:3300/0 conn(0x7fc38815fe50 0x7fc38806d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 >> v1:172.21.15.167:6789/0 conn(0x7fc3880b27d0 legacy=0x7fc3880cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880b3fd0 con 0x7fc3880b3b80 2023-11-28T11:09:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fc37c001670 con 0x7fc3880b3b80 2023-11-28T11:09:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 >> v1:172.21.15.125:6789/0 conn(0x7fc3880b3b80 legacy=0x7fc388160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc370003a00 0x7fc370003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc370004850 0x7fc370004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc370005200 0x7fc37000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc388160220 con 0x7fc370003a00 2023-11-28T11:09:59.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.543+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37000c080 con 0x7fc370004850 2023-11-28T11:09:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37000c240 con 0x7fc370005200 2023-11-28T11:09:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc386ffd700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc370003a00 0x7fc370003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc3867fc700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc370004850 0x7fc370004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc3877fe700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc370005200 0x7fc37000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc386ffd700 1 -- 172.21.15.125:0/4081634304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc370005200 msgr2=0x7fc37000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc386ffd700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc370005200 0x7fc37000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc386ffd700 1 -- 172.21.15.125:0/4081634304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc370004850 msgr2=0x7fc370004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc386ffd700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc370004850 0x7fc370004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc3877fe700 1 -- 172.21.15.125:0/4081634304 reap_dead start 2023-11-28T11:09:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc386ffd700 1 -- 172.21.15.125:0/4081634304 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3700035b0 con 0x7fc370003a00 2023-11-28T11:09:59.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc3867fc700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc370004850 0x7fc370004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:59.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc386ffd700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc370003a00 0x7fc370003e10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc378009b60 tx=0x7fc370005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4061dfd0b4aaae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:59.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37800e6c0 con 0x7fc370003a00 2023-11-28T11:09:59.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37800e820 con 0x7fc370003a00 2023-11-28T11:09:59.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.544+0000 7fc385ffb700 1 -- 172.21.15.125:0/4081634304 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37800ebb0 con 0x7fc370003a00 2023-11-28T11:09:59.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.545+0000 7fc38d3ec700 1 -- 172.21.15.125:0/4081634304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc370003a00 msgr2=0x7fc370003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.545+0000 7fc38d3ec700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc370003a00 0x7fc370003e10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc378009b60 tx=0x7fc370005880 comp rx=0 tx=0).stop 2023-11-28T11:09:59.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.545+0000 7fc38d3ec700 1 -- 172.21.15.125:0/4081634304 shutdown_connections 2023-11-28T11:09:59.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.545+0000 7fc38d3ec700 1 --2- 172.21.15.125:0/4081634304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc370003a00 0x7fc370003e10 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.545+0000 7fc38d3ec700 1 -- 172.21.15.125:0/4081634304 >> 172.21.15.125:0/4081634304 conn(0x7fc38806ea80 msgr2=0x7fc38806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:59.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.545+0000 7fc38d3ec700 1 -- 172.21.15.125:0/4081634304 shutdown_connections 2023-11-28T11:09:59.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.545+0000 7fc38d3ec700 1 -- 172.21.15.125:0/4081634304 wait complete. 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.546+0000 7fc38d3ec700 1 Processor -- start 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.546+0000 7fc38d3ec700 1 -- start start 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc38d3ec700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc370003a00 0x7fc38815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc38d3ec700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3880ad750 0x7fc3880adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc38d3ec700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3880b46e0 0x7fc3880b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc38d3ec700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38814fc60 con 0x7fc3880b46e0 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc38d3ec700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880ae100 con 0x7fc3880ad750 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc38d3ec700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880ae350 con 0x7fc370003a00 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc3877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3880b46e0 0x7fc3880b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc3877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3880b46e0 0x7fc3880b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59370/0 (socket says 172.21.15.125:59370) 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc3877fe700 1 -- 172.21.15.125:0/716827713 learned_addr learned my addr 172.21.15.125:0/716827713 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:59.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc3867fc700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3880ad750 0x7fc3880adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc386ffd700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc370003a00 0x7fc38815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc3877fe700 1 -- 172.21.15.125:0/716827713 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc370003a00 msgr2=0x7fc38815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc3877fe700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc370003a00 0x7fc38815aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc3877fe700 1 -- 172.21.15.125:0/716827713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3880ad750 msgr2=0x7fc3880adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc3877fe700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3880ad750 0x7fc3880adbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc3877fe700 1 -- 172.21.15.125:0/716827713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880cf0b0 con 0x7fc3880b46e0 2023-11-28T11:09:59.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc3867fc700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3880ad750 0x7fc3880adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:09:59.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc3877fe700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3880b46e0 0x7fc3880b4b50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc388072a20 tx=0x7fc38000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:59.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc36f7fe700 1 -- 172.21.15.125:0/716827713 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380003c10 con 0x7fc3880b46e0 2023-11-28T11:09:59.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc36f7fe700 1 -- 172.21.15.125:0/716827713 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc380003d70 con 0x7fc3880b46e0 2023-11-28T11:09:59.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc36f7fe700 1 -- 172.21.15.125:0/716827713 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380005310 con 0x7fc3880b46e0 2023-11-28T11:09:59.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc38d3ec700 1 -- 172.21.15.125:0/716827713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3880cedd0 con 0x7fc3880b46e0 2023-11-28T11:09:59.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.547+0000 7fc38d3ec700 1 -- 172.21.15.125:0/716827713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3880cf390 con 0x7fc3880b46e0 2023-11-28T11:09:59.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.548+0000 7fc38d3ec700 1 -- 172.21.15.125:0/716827713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38806bd20 con 0x7fc3880b46e0 2023-11-28T11:09:59.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.549+0000 7fc36f7fe700 1 -- 172.21.15.125:0/716827713 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc380005470 con 0x7fc3880b46e0 2023-11-28T11:09:59.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.549+0000 7fc36f7fe700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3740682f0 0x7fc37406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.549+0000 7fc36f7fe700 1 -- 172.21.15.125:0/716827713 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc380085e50 con 0x7fc3880b46e0 2023-11-28T11:09:59.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.549+0000 7fc386ffd700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3740682f0 0x7fc37406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.550+0000 7fc386ffd700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3740682f0 0x7fc37406a7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc3780090b0 tx=0x7fc378008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:59.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.553+0000 7fc36f7fe700 1 -- 172.21.15.125:0/716827713 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc3800526b0 con 0x7fc3880b46e0 2023-11-28T11:09:59.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.736+0000 7fc38d3ec700 1 -- 172.21.15.125:0/716827713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3880743f0 con 0x7fc3880b46e0 2023-11-28T11:09:59.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.736+0000 7fc36f7fe700 1 -- 172.21.15.125:0/716827713 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc380055cd0 con 0x7fc3880b46e0 2023-11-28T11:09:59.738 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:09:59.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 -- 172.21.15.125:0/716827713 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3740682f0 msgr2=0x7fc37406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3740682f0 0x7fc37406a7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc3780090b0 tx=0x7fc378008030 comp rx=0 tx=0).stop 2023-11-28T11:09:59.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 -- 172.21.15.125:0/716827713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3880b46e0 msgr2=0x7fc3880b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3880b46e0 0x7fc3880b4b50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc388072a20 tx=0x7fc38000ee80 comp rx=0 tx=0).stop 2023-11-28T11:09:59.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 -- 172.21.15.125:0/716827713 shutdown_connections 2023-11-28T11:09:59.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3880b46e0 0x7fc3880b4b50 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3740682f0 0x7fc37406a7a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc370003a00 0x7fc38815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 --2- 172.21.15.125:0/716827713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3880ad750 0x7fc3880adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 -- 172.21.15.125:0/716827713 >> 172.21.15.125:0/716827713 conn(0x7fc38806ea80 msgr2=0x7fc3880b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:59.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 -- 172.21.15.125:0/716827713 shutdown_connections 2023-11-28T11:09:59.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.738+0000 7fc38d3ec700 1 -- 172.21.15.125:0/716827713 wait complete. 2023-11-28T11:09:59.751 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:09:59.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.873+0000 7f288d5e7700 1 Processor -- start 2023-11-28T11:09:59.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.873+0000 7f288d5e7700 1 -- start start 2023-11-28T11:09:59.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.874+0000 7f288d5e7700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2888071890 0x7f28880ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.874+0000 7f288d5e7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288815cc10 con 0x7f288806a980 2023-11-28T11:09:59.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.874+0000 7f288d5e7700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288806c9b0 con 0x7f28880cf710 2023-11-28T11:09:59.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.874+0000 7f288d5e7700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288806cc90 con 0x7f2888071890 2023-11-28T11:09:59.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.874+0000 7f28867fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f288806a980 0x7f2888160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43500/0 (socket says 172.21.15.125:43500) 2023-11-28T11:09:59.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.874+0000 7f28867fc700 1 -- 172.21.15.125:0/3346825568 learned_addr learned my addr 172.21.15.125:0/3346825568 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:09:59.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f28877fe700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2888071890 0x7f28880ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875029281 0 0) 0x7f288815cc10 con 0x7f288806a980 2023-11-28T11:09:59.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28700035b0 con 0x7f288806a980 2023-11-28T11:09:59.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912350376 0 0) 0x7f288806c9b0 con 0x7f28880cf710 2023-11-28T11:09:59.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f288815cc10 con 0x7f28880cf710 2023-11-28T11:09:59.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3486806432 0 0) 0x7f28700035b0 con 0x7f288806a980 2023-11-28T11:09:59.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2888071890 msgr2=0x7f28880ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:59.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2888071890 0x7f28880ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 >> v1:172.21.15.167:6789/0 conn(0x7f28880cf710 legacy=0x7f288806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288806cf70 con 0x7f288806a980 2023-11-28T11:09:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f2878001670 con 0x7f288806a980 2023-11-28T11:09:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f28877fe700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2888071890 0x7f28880ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:09:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 >> v1:172.21.15.125:6789/0 conn(0x7f288806a980 legacy=0x7f2888160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870003bc0 0x7f2870003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2870004850 0x7f2870004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2888071890 0x7f2870005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288806cc90 con 0x7f2870004850 2023-11-28T11:09:59.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287000bac0 con 0x7f2870003bc0 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287000bc80 con 0x7f2888071890 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f2886ffd700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870003bc0 0x7f2870003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f28867fc700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2870004850 0x7f2870004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f28877fe700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2888071890 0x7f2870005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f28867fc700 1 -- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2888071890 msgr2=0x7f2870005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f28867fc700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2888071890 0x7f2870005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f28867fc700 1 -- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870003bc0 msgr2=0x7f2870003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.875+0000 7f28867fc700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870003bc0 0x7f2870003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f28867fc700 1 -- 172.21.15.125:0/3346825568 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2880009a70 con 0x7f2870004850 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f28867fc700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2870004850 0x7f2870004cc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f287800c210 tx=0x7f2870005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab88add606797f00 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800cd50 con 0x7f2870004850 2023-11-28T11:09:59.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2878005960 con 0x7f2870004850 2023-11-28T11:09:59.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f2885ffb700 1 -- 172.21.15.125:0/3346825568 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878005cd0 con 0x7f2870004850 2023-11-28T11:09:59.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f288d5e7700 1 -- 172.21.15.125:0/3346825568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2870004850 msgr2=0x7f2870004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f288d5e7700 1 --2- 172.21.15.125:0/3346825568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2870004850 0x7f2870004cc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f287800c210 tx=0x7f2870005880 comp rx=0 tx=0).stop 2023-11-28T11:09:59.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f28877fe700 1 -- 172.21.15.125:0/3346825568 reap_dead start 2023-11-28T11:09:59.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f288d5e7700 1 -- 172.21.15.125:0/3346825568 shutdown_connections 2023-11-28T11:09:59.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f288d5e7700 1 -- 172.21.15.125:0/3346825568 >> 172.21.15.125:0/3346825568 conn(0x7f288806c010 msgr2=0x7f28880cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:09:59.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f288d5e7700 1 -- 172.21.15.125:0/3346825568 shutdown_connections 2023-11-28T11:09:59.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.876+0000 7f288d5e7700 1 -- 172.21.15.125:0/3346825568 wait complete. 2023-11-28T11:09:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.878+0000 7f288d5e7700 1 Processor -- start 2023-11-28T11:09:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.878+0000 7f288d5e7700 1 -- start start 2023-11-28T11:09:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f288d5e7700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2870004850 0x7f2888154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f288d5e7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28881520a0 0x7f28881517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f288d5e7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2888157520 0x7f28881579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f288d5e7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2888152db0 con 0x7f2888157520 2023-11-28T11:09:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f288d5e7700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880aef00 con 0x7f28881520a0 2023-11-28T11:09:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f288d5e7700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2888157ee0 con 0x7f2870004850 2023-11-28T11:09:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f28877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2888157520 0x7f28881579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f28877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2888157520 0x7f28881579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59390/0 (socket says 172.21.15.125:59390) 2023-11-28T11:09:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f28877fe700 1 -- 172.21.15.125:0/1084549638 learned_addr learned my addr 172.21.15.125:0/1084549638 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:09:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f2886ffd700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2870004850 0x7f2888154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f28867fc700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28881520a0 0x7f28881517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f28877fe700 1 -- 172.21.15.125:0/1084549638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2870004850 msgr2=0x7f2888154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f28877fe700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2870004850 0x7f2888154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f28877fe700 1 -- 172.21.15.125:0/1084549638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28881520a0 msgr2=0x7f28881517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f28877fe700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28881520a0 0x7f28881517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f28877fe700 1 -- 172.21.15.125:0/1084549638 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288806d530 con 0x7f2888157520 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.879+0000 7f2886ffd700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2870004850 0x7f2888154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.880+0000 7f28877fe700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2888157520 0x7f28881579a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f28880672e0 tx=0x7f288000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.880+0000 7f286f7fe700 1 -- 172.21.15.125:0/1084549638 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000e040 con 0x7f2888157520 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.880+0000 7f286f7fe700 1 -- 172.21.15.125:0/1084549638 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288000f040 con 0x7f2888157520 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.880+0000 7f288d5e7700 1 -- 172.21.15.125:0/1084549638 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288806d250 con 0x7f2888157520 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.880+0000 7f286f7fe700 1 -- 172.21.15.125:0/1084549638 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880003c60 con 0x7f2888157520 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.880+0000 7f288d5e7700 1 -- 172.21.15.125:0/1084549638 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28880ce740 con 0x7f2888157520 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.881+0000 7f288d5e7700 1 -- 172.21.15.125:0/1084549638 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2888152ef0 con 0x7f2888157520 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.881+0000 7f286f7fe700 1 -- 172.21.15.125:0/1084549638 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2880024070 con 0x7f2888157520 2023-11-28T11:09:59.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.881+0000 7f286f7fe700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28740682f0 0x7f287406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:09:59.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.881+0000 7f286f7fe700 1 -- 172.21.15.125:0/1084549638 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2880086290 con 0x7f2888157520 2023-11-28T11:09:59.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.881+0000 7f2886ffd700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28740682f0 0x7f287406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:09:59.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.882+0000 7f2886ffd700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28740682f0 0x7f287406a7a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f287c007fd0 tx=0x7f287c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:09:59.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:09:59.885+0000 7f286f7fe700 1 -- 172.21.15.125:0/1084549638 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2888152ef0 con 0x7f2888157520 2023-11-28T11:10:00.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.067+0000 7f288d5e7700 1 -- 172.21.15.125:0/1084549638 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2888152ef0 con 0x7f2888157520 2023-11-28T11:10:00.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.068+0000 7f286f7fe700 1 -- 172.21.15.125:0/1084549638 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2888152ef0 con 0x7f2888157520 2023-11-28T11:10:00.070 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:10:00.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 -- 172.21.15.125:0/1084549638 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28740682f0 msgr2=0x7f287406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28740682f0 0x7f287406a7a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f287c007fd0 tx=0x7f287c009040 comp rx=0 tx=0).stop 2023-11-28T11:10:00.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 -- 172.21.15.125:0/1084549638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2888157520 msgr2=0x7f28881579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2888157520 0x7f28881579a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f28880672e0 tx=0x7f288000f490 comp rx=0 tx=0).stop 2023-11-28T11:10:00.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 -- 172.21.15.125:0/1084549638 shutdown_connections 2023-11-28T11:10:00.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2888157520 0x7f28881579a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28740682f0 0x7f287406a7a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2870004850 0x7f2888154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 --2- 172.21.15.125:0/1084549638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28881520a0 0x7f28881517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 -- 172.21.15.125:0/1084549638 >> 172.21.15.125:0/1084549638 conn(0x7f288806c010 msgr2=0x7f28880ac8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:00.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 -- 172.21.15.125:0/1084549638 shutdown_connections 2023-11-28T11:10:00.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.070+0000 7f288d5e7700 1 -- 172.21.15.125:0/1084549638 wait complete. 2023-11-28T11:10:00.085 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:10:00.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.206+0000 7f3ed7ce2700 1 Processor -- start 2023-11-28T11:10:00.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.207+0000 7f3ed7ce2700 1 -- start start 2023-11-28T11:10:00.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.207+0000 7f3ed7ce2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ed015fe50 0x7f3ed006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.207+0000 7f3ed7ce2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ed00b3b80 0x7f3ed0160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.207+0000 7f3ed7ce2700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed0161370 con 0x7f3ed00b27d0 2023-11-28T11:10:00.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.207+0000 7f3ed7ce2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed0160220 con 0x7f3ed00b3b80 2023-11-28T11:10:00.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.207+0000 7f3ed7ce2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00cf700 con 0x7f3ed015fe50 2023-11-28T11:10:00.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.207+0000 7f3ed527d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ed00b3b80 0x7f3ed0160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.208+0000 7f3ed527d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ed00b3b80 0x7f3ed0160ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59396/0 (socket says 172.21.15.125:59396) 2023-11-28T11:10:00.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.208+0000 7f3ed527d700 1 -- 172.21.15.125:0/2437982706 learned_addr learned my addr 172.21.15.125:0/2437982706 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:00.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.208+0000 7f3ed5a7e700 1 --2- 172.21.15.125:0/2437982706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ed015fe50 0x7f3ed006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.208+0000 7f3ed527d700 1 -- 172.21.15.125:0/2437982706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ed015fe50 msgr2=0x7f3ed006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:00.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.208+0000 7f3ed527d700 1 --2- 172.21.15.125:0/2437982706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ed015fe50 0x7f3ed006d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.208+0000 7f3ed527d700 1 -- 172.21.15.125:0/2437982706 >> v1:172.21.15.167:6789/0 conn(0x7f3ed00b27d0 legacy=0x7f3ed00cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.208+0000 7f3ed527d700 1 -- 172.21.15.125:0/2437982706 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed00b3fd0 con 0x7f3ed00b3b80 2023-11-28T11:10:00.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.208+0000 7f3ed527d700 1 --2- 172.21.15.125:0/2437982706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ed00b3b80 0x7f3ed0160ad0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0098f0 tx=0x7f3ecc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f1ac4bab070e3c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:00.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.208+0000 7f3ed4a7c700 1 -- 172.21.15.125:0/2437982706 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00b8a0 con 0x7f3ed00b3b80 2023-11-28T11:10:00.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.208+0000 7f3ed4a7c700 1 -- 172.21.15.125:0/2437982706 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc00ba00 con 0x7f3ed00b3b80 2023-11-28T11:10:00.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.208+0000 7f3ed4a7c700 1 -- 172.21.15.125:0/2437982706 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00bd90 con 0x7f3ed00b3b80 2023-11-28T11:10:00.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.209+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/2437982706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ed00b3b80 msgr2=0x7f3ed0160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.209+0000 7f3ed7ce2700 1 --2- 172.21.15.125:0/2437982706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ed00b3b80 0x7f3ed0160ad0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0098f0 tx=0x7f3ecc009c00 comp rx=0 tx=0).stop 2023-11-28T11:10:00.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.209+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/2437982706 shutdown_connections 2023-11-28T11:10:00.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.209+0000 7f3ed7ce2700 1 --2- 172.21.15.125:0/2437982706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ed015fe50 0x7f3ed006d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.209+0000 7f3ed7ce2700 1 --2- 172.21.15.125:0/2437982706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ed00b3b80 0x7f3ed0160ad0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.209+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/2437982706 >> 172.21.15.125:0/2437982706 conn(0x7f3ed006ea80 msgr2=0x7f3ed006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:00.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.209+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/2437982706 shutdown_connections 2023-11-28T11:10:00.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.209+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/2437982706 wait complete. 2023-11-28T11:10:00.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.210+0000 7f3ed7ce2700 1 Processor -- start 2023-11-28T11:10:00.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.210+0000 7f3ed7ce2700 1 -- start start 2023-11-28T11:10:00.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.211+0000 7f3ed7ce2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ed00b27d0 0x7f3ed0154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.211+0000 7f3ed7ce2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ed00b3b80 0x7f3ed00c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.211+0000 7f3ed7ce2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ed015fe50 0x7f3ed00c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.211+0000 7f3ed7ce2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed01e90b0 con 0x7f3ed00b3b80 2023-11-28T11:10:00.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.211+0000 7f3ed7ce2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed01e8dd0 con 0x7f3ed00b27d0 2023-11-28T11:10:00.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.211+0000 7f3ed7ce2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00aca20 con 0x7f3ed015fe50 2023-11-28T11:10:00.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.211+0000 7f3ed527d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ed00b3b80 0x7f3ed00c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.211+0000 7f3ed527d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ed00b3b80 0x7f3ed00c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59402/0 (socket says 172.21.15.125:59402) 2023-11-28T11:10:00.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.211+0000 7f3ed527d700 1 -- 172.21.15.125:0/3782557137 learned_addr learned my addr 172.21.15.125:0/3782557137 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:00.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ed627f700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ed015fe50 0x7f3ed00c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ed5a7e700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ed00b27d0 0x7f3ed0154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ed527d700 1 -- 172.21.15.125:0/3782557137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ed015fe50 msgr2=0x7f3ed00c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ed527d700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ed015fe50 0x7f3ed00c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ed527d700 1 -- 172.21.15.125:0/3782557137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ed00b27d0 msgr2=0x7f3ed0154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ed527d700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ed00b27d0 0x7f3ed0154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ed527d700 1 -- 172.21.15.125:0/3782557137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc009550 con 0x7f3ed00b3b80 2023-11-28T11:10:00.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ed5a7e700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ed00b27d0 0x7f3ed0154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:00.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ed527d700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ed00b3b80 0x7f3ed00c7e00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009c40 tx=0x7f3ecc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:00.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ec67fc700 1 -- 172.21.15.125:0/3782557137 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc004590 con 0x7f3ed00b3b80 2023-11-28T11:10:00.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ec67fc700 1 -- 172.21.15.125:0/3782557137 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc01e070 con 0x7f3ed00b3b80 2023-11-28T11:10:00.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ec67fc700 1 -- 172.21.15.125:0/3782557137 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc0038e0 con 0x7f3ed00b3b80 2023-11-28T11:10:00.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/3782557137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed00cf0b0 con 0x7f3ed00b3b80 2023-11-28T11:10:00.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.212+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/3782557137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed00cedd0 con 0x7f3ed00b3b80 2023-11-28T11:10:00.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.213+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/3782557137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed00cf390 con 0x7f3ed00b3b80 2023-11-28T11:10:00.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.213+0000 7f3ec67fc700 1 -- 172.21.15.125:0/3782557137 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3ecc00f050 con 0x7f3ed00b3b80 2023-11-28T11:10:00.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.214+0000 7f3ec67fc700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb40682f0 0x7f3eb406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.214+0000 7f3ec67fc700 1 -- 172.21.15.125:0/3782557137 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ecc020070 con 0x7f3ed00b3b80 2023-11-28T11:10:00.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.214+0000 7f3ed5a7e700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb40682f0 0x7f3eb406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.214+0000 7f3ed5a7e700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb40682f0 0x7f3eb406a7a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3ed015f160 tx=0x7f3ec0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:00.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.218+0000 7f3ec67fc700 1 -- 172.21.15.125:0/3782557137 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3ecc053a50 con 0x7f3ed00b3b80 2023-11-28T11:10:00.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.415+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/3782557137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ed00743f0 con 0x7f3ed00b3b80 2023-11-28T11:10:00.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.416+0000 7f3ec67fc700 1 -- 172.21.15.125:0/3782557137 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ecc057070 con 0x7f3ed00b3b80 2023-11-28T11:10:00.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/3782557137 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb40682f0 msgr2=0x7f3eb406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb40682f0 0x7f3eb406a7a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3ed015f160 tx=0x7f3ec0008040 comp rx=0 tx=0).stop 2023-11-28T11:10:00.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/3782557137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ed00b3b80 msgr2=0x7f3ed00c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ed00b3b80 0x7f3ed00c7e00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009c40 tx=0x7f3ecc004750 comp rx=0 tx=0).stop 2023-11-28T11:10:00.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/3782557137 shutdown_connections 2023-11-28T11:10:00.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb40682f0 0x7f3eb406a7a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ed015fe50 0x7f3ed00c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ed00b27d0 0x7f3ed0154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 --2- 172.21.15.125:0/3782557137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ed00b3b80 0x7f3ed00c7e00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/3782557137 >> 172.21.15.125:0/3782557137 conn(0x7f3ed006ea80 msgr2=0x7f3ed00b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:00.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/3782557137 shutdown_connections 2023-11-28T11:10:00.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.418+0000 7f3ed7ce2700 1 -- 172.21.15.125:0/3782557137 wait complete. 2023-11-28T11:10:00.421 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:10:00.432 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:10:00.432 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:10:00.449 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:10:00.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.607+0000 7fdd345d2700 1 Processor -- start 2023-11-28T11:10:00.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.607+0000 7fdd345d2700 1 -- start start 2023-11-28T11:10:00.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.608+0000 7fdd345d2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd2c06a270 0x7fdd2c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.608+0000 7fdd345d2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd2c15cc80 0x7fdd2c06de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.608+0000 7fdd345d2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c06ab80 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.608+0000 7fdd345d2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c0b2490 con 0x7fdd2c15cc80 2023-11-28T11:10:00.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.608+0000 7fdd345d2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c0b1810 con 0x7fdd2c06a270 2023-11-28T11:10:00.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd31b6d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd2c15cc80 0x7fdd2c06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd31b6d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd2c15cc80 0x7fdd2c06de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59410/0 (socket says 172.21.15.125:59410) 2023-11-28T11:10:00.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd31b6d700 1 -- 172.21.15.125:0/1706439180 learned_addr learned my addr 172.21.15.125:0/1706439180 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:00.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd32b6f700 1 --1- 172.21.15.125:0/1706439180 >> v1:172.21.15.125:6789/0 conn(0x7fdd2c06e3a0 0x7fdd2c06ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43536/0 (socket says 172.21.15.125:43536) 2023-11-28T11:10:00.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd3236e700 1 --2- 172.21.15.125:0/1706439180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd2c06a270 0x7fdd2c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd31b6d700 1 -- 172.21.15.125:0/1706439180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd2c06a270 msgr2=0x7fdd2c06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:00.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd31b6d700 1 --2- 172.21.15.125:0/1706439180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd2c06a270 0x7fdd2c06a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd31b6d700 1 -- 172.21.15.125:0/1706439180 >> v1:172.21.15.125:6789/0 conn(0x7fdd2c06e3a0 legacy=0x7fdd2c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd31b6d700 1 -- 172.21.15.125:0/1706439180 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c0b1af0 con 0x7fdd2c15cc80 2023-11-28T11:10:00.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd3136c700 1 -- 172.21.15.125:0/1706439180 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892541060 0 0) 0x7fdd2c06ab80 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd31b6d700 1 --2- 172.21.15.125:0/1706439180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c15cc80 0x7fdd2c06de60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdd200098f0 tx=0x7fdd20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cd01a2c11a4f16 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:00.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd3136c700 1 -- 172.21.15.125:0/1706439180 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000b8a0 con 0x7fdd2c15cc80 2023-11-28T11:10:00.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd3136c700 1 -- 172.21.15.125:0/1706439180 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2000ba00 con 0x7fdd2c15cc80 2023-11-28T11:10:00.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.609+0000 7fdd3136c700 1 -- 172.21.15.125:0/1706439180 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000bd90 con 0x7fdd2c15cc80 2023-11-28T11:10:00.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.610+0000 7fdd345d2700 1 -- 172.21.15.125:0/1706439180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c15cc80 msgr2=0x7fdd2c06de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.610+0000 7fdd345d2700 1 --2- 172.21.15.125:0/1706439180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c15cc80 0x7fdd2c06de60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdd200098f0 tx=0x7fdd20009c00 comp rx=0 tx=0).stop 2023-11-28T11:10:00.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.610+0000 7fdd345d2700 1 -- 172.21.15.125:0/1706439180 shutdown_connections 2023-11-28T11:10:00.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.610+0000 7fdd345d2700 1 --2- 172.21.15.125:0/1706439180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd2c06a270 0x7fdd2c06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.610+0000 7fdd345d2700 1 --2- 172.21.15.125:0/1706439180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c15cc80 0x7fdd2c06de60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.610+0000 7fdd345d2700 1 -- 172.21.15.125:0/1706439180 >> 172.21.15.125:0/1706439180 conn(0x7fdd2c06c010 msgr2=0x7fdd2c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:00.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.610+0000 7fdd345d2700 1 -- 172.21.15.125:0/1706439180 shutdown_connections 2023-11-28T11:10:00.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.610+0000 7fdd345d2700 1 -- 172.21.15.125:0/1706439180 wait complete. 2023-11-28T11:10:00.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.611+0000 7fdd345d2700 1 Processor -- start 2023-11-28T11:10:00.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.611+0000 7fdd345d2700 1 -- start start 2023-11-28T11:10:00.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd345d2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2c06a270 0x7fdd2c0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd345d2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c06e3a0 0x7fdd2c1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd345d2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd2c15cc80 0x7fdd2c152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd345d2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c0c7300 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd345d2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c1528f0 con 0x7fdd2c06a270 2023-11-28T11:10:00.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd345d2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c0b59f0 con 0x7fdd2c15cc80 2023-11-28T11:10:00.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd31b6d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c06e3a0 0x7fdd2c1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd31b6d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c06e3a0 0x7fdd2c1523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59416/0 (socket says 172.21.15.125:59416) 2023-11-28T11:10:00.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd31b6d700 1 -- 172.21.15.125:0/2358945852 learned_addr learned my addr 172.21.15.125:0/2358945852 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd3236e700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2c06a270 0x7fdd2c0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd32b6f700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd2c15cc80 0x7fdd2c152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd31b6d700 1 -- 172.21.15.125:0/2358945852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd2c15cc80 msgr2=0x7fdd2c152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd31b6d700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd2c15cc80 0x7fdd2c152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd31b6d700 1 -- 172.21.15.125:0/2358945852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2c06a270 msgr2=0x7fdd2c0c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd31b6d700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2c06a270 0x7fdd2c0c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd31b6d700 1 -- 172.21.15.125:0/2358945852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd20009550 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd3236e700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2c06a270 0x7fdd2c0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd32b6f700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd2c15cc80 0x7fdd2c152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd31b6d700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c06e3a0 0x7fdd2c1523b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009c40 tx=0x7fdd20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd1effd700 1 -- 172.21.15.125:0/2358945852 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd200036a0 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd1effd700 1 -- 172.21.15.125:0/2358945852 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd20003800 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd345d2700 1 -- 172.21.15.125:0/2358945852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2c0b20b0 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.612+0000 7fdd1effd700 1 -- 172.21.15.125:0/2358945852 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20003b70 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.613+0000 7fdd345d2700 1 -- 172.21.15.125:0/2358945852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2c0b1dd0 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.613+0000 7fdd345d2700 1 -- 172.21.15.125:0/2358945852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2c06e7e0 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.614+0000 7fdd1effd700 1 -- 172.21.15.125:0/2358945852 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdd2002d070 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.614+0000 7fdd1effd700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd100682f0 0x7fdd1006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.614+0000 7fdd1effd700 1 -- 172.21.15.125:0/2358945852 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd20021030 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.614+0000 7fdd3236e700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd100682f0 0x7fdd1006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.615+0000 7fdd3236e700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd100682f0 0x7fdd1006a7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdd28006fd0 tx=0x7fdd28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:00.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.618+0000 7fdd1effd700 1 -- 172.21.15.125:0/2358945852 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdd20053c20 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.799+0000 7fdd345d2700 1 -- 172.21.15.125:0/2358945852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd2c0743f0 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.800+0000 7fdd1effd700 1 -- 172.21.15.125:0/2358945852 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18027 (secure 0 0 0) 0x7fdd20057240 con 0x7fdd2c06e3a0 2023-11-28T11:10:00.802 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:00.802 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":38,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:09:49.562761+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:09:46.832058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T11:09:47.518555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:10:00.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 -- 172.21.15.125:0/2358945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd100682f0 msgr2=0x7fdd1006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd100682f0 0x7fdd1006a7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdd28006fd0 tx=0x7fdd28008040 comp rx=0 tx=0).stop 2023-11-28T11:10:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 -- 172.21.15.125:0/2358945852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c06e3a0 msgr2=0x7fdd2c1523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c06e3a0 0x7fdd2c1523b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009c40 tx=0x7fdd20004750 comp rx=0 tx=0).stop 2023-11-28T11:10:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 -- 172.21.15.125:0/2358945852 shutdown_connections 2023-11-28T11:10:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd100682f0 0x7fdd1006a7a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd2c15cc80 0x7fdd2c152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2c06a270 0x7fdd2c0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 --2- 172.21.15.125:0/2358945852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd2c06e3a0 0x7fdd2c1523b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 -- 172.21.15.125:0/2358945852 >> 172.21.15.125:0/2358945852 conn(0x7fdd2c06c010 msgr2=0x7fdd2c0b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 -- 172.21.15.125:0/2358945852 shutdown_connections 2023-11-28T11:10:00.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.802+0000 7fdd345d2700 1 -- 172.21.15.125:0/2358945852 wait complete. 2023-11-28T11:10:00.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:09:46.832058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:09:47.518555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:10:00.816 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:10:00.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.938+0000 7f035a398700 1 Processor -- start 2023-11-28T11:10:00.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.938+0000 7f035a398700 1 -- start start 2023-11-28T11:10:00.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f035a398700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f035415c810 0x7f0354160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f035a398700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035406a270 0x7f035406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f035a398700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035406abf0 con 0x7f03540718e0 2023-11-28T11:10:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f035a398700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035415cbe0 con 0x7f035415c810 2023-11-28T11:10:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f035a398700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03541607a0 con 0x7f035406a270 2023-11-28T11:10:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f0353fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f035415c810 0x7f0354160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f03537fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f03540718e0 0x7f035406c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43546/0 (socket says 172.21.15.125:43546) 2023-11-28T11:10:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f03537fe700 1 -- 172.21.15.125:0/2654604030 learned_addr learned my addr 172.21.15.125:0/2654604030 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f0358935700 1 --2- 172.21.15.125:0/2654604030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035406a270 0x7f035406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f0353fff700 1 -- 172.21.15.125:0/2654604030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035406a270 msgr2=0x7f035406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f0353fff700 1 --2- 172.21.15.125:0/2654604030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035406a270 0x7f035406a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f0353fff700 1 -- 172.21.15.125:0/2654604030 >> v1:172.21.15.125:6789/0 conn(0x7f03540718e0 legacy=0x7f035406c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f0353fff700 1 -- 172.21.15.125:0/2654604030 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0354160a50 con 0x7f035415c810 2023-11-28T11:10:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f0352ffd700 1 -- 172.21.15.125:0/2654604030 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331422394 0 0) 0x7f035406abf0 con 0x7f03540718e0 2023-11-28T11:10:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.939+0000 7f0358935700 1 --2- 172.21.15.125:0/2654604030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035406a270 0x7f035406a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f0353fff700 1 --2- 172.21.15.125:0/2654604030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f035415c810 0x7f0354160260 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0348009840 tx=0x7f0348009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c602475e67f9a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f0352ffd700 1 -- 172.21.15.125:0/2654604030 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348011830 con 0x7f035415c810 2023-11-28T11:10:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f0352ffd700 1 -- 172.21.15.125:0/2654604030 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348011990 con 0x7f035415c810 2023-11-28T11:10:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f0352ffd700 1 -- 172.21.15.125:0/2654604030 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348011d20 con 0x7f035415c810 2023-11-28T11:10:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f035a398700 1 -- 172.21.15.125:0/2654604030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f035415c810 msgr2=0x7f0354160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f035a398700 1 --2- 172.21.15.125:0/2654604030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f035415c810 0x7f0354160260 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0348009840 tx=0x7f0348009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f035a398700 1 -- 172.21.15.125:0/2654604030 shutdown_connections 2023-11-28T11:10:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f035a398700 1 --2- 172.21.15.125:0/2654604030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035406a270 0x7f035406a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f035a398700 1 --2- 172.21.15.125:0/2654604030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f035415c810 0x7f0354160260 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f035a398700 1 -- 172.21.15.125:0/2654604030 >> 172.21.15.125:0/2654604030 conn(0x7f035406c010 msgr2=0x7f03540cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f035a398700 1 -- 172.21.15.125:0/2654604030 shutdown_connections 2023-11-28T11:10:00.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.940+0000 7f035a398700 1 -- 172.21.15.125:0/2654604030 wait complete. 2023-11-28T11:10:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.941+0000 7f035a398700 1 Processor -- start 2023-11-28T11:10:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.942+0000 7f035a398700 1 -- start start 2023-11-28T11:10:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.942+0000 7f035a398700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f035406a270 0x7f035415cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.942+0000 7f035a398700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03540718e0 0x7f0354159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.942+0000 7f035a398700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035415c810 0x7f035415f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.942+0000 7f035a398700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035415a5c0 con 0x7f035406a270 2023-11-28T11:10:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.942+0000 7f035a398700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035415a8a0 con 0x7f03540718e0 2023-11-28T11:10:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.942+0000 7f035a398700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035415ab80 con 0x7f035415c810 2023-11-28T11:10:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.942+0000 7f0353fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f035406a270 0x7f035415cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.942+0000 7f0353fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f035406a270 0x7f035415cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59428/0 (socket says 172.21.15.125:59428) 2023-11-28T11:10:00.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0353fff700 1 -- 172.21.15.125:0/2264100218 learned_addr learned my addr 172.21.15.125:0/2264100218 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f03537fe700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03540718e0 0x7f0354159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0358935700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035415c810 0x7f035415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0353fff700 1 -- 172.21.15.125:0/2264100218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035415c810 msgr2=0x7f035415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0353fff700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035415c810 0x7f035415f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0353fff700 1 -- 172.21.15.125:0/2264100218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03540718e0 msgr2=0x7f0354159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0353fff700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03540718e0 0x7f0354159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0353fff700 1 -- 172.21.15.125:0/2264100218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480094a0 con 0x7f035406a270 2023-11-28T11:10:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0358935700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035415c810 0x7f035415f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0353fff700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f035406a270 0x7f035415cf90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0348014040 tx=0x7f0348004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0350ff9700 1 -- 172.21.15.125:0/2264100218 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480038a0 con 0x7f035406a270 2023-11-28T11:10:00.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0350ff9700 1 -- 172.21.15.125:0/2264100218 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034801e070 con 0x7f035406a270 2023-11-28T11:10:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f035a398700 1 -- 172.21.15.125:0/2264100218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0354161010 con 0x7f035406a270 2023-11-28T11:10:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f0350ff9700 1 -- 172.21.15.125:0/2264100218 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348003c20 con 0x7f035406a270 2023-11-28T11:10:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.943+0000 7f035a398700 1 -- 172.21.15.125:0/2264100218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0354160d30 con 0x7f035406a270 2023-11-28T11:10:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.944+0000 7f035a398700 1 -- 172.21.15.125:0/2264100218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03540ceb20 con 0x7f035406a270 2023-11-28T11:10:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.944+0000 7f0350ff9700 1 -- 172.21.15.125:0/2264100218 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f034800f050 con 0x7f035406a270 2023-11-28T11:10:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.945+0000 7f0350ff9700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f03400682f0 0x7f034006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.945+0000 7f03537fe700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f03400682f0 0x7f034006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.945+0000 7f0350ff9700 1 -- 172.21.15.125:0/2264100218 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0348086d50 con 0x7f035406a270 2023-11-28T11:10:00.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.945+0000 7f03537fe700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f03400682f0 0x7f034006a7a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f03540b5a90 tx=0x7f0344007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:00.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:00.949+0000 7f0350ff9700 1 -- 172.21.15.125:0/2264100218 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f03480535b0 con 0x7f035406a270 2023-11-28T11:10:01.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.131+0000 7f035a398700 1 -- 172.21.15.125:0/2264100218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03540743f0 con 0x7f035406a270 2023-11-28T11:10:01.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.132+0000 7f0350ff9700 1 -- 172.21.15.125:0/2264100218 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03480150a0 con 0x7f035406a270 2023-11-28T11:10:01.133 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:10:01.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 -- 172.21.15.125:0/2264100218 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f03400682f0 msgr2=0x7f034006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f03400682f0 0x7f034006a7a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f03540b5a90 tx=0x7f0344007be0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 -- 172.21.15.125:0/2264100218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f035406a270 msgr2=0x7f035415cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f035406a270 0x7f035415cf90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0348014040 tx=0x7f0348004750 comp rx=0 tx=0).stop 2023-11-28T11:10:01.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 -- 172.21.15.125:0/2264100218 shutdown_connections 2023-11-28T11:10:01.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f03400682f0 0x7f034006a7a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035415c810 0x7f035415f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f035406a270 0x7f035415cf90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 --2- 172.21.15.125:0/2264100218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03540718e0 0x7f0354159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 -- 172.21.15.125:0/2264100218 >> 172.21.15.125:0/2264100218 conn(0x7f035406c010 msgr2=0x7f03540cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:01.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 -- 172.21.15.125:0/2264100218 shutdown_connections 2023-11-28T11:10:01.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.134+0000 7f035a398700 1 -- 172.21.15.125:0/2264100218 wait complete. 2023-11-28T11:10:01.147 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:10:01.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.269+0000 7f8cafd53700 1 Processor -- start 2023-11-28T11:10:01.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.269+0000 7f8cafd53700 1 -- start start 2023-11-28T11:10:01.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cafd53700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8071890 0x7f8ca80ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cafd53700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca815cc10 con 0x7f8ca806a980 2023-11-28T11:10:01.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cafd53700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca806c9b0 con 0x7f8ca80cf710 2023-11-28T11:10:01.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cafd53700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca806cc90 con 0x7f8ca8071890 2023-11-28T11:10:01.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cad2ee700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8ca806a980 0x7f8ca8160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43562/0 (socket says 172.21.15.125:43562) 2023-11-28T11:10:01.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cad2ee700 1 -- 172.21.15.125:0/1128722670 learned_addr learned my addr 172.21.15.125:0/1128722670 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:01.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cae2f0700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8071890 0x7f8ca80ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501965841 0 0) 0x7f8ca815cc10 con 0x7f8ca806a980 2023-11-28T11:10:01.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c940035b0 con 0x7f8ca806a980 2023-11-28T11:10:01.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3003709910 0 0) 0x7f8c940035b0 con 0x7f8ca806a980 2023-11-28T11:10:01.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8071890 msgr2=0x7f8ca80ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:01.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8071890 0x7f8ca80ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 >> v1:172.21.15.167:6789/0 conn(0x7f8ca80cf710 legacy=0x7f8ca806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca806cf70 con 0x7f8ca806a980 2023-11-28T11:10:01.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f8ca4001670 con 0x7f8ca806a980 2023-11-28T11:10:01.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 >> v1:172.21.15.125:6789/0 conn(0x7f8ca806a980 legacy=0x7f8ca8160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8071890 0x7f8c94003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c94003fb0 0x7f8c94004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c94004d90 0x7f8c94005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca806cc90 con 0x7f8c94003fb0 2023-11-28T11:10:01.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9400bba0 con 0x7f8c94004d90 2023-11-28T11:10:01.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9400bd60 con 0x7f8ca8071890 2023-11-28T11:10:01.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cad2ee700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c94003fb0 0x7f8c94004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.270+0000 7f8cadaef700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8071890 0x7f8c94003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cae2f0700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c94004d90 0x7f8c94005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cad2ee700 1 -- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8071890 msgr2=0x7f8c94003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:01.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cad2ee700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8071890 0x7f8c94003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cad2ee700 1 -- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c94004d90 msgr2=0x7f8c94005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:01.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cad2ee700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c94004d90 0x7f8c94005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cad2ee700 1 -- 172.21.15.125:0/1128722670 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c940035b0 con 0x7f8c94003fb0 2023-11-28T11:10:01.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cae2f0700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c94004d90 0x7f8c94005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:01.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cad2ee700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c94003fb0 0x7f8c94004850 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c210 tx=0x7f8c94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bb245919b36622 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:01.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4007c10 con 0x7f8c94003fb0 2023-11-28T11:10:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca400cdd0 con 0x7f8c94003fb0 2023-11-28T11:10:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cacaed700 1 -- 172.21.15.125:0/1128722670 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4005ba0 con 0x7f8c94003fb0 2023-11-28T11:10:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cafd53700 1 -- 172.21.15.125:0/1128722670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c94003fb0 msgr2=0x7f8c94004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cafd53700 1 --2- 172.21.15.125:0/1128722670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8c94003fb0 0x7f8c94004850 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c210 tx=0x7f8c94005880 comp rx=0 tx=0).stop 2023-11-28T11:10:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cae2f0700 1 -- 172.21.15.125:0/1128722670 reap_dead start 2023-11-28T11:10:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cafd53700 1 -- 172.21.15.125:0/1128722670 shutdown_connections 2023-11-28T11:10:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.271+0000 7f8cafd53700 1 -- 172.21.15.125:0/1128722670 >> 172.21.15.125:0/1128722670 conn(0x7f8ca806c010 msgr2=0x7f8ca80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.272+0000 7f8cafd53700 1 -- 172.21.15.125:0/1128722670 shutdown_connections 2023-11-28T11:10:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.272+0000 7f8cafd53700 1 -- 172.21.15.125:0/1128722670 wait complete. 2023-11-28T11:10:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.273+0000 7f8cafd53700 1 Processor -- start 2023-11-28T11:10:01.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.273+0000 7f8cafd53700 1 -- start start 2023-11-28T11:10:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.273+0000 7f8cafd53700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c94003fb0 0x7f8ca8151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.273+0000 7f8cafd53700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca81544c0 0x7f8ca81529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cafd53700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8152f10 0x7f8ca80c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cafd53700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca8153420 con 0x7f8ca81544c0 2023-11-28T11:10:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cafd53700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca8153700 con 0x7f8c94003fb0 2023-11-28T11:10:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cafd53700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca81539e0 con 0x7f8ca8152f10 2023-11-28T11:10:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cad2ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca81544c0 0x7f8ca81529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cad2ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca81544c0 0x7f8ca81529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59450/0 (socket says 172.21.15.125:59450) 2023-11-28T11:10:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cad2ee700 1 -- 172.21.15.125:0/1957042613 learned_addr learned my addr 172.21.15.125:0/1957042613 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cae2f0700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8152f10 0x7f8ca80c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cadaef700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c94003fb0 0x7f8ca8151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cad2ee700 1 -- 172.21.15.125:0/1957042613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8152f10 msgr2=0x7f8ca80c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cad2ee700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8152f10 0x7f8ca80c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cad2ee700 1 -- 172.21.15.125:0/1957042613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c94003fb0 msgr2=0x7f8ca8151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cad2ee700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c94003fb0 0x7f8ca8151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cad2ee700 1 -- 172.21.15.125:0/1957042613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca806d530 con 0x7f8ca81544c0 2023-11-28T11:10:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cad2ee700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca81544c0 0x7f8ca81529d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8c94005810 tx=0x7f8ca4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8c9e7fc700 1 -- 172.21.15.125:0/1957042613 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4001630 con 0x7f8ca81544c0 2023-11-28T11:10:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8c9e7fc700 1 -- 172.21.15.125:0/1957042613 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca40070d0 con 0x7f8ca81544c0 2023-11-28T11:10:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cafd53700 1 -- 172.21.15.125:0/1957042613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca806d250 con 0x7f8ca81544c0 2023-11-28T11:10:01.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8c9e7fc700 1 -- 172.21.15.125:0/1957042613 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4007480 con 0x7f8ca81544c0 2023-11-28T11:10:01.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.274+0000 7f8cafd53700 1 -- 172.21.15.125:0/1957042613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca80ce740 con 0x7f8ca81544c0 2023-11-28T11:10:01.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.275+0000 7f8cafd53700 1 -- 172.21.15.125:0/1957042613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca80743f0 con 0x7f8ca81544c0 2023-11-28T11:10:01.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.276+0000 7f8c9e7fc700 1 -- 172.21.15.125:0/1957042613 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8ca4010070 con 0x7f8ca81544c0 2023-11-28T11:10:01.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.276+0000 7f8c9e7fc700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8c8c0682f0 0x7f8c8c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.276+0000 7f8cadaef700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8c8c0682f0 0x7f8c8c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.276+0000 7f8c9e7fc700 1 -- 172.21.15.125:0/1957042613 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ca4087480 con 0x7f8ca81544c0 2023-11-28T11:10:01.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.276+0000 7f8cadaef700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8c8c0682f0 0x7f8c8c06a7a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8c98000c00 tx=0x7f8c98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:01.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.280+0000 7f8c9e7fc700 1 -- 172.21.15.125:0/1957042613 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8ca4053c60 con 0x7f8ca81544c0 2023-11-28T11:10:01.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.462+0000 7f8cafd53700 1 -- 172.21.15.125:0/1957042613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8ca80ccf90 con 0x7f8ca81544c0 2023-11-28T11:10:01.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.462+0000 7f8c9e7fc700 1 -- 172.21.15.125:0/1957042613 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8ca4057280 con 0x7f8ca81544c0 2023-11-28T11:10:01.464 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:10:01.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.464+0000 7f8cafd53700 1 -- 172.21.15.125:0/1957042613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8c8c0682f0 msgr2=0x7f8c8c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.464+0000 7f8cafd53700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8c8c0682f0 0x7f8c8c06a7a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8c98000c00 tx=0x7f8c98009040 comp rx=0 tx=0).stop 2023-11-28T11:10:01.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.464+0000 7f8cafd53700 1 -- 172.21.15.125:0/1957042613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca81544c0 msgr2=0x7f8ca81529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.464+0000 7f8cafd53700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca81544c0 0x7f8ca81529d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8c94005810 tx=0x7f8ca4001a00 comp rx=0 tx=0).stop 2023-11-28T11:10:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.464+0000 7f8cafd53700 1 -- 172.21.15.125:0/1957042613 shutdown_connections 2023-11-28T11:10:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.464+0000 7f8cafd53700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8c8c0682f0 0x7f8c8c06a7a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.464+0000 7f8cafd53700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca8152f10 0x7f8ca80c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.464+0000 7f8cafd53700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c94003fb0 0x7f8ca8151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.464+0000 7f8cafd53700 1 --2- 172.21.15.125:0/1957042613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca81544c0 0x7f8ca81529d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.464+0000 7f8cafd53700 1 -- 172.21.15.125:0/1957042613 >> 172.21.15.125:0/1957042613 conn(0x7f8ca806c010 msgr2=0x7f8ca806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.464+0000 7f8cafd53700 1 -- 172.21.15.125:0/1957042613 shutdown_connections 2023-11-28T11:10:01.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.465+0000 7f8cafd53700 1 -- 172.21.15.125:0/1957042613 wait complete. 2023-11-28T11:10:01.478 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:10:01.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.599+0000 7f15c7872700 1 Processor -- start 2023-11-28T11:10:01.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.599+0000 7f15c7872700 1 -- start start 2023-11-28T11:10:01.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c7872700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f15c015a5f0 0x7f15c00d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c7872700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00cc200 0x7f15c00b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c7872700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c015a9c0 con 0x7f15c00b2d10 2023-11-28T11:10:01.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c7872700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c00b3190 con 0x7f15c015a5f0 2023-11-28T11:10:01.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c7872700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00c7b80 con 0x7f15c00cc200 2023-11-28T11:10:01.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c4e0d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00cc200 0x7f15c00b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c560e700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f15c015a5f0 0x7f15c00d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c5e0f700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f15c00b2d10 0x7f15c015e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:46384/0 (socket says 172.21.15.125:46384) 2023-11-28T11:10:01.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c5e0f700 1 -- 172.21.15.125:0/1141104804 learned_addr learned my addr 172.21.15.125:0/1141104804 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:01.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c4e0d700 1 --2- 172.21.15.125:0/1141104804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00cc200 0x7f15c00b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:54462/0 (socket says 172.21.15.125:54462) 2023-11-28T11:10:01.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15b7fff700 1 -- 172.21.15.125:0/1141104804 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268493309 0 0) 0x7f15c015a9c0 con 0x7f15c00b2d10 2023-11-28T11:10:01.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15b7fff700 1 -- 172.21.15.125:0/1141104804 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15ac0035b0 con 0x7f15c00b2d10 2023-11-28T11:10:01.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c4e0d700 1 -- 172.21.15.125:0/1141104804 >> v2:172.21.15.167:3300/0 conn(0x7f15c015a5f0 msgr2=0x7f15c00d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:01.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c4e0d700 1 --2- 172.21.15.125:0/1141104804 >> v2:172.21.15.167:3300/0 conn(0x7f15c015a5f0 0x7f15c00d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c4e0d700 1 -- 172.21.15.125:0/1141104804 >> v1:172.21.15.167:6789/0 conn(0x7f15c00b2d10 legacy=0x7f15c015e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c4e0d700 1 -- 172.21.15.125:0/1141104804 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c00cc990 con 0x7f15c00cc200 2023-11-28T11:10:01.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.600+0000 7f15c560e700 1 --2- 172.21.15.125:0/1141104804 >> v2:172.21.15.167:3300/0 conn(0x7f15c015a5f0 0x7f15c00d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:10:01.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15c4e0d700 1 --2- 172.21.15.125:0/1141104804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00cc200 0x7f15c00b27d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009840 tx=0x7f15b0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afd08e2f0b0de81e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:01.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15b7fff700 1 -- 172.21.15.125:0/1141104804 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0011830 con 0x7f15c00cc200 2023-11-28T11:10:01.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15b7fff700 1 -- 172.21.15.125:0/1141104804 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b0011990 con 0x7f15c00cc200 2023-11-28T11:10:01.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15b7fff700 1 -- 172.21.15.125:0/1141104804 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0011d00 con 0x7f15c00cc200 2023-11-28T11:10:01.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15c7872700 1 -- 172.21.15.125:0/1141104804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00cc200 msgr2=0x7f15c00b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15c7872700 1 --2- 172.21.15.125:0/1141104804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00cc200 0x7f15c00b27d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009840 tx=0x7f15b0009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:01.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15c7872700 1 -- 172.21.15.125:0/1141104804 shutdown_connections 2023-11-28T11:10:01.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15c7872700 1 --2- 172.21.15.125:0/1141104804 >> v2:172.21.15.167:3300/0 conn(0x7f15c015a5f0 0x7f15c00d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15c7872700 1 --2- 172.21.15.125:0/1141104804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00cc200 0x7f15c00b27d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15c7872700 1 -- 172.21.15.125:0/1141104804 >> 172.21.15.125:0/1141104804 conn(0x7f15c006ea80 msgr2=0x7f15c006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:01.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15c7872700 1 -- 172.21.15.125:0/1141104804 shutdown_connections 2023-11-28T11:10:01.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.601+0000 7f15c7872700 1 -- 172.21.15.125:0/1141104804 wait complete. 2023-11-28T11:10:01.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.603+0000 7f15c7872700 1 Processor -- start 2023-11-28T11:10:01.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.603+0000 7f15c7872700 1 -- start start 2023-11-28T11:10:01.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.603+0000 7f15c7872700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c00b2d10 0x7f15c014b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.603+0000 7f15c7872700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c00cc200 0x7f15c00ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.603+0000 7f15c7872700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c015a5f0 0x7f15c006f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.603+0000 7f15c7872700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00c9f50 con 0x7f15c00b2d10 2023-11-28T11:10:01.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.603+0000 7f15c7872700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00b50f0 con 0x7f15c00cc200 2023-11-28T11:10:01.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.603+0000 7f15c7872700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00c93d0 con 0x7f15c015a5f0 2023-11-28T11:10:01.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.603+0000 7f15c560e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c00b2d10 0x7f15c014b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.603+0000 7f15c560e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c00b2d10 0x7f15c014b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59460/0 (socket says 172.21.15.125:59460) 2023-11-28T11:10:01.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.603+0000 7f15c560e700 1 -- 172.21.15.125:0/3855770364 learned_addr learned my addr 172.21.15.125:0/3855770364 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:01.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15c5e0f700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c015a5f0 0x7f15c006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15c4e0d700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c00cc200 0x7f15c00ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15c560e700 1 -- 172.21.15.125:0/3855770364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c015a5f0 msgr2=0x7f15c006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15c560e700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c015a5f0 0x7f15c006f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15c560e700 1 -- 172.21.15.125:0/3855770364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c00cc200 msgr2=0x7f15c00ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15c560e700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c00cc200 0x7f15c00ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15c560e700 1 -- 172.21.15.125:0/3855770364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc0094a0 con 0x7f15c00b2d10 2023-11-28T11:10:01.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15c560e700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c00b2d10 0x7f15c014b300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00ebe0 tx=0x7f15bc009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:01.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15b5ffb700 1 -- 172.21.15.125:0/3855770364 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00c910 con 0x7f15c00b2d10 2023-11-28T11:10:01.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15b5ffb700 1 -- 172.21.15.125:0/3855770364 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc00ca70 con 0x7f15c00b2d10 2023-11-28T11:10:01.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15c7872700 1 -- 172.21.15.125:0/3855770364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b00094a0 con 0x7f15c00b2d10 2023-11-28T11:10:01.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15b5ffb700 1 -- 172.21.15.125:0/3855770364 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00cde0 con 0x7f15c00b2d10 2023-11-28T11:10:01.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.604+0000 7f15c7872700 1 -- 172.21.15.125:0/3855770364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c00ccf50 con 0x7f15c00b2d10 2023-11-28T11:10:01.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.605+0000 7f15c7872700 1 -- 172.21.15.125:0/3855770364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c00ccc70 con 0x7f15c00b2d10 2023-11-28T11:10:01.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.606+0000 7f15b5ffb700 1 -- 172.21.15.125:0/3855770364 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f15bc019030 con 0x7f15c00b2d10 2023-11-28T11:10:01.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.606+0000 7f15b5ffb700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15a40682f0 0x7f15a406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.606+0000 7f15b5ffb700 1 -- 172.21.15.125:0/3855770364 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15bc085de0 con 0x7f15c00b2d10 2023-11-28T11:10:01.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.606+0000 7f15c4e0d700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15a40682f0 0x7f15a406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.606+0000 7f15c4e0d700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15a40682f0 0x7f15a406a7a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009fd0 tx=0x7f15b0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:01.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.610+0000 7f15b5ffb700 1 -- 172.21.15.125:0/3855770364 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f15bc0525c0 con 0x7f15c00b2d10 2023-11-28T11:10:01.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.793+0000 7f15c7872700 1 -- 172.21.15.125:0/3855770364 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15c00b5420 con 0x7f15c00b2d10 2023-11-28T11:10:01.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.794+0000 7f15b5ffb700 1 -- 172.21.15.125:0/3855770364 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15bc017020 con 0x7f15c00b2d10 2023-11-28T11:10:01.795 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:10:01.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.795+0000 7f15c7872700 1 -- 172.21.15.125:0/3855770364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15a40682f0 msgr2=0x7f15a406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.795+0000 7f15c7872700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15a40682f0 0x7f15a406a7a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009fd0 tx=0x7f15b0008030 comp rx=0 tx=0).stop 2023-11-28T11:10:01.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.795+0000 7f15c7872700 1 -- 172.21.15.125:0/3855770364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c00b2d10 msgr2=0x7f15c014b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.795+0000 7f15c7872700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c00b2d10 0x7f15c014b300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00ebe0 tx=0x7f15bc009ec0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.795+0000 7f15c7872700 1 -- 172.21.15.125:0/3855770364 shutdown_connections 2023-11-28T11:10:01.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.795+0000 7f15c7872700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15a40682f0 0x7f15a406a7a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.795+0000 7f15c7872700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c015a5f0 0x7f15c006f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.795+0000 7f15c7872700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c00b2d10 0x7f15c014b300 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.795+0000 7f15c7872700 1 --2- 172.21.15.125:0/3855770364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c00cc200 0x7f15c00ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.795+0000 7f15c7872700 1 -- 172.21.15.125:0/3855770364 >> 172.21.15.125:0/3855770364 conn(0x7f15c006ea80 msgr2=0x7f15c00cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.796+0000 7f15c7872700 1 -- 172.21.15.125:0/3855770364 shutdown_connections 2023-11-28T11:10:01.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.796+0000 7f15c7872700 1 -- 172.21.15.125:0/3855770364 wait complete. 2023-11-28T11:10:01.809 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:10:01.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.932+0000 7f6f6cf05700 1 Processor -- start 2023-11-28T11:10:01.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.932+0000 7f6f6cf05700 1 -- start start 2023-11-28T11:10:01.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f6cf05700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f680b2ee0 0x7f6f680d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f6cf05700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6815a9c0 con 0x7f6f6815a5f0 2023-11-28T11:10:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f6cf05700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f680c7b80 con 0x7f6f680cc200 2023-11-28T11:10:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f6cf05700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f680cc990 con 0x7f6f680b2ee0 2023-11-28T11:10:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f6659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6f6815a5f0 0x7f6f680b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43592/0 (socket says 172.21.15.125:43592) 2023-11-28T11:10:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f65d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f680b2ee0 0x7f6f680d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f6659c700 1 -- 172.21.15.125:0/56897701 learned_addr learned my addr 172.21.15.125:0/56897701 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f65d9b700 1 -- 172.21.15.125:0/56897701 >> v1:172.21.15.167:6789/0 conn(0x7f6f680cc200 legacy=0x7f6f680ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f65d9b700 1 -- 172.21.15.125:0/56897701 >> v1:172.21.15.125:6789/0 conn(0x7f6f6815a5f0 legacy=0x7f6f680b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f65d9b700 1 -- 172.21.15.125:0/56897701 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680ccc70 con 0x7f6f680b2ee0 2023-11-28T11:10:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f6559a700 1 -- 172.21.15.125:0/56897701 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343086734 0 0) 0x7f6f6815a9c0 con 0x7f6f6815a5f0 2023-11-28T11:10:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f65d9b700 1 --2- 172.21.15.125:0/56897701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f680b2ee0 0x7f6f680d0ad0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009840 tx=0x7f6f5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e3145bc710b7c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f6559a700 1 -- 172.21.15.125:0/56897701 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c011830 con 0x7f6f680b2ee0 2023-11-28T11:10:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f6559a700 1 -- 172.21.15.125:0/56897701 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c011990 con 0x7f6f680b2ee0 2023-11-28T11:10:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.933+0000 7f6f6559a700 1 -- 172.21.15.125:0/56897701 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c011d20 con 0x7f6f680b2ee0 2023-11-28T11:10:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.934+0000 7f6f6cf05700 1 -- 172.21.15.125:0/56897701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f680b2ee0 msgr2=0x7f6f680d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.934+0000 7f6f6cf05700 1 --2- 172.21.15.125:0/56897701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f680b2ee0 0x7f6f680d0ad0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009840 tx=0x7f6f5c009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.934+0000 7f6f6cf05700 1 -- 172.21.15.125:0/56897701 shutdown_connections 2023-11-28T11:10:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.934+0000 7f6f6cf05700 1 --2- 172.21.15.125:0/56897701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f680b2ee0 0x7f6f680d0ad0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.934+0000 7f6f6cf05700 1 -- 172.21.15.125:0/56897701 >> 172.21.15.125:0/56897701 conn(0x7f6f6806ea80 msgr2=0x7f6f6806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.934+0000 7f6f6cf05700 1 -- 172.21.15.125:0/56897701 shutdown_connections 2023-11-28T11:10:01.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.934+0000 7f6f6cf05700 1 -- 172.21.15.125:0/56897701 wait complete. 2023-11-28T11:10:01.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.935+0000 7f6f6cf05700 1 Processor -- start 2023-11-28T11:10:01.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.935+0000 7f6f6cf05700 1 -- start start 2023-11-28T11:10:01.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f6cf05700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f680b2ee0 0x7f6f6814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f6cf05700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f680cc200 0x7f6f680b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f6cf05700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f6815a5f0 0x7f6f680c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f6cf05700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680b5560 con 0x7f6f680cc200 2023-11-28T11:10:01.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f6cf05700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680b4950 con 0x7f6f680b2ee0 2023-11-28T11:10:01.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f6cf05700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680b4c30 con 0x7f6f6815a5f0 2023-11-28T11:10:01.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f65d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f680cc200 0x7f6f680b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f65d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f680cc200 0x7f6f680b57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59476/0 (socket says 172.21.15.125:59476) 2023-11-28T11:10:01.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f65d9b700 1 -- 172.21.15.125:0/397394044 learned_addr learned my addr 172.21.15.125:0/397394044 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:01.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f65d9b700 1 -- 172.21.15.125:0/397394044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f6815a5f0 msgr2=0x7f6f680c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f6659c700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f680b2ee0 0x7f6f6814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f66d9d700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f6815a5f0 0x7f6f680c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.936+0000 7f6f65d9b700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f6815a5f0 0x7f6f680c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.937+0000 7f6f65d9b700 1 -- 172.21.15.125:0/397394044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f680b2ee0 msgr2=0x7f6f6814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:01.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.937+0000 7f6f65d9b700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f680b2ee0 0x7f6f6814ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:01.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.937+0000 7f6f65d9b700 1 -- 172.21.15.125:0/397394044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0094a0 con 0x7f6f680cc200 2023-11-28T11:10:01.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.937+0000 7f6f65d9b700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f680cc200 0x7f6f680b57e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0090b0 tx=0x7f6f5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:01.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.937+0000 7f6f56ffd700 1 -- 172.21.15.125:0/397394044 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c01a900 con 0x7f6f680cc200 2023-11-28T11:10:01.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.937+0000 7f6f56ffd700 1 -- 172.21.15.125:0/397394044 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c01aa60 con 0x7f6f680cc200 2023-11-28T11:10:01.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.937+0000 7f6f6cf05700 1 -- 172.21.15.125:0/397394044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f680cd230 con 0x7f6f680cc200 2023-11-28T11:10:01.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.937+0000 7f6f56ffd700 1 -- 172.21.15.125:0/397394044 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c01adf0 con 0x7f6f680cc200 2023-11-28T11:10:01.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.937+0000 7f6f6cf05700 1 -- 172.21.15.125:0/397394044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f680ccf50 con 0x7f6f680cc200 2023-11-28T11:10:01.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.938+0000 7f6f6cf05700 1 -- 172.21.15.125:0/397394044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f680cd510 con 0x7f6f680cc200 2023-11-28T11:10:01.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.938+0000 7f6f56ffd700 1 -- 172.21.15.125:0/397394044 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6f5c02b030 con 0x7f6f680cc200 2023-11-28T11:10:01.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.938+0000 7f6f56ffd700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6f480682f0 0x7f6f4806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:01.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.939+0000 7f6f56ffd700 1 -- 172.21.15.125:0/397394044 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f5c086f90 con 0x7f6f680cc200 2023-11-28T11:10:01.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.939+0000 7f6f6659c700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6f480682f0 0x7f6f4806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:01.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.939+0000 7f6f6659c700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6f480682f0 0x7f6f4806a7a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6f58000f60 tx=0x7f6f58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:01.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:01.943+0000 7f6f56ffd700 1 -- 172.21.15.125:0/397394044 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6f5c0537f0 con 0x7f6f680cc200 2023-11-28T11:10:02.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.124+0000 7f6f6cf05700 1 -- 172.21.15.125:0/397394044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f680743f0 con 0x7f6f680cc200 2023-11-28T11:10:02.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.125+0000 7f6f56ffd700 1 -- 172.21.15.125:0/397394044 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f5c056e10 con 0x7f6f680cc200 2023-11-28T11:10:02.127 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:10:02.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 -- 172.21.15.125:0/397394044 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6f480682f0 msgr2=0x7f6f4806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:02.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6f480682f0 0x7f6f4806a7a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6f58000f60 tx=0x7f6f58009040 comp rx=0 tx=0).stop 2023-11-28T11:10:02.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 -- 172.21.15.125:0/397394044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f680cc200 msgr2=0x7f6f680b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:02.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f680cc200 0x7f6f680b57e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0090b0 tx=0x7f6f5c004750 comp rx=0 tx=0).stop 2023-11-28T11:10:02.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 -- 172.21.15.125:0/397394044 shutdown_connections 2023-11-28T11:10:02.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6f480682f0 0x7f6f4806a7a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f6815a5f0 0x7f6f680c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f680b2ee0 0x7f6f6814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 --2- 172.21.15.125:0/397394044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f680cc200 0x7f6f680b57e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 -- 172.21.15.125:0/397394044 >> 172.21.15.125:0/397394044 conn(0x7f6f6806ea80 msgr2=0x7f6f68159130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:02.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 -- 172.21.15.125:0/397394044 shutdown_connections 2023-11-28T11:10:02.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.127+0000 7f6f6cf05700 1 -- 172.21.15.125:0/397394044 wait complete. 2023-11-28T11:10:02.140 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:10:02.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.259+0000 7f2a7a969700 1 Processor -- start 2023-11-28T11:10:02.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.259+0000 7f2a7a969700 1 -- start start 2023-11-28T11:10:02.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.260+0000 7f2a7a969700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a740718e0 0x7f2a7406c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:02.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.260+0000 7f2a7a969700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a7406cdc0 0x7f2a7406a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:02.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.260+0000 7f2a7a969700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a74160a50 con 0x7f2a7415c810 2023-11-28T11:10:02.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.260+0000 7f2a7a969700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7415cbe0 con 0x7f2a740718e0 2023-11-28T11:10:02.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.260+0000 7f2a7a969700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a74160d30 con 0x7f2a7406cdc0 2023-11-28T11:10:02.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.260+0000 7f2a737fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a740718e0 0x7f2a7406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:02.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.260+0000 7f2a73fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2a7415c810 0x7f2a74160260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43606/0 (socket says 172.21.15.125:43606) 2023-11-28T11:10:02.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.260+0000 7f2a73fff700 1 -- 172.21.15.125:0/227172108 learned_addr learned my addr 172.21.15.125:0/227172108 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:02.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.261+0000 7f2a78f06700 1 --2- 172.21.15.125:0/227172108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a7406cdc0 0x7f2a7406a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:02.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.261+0000 7f2a737fe700 1 -- 172.21.15.125:0/227172108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a7406cdc0 msgr2=0x7f2a7406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:02.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.261+0000 7f2a737fe700 1 --2- 172.21.15.125:0/227172108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a7406cdc0 0x7f2a7406a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.261+0000 7f2a737fe700 1 -- 172.21.15.125:0/227172108 >> v1:172.21.15.125:6789/0 conn(0x7f2a7415c810 legacy=0x7f2a74160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:02.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.261+0000 7f2a737fe700 1 -- 172.21.15.125:0/227172108 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74161010 con 0x7f2a740718e0 2023-11-28T11:10:02.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.261+0000 7f2a72ffd700 1 -- 172.21.15.125:0/227172108 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567853675 0 0) 0x7f2a74160a50 con 0x7f2a7415c810 2023-11-28T11:10:02.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.261+0000 7f2a737fe700 1 --2- 172.21.15.125:0/227172108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a740718e0 0x7f2a7406c880 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009870 tx=0x7f2a64009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d436a21f4cc737f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:02.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.261+0000 7f2a72ffd700 1 -- 172.21.15.125:0/227172108 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64011830 con 0x7f2a740718e0 2023-11-28T11:10:02.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.261+0000 7f2a72ffd700 1 -- 172.21.15.125:0/227172108 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a64011990 con 0x7f2a740718e0 2023-11-28T11:10:02.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.261+0000 7f2a72ffd700 1 -- 172.21.15.125:0/227172108 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64011d20 con 0x7f2a740718e0 2023-11-28T11:10:02.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.262+0000 7f2a7a969700 1 -- 172.21.15.125:0/227172108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a740718e0 msgr2=0x7f2a7406c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:02.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.262+0000 7f2a7a969700 1 --2- 172.21.15.125:0/227172108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a740718e0 0x7f2a7406c880 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009870 tx=0x7f2a64009b80 comp rx=0 tx=0).stop 2023-11-28T11:10:02.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.262+0000 7f2a7a969700 1 -- 172.21.15.125:0/227172108 shutdown_connections 2023-11-28T11:10:02.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.262+0000 7f2a7a969700 1 --2- 172.21.15.125:0/227172108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a7406cdc0 0x7f2a7406a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.262+0000 7f2a7a969700 1 --2- 172.21.15.125:0/227172108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a740718e0 0x7f2a7406c880 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.262+0000 7f2a7a969700 1 -- 172.21.15.125:0/227172108 >> 172.21.15.125:0/227172108 conn(0x7f2a7406c010 msgr2=0x7f2a740cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:02.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.262+0000 7f2a7a969700 1 -- 172.21.15.125:0/227172108 shutdown_connections 2023-11-28T11:10:02.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.262+0000 7f2a7a969700 1 -- 172.21.15.125:0/227172108 wait complete. 2023-11-28T11:10:02.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.263+0000 7f2a7a969700 1 Processor -- start 2023-11-28T11:10:02.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.263+0000 7f2a7a969700 1 -- start start 2023-11-28T11:10:02.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a7a969700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7406cdc0 0x7f2a740b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:02.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a7a969700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a740718e0 0x7f2a740b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:02.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a7a969700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a7415c810 0x7f2a740aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:02.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a7a969700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a740c6440 con 0x7f2a740718e0 2023-11-28T11:10:02.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a7a969700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7415dd70 con 0x7f2a7406cdc0 2023-11-28T11:10:02.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a7a969700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7415e050 con 0x7f2a7415c810 2023-11-28T11:10:02.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a737fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a740718e0 0x7f2a740b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:02.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a737fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a740718e0 0x7f2a740b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59490/0 (socket says 172.21.15.125:59490) 2023-11-28T11:10:02.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a737fe700 1 -- 172.21.15.125:0/2798196242 learned_addr learned my addr 172.21.15.125:0/2798196242 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:02.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a73fff700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7406cdc0 0x7f2a740b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:02.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a78f06700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a7415c810 0x7f2a740aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:02.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a737fe700 1 -- 172.21.15.125:0/2798196242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a7415c810 msgr2=0x7f2a740aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:02.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a737fe700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a7415c810 0x7f2a740aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a737fe700 1 -- 172.21.15.125:0/2798196242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7406cdc0 msgr2=0x7f2a740b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:02.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a737fe700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7406cdc0 0x7f2a740b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a737fe700 1 -- 172.21.15.125:0/2798196242 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a640094a0 con 0x7f2a740718e0 2023-11-28T11:10:02.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a73fff700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7406cdc0 0x7f2a740b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:02.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a737fe700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a740718e0 0x7f2a740b1680 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2a640090b0 tx=0x7f2a64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:02.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a70ff9700 1 -- 172.21.15.125:0/2798196242 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640036a0 con 0x7f2a740718e0 2023-11-28T11:10:02.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a70ff9700 1 -- 172.21.15.125:0/2798196242 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6401f070 con 0x7f2a740718e0 2023-11-28T11:10:02.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.264+0000 7f2a70ff9700 1 -- 172.21.15.125:0/2798196242 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64003a60 con 0x7f2a740718e0 2023-11-28T11:10:02.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.265+0000 7f2a7a969700 1 -- 172.21.15.125:0/2798196242 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a740ce740 con 0x7f2a740718e0 2023-11-28T11:10:02.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.265+0000 7f2a7a969700 1 -- 172.21.15.125:0/2798196242 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a740ceb20 con 0x7f2a740718e0 2023-11-28T11:10:02.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.265+0000 7f2a7a969700 1 -- 172.21.15.125:0/2798196242 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a740ce8d0 con 0x7f2a740718e0 2023-11-28T11:10:02.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.266+0000 7f2a70ff9700 1 -- 172.21.15.125:0/2798196242 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2a6400f050 con 0x7f2a740718e0 2023-11-28T11:10:02.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.266+0000 7f2a70ff9700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2a540682f0 0x7f2a5406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:02.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.266+0000 7f2a70ff9700 1 -- 172.21.15.125:0/2798196242 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a64021070 con 0x7f2a740718e0 2023-11-28T11:10:02.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.266+0000 7f2a73fff700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2a540682f0 0x7f2a5406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:02.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.267+0000 7f2a73fff700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2a540682f0 0x7f2a5406a7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c000f60 tx=0x7f2a5c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:02.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.270+0000 7f2a70ff9700 1 -- 172.21.15.125:0/2798196242 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2a64053d50 con 0x7f2a740718e0 2023-11-28T11:10:02.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.468+0000 7f2a7a969700 1 -- 172.21.15.125:0/2798196242 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a740743f0 con 0x7f2a740718e0 2023-11-28T11:10:02.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.468+0000 7f2a70ff9700 1 -- 172.21.15.125:0/2798196242 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2a64057370 con 0x7f2a740718e0 2023-11-28T11:10:02.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 -- 172.21.15.125:0/2798196242 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2a540682f0 msgr2=0x7f2a5406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:02.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2a540682f0 0x7f2a5406a7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c000f60 tx=0x7f2a5c007d30 comp rx=0 tx=0).stop 2023-11-28T11:10:02.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 -- 172.21.15.125:0/2798196242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a740718e0 msgr2=0x7f2a740b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:02.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a740718e0 0x7f2a740b1680 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2a640090b0 tx=0x7f2a64004750 comp rx=0 tx=0).stop 2023-11-28T11:10:02.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 -- 172.21.15.125:0/2798196242 shutdown_connections 2023-11-28T11:10:02.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2a540682f0 0x7f2a5406a7a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a7415c810 0x7f2a740aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7406cdc0 0x7f2a740b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 --2- 172.21.15.125:0/2798196242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a740718e0 0x7f2a740b1680 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 -- 172.21.15.125:0/2798196242 >> 172.21.15.125:0/2798196242 conn(0x7f2a7406c010 msgr2=0x7f2a740cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 -- 172.21.15.125:0/2798196242 shutdown_connections 2023-11-28T11:10:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:02.470+0000 7f2a7a969700 1 -- 172.21.15.125:0/2798196242 wait complete. 2023-11-28T11:10:02.473 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:10:02.483 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-11-28T11:10:02.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:02.484 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T11:10:02.514 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[119628]: fuse finished with error 0 and tester_r 0 2023-11-28T11:10:02.515 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:10:02.745 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:10:02.748 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:10:08.616 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:10:08.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:08.617 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:10:08.639 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:10:08.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.817+0000 7f33758b6700 1 Processor -- start 2023-11-28T11:10:08.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.817+0000 7f33758b6700 1 -- start start 2023-11-28T11:10:08.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f33758b6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f337006ce20 0x7f337015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:08.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f33758b6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f337015db00 0x7f337006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:08.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f33758b6700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f33700c9230 0x7f33700ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:08.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f33758b6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337015a060 con 0x7f337006ce20 2023-11-28T11:10:08.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f33758b6700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3370159a80 con 0x7f33700c9230 2023-11-28T11:10:08.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f33758b6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337006d730 con 0x7f337015db00 2023-11-28T11:10:08.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f337006ce20 0x7f337015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:08.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f337006ce20 0x7f337015a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59496/0 (socket says 172.21.15.125:59496) 2023-11-28T11:10:08.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336effd700 1 -- 172.21.15.125:0/631353928 learned_addr learned my addr 172.21.15.125:0/631353928 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:08.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336e7fc700 1 --2- 172.21.15.125:0/631353928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f337015db00 0x7f337006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:08.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336f7fe700 1 --2- 172.21.15.125:0/631353928 >> v2:172.21.15.167:3300/0 conn(0x7f33700c9230 0x7f33700ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336effd700 1 -- 172.21.15.125:0/631353928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f337015db00 msgr2=0x7f337006d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336effd700 1 --2- 172.21.15.125:0/631353928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f337015db00 0x7f337006d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336effd700 1 -- 172.21.15.125:0/631353928 >> v2:172.21.15.167:3300/0 conn(0x7f33700c9230 msgr2=0x7f33700ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336effd700 1 --2- 172.21.15.125:0/631353928 >> v2:172.21.15.167:3300/0 conn(0x7f33700c9230 0x7f33700ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336effd700 1 -- 172.21.15.125:0/631353928 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33700c9ac0 con 0x7f337006ce20 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336e7fc700 1 --2- 172.21.15.125:0/631353928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f337015db00 0x7f337006d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.818+0000 7f336f7fe700 1 --2- 172.21.15.125:0/631353928 >> v2:172.21.15.167:3300/0 conn(0x7f33700c9230 0x7f33700ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f336effd700 1 --2- 172.21.15.125:0/631353928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f337006ce20 0x7f337015a4f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f33700c5b00 tx=0x7f336400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103b067c6561e7ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f336dffb700 1 -- 172.21.15.125:0/631353928 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336400dd30 con 0x7f337006ce20 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f336dffb700 1 -- 172.21.15.125:0/631353928 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336400de90 con 0x7f337006ce20 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f336dffb700 1 -- 172.21.15.125:0/631353928 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364010690 con 0x7f337006ce20 2023-11-28T11:10:08.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f33758b6700 1 -- 172.21.15.125:0/631353928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f337006ce20 msgr2=0x7f337015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:08.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f33758b6700 1 --2- 172.21.15.125:0/631353928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f337006ce20 0x7f337015a4f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f33700c5b00 tx=0x7f336400be70 comp rx=0 tx=0).stop 2023-11-28T11:10:08.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f33758b6700 1 -- 172.21.15.125:0/631353928 shutdown_connections 2023-11-28T11:10:08.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f33758b6700 1 --2- 172.21.15.125:0/631353928 >> v2:172.21.15.167:3300/0 conn(0x7f33700c9230 0x7f33700ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:08.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f33758b6700 1 --2- 172.21.15.125:0/631353928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f337006ce20 0x7f337015a4f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:08.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f33758b6700 1 --2- 172.21.15.125:0/631353928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f337015db00 0x7f337006d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:08.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f33758b6700 1 -- 172.21.15.125:0/631353928 >> 172.21.15.125:0/631353928 conn(0x7f33700cb660 msgr2=0x7f33700cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:08.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f33758b6700 1 -- 172.21.15.125:0/631353928 shutdown_connections 2023-11-28T11:10:08.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.819+0000 7f33758b6700 1 -- 172.21.15.125:0/631353928 wait complete. 2023-11-28T11:10:08.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.821+0000 7f33758b6700 1 Processor -- start 2023-11-28T11:10:08.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.821+0000 7f33758b6700 1 -- start start 2023-11-28T11:10:08.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f33758b6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f337006ce20 0x7f33700c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:08.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f33758b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33700c9230 0x7f33700c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:08.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f33758b6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f337015db00 0x7f33700c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:08.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f33758b6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33700c30f0 con 0x7f33700c9230 2023-11-28T11:10:08.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f33758b6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33700c54c0 con 0x7f337006ce20 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f33758b6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33700c3370 con 0x7f337015db00 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f336e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33700c9230 0x7f33700c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f336e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33700c9230 0x7f33700c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59504/0 (socket says 172.21.15.125:59504) 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f336e7fc700 1 -- 172.21.15.125:0/826978581 learned_addr learned my addr 172.21.15.125:0/826978581 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f336effd700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f337006ce20 0x7f33700c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f336f7fe700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f337015db00 0x7f33700c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f336e7fc700 1 -- 172.21.15.125:0/826978581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f337015db00 msgr2=0x7f33700c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f336e7fc700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f337015db00 0x7f33700c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f336e7fc700 1 -- 172.21.15.125:0/826978581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f337006ce20 msgr2=0x7f33700c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f336e7fc700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f337006ce20 0x7f33700c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f336e7fc700 1 -- 172.21.15.125:0/826978581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336400b7f0 con 0x7f33700c9230 2023-11-28T11:10:08.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f336e7fc700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33700c9230 0x7f33700c80e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f336000c750 tx=0x7f336000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:08.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f3357fff700 1 -- 172.21.15.125:0/826978581 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360011800 con 0x7f33700c9230 2023-11-28T11:10:08.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f3357fff700 1 -- 172.21.15.125:0/826978581 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3360011960 con 0x7f33700c9230 2023-11-28T11:10:08.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f33758b6700 1 -- 172.21.15.125:0/826978581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3370159790 con 0x7f33700c9230 2023-11-28T11:10:08.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f3357fff700 1 -- 172.21.15.125:0/826978581 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360011cd0 con 0x7f33700c9230 2023-11-28T11:10:08.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.822+0000 7f33758b6700 1 -- 172.21.15.125:0/826978581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3370159cf0 con 0x7f33700c9230 2023-11-28T11:10:08.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.823+0000 7f33758b6700 1 -- 172.21.15.125:0/826978581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33700c9da0 con 0x7f33700c9230 2023-11-28T11:10:08.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.824+0000 7f3357fff700 1 -- 172.21.15.125:0/826978581 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3360020070 con 0x7f33700c9230 2023-11-28T11:10:08.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.824+0000 7f3357fff700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f335c0682f0 0x7f335c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:08.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.824+0000 7f3357fff700 1 -- 172.21.15.125:0/826978581 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3360085b10 con 0x7f33700c9230 2023-11-28T11:10:08.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.824+0000 7f336effd700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f335c0682f0 0x7f335c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:08.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.825+0000 7f336effd700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f335c0682f0 0x7f335c06a7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f336400beb0 tx=0x7f3364012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:08.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:08.829+0000 7f3357fff700 1 -- 172.21.15.125:0/826978581 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3360052370 con 0x7f33700c9230 2023-11-28T11:10:09.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.055+0000 7f33758b6700 1 -- 172.21.15.125:0/826978581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33700c3530 con 0x7f33700c9230 2023-11-28T11:10:09.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.055+0000 7f3357fff700 1 -- 172.21.15.125:0/826978581 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f3360055990 con 0x7f33700c9230 2023-11-28T11:10:09.057 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:09.057 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1240521006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1240521006},{"type":"v1","addr":"172.21.15.167:6834","nonce":1240521006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2122606110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2122606110},{"type":"v1","addr":"172.21.15.167:6835","nonce":2122606110}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5280,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/888812458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":888812458},{"type":"v1","addr":"172.21.15.125:6835","nonce":888812458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:09:48.560821+0000","modified":"2023-11-28T11:09:51.580459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/2632892245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2632892245},{"type":"v1","addr":"172.21.15.125:6837","nonce":2632892245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:10:09.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.057+0000 7f33758b6700 1 -- 172.21.15.125:0/826978581 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f335c0682f0 msgr2=0x7f335c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:09.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.057+0000 7f33758b6700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f335c0682f0 0x7f335c06a7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f336400beb0 tx=0x7f3364012000 comp rx=0 tx=0).stop 2023-11-28T11:10:09.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.057+0000 7f33758b6700 1 -- 172.21.15.125:0/826978581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33700c9230 msgr2=0x7f33700c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:09.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.057+0000 7f33758b6700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33700c9230 0x7f33700c80e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f336000c750 tx=0x7f336000cb10 comp rx=0 tx=0).stop 2023-11-28T11:10:09.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.057+0000 7f33758b6700 1 -- 172.21.15.125:0/826978581 shutdown_connections 2023-11-28T11:10:09.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.057+0000 7f33758b6700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f335c0682f0 0x7f335c06a7a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.057+0000 7f33758b6700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f337015db00 0x7f33700c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.057+0000 7f33758b6700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f337006ce20 0x7f33700c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.057+0000 7f33758b6700 1 --2- 172.21.15.125:0/826978581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33700c9230 0x7f33700c80e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.057+0000 7f33758b6700 1 -- 172.21.15.125:0/826978581 >> 172.21.15.125:0/826978581 conn(0x7f33700cb660 msgr2=0x7f337006fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:09.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.058+0000 7f33758b6700 1 -- 172.21.15.125:0/826978581 shutdown_connections 2023-11-28T11:10:09.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.058+0000 7f33758b6700 1 -- 172.21.15.125:0/826978581 wait complete. 2023-11-28T11:10:09.062 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 16 2023-11-28T11:10:09.071 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-28T11:10:09.221 INFO:teuthology.orchestra.run.smithi125.stdout:{"message":"","return_code":0} 2023-11-28T11:10:09.221 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:10:09.221 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:10:09.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.339+0000 7f80368f9700 1 Processor -- start 2023-11-28T11:10:09.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.339+0000 7f80368f9700 1 -- start start 2023-11-28T11:10:09.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.340+0000 7f80368f9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803006e570 0x7f8030160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:09.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.340+0000 7f80368f9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80300b1810 con 0x7f803015cc80 2023-11-28T11:10:09.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.340+0000 7f80368f9700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80300b1af0 con 0x7f803006a270 2023-11-28T11:10:09.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.340+0000 7f80368f9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80300b2490 con 0x7f803006e570 2023-11-28T11:10:09.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.340+0000 7f802f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f803015cc80 0x7f803006de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43634/0 (socket says 172.21.15.125:43634) 2023-11-28T11:10:09.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.340+0000 7f802f7fe700 1 -- 172.21.15.125:0/1087717065 learned_addr learned my addr 172.21.15.125:0/1087717065 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:09.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f8034e96700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803006e570 0x7f8030160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:09.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741605587 0 0) 0x7f80300b1810 con 0x7f803015cc80 2023-11-28T11:10:09.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80180035b0 con 0x7f803015cc80 2023-11-28T11:10:09.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1919591276 0 0) 0x7f80180035b0 con 0x7f803015cc80 2023-11-28T11:10:09.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803006e570 msgr2=0x7f8030160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:09.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803006e570 0x7f8030160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 >> v1:172.21.15.167:6789/0 conn(0x7f803006a270 legacy=0x7f803006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:09.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80300b1dd0 con 0x7f803015cc80 2023-11-28T11:10:09.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f8024001670 con 0x7f803015cc80 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 >> v1:172.21.15.125:6789/0 conn(0x7f803015cc80 legacy=0x7f803006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8018003a30 0x7f8018003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803006e570 0x7f8018004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8018004d90 0x7f8018005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80300b2490 con 0x7f8018004d90 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801800bac0 con 0x7f8018003a30 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801800bc50 con 0x7f803006e570 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f8034e96700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8018004d90 0x7f8018005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802ffff700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8018003a30 0x7f8018003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802f7fe700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803006e570 0x7f8018004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f8034e96700 1 -- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803006e570 msgr2=0x7f8018004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:09.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f8034e96700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803006e570 0x7f8018004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f8034e96700 1 -- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8018003a30 msgr2=0x7f8018003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f8034e96700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8018003a30 0x7f8018003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f8034e96700 1 -- 172.21.15.125:0/1087717065 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80180035b0 con 0x7f8018004d90 2023-11-28T11:10:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.341+0000 7f802f7fe700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803006e570 0x7f8018004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.342+0000 7f8034e96700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8018004d90 0x7f8018005200 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8028009fc0 tx=0x7f8018005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2358b45b9bef9c81 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.342+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800ec30 con 0x7f8018004d90 2023-11-28T11:10:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.342+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802800f040 con 0x7f8018004d90 2023-11-28T11:10:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.342+0000 7f802effd700 1 -- 172.21.15.125:0/1087717065 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028014480 con 0x7f8018004d90 2023-11-28T11:10:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.342+0000 7f80368f9700 1 -- 172.21.15.125:0/1087717065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8018004d90 msgr2=0x7f8018005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.342+0000 7f80368f9700 1 --2- 172.21.15.125:0/1087717065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8018004d90 0x7f8018005200 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8028009fc0 tx=0x7f8018005880 comp rx=0 tx=0).stop 2023-11-28T11:10:09.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.342+0000 7f8034e96700 1 -- 172.21.15.125:0/1087717065 reap_dead start 2023-11-28T11:10:09.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.342+0000 7f80368f9700 1 -- 172.21.15.125:0/1087717065 shutdown_connections 2023-11-28T11:10:09.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.342+0000 7f80368f9700 1 -- 172.21.15.125:0/1087717065 >> 172.21.15.125:0/1087717065 conn(0x7f803006c010 msgr2=0x7f80300cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:09.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.342+0000 7f80368f9700 1 -- 172.21.15.125:0/1087717065 shutdown_connections 2023-11-28T11:10:09.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.342+0000 7f80368f9700 1 -- 172.21.15.125:0/1087717065 wait complete. 2023-11-28T11:10:09.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.344+0000 7f80368f9700 1 Processor -- start 2023-11-28T11:10:09.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.344+0000 7f80368f9700 1 -- start start 2023-11-28T11:10:09.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f80368f9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8030152770 0x7f803015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:09.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f80368f9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80300b02e0 0x7f80300b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:09.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f80368f9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803015f340 0x7f803015f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:09.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f80368f9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80300b0c90 con 0x7f80300b02e0 2023-11-28T11:10:09.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f80368f9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803015fcf0 con 0x7f803015f340 2023-11-28T11:10:09.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f80368f9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803015ddf0 con 0x7f8030152770 2023-11-28T11:10:09.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f802f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80300b02e0 0x7f80300b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:09.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f802f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80300b02e0 0x7f80300b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59524/0 (socket says 172.21.15.125:59524) 2023-11-28T11:10:09.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f802f7fe700 1 -- 172.21.15.125:0/2893479912 learned_addr learned my addr 172.21.15.125:0/2893479912 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:09.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f8034e96700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803015f340 0x7f803015f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:09.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f802ffff700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8030152770 0x7f803015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:09.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f802f7fe700 1 -- 172.21.15.125:0/2893479912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8030152770 msgr2=0x7f803015eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:09.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f802f7fe700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8030152770 0x7f803015eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f802f7fe700 1 -- 172.21.15.125:0/2893479912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803015f340 msgr2=0x7f803015f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f802f7fe700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803015f340 0x7f803015f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f802f7fe700 1 -- 172.21.15.125:0/2893479912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803015daa0 con 0x7f80300b02e0 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f802f7fe700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80300b02e0 0x7f80300b0750 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8024001eb0 tx=0x7f802400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.345+0000 7f802cff9700 1 -- 172.21.15.125:0/2893479912 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8024005e10 con 0x7f80300b02e0 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.346+0000 7f802cff9700 1 -- 172.21.15.125:0/2893479912 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802400c7e0 con 0x7f80300b02e0 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.346+0000 7f802cff9700 1 -- 172.21.15.125:0/2893479912 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802400cb70 con 0x7f80300b02e0 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.346+0000 7f80368f9700 1 -- 172.21.15.125:0/2893479912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80300b20b0 con 0x7f80300b02e0 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.346+0000 7f80368f9700 1 -- 172.21.15.125:0/2893479912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803015dc30 con 0x7f80300b02e0 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.346+0000 7f80368f9700 1 -- 172.21.15.125:0/2893479912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80300743f0 con 0x7f80300b02e0 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.347+0000 7f802cff9700 1 -- 172.21.15.125:0/2893479912 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f802400ccd0 con 0x7f80300b02e0 2023-11-28T11:10:09.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.347+0000 7f802cff9700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f801c0682f0 0x7f801c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:09.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.347+0000 7f802cff9700 1 -- 172.21.15.125:0/2893479912 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8024085b90 con 0x7f80300b02e0 2023-11-28T11:10:09.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.347+0000 7f802ffff700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f801c0682f0 0x7f801c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:09.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.348+0000 7f802ffff700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f801c0682f0 0x7f801c06a7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8020000c00 tx=0x7f8020009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:09.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.351+0000 7f802cff9700 1 -- 172.21.15.125:0/2893479912 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f80240523f0 con 0x7f80300b02e0 2023-11-28T11:10:09.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.576+0000 7f80368f9700 1 -- 172.21.15.125:0/2893479912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80300cd5f0 con 0x7f80300b02e0 2023-11-28T11:10:09.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.576+0000 7f802cff9700 1 -- 172.21.15.125:0/2893479912 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f8024055a10 con 0x7f80300b02e0 2023-11-28T11:10:09.578 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:09.578 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1240521006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1240521006},{"type":"v1","addr":"172.21.15.167:6834","nonce":1240521006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2122606110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2122606110},{"type":"v1","addr":"172.21.15.167:6835","nonce":2122606110}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5280,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/888812458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":888812458},{"type":"v1","addr":"172.21.15.125:6835","nonce":888812458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:09:48.560821+0000","modified":"2023-11-28T11:09:51.580459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/2632892245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2632892245},{"type":"v1","addr":"172.21.15.125:6837","nonce":2632892245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:10:09.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 -- 172.21.15.125:0/2893479912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f801c0682f0 msgr2=0x7f801c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:09.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f801c0682f0 0x7f801c06a7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8020000c00 tx=0x7f8020009040 comp rx=0 tx=0).stop 2023-11-28T11:10:09.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 -- 172.21.15.125:0/2893479912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80300b02e0 msgr2=0x7f80300b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:09.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80300b02e0 0x7f80300b0750 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8024001eb0 tx=0x7f802400edd0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 -- 172.21.15.125:0/2893479912 shutdown_connections 2023-11-28T11:10:09.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803015f340 0x7f803015f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f801c0682f0 0x7f801c06a7a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8030152770 0x7f803015eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 --2- 172.21.15.125:0/2893479912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80300b02e0 0x7f80300b0750 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:09.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 -- 172.21.15.125:0/2893479912 >> 172.21.15.125:0/2893479912 conn(0x7f803006c010 msgr2=0x7f80300adb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:09.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 -- 172.21.15.125:0/2893479912 shutdown_connections 2023-11-28T11:10:09.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:09.578+0000 7f80368f9700 1 -- 172.21.15.125:0/2893479912 wait complete. 2023-11-28T11:10:09.582 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 16 2023-11-28T11:10:09.593 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2023-11-28T11:10:09.735 INFO:teuthology.orchestra.run.smithi125.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2023-11-28T11:10:09.735 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2023-11-28T11:10:19.736 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2023-11-28T11:10:19.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.786+0000 7f8df5095080 1 Processor -- start 2023-11-28T11:10:19.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.786+0000 7f8df5095080 1 -- start start 2023-11-28T11:10:19.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8df5095080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c93e3ec80 0x563c93e13420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8df5095080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fa20 0x563c93e52dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8df5095080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c93e3fdf0 0x563c93e3d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8df5095080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c93d4bfe0 con 0x563c93e3fa20 2023-11-28T11:10:19.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8df5095080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c93ee2de0 con 0x563c93e3ec80 2023-11-28T11:10:19.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8df5095080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c93ee2b90 con 0x563c93e3fdf0 2023-11-28T11:10:19.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8dea997700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fa20 0x563c93e52dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8dea997700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fa20 0x563c93e52dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59538/0 (socket says 172.21.15.125:59538) 2023-11-28T11:10:19.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8dea997700 1 -- 172.21.15.125:0/1790694027 learned_addr learned my addr 172.21.15.125:0/1790694027 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:19.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8deb198700 1 --2- 172.21.15.125:0/1790694027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c93e3ec80 0x563c93e13420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8dea997700 1 -- 172.21.15.125:0/1790694027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c93e3fdf0 msgr2=0x563c93e3d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8dea997700 1 --2- 172.21.15.125:0/1790694027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c93e3fdf0 0x563c93e3d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8dea997700 1 -- 172.21.15.125:0/1790694027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c93e3ec80 msgr2=0x563c93e13420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8dea997700 1 --2- 172.21.15.125:0/1790694027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c93e3ec80 0x563c93e13420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8dea997700 1 -- 172.21.15.125:0/1790694027 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc005d20 con 0x563c93e3fa20 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.787+0000 7f8deb198700 1 --2- 172.21.15.125:0/1790694027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c93e3ec80 0x563c93e13420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8dea997700 1 --2- 172.21.15.125:0/1790694027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fa20 0x563c93e52dd0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8de000a770 tx=0x7f8de000aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07502b5623971c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8de9995700 1 -- 172.21.15.125:0/1790694027 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000f070 con 0x563c93e3fa20 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8de9995700 1 -- 172.21.15.125:0/1790694027 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0008580 con 0x563c93e3fa20 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8de9995700 1 -- 172.21.15.125:0/1790694027 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0008910 con 0x563c93e3fa20 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8df5095080 1 -- 172.21.15.125:0/1790694027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fa20 msgr2=0x563c93e52dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8df5095080 1 --2- 172.21.15.125:0/1790694027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fa20 0x563c93e52dd0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8de000a770 tx=0x7f8de000aa80 comp rx=0 tx=0).stop 2023-11-28T11:10:19.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8df5095080 1 -- 172.21.15.125:0/1790694027 shutdown_connections 2023-11-28T11:10:19.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8df5095080 1 --2- 172.21.15.125:0/1790694027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c93e3fdf0 0x563c93e3d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8df5095080 1 --2- 172.21.15.125:0/1790694027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c93e3ec80 0x563c93e13420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8df5095080 1 --2- 172.21.15.125:0/1790694027 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fa20 0x563c93e52dd0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8df5095080 1 -- 172.21.15.125:0/1790694027 >> 172.21.15.125:0/1790694027 conn(0x563c93e10ba0 msgr2=0x563c93e3c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:19.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8df5095080 1 -- 172.21.15.125:0/1790694027 shutdown_connections 2023-11-28T11:10:19.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.788+0000 7f8df5095080 1 -- 172.21.15.125:0/1790694027 wait complete. 2023-11-28T11:10:19.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.789+0000 7f8df5095080 1 Processor -- start 2023-11-28T11:10:19.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.789+0000 7f8df5095080 1 -- start start 2023-11-28T11:10:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8df5095080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c93e3ec80 0x563c93ee33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8df5095080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c93e3fa20 0x563c93edebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8df5095080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fdf0 0x563c93e3bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8df5095080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c93ee0d10 con 0x563c93e3fdf0 2023-11-28T11:10:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8df5095080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c93edfc30 con 0x563c93e3fa20 2023-11-28T11:10:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8df5095080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c93ee2560 con 0x563c93e3ec80 2023-11-28T11:10:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8deb999700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fdf0 0x563c93e3bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8deb999700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fdf0 0x563c93e3bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59546/0 (socket says 172.21.15.125:59546) 2023-11-28T11:10:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8deb999700 1 -- 172.21.15.125:0/3533860478 learned_addr learned my addr 172.21.15.125:0/3533860478 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8dea997700 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c93e3fa20 0x563c93edebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8deb198700 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c93e3ec80 0x563c93ee33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8deb999700 1 -- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c93e3ec80 msgr2=0x563c93ee33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8deb999700 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c93e3ec80 0x563c93ee33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8deb999700 1 -- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c93e3fa20 msgr2=0x563c93edebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8deb999700 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c93e3fa20 0x563c93edebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8deb999700 1 -- 172.21.15.125:0/3533860478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de000a420 con 0x563c93e3fdf0 2023-11-28T11:10:19.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8deb198700 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c93e3ec80 0x563c93ee33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:19.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.790+0000 7f8deb999700 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fdf0 0x563c93e3bdb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8de4006fc0 tx=0x7f8de400b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.791+0000 7f8de8993700 1 -- 172.21.15.125:0/3533860478 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de400bc50 con 0x563c93e3fdf0 2023-11-28T11:10:19.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.791+0000 7f8de8993700 1 -- 172.21.15.125:0/3533860478 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de400bdd0 con 0x563c93e3fdf0 2023-11-28T11:10:19.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.791+0000 7f8df5095080 1 -- 172.21.15.125:0/3533860478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c93d64120 con 0x563c93e3fdf0 2023-11-28T11:10:19.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.791+0000 7f8de8993700 1 -- 172.21.15.125:0/3533860478 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4003690 con 0x563c93e3fdf0 2023-11-28T11:10:19.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.791+0000 7f8df5095080 1 -- 172.21.15.125:0/3533860478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c93d57830 con 0x563c93e3fdf0 2023-11-28T11:10:19.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.792+0000 7f8de8993700 1 -- 172.21.15.125:0/3533860478 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8de4019020 con 0x563c93e3fdf0 2023-11-28T11:10:19.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.792+0000 7f8de8993700 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8dd8066c10 0x7f8dd80690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.793+0000 7f8de8993700 1 -- 172.21.15.125:0/3533860478 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f8de4084380 con 0x563c93e3fdf0 2023-11-28T11:10:19.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.793+0000 7f8deb198700 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8dd8066c10 0x7f8dd80690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.793+0000 7f8df5095080 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x563c93e5b440 0x563c93eebb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.793+0000 7f8df5095080 1 -- 172.21.15.125:0/3533860478 --> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) v8 -- 0x563c93eec0d0 con 0x563c93e5b440 2023-11-28T11:10:19.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.793+0000 7f8dea997700 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x563c93e5b440 0x563c93eebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.793+0000 7f8deb198700 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8dd8066c10 0x7f8dd80690c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc015040 tx=0x7f8ddc00f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.793+0000 7f8dea997700 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x563c93e5b440 0x563c93eebb90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8dea997700 1 -- 172.21.15.125:0/3533860478 <== osd.7 v2:172.21.15.167:6824/103835 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f8de00089d0 con 0x563c93e5b440 2023-11-28T11:10:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8df5095080 1 -- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x563c93e5b440 msgr2=0x563c93eebb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8df5095080 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x563c93e5b440 0x563c93eebb90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8df5095080 1 -- 172.21.15.125:0/3533860478 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8dd8066c10 msgr2=0x7f8dd80690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8df5095080 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8dd8066c10 0x7f8dd80690c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc015040 tx=0x7f8ddc00f000 comp rx=0 tx=0).stop 2023-11-28T11:10:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8df5095080 1 -- 172.21.15.125:0/3533860478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fdf0 msgr2=0x563c93e3bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8df5095080 1 --2- 172.21.15.125:0/3533860478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563c93e3fdf0 0x563c93e3bdb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8de4006fc0 tx=0x7f8de400b3c0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8deb999700 1 -- 172.21.15.125:0/3533860478 reap_dead start 2023-11-28T11:10:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8df5095080 1 -- 172.21.15.125:0/3533860478 shutdown_connections 2023-11-28T11:10:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8df5095080 1 -- 172.21.15.125:0/3533860478 >> 172.21.15.125:0/3533860478 conn(0x563c93e10ba0 msgr2=0x563c93e0f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8df5095080 1 -- 172.21.15.125:0/3533860478 shutdown_connections 2023-11-28T11:10:19.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.794+0000 7f8df5095080 1 -- 172.21.15.125:0/3533860478 wait complete. 2023-11-28T11:10:19.802 INFO:teuthology.orchestra.run.smithi125.stdout:mytag 2023-11-28T11:10:19.803 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2023-11-28T11:10:19.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.848+0000 7f4ddfa6b080 1 Processor -- start 2023-11-28T11:10:19.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.848+0000 7f4ddfa6b080 1 -- start start 2023-11-28T11:10:19.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4ddfa6b080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559253b3a7a0 0x559253c09c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4ddfa6b080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559253b817b0 0x559253b36490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4ddfa6b080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253c10430 0x559253c0df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4ddfa6b080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559253a72fe0 con 0x559253c10430 2023-11-28T11:10:19.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4ddfa6b080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559253b39eb0 con 0x559253b3a7a0 2023-11-28T11:10:19.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4ddfa6b080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559253c0faa0 con 0x559253b817b0 2023-11-28T11:10:19.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd636f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253c10430 0x559253c0df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd636f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253c10430 0x559253c0df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59562/0 (socket says 172.21.15.125:59562) 2023-11-28T11:10:19.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd636f700 1 -- 172.21.15.125:0/3554645909 learned_addr learned my addr 172.21.15.125:0/3554645909 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:19.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd536d700 1 --2- 172.21.15.125:0/3554645909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559253b817b0 0x559253b36490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd5b6e700 1 --2- 172.21.15.125:0/3554645909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559253b3a7a0 0x559253c09c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd636f700 1 -- 172.21.15.125:0/3554645909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559253b817b0 msgr2=0x559253b36490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:19.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd636f700 1 --2- 172.21.15.125:0/3554645909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559253b817b0 0x559253b36490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd636f700 1 -- 172.21.15.125:0/3554645909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559253b3a7a0 msgr2=0x559253c09c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:19.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd636f700 1 --2- 172.21.15.125:0/3554645909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559253b3a7a0 0x559253c09c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd636f700 1 -- 172.21.15.125:0/3554645909 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd000a100 con 0x559253c10430 2023-11-28T11:10:19.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd5b6e700 1 --2- 172.21.15.125:0/3554645909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559253b3a7a0 0x559253c09c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:19.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dd636f700 1 --2- 172.21.15.125:0/3554645909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253c10430 0x559253c0df50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000a3f0 tx=0x7f4dd000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dce649a5b59ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dc7fff700 1 -- 172.21.15.125:0/3554645909 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd000f790 con 0x559253c10430 2023-11-28T11:10:19.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dc7fff700 1 -- 172.21.15.125:0/3554645909 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd000fa60 con 0x559253c10430 2023-11-28T11:10:19.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.849+0000 7f4dc7fff700 1 -- 172.21.15.125:0/3554645909 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd000fdf0 con 0x559253c10430 2023-11-28T11:10:19.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.850+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3554645909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253c10430 msgr2=0x559253c0df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.850+0000 7f4ddfa6b080 1 --2- 172.21.15.125:0/3554645909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253c10430 0x559253c0df50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000a3f0 tx=0x7f4dd000f000 comp rx=0 tx=0).stop 2023-11-28T11:10:19.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.850+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3554645909 shutdown_connections 2023-11-28T11:10:19.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.850+0000 7f4ddfa6b080 1 --2- 172.21.15.125:0/3554645909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253c10430 0x559253c0df50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.850+0000 7f4ddfa6b080 1 --2- 172.21.15.125:0/3554645909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559253b3a7a0 0x559253c09c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.850+0000 7f4ddfa6b080 1 --2- 172.21.15.125:0/3554645909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559253b817b0 0x559253b36490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.850+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3554645909 >> 172.21.15.125:0/3554645909 conn(0x559253b64af0 msgr2=0x559253b64110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:19.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.850+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3554645909 shutdown_connections 2023-11-28T11:10:19.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.850+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3554645909 wait complete. 2023-11-28T11:10:19.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.850+0000 7f4ddfa6b080 1 Processor -- start 2023-11-28T11:10:19.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4ddfa6b080 1 -- start start 2023-11-28T11:10:19.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4ddfa6b080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559253b3a7a0 0x559253c045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4ddfa6b080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253b817b0 0x559253c0dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4ddfa6b080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559253c10430 0x559253c0ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4ddfa6b080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559253b687d0 con 0x559253b817b0 2023-11-28T11:10:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4ddfa6b080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559253c04b00 con 0x559253c10430 2023-11-28T11:10:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4ddfa6b080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559253c014f0 con 0x559253b3a7a0 2023-11-28T11:10:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4dd536d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253b817b0 0x559253c0dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4dd536d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253b817b0 0x559253c0dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59566/0 (socket says 172.21.15.125:59566) 2023-11-28T11:10:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4dd536d700 1 -- 172.21.15.125:0/3920381366 learned_addr learned my addr 172.21.15.125:0/3920381366 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4dd636f700 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559253c10430 0x559253c0ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.851+0000 7f4dd5b6e700 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559253b3a7a0 0x559253c045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.852+0000 7f4dd536d700 1 -- 172.21.15.125:0/3920381366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559253b3a7a0 msgr2=0x559253c045c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.852+0000 7f4dd536d700 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559253b3a7a0 0x559253c045c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.852+0000 7f4dd536d700 1 -- 172.21.15.125:0/3920381366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559253c10430 msgr2=0x559253c0ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.852+0000 7f4dd536d700 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559253c10430 0x559253c0ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.852+0000 7f4dd536d700 1 -- 172.21.15.125:0/3920381366 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559253aa54f0 con 0x559253b817b0 2023-11-28T11:10:19.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.852+0000 7f4dd536d700 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253b817b0 0x559253c0dfe0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00c5b0 tx=0x7f4dcc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.852+0000 7f4dc6ffd700 1 -- 172.21.15.125:0/3920381366 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc016030 con 0x559253b817b0 2023-11-28T11:10:19.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.852+0000 7f4dc6ffd700 1 -- 172.21.15.125:0/3920381366 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc005070 con 0x559253b817b0 2023-11-28T11:10:19.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.852+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3920381366 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559253a8b120 con 0x559253b817b0 2023-11-28T11:10:19.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.852+0000 7f4dc6ffd700 1 -- 172.21.15.125:0/3920381366 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0116a0 con 0x559253b817b0 2023-11-28T11:10:19.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.852+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3920381366 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559253a7e830 con 0x559253b817b0 2023-11-28T11:10:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.853+0000 7f4dc6ffd700 1 -- 172.21.15.125:0/3920381366 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4dcc011800 con 0x559253b817b0 2023-11-28T11:10:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.854+0000 7f4dc6ffd700 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4db8066c10 0x7f4db80690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.854+0000 7f4dc6ffd700 1 -- 172.21.15.125:0/3920381366 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f4dcc017070 con 0x559253b817b0 2023-11-28T11:10:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.854+0000 7f4dd5b6e700 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4db8066c10 0x7f4db80690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.854+0000 7f4ddfa6b080 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x559253ca0340 0x559253ca7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.854+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3920381366 --> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) v8 -- 0x559253ca7d80 con 0x559253ca0340 2023-11-28T11:10:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.854+0000 7f4dd5b6e700 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4db8066c10 0x7f4db80690c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x559253c0f9d0 tx=0x7f4dc800c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.854+0000 7f4dd636f700 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x559253ca0340 0x559253ca7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4dd636f700 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x559253ca0340 0x559253ca7840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4dd636f700 1 -- 172.21.15.125:0/3920381366 <== osd.5 v2:172.21.15.167:6816/103820 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f4dd002b040 con 0x559253ca0340 2023-11-28T11:10:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3920381366 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x559253ca0340 msgr2=0x559253ca7840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4ddfa6b080 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x559253ca0340 0x559253ca7840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3920381366 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4db8066c10 msgr2=0x7f4db80690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4ddfa6b080 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4db8066c10 0x7f4db80690c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x559253c0f9d0 tx=0x7f4dc800c040 comp rx=0 tx=0).stop 2023-11-28T11:10:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3920381366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253b817b0 msgr2=0x559253c0dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4ddfa6b080 1 --2- 172.21.15.125:0/3920381366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559253b817b0 0x559253c0dfe0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00c5b0 tx=0x7f4dcc00c8c0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4dd636f700 1 -- 172.21.15.125:0/3920381366 reap_dead start 2023-11-28T11:10:19.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3920381366 shutdown_connections 2023-11-28T11:10:19.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3920381366 >> 172.21.15.125:0/3920381366 conn(0x559253b64af0 msgr2=0x559253b78c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:19.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3920381366 shutdown_connections 2023-11-28T11:10:19.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.855+0000 7f4ddfa6b080 1 -- 172.21.15.125:0/3920381366 wait complete. 2023-11-28T11:10:19.866 INFO:teuthology.orchestra.run.smithi125.stdout:mytag 2023-11-28T11:10:19.866 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2023-11-28T11:10:19.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.909+0000 7fc3c99d9080 1 Processor -- start 2023-11-28T11:10:19.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.909+0000 7fc3c99d9080 1 -- start start 2023-11-28T11:10:19.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.910+0000 7fc3c99d9080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567835c17a0 0x5567835eef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.910+0000 7fc3c99d9080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567836087b0 0x5567835ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.910+0000 7fc3c99d9080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556783692130 0x5567835edb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.910+0000 7fc3c99d9080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567835eeac0 con 0x5567836087b0 2023-11-28T11:10:19.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.910+0000 7fc3c99d9080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567835ed0a0 con 0x5567835c17a0 2023-11-28T11:10:19.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.910+0000 7fc3c99d9080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567835eb090 con 0x556783692130 2023-11-28T11:10:19.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.910+0000 7fc3bf2db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567836087b0 0x5567835ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.910+0000 7fc3bf2db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567836087b0 0x5567835ed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59580/0 (socket says 172.21.15.125:59580) 2023-11-28T11:10:19.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.910+0000 7fc3bf2db700 1 -- 172.21.15.125:0/1138669874 learned_addr learned my addr 172.21.15.125:0/1138669874 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:19.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.910+0000 7fc3bfadc700 1 --2- 172.21.15.125:0/1138669874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567835c17a0 0x5567835eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.910+0000 7fc3c02dd700 1 --2- 172.21.15.125:0/1138669874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556783692130 0x5567835edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3bf2db700 1 -- 172.21.15.125:0/1138669874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556783692130 msgr2=0x5567835edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:19.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3bf2db700 1 --2- 172.21.15.125:0/1138669874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556783692130 0x5567835edb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3bf2db700 1 -- 172.21.15.125:0/1138669874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567835c17a0 msgr2=0x5567835eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3bf2db700 1 --2- 172.21.15.125:0/1138669874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567835c17a0 0x5567835eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3bf2db700 1 -- 172.21.15.125:0/1138669874 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b4005de0 con 0x5567836087b0 2023-11-28T11:10:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3bfadc700 1 --2- 172.21.15.125:0/1138669874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567835c17a0 0x5567835eef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3bf2db700 1 --2- 172.21.15.125:0/1138669874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567836087b0 0x5567835ed5f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000a770 tx=0x7fc3b000aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c7874c03e9bd82 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3be2d9700 1 -- 172.21.15.125:0/1138669874 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000f070 con 0x5567836087b0 2023-11-28T11:10:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3be2d9700 1 -- 172.21.15.125:0/1138669874 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b00084c0 con 0x5567836087b0 2023-11-28T11:10:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3be2d9700 1 -- 172.21.15.125:0/1138669874 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0008850 con 0x5567836087b0 2023-11-28T11:10:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3c99d9080 1 -- 172.21.15.125:0/1138669874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567836087b0 msgr2=0x5567835ed5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3c99d9080 1 --2- 172.21.15.125:0/1138669874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567836087b0 0x5567835ed5f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000a770 tx=0x7fc3b000aa80 comp rx=0 tx=0).stop 2023-11-28T11:10:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3c99d9080 1 -- 172.21.15.125:0/1138669874 shutdown_connections 2023-11-28T11:10:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3c99d9080 1 --2- 172.21.15.125:0/1138669874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556783692130 0x5567835edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3c99d9080 1 --2- 172.21.15.125:0/1138669874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5567835c17a0 0x5567835eef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3c99d9080 1 --2- 172.21.15.125:0/1138669874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567836087b0 0x5567835ed5f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3c99d9080 1 -- 172.21.15.125:0/1138669874 >> 172.21.15.125:0/1138669874 conn(0x5567835ebaf0 msgr2=0x5567835ef7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:19.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3c99d9080 1 -- 172.21.15.125:0/1138669874 shutdown_connections 2023-11-28T11:10:19.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.911+0000 7fc3c99d9080 1 -- 172.21.15.125:0/1138669874 wait complete. 2023-11-28T11:10:19.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.912+0000 7fc3c99d9080 1 Processor -- start 2023-11-28T11:10:19.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.912+0000 7fc3c99d9080 1 -- start start 2023-11-28T11:10:19.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3c99d9080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567835c17a0 0x5567835ec460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3c99d9080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5567836087b0 0x556783727820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3c99d9080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556783692130 0x556783695d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3c99d9080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678369a780 con 0x5567835c17a0 2023-11-28T11:10:19.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3c99d9080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556783726af0 con 0x556783692130 2023-11-28T11:10:19.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3c99d9080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556783727390 con 0x5567836087b0 2023-11-28T11:10:19.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3bfadc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567835c17a0 0x5567835ec460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3bfadc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567835c17a0 0x5567835ec460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59584/0 (socket says 172.21.15.125:59584) 2023-11-28T11:10:19.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3bfadc700 1 -- 172.21.15.125:0/926868183 learned_addr learned my addr 172.21.15.125:0/926868183 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:19.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3bf2db700 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5567836087b0 0x556783727820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3c02dd700 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556783692130 0x556783695d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3bfadc700 1 -- 172.21.15.125:0/926868183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5567836087b0 msgr2=0x556783727820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.913+0000 7fc3bfadc700 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5567836087b0 0x556783727820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.914+0000 7fc3bfadc700 1 -- 172.21.15.125:0/926868183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556783692130 msgr2=0x556783695d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.914+0000 7fc3bfadc700 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556783692130 0x556783695d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.914+0000 7fc3bfadc700 1 -- 172.21.15.125:0/926868183 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b000a420 con 0x5567835c17a0 2023-11-28T11:10:19.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.914+0000 7fc3bfadc700 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567835c17a0 0x5567835ec460 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4000c00 tx=0x7fc3b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.914+0000 7fc3bd2d7700 1 -- 172.21.15.125:0/926868183 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4008670 con 0x5567835c17a0 2023-11-28T11:10:19.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.914+0000 7fc3bd2d7700 1 -- 172.21.15.125:0/926868183 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4008ed0 con 0x5567835c17a0 2023-11-28T11:10:19.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.914+0000 7fc3c99d9080 1 -- 172.21.15.125:0/926868183 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55678352c4f0 con 0x5567835c17a0 2023-11-28T11:10:19.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.914+0000 7fc3bd2d7700 1 -- 172.21.15.125:0/926868183 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b401dad0 con 0x5567835c17a0 2023-11-28T11:10:19.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.914+0000 7fc3c99d9080 1 -- 172.21.15.125:0/926868183 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556783512120 con 0x5567835c17a0 2023-11-28T11:10:19.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.915+0000 7fc3bd2d7700 1 -- 172.21.15.125:0/926868183 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc3b402f070 con 0x5567835c17a0 2023-11-28T11:10:19.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.915+0000 7fc3bd2d7700 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3ac066c10 0x7fc3ac0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.916+0000 7fc3bd2d7700 1 -- 172.21.15.125:0/926868183 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fc3b4085ef0 con 0x5567835c17a0 2023-11-28T11:10:19.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.916+0000 7fc3bf2db700 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3ac066c10 0x7fc3ac0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.916+0000 7fc3c99d9080 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x556783727d60 0x556783698660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:19.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.916+0000 7fc3c99d9080 1 -- 172.21.15.125:0/926868183 --> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) v8 -- 0x55678368eed0 con 0x556783727d60 2023-11-28T11:10:19.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.916+0000 7fc3c02dd700 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x556783727d60 0x556783698660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.916+0000 7fc3bf2db700 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3ac066c10 0x7fc3ac0690c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5567835eb7e0 tx=0x7fc3b0012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.916+0000 7fc3c02dd700 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x556783727d60 0x556783698660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c02dd700 1 -- 172.21.15.125:0/926868183 <== osd.5 v2:172.21.15.167:6816/103820 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fc3b800e720 con 0x556783727d60 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c99d9080 1 -- 172.21.15.125:0/926868183 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x556783727d60 msgr2=0x556783698660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c99d9080 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x556783727d60 0x556783698660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c99d9080 1 -- 172.21.15.125:0/926868183 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3ac066c10 msgr2=0x7fc3ac0690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c99d9080 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3ac066c10 0x7fc3ac0690c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5567835eb7e0 tx=0x7fc3b0012000 comp rx=0 tx=0).stop 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c99d9080 1 -- 172.21.15.125:0/926868183 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567835c17a0 msgr2=0x5567835ec460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c99d9080 1 --2- 172.21.15.125:0/926868183 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5567835c17a0 0x5567835ec460 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4000c00 tx=0x7fc3b4002fb0 comp rx=0 tx=0).stop 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c02dd700 1 -- 172.21.15.125:0/926868183 reap_dead start 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c99d9080 1 -- 172.21.15.125:0/926868183 shutdown_connections 2023-11-28T11:10:19.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c99d9080 1 -- 172.21.15.125:0/926868183 >> 172.21.15.125:0/926868183 conn(0x5567835ebaf0 msgr2=0x556783693140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:19.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c99d9080 1 -- 172.21.15.125:0/926868183 shutdown_connections 2023-11-28T11:10:19.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:19.917+0000 7fc3c99d9080 1 -- 172.21.15.125:0/926868183 wait complete. 2023-11-28T11:10:19.925 INFO:teuthology.orchestra.run.smithi125.stdout:mytag 2023-11-28T11:10:19.926 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2023-11-28T11:10:20.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4c017c7080 1 Processor -- start 2023-11-28T11:10:20.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4c017c7080 1 -- start start 2023-11-28T11:10:20.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4c017c7080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be0002260 0x5620051d3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4c017c7080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56200506bfe0 0x5620051d3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4c017c7080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562005135390 0x5620051d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4c017c7080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562005011000 con 0x562005135390 2023-11-28T11:10:20.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4c017c7080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562004fa3fe0 con 0x7f4be0002260 2023-11-28T11:10:20.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4c017c7080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56200513db00 con 0x56200506bfe0 2023-11-28T11:10:20.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4bf80cb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562005135390 0x5620051d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4bf80cb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562005135390 0x5620051d3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59608/0 (socket says 172.21.15.125:59608) 2023-11-28T11:10:20.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4bf80cb700 1 -- 172.21.15.125:0/3841582961 learned_addr learned my addr 172.21.15.125:0/3841582961 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:20.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4bf70c9700 1 --2- 172.21.15.125:0/3841582961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56200506bfe0 0x5620051d3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.010+0000 7f4bf78ca700 1 --2- 172.21.15.125:0/3841582961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be0002260 0x5620051d3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4bf80cb700 1 -- 172.21.15.125:0/3841582961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56200506bfe0 msgr2=0x5620051d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:20.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4bf80cb700 1 --2- 172.21.15.125:0/3841582961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56200506bfe0 0x5620051d3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4bf80cb700 1 -- 172.21.15.125:0/3841582961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be0002260 msgr2=0x5620051d3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:20.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4bf80cb700 1 --2- 172.21.15.125:0/3841582961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be0002260 0x5620051d3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4bf80cb700 1 -- 172.21.15.125:0/3841582961 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562004fbc360 con 0x562005135390 2023-11-28T11:10:20.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4bf70c9700 1 --2- 172.21.15.125:0/3841582961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56200506bfe0 0x5620051d3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:20.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4bf80cb700 1 --2- 172.21.15.125:0/3841582961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562005135390 0x5620051d3b80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x5620050699e0 tx=0x7f4bf0006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8de35b265df81b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:20.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4bf60c7700 1 -- 172.21.15.125:0/3841582961 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0006ae0 con 0x562005135390 2023-11-28T11:10:20.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4bf60c7700 1 -- 172.21.15.125:0/3841582961 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf0006c40 con 0x562005135390 2023-11-28T11:10:20.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4bf60c7700 1 -- 172.21.15.125:0/3841582961 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0003450 con 0x562005135390 2023-11-28T11:10:20.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4c017c7080 1 -- 172.21.15.125:0/3841582961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562005135390 msgr2=0x5620051d3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4c017c7080 1 --2- 172.21.15.125:0/3841582961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562005135390 0x5620051d3b80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x5620050699e0 tx=0x7f4bf0006060 comp rx=0 tx=0).stop 2023-11-28T11:10:20.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4c017c7080 1 -- 172.21.15.125:0/3841582961 shutdown_connections 2023-11-28T11:10:20.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4c017c7080 1 --2- 172.21.15.125:0/3841582961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562005135390 0x5620051d3b80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4c017c7080 1 --2- 172.21.15.125:0/3841582961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be0002260 0x5620051d3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4c017c7080 1 --2- 172.21.15.125:0/3841582961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56200506bfe0 0x5620051d3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4c017c7080 1 -- 172.21.15.125:0/3841582961 >> 172.21.15.125:0/3841582961 conn(0x562005095af0 msgr2=0x5620050a9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:20.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4c017c7080 1 -- 172.21.15.125:0/3841582961 shutdown_connections 2023-11-28T11:10:20.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.011+0000 7f4c017c7080 1 -- 172.21.15.125:0/3841582961 wait complete. 2023-11-28T11:10:20.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.012+0000 7f4c017c7080 1 Processor -- start 2023-11-28T11:10:20.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.012+0000 7f4c017c7080 1 -- start start 2023-11-28T11:10:20.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4c017c7080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56200506bfe0 0x5620051443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4c017c7080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562005135390 0x5620051d3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4c017c7080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be0002260 0x5620050aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4c017c7080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56200513d310 con 0x56200506bfe0 2023-11-28T11:10:20.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4c017c7080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620051346c0 con 0x7f4be0002260 2023-11-28T11:10:20.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4c017c7080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562005143e90 con 0x562005135390 2023-11-28T11:10:20.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf78ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56200506bfe0 0x5620051443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf78ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56200506bfe0 0x5620051443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59610/0 (socket says 172.21.15.125:59610) 2023-11-28T11:10:20.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf78ca700 1 -- 172.21.15.125:0/1446751631 learned_addr learned my addr 172.21.15.125:0/1446751631 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:20.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf80cb700 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be0002260 0x5620050aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf70c9700 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562005135390 0x5620051d3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf78ca700 1 -- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562005135390 msgr2=0x5620051d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf78ca700 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562005135390 0x5620051d3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf78ca700 1 -- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be0002260 msgr2=0x5620050aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf78ca700 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be0002260 0x5620050aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf78ca700 1 -- 172.21.15.125:0/1446751631 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562004fbc120 con 0x56200506bfe0 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf70c9700 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562005135390 0x5620051d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf78ca700 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56200506bfe0 0x5620051443b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4be000aa80 tx=0x7f4bec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf50c5700 1 -- 172.21.15.125:0/1446751631 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec014040 con 0x56200506bfe0 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf50c5700 1 -- 172.21.15.125:0/1446751631 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec00f910 con 0x56200506bfe0 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4c017c7080 1 -- 172.21.15.125:0/1446751631 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5620050b2490 con 0x56200506bfe0 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4bf50c5700 1 -- 172.21.15.125:0/1446751631 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec00fca0 con 0x56200506bfe0 2023-11-28T11:10:20.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.013+0000 7f4c017c7080 1 -- 172.21.15.125:0/1446751631 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562004faf830 con 0x56200506bfe0 2023-11-28T11:10:20.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.015+0000 7f4bf50c5700 1 -- 172.21.15.125:0/1446751631 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4bec02c070 con 0x56200506bfe0 2023-11-28T11:10:20.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.015+0000 7f4bf50c5700 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4be4066c10 0x7f4be40690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.015+0000 7f4bf70c9700 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4be4066c10 0x7f4be40690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.015+0000 7f4bf50c5700 1 -- 172.21.15.125:0/1446751631 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f4bec085ca0 con 0x56200506bfe0 2023-11-28T11:10:20.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.015+0000 7f4c017c7080 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x562005096df0 0x562005142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.015+0000 7f4c017c7080 1 -- 172.21.15.125:0/1446751631 --> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) v8 -- 0x5620051d3a60 con 0x562005096df0 2023-11-28T11:10:20.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.015+0000 7f4bf70c9700 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4be4066c10 0x7f4be40690c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x5620050aa830 tx=0x7f4be800c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:20.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.016+0000 7f4bf80cb700 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x562005096df0 0x562005142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.016+0000 7f4bf80cb700 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x562005096df0 0x562005142900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.018+0000 7f4bf80cb700 1 -- 172.21.15.125:0/1446751631 <== osd.5 v2:172.21.15.167:6816/103820 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f4bf0006db0 con 0x562005096df0 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.018+0000 7f4c017c7080 1 -- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x562005096df0 msgr2=0x562005142900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.018+0000 7f4c017c7080 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x562005096df0 0x562005142900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.018+0000 7f4c017c7080 1 -- 172.21.15.125:0/1446751631 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4be4066c10 msgr2=0x7f4be40690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.018+0000 7f4c017c7080 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4be4066c10 0x7f4be40690c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x5620050aa830 tx=0x7f4be800c040 comp rx=0 tx=0).stop 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.018+0000 7f4c017c7080 1 -- 172.21.15.125:0/1446751631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56200506bfe0 msgr2=0x5620051443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.018+0000 7f4c017c7080 1 --2- 172.21.15.125:0/1446751631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56200506bfe0 0x5620051443b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4be000aa80 tx=0x7f4bec001120 comp rx=0 tx=0).stop 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.019+0000 7f4bf80cb700 1 -- 172.21.15.125:0/1446751631 reap_dead start 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.019+0000 7f4c017c7080 1 -- 172.21.15.125:0/1446751631 shutdown_connections 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.019+0000 7f4c017c7080 1 -- 172.21.15.125:0/1446751631 >> 172.21.15.125:0/1446751631 conn(0x562005095af0 msgr2=0x56200513dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.019+0000 7f4c017c7080 1 -- 172.21.15.125:0/1446751631 shutdown_connections 2023-11-28T11:10:20.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.019+0000 7f4c017c7080 1 -- 172.21.15.125:0/1446751631 wait complete. 2023-11-28T11:10:20.094 INFO:teuthology.orchestra.run.smithi125.stdout:mytag 2023-11-28T11:10:20.095 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2023-11-28T11:10:20.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.138+0000 7fac82c93080 1 Processor -- start 2023-11-28T11:10:20.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.138+0000 7fac82c93080 1 -- start start 2023-11-28T11:10:20.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac82c93080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6772610 0x55a7a683e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac82c93080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7a67736f0 0x55a7a67b7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac82c93080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a7a6845010 0x55a7a67b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac82c93080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a66aafe0 con 0x55a7a6772610 2023-11-28T11:10:20.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac82c93080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a683ec00 con 0x55a7a67736f0 2023-11-28T11:10:20.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac82c93080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7a67a1140 con 0x55a7a6845010 2023-11-28T11:10:20.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac78d96700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6772610 0x55a7a683e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac78d96700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6772610 0x55a7a683e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59626/0 (socket says 172.21.15.125:59626) 2023-11-28T11:10:20.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac78d96700 1 -- 172.21.15.125:0/2392901410 learned_addr learned my addr 172.21.15.125:0/2392901410 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:20.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac79597700 1 --2- 172.21.15.125:0/2392901410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a7a6845010 0x55a7a67b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac73fff700 1 --2- 172.21.15.125:0/2392901410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7a67736f0 0x55a7a67b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac78d96700 1 -- 172.21.15.125:0/2392901410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a7a6845010 msgr2=0x55a7a67b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:20.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac78d96700 1 --2- 172.21.15.125:0/2392901410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a7a6845010 0x55a7a67b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac78d96700 1 -- 172.21.15.125:0/2392901410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7a67736f0 msgr2=0x55a7a67b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac78d96700 1 --2- 172.21.15.125:0/2392901410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7a67736f0 0x55a7a67b7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac78d96700 1 -- 172.21.15.125:0/2392901410 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c005d20 con 0x55a7a6772610 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac78d96700 1 --2- 172.21.15.125:0/2392901410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6772610 0x55a7a683e6c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fac6400a8d0 tx=0x7fac64005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c2a7da842b18c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac72ffd700 1 -- 172.21.15.125:0/2392901410 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64005e70 con 0x55a7a6772610 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac72ffd700 1 -- 172.21.15.125:0/2392901410 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac64010040 con 0x55a7a6772610 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.139+0000 7fac72ffd700 1 -- 172.21.15.125:0/2392901410 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac640087d0 con 0x55a7a6772610 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.140+0000 7fac82c93080 1 -- 172.21.15.125:0/2392901410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6772610 msgr2=0x55a7a683e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.140+0000 7fac82c93080 1 --2- 172.21.15.125:0/2392901410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6772610 0x55a7a683e6c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fac6400a8d0 tx=0x7fac64005ac0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.140+0000 7fac82c93080 1 -- 172.21.15.125:0/2392901410 shutdown_connections 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.140+0000 7fac82c93080 1 --2- 172.21.15.125:0/2392901410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a7a6845010 0x55a7a67b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.140+0000 7fac82c93080 1 --2- 172.21.15.125:0/2392901410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6772610 0x55a7a683e6c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.140+0000 7fac82c93080 1 --2- 172.21.15.125:0/2392901410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7a67736f0 0x55a7a67b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.140+0000 7fac82c93080 1 -- 172.21.15.125:0/2392901410 >> 172.21.15.125:0/2392901410 conn(0x55a7a679d370 msgr2=0x55a7a676f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:20.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.140+0000 7fac82c93080 1 -- 172.21.15.125:0/2392901410 shutdown_connections 2023-11-28T11:10:20.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.140+0000 7fac82c93080 1 -- 172.21.15.125:0/2392901410 wait complete. 2023-11-28T11:10:20.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.141+0000 7fac82c93080 1 Processor -- start 2023-11-28T11:10:20.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.141+0000 7fac82c93080 1 -- start start 2023-11-28T11:10:20.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:10:20.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac82c93080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a7a6772610 0x55a7a67b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac82c93080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7a67736f0 0x55a7a676f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac82c93080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6845010 0x55a7a679f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac82c93080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a683c660 con 0x55a7a6845010 2023-11-28T11:10:20.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac82c93080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a67b2b50 con 0x55a7a67736f0 2023-11-28T11:10:20.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac82c93080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7a67b4fd0 con 0x55a7a6772610 2023-11-28T11:10:20.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac79597700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6845010 0x55a7a679f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac79597700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6845010 0x55a7a679f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59636/0 (socket says 172.21.15.125:59636) 2023-11-28T11:10:20.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac79597700 1 -- 172.21.15.125:0/1229092425 learned_addr learned my addr 172.21.15.125:0/1229092425 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:20.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac78d96700 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a7a6772610 0x55a7a67b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac73fff700 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7a67736f0 0x55a7a676f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac79597700 1 -- 172.21.15.125:0/1229092425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a7a6772610 msgr2=0x55a7a67b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac79597700 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a7a6772610 0x55a7a67b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac79597700 1 -- 172.21.15.125:0/1229092425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7a67736f0 msgr2=0x55a7a676f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac79597700 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7a67736f0 0x55a7a676f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac79597700 1 -- 172.21.15.125:0/1229092425 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6400a5b0 con 0x55a7a6845010 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac79597700 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6845010 0x55a7a679f7c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fac74006590 tx=0x7fac7400d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.142+0000 7fac71ffb700 1 -- 172.21.15.125:0/1229092425 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7400dec0 con 0x55a7a6845010 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.143+0000 7fac71ffb700 1 -- 172.21.15.125:0/1229092425 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac74013480 con 0x55a7a6845010 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.143+0000 7fac82c93080 1 -- 172.21.15.125:0/1229092425 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a7a66c3120 con 0x55a7a6845010 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.143+0000 7fac71ffb700 1 -- 172.21.15.125:0/1229092425 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74013810 con 0x55a7a6845010 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.143+0000 7fac82c93080 1 -- 172.21.15.125:0/1229092425 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7a66b6830 con 0x55a7a6845010 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.144+0000 7fac71ffb700 1 -- 172.21.15.125:0/1229092425 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fac74013970 con 0x55a7a6845010 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.144+0000 7fac71ffb700 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac5c066c10 0x7fac5c0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.144+0000 7fac78d96700 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac5c066c10 0x7fac5c0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.144+0000 7fac71ffb700 1 -- 172.21.15.125:0/1229092425 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fac74084a50 con 0x55a7a6845010 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.144+0000 7fac82c93080 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x55a7a67b7670 0x55a7a68e6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.144+0000 7fac82c93080 1 -- 172.21.15.125:0/1229092425 --> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) v8 -- 0x55a7a676fb60 con 0x55a7a67b7670 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.145+0000 7fac78d96700 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac5c066c10 0x7fac5c0690c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fac64017040 tx=0x7fac6400a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.145+0000 7fac73fff700 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x55a7a67b7670 0x55a7a68e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.145+0000 7fac73fff700 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x55a7a67b7670 0x55a7a68e6690 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.145+0000 7fac73fff700 1 -- 172.21.15.125:0/1229092425 <== osd.7 v2:172.21.15.167:6824/103835 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fac6c019040 con 0x55a7a67b7670 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.145+0000 7fac82c93080 1 -- 172.21.15.125:0/1229092425 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x55a7a67b7670 msgr2=0x55a7a68e6690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.145+0000 7fac82c93080 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x55a7a67b7670 0x55a7a68e6690 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.145+0000 7fac82c93080 1 -- 172.21.15.125:0/1229092425 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac5c066c10 msgr2=0x7fac5c0690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.145+0000 7fac82c93080 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac5c066c10 0x7fac5c0690c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fac64017040 tx=0x7fac6400a000 comp rx=0 tx=0).stop 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.145+0000 7fac82c93080 1 -- 172.21.15.125:0/1229092425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6845010 msgr2=0x55a7a679f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.145+0000 7fac82c93080 1 --2- 172.21.15.125:0/1229092425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a7a6845010 0x55a7a679f7c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fac74006590 tx=0x7fac7400d720 comp rx=0 tx=0).stop 2023-11-28T11:10:20.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.145+0000 7fac79597700 1 -- 172.21.15.125:0/1229092425 reap_dead start 2023-11-28T11:10:20.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.146+0000 7fac82c93080 1 -- 172.21.15.125:0/1229092425 shutdown_connections 2023-11-28T11:10:20.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.146+0000 7fac82c93080 1 -- 172.21.15.125:0/1229092425 >> 172.21.15.125:0/1229092425 conn(0x55a7a679d370 msgr2=0x55a7a6847c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:20.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.146+0000 7fac82c93080 1 -- 172.21.15.125:0/1229092425 shutdown_connections 2023-11-28T11:10:20.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.146+0000 7fac82c93080 1 -- 172.21.15.125:0/1229092425 wait complete. 2023-11-28T11:10:20.153 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:10:20.153 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:10:20.192 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:10:20.251 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:10:20.252 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:10:20.252 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:10:20.269 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16093 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T11:10:20.270 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:10:20.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:20.270 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:10:20.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:10:20.326 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-28T11:10:20.326 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:10:20.326 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:10:20.347 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:10:20.348 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:10:20.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:20.348 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T11:10:20.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:10:20.409 INFO:teuthology.orchestra.run.smithi167.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T11:10:20.409 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:10:20.409 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:10:20.427 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16093 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T11:10:20.427 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:10:20.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:20.427 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T11:10:20.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:10:20.484 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T11:10:20.484 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:10:20.484 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:10:20.505 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:10:20.505 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:10:20.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:20.505 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T11:10:20.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:10:20.565 INFO:teuthology.orchestra.run.smithi167.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T11:10:20.566 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:10:20.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.686+0000 7fae69598700 1 Processor -- start 2023-11-28T11:10:20.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.686+0000 7fae69598700 1 -- start start 2023-11-28T11:10:20.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae69598700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fae6406a270 0x7fae6406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae69598700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae6415cc80 0x7fae6406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae69598700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6406ab80 con 0x7fae6406e3a0 2023-11-28T11:10:20.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae69598700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae640b2490 con 0x7fae6415cc80 2023-11-28T11:10:20.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae69598700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae640b1810 con 0x7fae6406a270 2023-11-28T11:10:20.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae627fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae6415cc80 0x7fae6406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae627fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae6415cc80 0x7fae6406de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59644/0 (socket says 172.21.15.125:59644) 2023-11-28T11:10:20.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae627fc700 1 -- 172.21.15.125:0/3637567537 learned_addr learned my addr 172.21.15.125:0/3637567537 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:20.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae62ffd700 1 --2- 172.21.15.125:0/3637567537 >> v2:172.21.15.167:3300/0 conn(0x7fae6406a270 0x7fae6406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae627fc700 1 -- 172.21.15.125:0/3637567537 >> v2:172.21.15.167:3300/0 conn(0x7fae6406a270 msgr2=0x7fae6406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:20.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae627fc700 1 --2- 172.21.15.125:0/3637567537 >> v2:172.21.15.167:3300/0 conn(0x7fae6406a270 0x7fae6406a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae627fc700 1 -- 172.21.15.125:0/3637567537 >> v1:172.21.15.167:6789/0 conn(0x7fae6406e3a0 legacy=0x7fae6406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae627fc700 1 -- 172.21.15.125:0/3637567537 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae640b1af0 con 0x7fae6415cc80 2023-11-28T11:10:20.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.687+0000 7fae627fc700 1 --2- 172.21.15.125:0/3637567537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae6415cc80 0x7fae6406de60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fae64067380 tx=0x7fae54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a893db49e3f6fb80 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:20.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.688+0000 7fae61ffb700 1 -- 172.21.15.125:0/3637567537 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54011830 con 0x7fae6415cc80 2023-11-28T11:10:20.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.688+0000 7fae61ffb700 1 -- 172.21.15.125:0/3637567537 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae54011990 con 0x7fae6415cc80 2023-11-28T11:10:20.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.688+0000 7fae61ffb700 1 -- 172.21.15.125:0/3637567537 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54011d20 con 0x7fae6415cc80 2023-11-28T11:10:20.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.688+0000 7fae69598700 1 -- 172.21.15.125:0/3637567537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae6415cc80 msgr2=0x7fae6406de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.688+0000 7fae69598700 1 --2- 172.21.15.125:0/3637567537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae6415cc80 0x7fae6406de60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fae64067380 tx=0x7fae54009bd0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.688+0000 7fae69598700 1 -- 172.21.15.125:0/3637567537 shutdown_connections 2023-11-28T11:10:20.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.688+0000 7fae69598700 1 --2- 172.21.15.125:0/3637567537 >> v2:172.21.15.167:3300/0 conn(0x7fae6406a270 0x7fae6406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.688+0000 7fae69598700 1 --2- 172.21.15.125:0/3637567537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae6415cc80 0x7fae6406de60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.688+0000 7fae69598700 1 -- 172.21.15.125:0/3637567537 >> 172.21.15.125:0/3637567537 conn(0x7fae6406c010 msgr2=0x7fae640cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:20.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.688+0000 7fae69598700 1 -- 172.21.15.125:0/3637567537 shutdown_connections 2023-11-28T11:10:20.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.688+0000 7fae69598700 1 -- 172.21.15.125:0/3637567537 wait complete. 2023-11-28T11:10:20.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.689+0000 7fae69598700 1 Processor -- start 2023-11-28T11:10:20.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.690+0000 7fae69598700 1 -- start start 2023-11-28T11:10:20.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.690+0000 7fae69598700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae6406a270 0x7fae6414a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.690+0000 7fae69598700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae6406e3a0 0x7fae640b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.690+0000 7fae69598700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae6415cc80 0x7fae640acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.690+0000 7fae69598700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae640b54d0 con 0x7fae6406a270 2023-11-28T11:10:20.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.690+0000 7fae69598700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6414a670 con 0x7fae6415cc80 2023-11-28T11:10:20.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.690+0000 7fae69598700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae640b4850 con 0x7fae6406e3a0 2023-11-28T11:10:20.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.690+0000 7fae62ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae6406a270 0x7fae6414a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.690+0000 7fae62ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae6406a270 0x7fae6414a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59648/0 (socket says 172.21.15.125:59648) 2023-11-28T11:10:20.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.690+0000 7fae62ffd700 1 -- 172.21.15.125:0/839827644 learned_addr learned my addr 172.21.15.125:0/839827644 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:20.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.690+0000 7fae637fe700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae6415cc80 0x7fae640acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae627fc700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae6406e3a0 0x7fae640b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae62ffd700 1 -- 172.21.15.125:0/839827644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae6406e3a0 msgr2=0x7fae640b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae62ffd700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae6406e3a0 0x7fae640b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae62ffd700 1 -- 172.21.15.125:0/839827644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae6415cc80 msgr2=0x7fae640acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae62ffd700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae6415cc80 0x7fae640acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae62ffd700 1 -- 172.21.15.125:0/839827644 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54009550 con 0x7fae6406a270 2023-11-28T11:10:20.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae627fc700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae6406e3a0 0x7fae640b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:20.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae637fe700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae6415cc80 0x7fae640acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:20.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae62ffd700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae6406a270 0x7fae6414a130 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fae5800e870 tx=0x7fae5800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:20.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae4b7fe700 1 -- 172.21.15.125:0/839827644 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58009590 con 0x7fae6406a270 2023-11-28T11:10:20.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae4b7fe700 1 -- 172.21.15.125:0/839827644 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5800ee70 con 0x7fae6406a270 2023-11-28T11:10:20.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae69598700 1 -- 172.21.15.125:0/839827644 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae640b20b0 con 0x7fae6406a270 2023-11-28T11:10:20.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae4b7fe700 1 -- 172.21.15.125:0/839827644 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800ca50 con 0x7fae6406a270 2023-11-28T11:10:20.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.691+0000 7fae69598700 1 -- 172.21.15.125:0/839827644 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae640b1dd0 con 0x7fae6406a270 2023-11-28T11:10:20.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.692+0000 7fae69598700 1 -- 172.21.15.125:0/839827644 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6406e7c0 con 0x7fae6406a270 2023-11-28T11:10:20.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.692+0000 7fae4b7fe700 1 -- 172.21.15.125:0/839827644 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fae58019030 con 0x7fae6406a270 2023-11-28T11:10:20.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.693+0000 7fae4b7fe700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fae500682f0 0x7fae5006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:20.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.693+0000 7fae4b7fe700 1 -- 172.21.15.125:0/839827644 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fae58085b50 con 0x7fae6406a270 2023-11-28T11:10:20.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.693+0000 7fae627fc700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fae500682f0 0x7fae5006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:20.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.693+0000 7fae627fc700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fae500682f0 0x7fae5006a7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fae6414df20 tx=0x7fae54008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:20.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.697+0000 7fae4b7fe700 1 -- 172.21.15.125:0/839827644 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fae58052390 con 0x7fae6406a270 2023-11-28T11:10:20.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.923+0000 7fae69598700 1 -- 172.21.15.125:0/839827644 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae640743f0 con 0x7fae6406a270 2023-11-28T11:10:20.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.923+0000 7fae4b7fe700 1 -- 172.21.15.125:0/839827644 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4657 (secure 0 0 0) 0x7fae580559b0 con 0x7fae6406a270 2023-11-28T11:10:20.925 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:20.925 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1240521006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1240521006},{"type":"v1","addr":"172.21.15.167:6834","nonce":1240521006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2122606110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2122606110},{"type":"v1","addr":"172.21.15.167:6835","nonce":2122606110}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5280,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/888812458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":888812458},{"type":"v1","addr":"172.21.15.125:6835","nonce":888812458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:09:48.560821+0000","modified":"2023-11-28T11:09:51.580459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/2632892245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2632892245},{"type":"v1","addr":"172.21.15.125:6837","nonce":2632892245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:10:20.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 -- 172.21.15.125:0/839827644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fae500682f0 msgr2=0x7fae5006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fae500682f0 0x7fae5006a7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fae6414df20 tx=0x7fae54008030 comp rx=0 tx=0).stop 2023-11-28T11:10:20.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 -- 172.21.15.125:0/839827644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae6406a270 msgr2=0x7fae6414a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae6406a270 0x7fae6414a130 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fae5800e870 tx=0x7fae5800ec30 comp rx=0 tx=0).stop 2023-11-28T11:10:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 -- 172.21.15.125:0/839827644 shutdown_connections 2023-11-28T11:10:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae6415cc80 0x7fae640acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae6406a270 0x7fae6414a130 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fae500682f0 0x7fae5006a7a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 --2- 172.21.15.125:0/839827644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae6406e3a0 0x7fae640b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 -- 172.21.15.125:0/839827644 >> 172.21.15.125:0/839827644 conn(0x7fae6406c010 msgr2=0x7fae6415c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 -- 172.21.15.125:0/839827644 shutdown_connections 2023-11-28T11:10:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:20.925+0000 7fae69598700 1 -- 172.21.15.125:0/839827644 wait complete. 2023-11-28T11:10:20.929 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 16 2023-11-28T11:10:20.939 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:10:21.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.058+0000 7fe936f85700 1 Processor -- start 2023-11-28T11:10:21.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.058+0000 7fe936f85700 1 -- start start 2023-11-28T11:10:21.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.059+0000 7fe936f85700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930142db0 0x7fe93013ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.059+0000 7fe936f85700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe9300b1770 0x7fe9300b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.059+0000 7fe936f85700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe93015e010 con 0x7fe9300ce040 2023-11-28T11:10:21.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.059+0000 7fe936f85700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9300b2130 con 0x7fe9300b1770 2023-11-28T11:10:21.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.059+0000 7fe936f85700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93013fc90 con 0x7fe930142db0 2023-11-28T11:10:21.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.059+0000 7fe935522700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe9300b1770 0x7fe9300b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.059+0000 7fe92ffff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930142db0 0x7fe93013ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.059+0000 7fe934d21700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe9300ce040 0x7fe93015d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:46582/0 (socket says 172.21.15.125:46582) 2023-11-28T11:10:21.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.059+0000 7fe935522700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe9300b1770 0x7fe9300b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:56390/0 (socket says 172.21.15.125:56390) 2023-11-28T11:10:21.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.059+0000 7fe934d21700 1 -- 172.21.15.125:0/1737682881 learned_addr learned my addr 172.21.15.125:0/1737682881 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:21.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.060+0000 7fe935522700 1 -- 172.21.15.125:0/1737682881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930142db0 msgr2=0x7fe93013ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:21.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.060+0000 7fe935522700 1 --2- 172.21.15.125:0/1737682881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930142db0 0x7fe93013ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.060+0000 7fe935522700 1 -- 172.21.15.125:0/1737682881 >> v1:172.21.15.167:6789/0 conn(0x7fe9300ce040 legacy=0x7fe93015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.060+0000 7fe935522700 1 -- 172.21.15.125:0/1737682881 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93013f6d0 con 0x7fe9300b1770 2023-11-28T11:10:21.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.060+0000 7fe935522700 1 --2- 172.21.15.125:0/1737682881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9300b1770 0x7fe9300b1bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe928009d90 tx=0x7fe92800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2fc5642fd1890dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:21.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.060+0000 7fe92f7fe700 1 -- 172.21.15.125:0/1737682881 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92800e070 con 0x7fe9300b1770 2023-11-28T11:10:21.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.060+0000 7fe92f7fe700 1 -- 172.21.15.125:0/1737682881 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92800bb20 con 0x7fe9300b1770 2023-11-28T11:10:21.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.060+0000 7fe92f7fe700 1 -- 172.21.15.125:0/1737682881 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928012430 con 0x7fe9300b1770 2023-11-28T11:10:21.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.060+0000 7fe936f85700 1 -- 172.21.15.125:0/1737682881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9300b1770 msgr2=0x7fe9300b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.060+0000 7fe936f85700 1 --2- 172.21.15.125:0/1737682881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9300b1770 0x7fe9300b1bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe928009d90 tx=0x7fe92800b330 comp rx=0 tx=0).stop 2023-11-28T11:10:21.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.061+0000 7fe936f85700 1 -- 172.21.15.125:0/1737682881 shutdown_connections 2023-11-28T11:10:21.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.061+0000 7fe936f85700 1 --2- 172.21.15.125:0/1737682881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9300b1770 0x7fe9300b1bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.061+0000 7fe936f85700 1 --2- 172.21.15.125:0/1737682881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930142db0 0x7fe93013ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.061+0000 7fe936f85700 1 -- 172.21.15.125:0/1737682881 >> 172.21.15.125:0/1737682881 conn(0x7fe93006c010 msgr2=0x7fe9300cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:21.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.061+0000 7fe936f85700 1 -- 172.21.15.125:0/1737682881 shutdown_connections 2023-11-28T11:10:21.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.061+0000 7fe936f85700 1 -- 172.21.15.125:0/1737682881 wait complete. 2023-11-28T11:10:21.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.062+0000 7fe936f85700 1 Processor -- start 2023-11-28T11:10:21.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.062+0000 7fe936f85700 1 -- start start 2023-11-28T11:10:21.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe936f85700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9300b1770 0x7fe930157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe936f85700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9300ce040 0x7fe9300c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe936f85700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930142db0 0x7fe9300b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe936f85700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe930157870 con 0x7fe9300b1770 2023-11-28T11:10:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe936f85700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9301e2f60 con 0x7fe9300ce040 2023-11-28T11:10:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe936f85700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9301e4720 con 0x7fe930142db0 2023-11-28T11:10:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe934d21700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9300b1770 0x7fe930157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe934d21700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9300b1770 0x7fe930157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59662/0 (socket says 172.21.15.125:59662) 2023-11-28T11:10:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe934d21700 1 -- 172.21.15.125:0/3028998815 learned_addr learned my addr 172.21.15.125:0/3028998815 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe92ffff700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9300ce040 0x7fe9300c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe935522700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930142db0 0x7fe9300b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe934d21700 1 -- 172.21.15.125:0/3028998815 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930142db0 msgr2=0x7fe9300b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe934d21700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930142db0 0x7fe9300b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe934d21700 1 -- 172.21.15.125:0/3028998815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9300ce040 msgr2=0x7fe9300c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe934d21700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9300ce040 0x7fe9300c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe934d21700 1 -- 172.21.15.125:0/3028998815 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe928009a70 con 0x7fe9300b1770 2023-11-28T11:10:21.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe92ffff700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9300ce040 0x7fe9300c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:21.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe934d21700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9300b1770 0x7fe930157330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe92400c550 tx=0x7fe92400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:21.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe92d7fa700 1 -- 172.21.15.125:0/3028998815 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924005d70 con 0x7fe9300b1770 2023-11-28T11:10:21.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe92d7fa700 1 -- 172.21.15.125:0/3028998815 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9240070d0 con 0x7fe9300b1770 2023-11-28T11:10:21.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe936f85700 1 -- 172.21.15.125:0/3028998815 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93015d100 con 0x7fe9300b1770 2023-11-28T11:10:21.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe92d7fa700 1 -- 172.21.15.125:0/3028998815 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924007440 con 0x7fe9300b1770 2023-11-28T11:10:21.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.063+0000 7fe936f85700 1 -- 172.21.15.125:0/3028998815 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93013f9b0 con 0x7fe9300b1770 2023-11-28T11:10:21.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.064+0000 7fe936f85700 1 -- 172.21.15.125:0/3028998815 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93015d3e0 con 0x7fe9300b1770 2023-11-28T11:10:21.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.065+0000 7fe92d7fa700 1 -- 172.21.15.125:0/3028998815 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe924019030 con 0x7fe9300b1770 2023-11-28T11:10:21.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.066+0000 7fe92d7fa700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9140682f0 0x7fe91406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.066+0000 7fe92d7fa700 1 -- 172.21.15.125:0/3028998815 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fe924085380 con 0x7fe9300b1770 2023-11-28T11:10:21.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.066+0000 7fe92ffff700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9140682f0 0x7fe91406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.066+0000 7fe92ffff700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9140682f0 0x7fe91406a7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe93015cbf0 tx=0x7fe91c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:21.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.069+0000 7fe92d7fa700 1 -- 172.21.15.125:0/3028998815 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe924051c70 con 0x7fe9300b1770 2023-11-28T11:10:21.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.253+0000 7fe936f85700 1 -- 172.21.15.125:0/3028998815 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe93015e010 con 0x7fe9300b1770 2023-11-28T11:10:21.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.254+0000 7fe92d7fa700 1 -- 172.21.15.125:0/3028998815 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18076 (secure 0 0 0) 0x7fe93015e010 con 0x7fe9300b1770 2023-11-28T11:10:21.256 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:21.256 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":40,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:10:19.968658+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:09:46.832058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T11:09:47.518555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.30","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:10:21.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 -- 172.21.15.125:0/3028998815 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9140682f0 msgr2=0x7fe91406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9140682f0 0x7fe91406a7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe93015cbf0 tx=0x7fe91c008040 comp rx=0 tx=0).stop 2023-11-28T11:10:21.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 -- 172.21.15.125:0/3028998815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9300b1770 msgr2=0x7fe930157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9300b1770 0x7fe930157330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe92400c550 tx=0x7fe92400c910 comp rx=0 tx=0).stop 2023-11-28T11:10:21.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 -- 172.21.15.125:0/3028998815 shutdown_connections 2023-11-28T11:10:21.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe9140682f0 0x7fe91406a7a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930142db0 0x7fe9300b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9300b1770 0x7fe930157330 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 --2- 172.21.15.125:0/3028998815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9300ce040 0x7fe9300c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 -- 172.21.15.125:0/3028998815 >> 172.21.15.125:0/3028998815 conn(0x7fe93006c010 msgr2=0x7fe93006d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:21.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 -- 172.21.15.125:0/3028998815 shutdown_connections 2023-11-28T11:10:21.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.256+0000 7fe936f85700 1 -- 172.21.15.125:0/3028998815 wait complete. 2023-11-28T11:10:21.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:09:46.832058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:09:47.518555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:10:21.270 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:10:21.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.391+0000 7fedd6279700 1 Processor -- start 2023-11-28T11:10:21.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.391+0000 7fedd6279700 1 -- start start 2023-11-28T11:10:21.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedd6279700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fedd00b2ee0 0x7fedd00d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedd6279700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd015a9c0 con 0x7fedd00cc200 2023-11-28T11:10:21.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedd6279700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd00c7b80 con 0x7fedd015a5f0 2023-11-28T11:10:21.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedd6279700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd00cc990 con 0x7fedd00b2ee0 2023-11-28T11:10:21.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedcf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fedd00b2ee0 0x7fedd00d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedd4816700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fedd00cc200 0x7fedd00ced30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43798/0 (socket says 172.21.15.125:43798) 2023-11-28T11:10:21.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedd4816700 1 -- 172.21.15.125:0/1060006213 learned_addr learned my addr 172.21.15.125:0/1060006213 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:21.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedcf7fe700 1 -- 172.21.15.125:0/1060006213 >> v1:172.21.15.167:6789/0 conn(0x7fedd015a5f0 legacy=0x7fedd00b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:21.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedcf7fe700 1 -- 172.21.15.125:0/1060006213 >> v1:172.21.15.125:6789/0 conn(0x7fedd00cc200 legacy=0x7fedd00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedcf7fe700 1 -- 172.21.15.125:0/1060006213 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd00ccc70 con 0x7fedd00b2ee0 2023-11-28T11:10:21.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedcf7fe700 1 --2- 172.21.15.125:0/1060006213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedd00b2ee0 0x7fedd00d0ad0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009840 tx=0x7fedc0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0da48baf253cbb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:21.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedceffd700 1 -- 172.21.15.125:0/1060006213 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0004230 con 0x7fedd00b2ee0 2023-11-28T11:10:21.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.392+0000 7fedceffd700 1 -- 172.21.15.125:0/1060006213 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc0004390 con 0x7fedd00b2ee0 2023-11-28T11:10:21.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.393+0000 7fedceffd700 1 -- 172.21.15.125:0/1060006213 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc00036a0 con 0x7fedd00b2ee0 2023-11-28T11:10:21.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.393+0000 7fedd6279700 1 -- 172.21.15.125:0/1060006213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedd00b2ee0 msgr2=0x7fedd00d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.393+0000 7fedd6279700 1 --2- 172.21.15.125:0/1060006213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedd00b2ee0 0x7fedd00d0ad0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009840 tx=0x7fedc0009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:21.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.393+0000 7fedd6279700 1 -- 172.21.15.125:0/1060006213 shutdown_connections 2023-11-28T11:10:21.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.393+0000 7fedd6279700 1 --2- 172.21.15.125:0/1060006213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedd00b2ee0 0x7fedd00d0ad0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.393+0000 7fedd6279700 1 -- 172.21.15.125:0/1060006213 >> 172.21.15.125:0/1060006213 conn(0x7fedd006ea80 msgr2=0x7fedd006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:21.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.393+0000 7fedd6279700 1 -- 172.21.15.125:0/1060006213 shutdown_connections 2023-11-28T11:10:21.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.393+0000 7fedd6279700 1 -- 172.21.15.125:0/1060006213 wait complete. 2023-11-28T11:10:21.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.394+0000 7fedd6279700 1 Processor -- start 2023-11-28T11:10:21.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.394+0000 7fedd6279700 1 -- start start 2023-11-28T11:10:21.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.395+0000 7fedd6279700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedd00b2ee0 0x7fedd00b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.395+0000 7fedd6279700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd00cc200 0x7fedd00b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.395+0000 7fedd6279700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedd015a5f0 0x7fedd00b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.395+0000 7fedd6279700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd01f32c0 con 0x7fedd015a5f0 2023-11-28T11:10:21.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.395+0000 7fedd6279700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd01f26e0 con 0x7fedd00cc200 2023-11-28T11:10:21.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.395+0000 7fedd6279700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd01f2990 con 0x7fedd00b2ee0 2023-11-28T11:10:21.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.395+0000 7fedd4816700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedd015a5f0 0x7fedd00b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.395+0000 7fedd4816700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedd015a5f0 0x7fedd00b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59680/0 (socket says 172.21.15.125:59680) 2023-11-28T11:10:21.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.395+0000 7fedd4816700 1 -- 172.21.15.125:0/3321188261 learned_addr learned my addr 172.21.15.125:0/3321188261 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:21.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.395+0000 7fedcf7fe700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd00cc200 0x7fedd00b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.395+0000 7fedcffff700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedd00b2ee0 0x7fedd00b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedd4816700 1 -- 172.21.15.125:0/3321188261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedd00b2ee0 msgr2=0x7fedd00b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedd4816700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedd00b2ee0 0x7fedd00b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedd4816700 1 -- 172.21.15.125:0/3321188261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd00cc200 msgr2=0x7fedd00b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedd4816700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd00cc200 0x7fedd00b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedd4816700 1 -- 172.21.15.125:0/3321188261 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc00094a0 con 0x7fedd015a5f0 2023-11-28T11:10:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedcffff700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedd00b2ee0 0x7fedd00b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedd4816700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedd015a5f0 0x7fedd00b2300 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fedc800ca80 tx=0x7fedc800cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:21.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedccff9700 1 -- 172.21.15.125:0/3321188261 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc800a9e0 con 0x7fedd015a5f0 2023-11-28T11:10:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedccff9700 1 -- 172.21.15.125:0/3321188261 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc800ab40 con 0x7fedd015a5f0 2023-11-28T11:10:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedd6279700 1 -- 172.21.15.125:0/3321188261 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd00cd230 con 0x7fedd015a5f0 2023-11-28T11:10:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedccff9700 1 -- 172.21.15.125:0/3321188261 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8012400 con 0x7fedd015a5f0 2023-11-28T11:10:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.396+0000 7fedd6279700 1 -- 172.21.15.125:0/3321188261 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd00ccf50 con 0x7fedd015a5f0 2023-11-28T11:10:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.397+0000 7fedd6279700 1 -- 172.21.15.125:0/3321188261 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd00cd510 con 0x7fedd015a5f0 2023-11-28T11:10:21.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.397+0000 7fedccff9700 1 -- 172.21.15.125:0/3321188261 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fedc8019030 con 0x7fedd015a5f0 2023-11-28T11:10:21.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.398+0000 7fedccff9700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fedbc068320 0x7fedbc06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.398+0000 7fedccff9700 1 -- 172.21.15.125:0/3321188261 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fedc8085680 con 0x7fedd015a5f0 2023-11-28T11:10:21.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.398+0000 7fedcffff700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fedbc068320 0x7fedbc06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.398+0000 7fedcffff700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fedbc068320 0x7fedbc06a7d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fedc4003fc0 tx=0x7fedc4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:21.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.402+0000 7fedccff9700 1 -- 172.21.15.125:0/3321188261 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fedc804b5e0 con 0x7fedd015a5f0 2023-11-28T11:10:21.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.584+0000 7fedd6279700 1 -- 172.21.15.125:0/3321188261 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedd01f3650 con 0x7fedd015a5f0 2023-11-28T11:10:21.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.584+0000 7fedccff9700 1 -- 172.21.15.125:0/3321188261 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedc8051f70 con 0x7fedd015a5f0 2023-11-28T11:10:21.586 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:10:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 -- 172.21.15.125:0/3321188261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fedbc068320 msgr2=0x7fedbc06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fedbc068320 0x7fedbc06a7d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fedc4003fc0 tx=0x7fedc4009040 comp rx=0 tx=0).stop 2023-11-28T11:10:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 -- 172.21.15.125:0/3321188261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedd015a5f0 msgr2=0x7fedd00b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedd015a5f0 0x7fedd00b2300 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fedc800ca80 tx=0x7fedc800cd90 comp rx=0 tx=0).stop 2023-11-28T11:10:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 -- 172.21.15.125:0/3321188261 shutdown_connections 2023-11-28T11:10:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedd015a5f0 0x7fedd00b2300 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fedbc068320 0x7fedbc06a7d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedd00b2ee0 0x7fedd00b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 --2- 172.21.15.125:0/3321188261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd00cc200 0x7fedd00b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 -- 172.21.15.125:0/3321188261 >> 172.21.15.125:0/3321188261 conn(0x7fedd006ea80 msgr2=0x7fedd0154bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:21.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 -- 172.21.15.125:0/3321188261 shutdown_connections 2023-11-28T11:10:21.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.586+0000 7fedd6279700 1 -- 172.21.15.125:0/3321188261 wait complete. 2023-11-28T11:10:21.600 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:10:21.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.721+0000 7f16a54cb700 1 Processor -- start 2023-11-28T11:10:21.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.721+0000 7f16a54cb700 1 -- start start 2023-11-28T11:10:21.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f16a54cb700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f16a015c8c0 0x7f16a0160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f16a54cb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a00d2d30 con 0x7f16a00b5dc0 2023-11-28T11:10:21.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f16a54cb700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a00d0b40 con 0x7f16a006b220 2023-11-28T11:10:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f16a54cb700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a01611f0 con 0x7f16a015c8c0 2023-11-28T11:10:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f169e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f16a00b5dc0 0x7f16a006ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43808/0 (socket says 172.21.15.125:43808) 2023-11-28T11:10:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f169e7fc700 1 -- 172.21.15.125:0/2752685257 learned_addr learned my addr 172.21.15.125:0/2752685257 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f169effd700 1 --2- 172.21.15.125:0/2752685257 >> v2:172.21.15.167:3300/0 conn(0x7f16a015c8c0 0x7f16a0160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f169dffb700 1 -- 172.21.15.125:0/2752685257 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578634913 0 0) 0x7f1690001110 con 0x7f16a00b5dc0 2023-11-28T11:10:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f169dffb700 1 -- 172.21.15.125:0/2752685257 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16880035b0 con 0x7f16a00b5dc0 2023-11-28T11:10:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f169dffb700 1 -- 172.21.15.125:0/2752685257 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293034197 0 0) 0x7f16a00d0b40 con 0x7f16a006b220 2023-11-28T11:10:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f169dffb700 1 -- 172.21.15.125:0/2752685257 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1690001110 con 0x7f16a006b220 2023-11-28T11:10:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f169dffb700 1 -- 172.21.15.125:0/2752685257 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1071324608 0 0) 0x7f16880035b0 con 0x7f16a00b5dc0 2023-11-28T11:10:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f169effd700 1 -- 172.21.15.125:0/2752685257 >> v1:172.21.15.167:6789/0 conn(0x7f16a006b220 legacy=0x7f16a00d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f169effd700 1 -- 172.21.15.125:0/2752685257 >> v1:172.21.15.125:6789/0 conn(0x7f16a00b5dc0 legacy=0x7f16a006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.722+0000 7f169effd700 1 -- 172.21.15.125:0/2752685257 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a00d2a50 con 0x7f16a015c8c0 2023-11-28T11:10:21.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.723+0000 7f169effd700 1 --2- 172.21.15.125:0/2752685257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16a015c8c0 0x7f16a0160cb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1694009840 tx=0x7f1694009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62f099d138441725 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:21.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.723+0000 7f169dffb700 1 -- 172.21.15.125:0/2752685257 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690001800 con 0x7f16a015c8c0 2023-11-28T11:10:21.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.723+0000 7f169dffb700 1 -- 172.21.15.125:0/2752685257 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694004030 con 0x7f16a015c8c0 2023-11-28T11:10:21.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.723+0000 7f169dffb700 1 -- 172.21.15.125:0/2752685257 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940043c0 con 0x7f16a015c8c0 2023-11-28T11:10:21.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.723+0000 7f16a54cb700 1 -- 172.21.15.125:0/2752685257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16a015c8c0 msgr2=0x7f16a0160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.723+0000 7f16a54cb700 1 --2- 172.21.15.125:0/2752685257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16a015c8c0 0x7f16a0160cb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1694009840 tx=0x7f1694009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:21.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.723+0000 7f16a54cb700 1 -- 172.21.15.125:0/2752685257 shutdown_connections 2023-11-28T11:10:21.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.723+0000 7f16a54cb700 1 --2- 172.21.15.125:0/2752685257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16a015c8c0 0x7f16a0160cb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.723+0000 7f16a54cb700 1 -- 172.21.15.125:0/2752685257 >> 172.21.15.125:0/2752685257 conn(0x7f16a006c520 msgr2=0x7f16a006c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:21.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.723+0000 7f16a54cb700 1 -- 172.21.15.125:0/2752685257 shutdown_connections 2023-11-28T11:10:21.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.723+0000 7f16a54cb700 1 -- 172.21.15.125:0/2752685257 wait complete. 2023-11-28T11:10:21.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.725+0000 7f16a54cb700 1 Processor -- start 2023-11-28T11:10:21.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.725+0000 7f16a54cb700 1 -- start start 2023-11-28T11:10:21.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f16a54cb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a006b220 0x7f16a0150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f16a54cb700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16a00b5dc0 0x7f16a00c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f16a54cb700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16a015c8c0 0x7f16a01586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f16a54cb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a0150bb0 con 0x7f16a006b220 2023-11-28T11:10:21.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f16a54cb700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00c8c10 con 0x7f16a00b5dc0 2023-11-28T11:10:21.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f16a54cb700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00c76d0 con 0x7f16a015c8c0 2023-11-28T11:10:21.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f169effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a006b220 0x7f16a0150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f169effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a006b220 0x7f16a0150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59690/0 (socket says 172.21.15.125:59690) 2023-11-28T11:10:21.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f169effd700 1 -- 172.21.15.125:0/2684755879 learned_addr learned my addr 172.21.15.125:0/2684755879 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:21.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f169e7fc700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16a00b5dc0 0x7f16a00c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f169effd700 1 -- 172.21.15.125:0/2684755879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16a015c8c0 msgr2=0x7f16a01586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f169f7fe700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16a015c8c0 0x7f16a01586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f169effd700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16a015c8c0 0x7f16a01586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f169effd700 1 -- 172.21.15.125:0/2684755879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16a00b5dc0 msgr2=0x7f16a00c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f169effd700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16a00b5dc0 0x7f16a00c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f169effd700 1 -- 172.21.15.125:0/2684755879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16940094a0 con 0x7f16a006b220 2023-11-28T11:10:21.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.726+0000 7f169e7fc700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16a00b5dc0 0x7f16a00c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:21.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.727+0000 7f169effd700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a006b220 0x7f16a0150020 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f169400a010 tx=0x7f1694004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:21.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.727+0000 7f16877fe700 1 -- 172.21.15.125:0/2684755879 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694003db0 con 0x7f16a006b220 2023-11-28T11:10:21.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.727+0000 7f16877fe700 1 -- 172.21.15.125:0/2684755879 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169401f070 con 0x7f16a006b220 2023-11-28T11:10:21.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.727+0000 7f16a54cb700 1 -- 172.21.15.125:0/2684755879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a00cda40 con 0x7f16a006b220 2023-11-28T11:10:21.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.727+0000 7f16877fe700 1 -- 172.21.15.125:0/2684755879 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694011870 con 0x7f16a006b220 2023-11-28T11:10:21.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.727+0000 7f16a54cb700 1 -- 172.21.15.125:0/2684755879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a00cd760 con 0x7f16a006b220 2023-11-28T11:10:21.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.728+0000 7f16a54cb700 1 -- 172.21.15.125:0/2684755879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a00d2700 con 0x7f16a006b220 2023-11-28T11:10:21.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.728+0000 7f16877fe700 1 -- 172.21.15.125:0/2684755879 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f169402a020 con 0x7f16a006b220 2023-11-28T11:10:21.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.729+0000 7f16877fe700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f168c0682f0 0x7f168c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:21.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.729+0000 7f16877fe700 1 -- 172.21.15.125:0/2684755879 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f1694087150 con 0x7f16a006b220 2023-11-28T11:10:21.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.729+0000 7f169e7fc700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f168c0682f0 0x7f168c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:21.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.729+0000 7f169e7fc700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f168c0682f0 0x7f168c06a7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1690001370 tx=0x7f1690009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:21.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.733+0000 7f16877fe700 1 -- 172.21.15.125:0/2684755879 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1694053990 con 0x7f16a006b220 2023-11-28T11:10:21.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.918+0000 7f16a54cb700 1 -- 172.21.15.125:0/2684755879 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f16a0067d70 con 0x7f16a006b220 2023-11-28T11:10:21.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.918+0000 7f16877fe700 1 -- 172.21.15.125:0/2684755879 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1694056fb0 con 0x7f16a006b220 2023-11-28T11:10:21.920 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:10:21.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 -- 172.21.15.125:0/2684755879 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f168c0682f0 msgr2=0x7f168c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f168c0682f0 0x7f168c06a7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1690001370 tx=0x7f1690009040 comp rx=0 tx=0).stop 2023-11-28T11:10:21.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 -- 172.21.15.125:0/2684755879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a006b220 msgr2=0x7f16a0150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:21.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a006b220 0x7f16a0150020 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f169400a010 tx=0x7f1694004750 comp rx=0 tx=0).stop 2023-11-28T11:10:21.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 -- 172.21.15.125:0/2684755879 shutdown_connections 2023-11-28T11:10:21.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f168c0682f0 0x7f168c06a7a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16a015c8c0 0x7f16a01586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a006b220 0x7f16a0150020 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 --2- 172.21.15.125:0/2684755879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16a00b5dc0 0x7f16a00c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:21.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 -- 172.21.15.125:0/2684755879 >> 172.21.15.125:0/2684755879 conn(0x7f16a006c520 msgr2=0x7f16a00cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:21.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 -- 172.21.15.125:0/2684755879 shutdown_connections 2023-11-28T11:10:21.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:21.920+0000 7f16a54cb700 1 -- 172.21.15.125:0/2684755879 wait complete. 2023-11-28T11:10:21.934 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:10:22.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.056+0000 7fa3d8379700 1 Processor -- start 2023-11-28T11:10:22.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.056+0000 7fa3d8379700 1 -- start start 2023-11-28T11:10:22.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d8379700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3d015c810 0x7fa3d0160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d8379700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa3d006a270 0x7fa3d006a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d8379700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d006ac10 con 0x7fa3d00718e0 2023-11-28T11:10:22.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d8379700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d015cbe0 con 0x7fa3d006a270 2023-11-28T11:10:22.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d8379700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d01607a0 con 0x7fa3d015c810 2023-11-28T11:10:22.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d6916700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa3d006a270 0x7fa3d006a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d5914700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa3d00718e0 0x7fa3d006c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43824/0 (socket says 172.21.15.125:43824) 2023-11-28T11:10:22.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d5914700 1 -- 172.21.15.125:0/881684709 learned_addr learned my addr 172.21.15.125:0/881684709 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:22.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d6916700 1 -- 172.21.15.125:0/881684709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3d015c810 msgr2=0x7fa3d0160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d6916700 1 --2- 172.21.15.125:0/881684709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3d015c810 0x7fa3d0160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d6916700 1 -- 172.21.15.125:0/881684709 >> v1:172.21.15.125:6789/0 conn(0x7fa3d00718e0 legacy=0x7fa3d006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d6916700 1 -- 172.21.15.125:0/881684709 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0160a50 con 0x7fa3d006a270 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d5113700 1 -- 172.21.15.125:0/881684709 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949965179 0 0) 0x7fa3d006ac10 con 0x7fa3d00718e0 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d6916700 1 --2- 172.21.15.125:0/881684709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3d006a270 0x7fa3d006a6d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009d90 tx=0x7fa3c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1dbf116f608335 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.057+0000 7fa3d5113700 1 -- 172.21.15.125:0/881684709 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c800e070 con 0x7fa3d006a270 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.058+0000 7fa3d5113700 1 -- 172.21.15.125:0/881684709 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c800bbd0 con 0x7fa3d006a270 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.058+0000 7fa3d5113700 1 -- 172.21.15.125:0/881684709 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8012430 con 0x7fa3d006a270 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.058+0000 7fa3d8379700 1 -- 172.21.15.125:0/881684709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3d006a270 msgr2=0x7fa3d006a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.058+0000 7fa3d8379700 1 --2- 172.21.15.125:0/881684709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3d006a270 0x7fa3d006a6d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009d90 tx=0x7fa3c800b330 comp rx=0 tx=0).stop 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.058+0000 7fa3d8379700 1 -- 172.21.15.125:0/881684709 shutdown_connections 2023-11-28T11:10:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.058+0000 7fa3d8379700 1 --2- 172.21.15.125:0/881684709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3d006a270 0x7fa3d006a6d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.058+0000 7fa3d8379700 1 --2- 172.21.15.125:0/881684709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3d015c810 0x7fa3d0160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.058+0000 7fa3d8379700 1 -- 172.21.15.125:0/881684709 >> 172.21.15.125:0/881684709 conn(0x7fa3d006c010 msgr2=0x7fa3d00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:22.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.058+0000 7fa3d8379700 1 -- 172.21.15.125:0/881684709 shutdown_connections 2023-11-28T11:10:22.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.058+0000 7fa3d8379700 1 -- 172.21.15.125:0/881684709 wait complete. 2023-11-28T11:10:22.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.059+0000 7fa3d8379700 1 Processor -- start 2023-11-28T11:10:22.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.059+0000 7fa3d8379700 1 -- start start 2023-11-28T11:10:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d8379700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3d006a270 0x7fa3d00af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d8379700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3d00718e0 0x7fa3d014e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d8379700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d015c810 0x7fa3d0157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d8379700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00b0960 con 0x7fa3d006a270 2023-11-28T11:10:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d8379700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d0157e40 con 0x7fa3d015c810 2023-11-28T11:10:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d8379700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00afd50 con 0x7fa3d00718e0 2023-11-28T11:10:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d6115700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3d006a270 0x7fa3d00af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d6115700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3d006a270 0x7fa3d00af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59704/0 (socket says 172.21.15.125:59704) 2023-11-28T11:10:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d6115700 1 -- 172.21.15.125:0/1043417016 learned_addr learned my addr 172.21.15.125:0/1043417016 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d6115700 1 -- 172.21.15.125:0/1043417016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3d00718e0 msgr2=0x7fa3d014e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d6115700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3d00718e0 0x7fa3d014e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d6115700 1 -- 172.21.15.125:0/1043417016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d015c810 msgr2=0x7fa3d0157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d6115700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d015c810 0x7fa3d0157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.060+0000 7fa3d6115700 1 -- 172.21.15.125:0/1043417016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c8009a70 con 0x7fa3d006a270 2023-11-28T11:10:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.061+0000 7fa3d6115700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3d006a270 0x7fa3d00af6e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00b4a0 tx=0x7fa3cc00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.061+0000 7fa3c6ffd700 1 -- 172.21.15.125:0/1043417016 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc011830 con 0x7fa3d006a270 2023-11-28T11:10:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.061+0000 7fa3c6ffd700 1 -- 172.21.15.125:0/1043417016 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc011990 con 0x7fa3d006a270 2023-11-28T11:10:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.061+0000 7fa3d8379700 1 -- 172.21.15.125:0/1043417016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d0161010 con 0x7fa3d006a270 2023-11-28T11:10:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.061+0000 7fa3c6ffd700 1 -- 172.21.15.125:0/1043417016 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc011d40 con 0x7fa3d006a270 2023-11-28T11:10:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.061+0000 7fa3d8379700 1 -- 172.21.15.125:0/1043417016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d0160d30 con 0x7fa3d006a270 2023-11-28T11:10:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.062+0000 7fa3d8379700 1 -- 172.21.15.125:0/1043417016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d00ceb20 con 0x7fa3d006a270 2023-11-28T11:10:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.062+0000 7fa3c6ffd700 1 -- 172.21.15.125:0/1043417016 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa3cc021070 con 0x7fa3d006a270 2023-11-28T11:10:22.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.062+0000 7fa3c6ffd700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa3b40682f0 0x7fa3b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.062+0000 7fa3c6ffd700 1 -- 172.21.15.125:0/1043417016 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fa3cc085c60 con 0x7fa3d006a270 2023-11-28T11:10:22.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.062+0000 7fa3d5914700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa3b40682f0 0x7fa3b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.063+0000 7fa3d5914700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa3b40682f0 0x7fa3b406a7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00011e0 tx=0x7fa3c00079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.067+0000 7fa3c6ffd700 1 -- 172.21.15.125:0/1043417016 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa3cc052420 con 0x7fa3d006a270 2023-11-28T11:10:22.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.249+0000 7fa3d8379700 1 -- 172.21.15.125:0/1043417016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3d00b0c40 con 0x7fa3d006a270 2023-11-28T11:10:22.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.249+0000 7fa3c6ffd700 1 -- 172.21.15.125:0/1043417016 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3cc0150a0 con 0x7fa3d006a270 2023-11-28T11:10:22.251 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:10:22.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 -- 172.21.15.125:0/1043417016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa3b40682f0 msgr2=0x7fa3b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa3b40682f0 0x7fa3b406a7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00011e0 tx=0x7fa3c00079b0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 -- 172.21.15.125:0/1043417016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3d006a270 msgr2=0x7fa3d00af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3d006a270 0x7fa3d00af6e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00b4a0 tx=0x7fa3cc00b860 comp rx=0 tx=0).stop 2023-11-28T11:10:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 -- 172.21.15.125:0/1043417016 shutdown_connections 2023-11-28T11:10:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d015c810 0x7fa3d0157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3d006a270 0x7fa3d00af6e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa3b40682f0 0x7fa3b406a7a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 --2- 172.21.15.125:0/1043417016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3d00718e0 0x7fa3d014e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 -- 172.21.15.125:0/1043417016 >> 172.21.15.125:0/1043417016 conn(0x7fa3d006c010 msgr2=0x7fa3d00ad570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 -- 172.21.15.125:0/1043417016 shutdown_connections 2023-11-28T11:10:22.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.251+0000 7fa3d8379700 1 -- 172.21.15.125:0/1043417016 wait complete. 2023-11-28T11:10:22.265 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:10:22.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.387+0000 7f755c3a4700 1 Processor -- start 2023-11-28T11:10:22.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.387+0000 7f755c3a4700 1 -- start start 2023-11-28T11:10:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755c3a4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75540ae850 0x7f755406c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755c3a4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75540cbcc0 con 0x7f755406c980 2023-11-28T11:10:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755c3a4700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75540ca140 con 0x7f7554158e10 2023-11-28T11:10:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755c3a4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755406ac30 con 0x7f75540ae850 2023-11-28T11:10:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755a941700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f755406c980 0x7f7554070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43840/0 (socket says 172.21.15.125:43840) 2023-11-28T11:10:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755a941700 1 -- 172.21.15.125:0/229132233 learned_addr learned my addr 172.21.15.125:0/229132233 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755993f700 1 --2- 172.21.15.125:0/229132233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75540ae850 0x7f755406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755913e700 1 -- 172.21.15.125:0/229132233 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438990922 0 0) 0x7f75540cbcc0 con 0x7f755406c980 2023-11-28T11:10:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755913e700 1 -- 172.21.15.125:0/229132233 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75400035b0 con 0x7f755406c980 2023-11-28T11:10:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755913e700 1 -- 172.21.15.125:0/229132233 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377892959 0 0) 0x7f75540ca140 con 0x7f7554158e10 2023-11-28T11:10:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755913e700 1 -- 172.21.15.125:0/229132233 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75540cbcc0 con 0x7f7554158e10 2023-11-28T11:10:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755993f700 1 -- 172.21.15.125:0/229132233 >> v1:172.21.15.167:6789/0 conn(0x7f7554158e10 legacy=0x7f75540cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755913e700 1 -- 172.21.15.125:0/229132233 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 479484644 0 0) 0x7f75400035b0 con 0x7f755406c980 2023-11-28T11:10:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755993f700 1 -- 172.21.15.125:0/229132233 >> v1:172.21.15.125:6789/0 conn(0x7f755406c980 legacy=0x7f7554070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.388+0000 7f755993f700 1 -- 172.21.15.125:0/229132233 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75540c9b80 con 0x7f75540ae850 2023-11-28T11:10:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.389+0000 7f755993f700 1 --2- 172.21.15.125:0/229132233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75540ae850 0x7f755406c440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f754400aa10 tx=0x7f754400ad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2819328e7c64fbd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.389+0000 7f755913e700 1 -- 172.21.15.125:0/229132233 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c0019f0 con 0x7f75540ae850 2023-11-28T11:10:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.389+0000 7f755913e700 1 -- 172.21.15.125:0/229132233 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754400aeb0 con 0x7f75540ae850 2023-11-28T11:10:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.389+0000 7f755913e700 1 -- 172.21.15.125:0/229132233 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544004230 con 0x7f75540ae850 2023-11-28T11:10:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.389+0000 7f755c3a4700 1 -- 172.21.15.125:0/229132233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75540ae850 msgr2=0x7f755406c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.389+0000 7f755c3a4700 1 --2- 172.21.15.125:0/229132233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75540ae850 0x7f755406c440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f754400aa10 tx=0x7f754400ad20 comp rx=0 tx=0).stop 2023-11-28T11:10:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.389+0000 7f755c3a4700 1 -- 172.21.15.125:0/229132233 shutdown_connections 2023-11-28T11:10:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.389+0000 7f755c3a4700 1 --2- 172.21.15.125:0/229132233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75540ae850 0x7f755406c440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.389+0000 7f755c3a4700 1 -- 172.21.15.125:0/229132233 >> 172.21.15.125:0/229132233 conn(0x7f75540cf400 msgr2=0x7f75540cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.389+0000 7f755c3a4700 1 -- 172.21.15.125:0/229132233 shutdown_connections 2023-11-28T11:10:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.389+0000 7f755c3a4700 1 -- 172.21.15.125:0/229132233 wait complete. 2023-11-28T11:10:22.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.391+0000 7f755c3a4700 1 Processor -- start 2023-11-28T11:10:22.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.391+0000 7f755c3a4700 1 -- start start 2023-11-28T11:10:22.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.391+0000 7f755c3a4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f755406c980 0x7f7554159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.391+0000 7f755c3a4700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75540ae850 0x7f75541597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.391+0000 7f755c3a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7554158e10 0x7f75540cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.391+0000 7f755c3a4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7554157560 con 0x7f7554158e10 2023-11-28T11:10:22.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.391+0000 7f755c3a4700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7554159e30 con 0x7f75540ae850 2023-11-28T11:10:22.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.391+0000 7f755c3a4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755415a110 con 0x7f755406c980 2023-11-28T11:10:22.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.391+0000 7f755a941700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7554158e10 0x7f75540cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.391+0000 7f755a941700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7554158e10 0x7f75540cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59722/0 (socket says 172.21.15.125:59722) 2023-11-28T11:10:22.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.391+0000 7f755a941700 1 -- 172.21.15.125:0/1968831476 learned_addr learned my addr 172.21.15.125:0/1968831476 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:22.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f755a140700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f755406c980 0x7f7554159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f755993f700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75540ae850 0x7f75541597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f755a941700 1 -- 172.21.15.125:0/1968831476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f755406c980 msgr2=0x7f7554159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f755a941700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f755406c980 0x7f7554159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f755a941700 1 -- 172.21.15.125:0/1968831476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75540ae850 msgr2=0x7f75541597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f755a941700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75540ae850 0x7f75541597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f755a941700 1 -- 172.21.15.125:0/1968831476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754400a640 con 0x7f7554158e10 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f755a941700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7554158e10 0x7f75540cd300 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f754c001870 tx=0x7f754c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f754affd700 1 -- 172.21.15.125:0/1968831476 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00ad80 con 0x7f7554158e10 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f754affd700 1 -- 172.21.15.125:0/1968831476 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c0070d0 con 0x7f7554158e10 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f755c3a4700 1 -- 172.21.15.125:0/1968831476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755406ae20 con 0x7f7554158e10 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f754affd700 1 -- 172.21.15.125:0/1968831476 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c007480 con 0x7f7554158e10 2023-11-28T11:10:22.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.392+0000 7f755c3a4700 1 -- 172.21.15.125:0/1968831476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75540c9e60 con 0x7f7554158e10 2023-11-28T11:10:22.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.393+0000 7f755c3a4700 1 -- 172.21.15.125:0/1968831476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755406b100 con 0x7f7554158e10 2023-11-28T11:10:22.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.393+0000 7f754affd700 1 -- 172.21.15.125:0/1968831476 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f754c01a030 con 0x7f7554158e10 2023-11-28T11:10:22.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.394+0000 7f754affd700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75380682f0 0x7f753806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.394+0000 7f754affd700 1 -- 172.21.15.125:0/1968831476 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f754c085b30 con 0x7f7554158e10 2023-11-28T11:10:22.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.394+0000 7f755a140700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75380682f0 0x7f753806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.394+0000 7f755a140700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75380682f0 0x7f753806a7a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f75500010e0 tx=0x7f7550009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:22.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.398+0000 7f754affd700 1 -- 172.21.15.125:0/1968831476 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f754c052310 con 0x7f7554158e10 2023-11-28T11:10:22.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.580+0000 7f755c3a4700 1 -- 172.21.15.125:0/1968831476 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75540743f0 con 0x7f7554158e10 2023-11-28T11:10:22.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.581+0000 7f754affd700 1 -- 172.21.15.125:0/1968831476 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f754c0180a0 con 0x7f7554158e10 2023-11-28T11:10:22.582 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:10:22.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.582+0000 7f755c3a4700 1 -- 172.21.15.125:0/1968831476 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75380682f0 msgr2=0x7f753806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.582+0000 7f755c3a4700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75380682f0 0x7f753806a7a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f75500010e0 tx=0x7f7550009040 comp rx=0 tx=0).stop 2023-11-28T11:10:22.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.582+0000 7f755c3a4700 1 -- 172.21.15.125:0/1968831476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7554158e10 msgr2=0x7f75540cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.582+0000 7f755c3a4700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7554158e10 0x7f75540cd300 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f754c001870 tx=0x7f754c00a340 comp rx=0 tx=0).stop 2023-11-28T11:10:22.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.582+0000 7f755c3a4700 1 -- 172.21.15.125:0/1968831476 shutdown_connections 2023-11-28T11:10:22.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.582+0000 7f755c3a4700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7554158e10 0x7f75540cd300 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.583+0000 7f755c3a4700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75380682f0 0x7f753806a7a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.583+0000 7f755c3a4700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f755406c980 0x7f7554159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.583+0000 7f755c3a4700 1 --2- 172.21.15.125:0/1968831476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75540ae850 0x7f75541597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.583+0000 7f755c3a4700 1 -- 172.21.15.125:0/1968831476 >> 172.21.15.125:0/1968831476 conn(0x7f75540cf400 msgr2=0x7f7554070930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:22.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.583+0000 7f755c3a4700 1 -- 172.21.15.125:0/1968831476 shutdown_connections 2023-11-28T11:10:22.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.583+0000 7f755c3a4700 1 -- 172.21.15.125:0/1968831476 wait complete. 2023-11-28T11:10:22.597 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:10:22.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.716+0000 7f7c85cd6700 1 Processor -- start 2023-11-28T11:10:22.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.716+0000 7f7c85cd6700 1 -- start start 2023-11-28T11:10:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.716+0000 7f7c85cd6700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c800b22a0 0x7f7c800cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.716+0000 7f7c85cd6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c800d1ee0 con 0x7f7c800cd5a0 2023-11-28T11:10:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.716+0000 7f7c85cd6700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c800cdb10 con 0x7f7c8006ab10 2023-11-28T11:10:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.716+0000 7f7c85cd6700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c800d1890 con 0x7f7c800b22a0 2023-11-28T11:10:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7c800cd5a0 0x7f7c800cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43852/0 (socket says 172.21.15.125:43852) 2023-11-28T11:10:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7effd700 1 -- 172.21.15.125:0/2123277680 learned_addr learned my addr 172.21.15.125:0/2123277680 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7ffff700 1 --2- 172.21.15.125:0/2123277680 >> v2:172.21.15.167:3300/0 conn(0x7f7c800b22a0 0x7f7c800cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523999103 0 0) 0x7f7c800d1ee0 con 0x7f7c800cd5a0 2023-11-28T11:10:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c680035b0 con 0x7f7c800cd5a0 2023-11-28T11:10:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2050608124 0 0) 0x7f7c680035b0 con 0x7f7c800cd5a0 2023-11-28T11:10:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 >> v2:172.21.15.167:3300/0 conn(0x7f7c800b22a0 msgr2=0x7f7c800cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:22.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 --2- 172.21.15.125:0/2123277680 >> v2:172.21.15.167:3300/0 conn(0x7f7c800b22a0 0x7f7c800cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 >> v1:172.21.15.167:6789/0 conn(0x7f7c8006ab10 legacy=0x7f7c8006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800d1b70 con 0x7f7c800cd5a0 2023-11-28T11:10:22.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f7c74001670 con 0x7f7c800cd5a0 2023-11-28T11:10:22.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 >> v1:172.21.15.125:6789/0 conn(0x7f7c800cd5a0 legacy=0x7f7c800cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 --2- 172.21.15.125:0/2123277680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 0x7f7c68003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 --2- 172.21.15.125:0/2123277680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c68004850 0x7f7c68004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 --2- 172.21.15.125:0/2123277680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c68005200 0x7f7c6800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c800d1890 con 0x7f7c68003a00 2023-11-28T11:10:22.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6800c080 con 0x7f7c68005200 2023-11-28T11:10:22.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6800c240 con 0x7f7c68004850 2023-11-28T11:10:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7f7fe700 1 --2- 172.21.15.125:0/2123277680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 0x7f7c68003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7ffff700 1 --2- 172.21.15.125:0/2123277680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c68005200 0x7f7c6800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.717+0000 7f7c7effd700 1 --2- 172.21.15.125:0/2123277680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c68004850 0x7f7c68004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c7f7fe700 1 -- 172.21.15.125:0/2123277680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c68004850 msgr2=0x7f7c68004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c7f7fe700 1 --2- 172.21.15.125:0/2123277680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c68004850 0x7f7c68004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c7f7fe700 1 -- 172.21.15.125:0/2123277680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c68005200 msgr2=0x7f7c6800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c7f7fe700 1 --2- 172.21.15.125:0/2123277680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c68005200 0x7f7c6800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c7f7fe700 1 -- 172.21.15.125:0/2123277680 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c680035b0 con 0x7f7c68003a00 2023-11-28T11:10:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c7ffff700 1 -- 172.21.15.125:0/2123277680 reap_dead start 2023-11-28T11:10:22.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c7f7fe700 1 --2- 172.21.15.125:0/2123277680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 0x7f7c68003e10 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7c700017c0 tx=0x7f7c68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3632b1179b71c58 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c700052d0 con 0x7f7c68003a00 2023-11-28T11:10:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c70005430 con 0x7f7c68003a00 2023-11-28T11:10:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/2123277680 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c700038c0 con 0x7f7c68003a00 2023-11-28T11:10:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2123277680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 msgr2=0x7f7c68003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c85cd6700 1 --2- 172.21.15.125:0/2123277680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 0x7f7c68003e10 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7c700017c0 tx=0x7f7c68005880 comp rx=0 tx=0).stop 2023-11-28T11:10:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2123277680 shutdown_connections 2023-11-28T11:10:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c85cd6700 1 --2- 172.21.15.125:0/2123277680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 0x7f7c68003e10 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2123277680 >> 172.21.15.125:0/2123277680 conn(0x7f7c8006c520 msgr2=0x7f7c8006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2123277680 shutdown_connections 2023-11-28T11:10:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.718+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2123277680 wait complete. 2023-11-28T11:10:22.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.720+0000 7f7c85cd6700 1 Processor -- start 2023-11-28T11:10:22.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.720+0000 7f7c85cd6700 1 -- start start 2023-11-28T11:10:22.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.720+0000 7f7c85cd6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 0x7f7c8015f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.720+0000 7f7c85cd6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c80152d70 0x7f7c8015d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.720+0000 7f7c85cd6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c800c8590 0x7f7c800c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.720+0000 7f7c85cd6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8015faf0 con 0x7f7c68003a00 2023-11-28T11:10:22.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.720+0000 7f7c85cd6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8015b730 con 0x7f7c80152d70 2023-11-28T11:10:22.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.720+0000 7f7c85cd6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8015db40 con 0x7f7c800c8590 2023-11-28T11:10:22.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c7f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 0x7f7c8015f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c7f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 0x7f7c8015f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59738/0 (socket says 172.21.15.125:59738) 2023-11-28T11:10:22.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c7f7fe700 1 -- 172.21.15.125:0/2516513318 learned_addr learned my addr 172.21.15.125:0/2516513318 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:22.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c7effd700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c80152d70 0x7f7c8015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c7ffff700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c800c8590 0x7f7c800c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c7f7fe700 1 -- 172.21.15.125:0/2516513318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c800c8590 msgr2=0x7f7c800c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c7f7fe700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c800c8590 0x7f7c800c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c7f7fe700 1 -- 172.21.15.125:0/2516513318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c80152d70 msgr2=0x7f7c8015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c7f7fe700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c80152d70 0x7f7c8015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c7f7fe700 1 -- 172.21.15.125:0/2516513318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800b1ec0 con 0x7f7c68003a00 2023-11-28T11:10:22.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c7f7fe700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 0x7f7c8015f5b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7c70015040 tx=0x7f7c70001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:22.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c67fff700 1 -- 172.21.15.125:0/2516513318 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70001290 con 0x7f7c68003a00 2023-11-28T11:10:22.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c67fff700 1 -- 172.21.15.125:0/2516513318 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7001d480 con 0x7f7c68003a00 2023-11-28T11:10:22.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c67fff700 1 -- 172.21.15.125:0/2516513318 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7001d810 con 0x7f7c68003a00 2023-11-28T11:10:22.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2516513318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8015cad0 con 0x7f7c68003a00 2023-11-28T11:10:22.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.721+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2516513318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c800b2050 con 0x7f7c68003a00 2023-11-28T11:10:22.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.722+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2516513318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8015dd50 con 0x7f7c68003a00 2023-11-28T11:10:22.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.722+0000 7f7c67fff700 1 -- 172.21.15.125:0/2516513318 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7c7002f070 con 0x7f7c68003a00 2023-11-28T11:10:22.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.723+0000 7f7c67fff700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c6c0682f0 0x7f7c6c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:22.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.723+0000 7f7c7effd700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c6c0682f0 0x7f7c6c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:22.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.723+0000 7f7c67fff700 1 -- 172.21.15.125:0/2516513318 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f7c70086990 con 0x7f7c68003a00 2023-11-28T11:10:22.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.723+0000 7f7c7effd700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c6c0682f0 0x7f7c6c06a7a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c8015d010 tx=0x7f7c74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:22.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.727+0000 7f7c67fff700 1 -- 172.21.15.125:0/2516513318 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7c700531d0 con 0x7f7c68003a00 2023-11-28T11:10:22.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.949+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2516513318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c800743f0 con 0x7f7c68003a00 2023-11-28T11:10:22.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.950+0000 7f7c67fff700 1 -- 172.21.15.125:0/2516513318 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f7c70017090 con 0x7f7c68003a00 2023-11-28T11:10:22.952 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:22.952 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1240521006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1240521006},{"type":"v1","addr":"172.21.15.167:6834","nonce":1240521006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2122606110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2122606110},{"type":"v1","addr":"172.21.15.167:6835","nonce":2122606110}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5280,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/888812458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":888812458},{"type":"v1","addr":"172.21.15.125:6835","nonce":888812458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:09:48.560821+0000","modified":"2023-11-28T11:09:51.580459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/2632892245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2632892245},{"type":"v1","addr":"172.21.15.125:6837","nonce":2632892245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:10:22.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2516513318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c6c0682f0 msgr2=0x7f7c6c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c6c0682f0 0x7f7c6c06a7a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c8015d010 tx=0x7f7c74009040 comp rx=0 tx=0).stop 2023-11-28T11:10:22.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2516513318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 msgr2=0x7f7c8015f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:22.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 0x7f7c8015f5b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7c70015040 tx=0x7f7c70001120 comp rx=0 tx=0).stop 2023-11-28T11:10:22.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2516513318 shutdown_connections 2023-11-28T11:10:22.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c6c0682f0 0x7f7c6c06a7a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c800c8590 0x7f7c800c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c68003a00 0x7f7c8015f5b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 --2- 172.21.15.125:0/2516513318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c80152d70 0x7f7c8015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:22.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2516513318 >> 172.21.15.125:0/2516513318 conn(0x7f7c8006c520 msgr2=0x7f7c800d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:22.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2516513318 shutdown_connections 2023-11-28T11:10:22.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:22.952+0000 7f7c85cd6700 1 -- 172.21.15.125:0/2516513318 wait complete. 2023-11-28T11:10:22.955 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 16 2023-11-28T11:10:22.965 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:10:23.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.084+0000 7f24f96e8700 1 Processor -- start 2023-11-28T11:10:23.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.084+0000 7f24f96e8700 1 -- start start 2023-11-28T11:10:23.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.085+0000 7f24f96e8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24f40ce040 0x7f24f415d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.085+0000 7f24f96e8700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f24f4142db0 0x7f24f413ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.085+0000 7f24f96e8700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f413fc90 con 0x7f24f40b1770 2023-11-28T11:10:23.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.085+0000 7f24f96e8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f413f6d0 con 0x7f24f40ce040 2023-11-28T11:10:23.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.085+0000 7f24f96e8700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f413f9b0 con 0x7f24f4142db0 2023-11-28T11:10:23.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.085+0000 7f24f2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24f40ce040 0x7f24f415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.085+0000 7f24f2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24f40ce040 0x7f24f415d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59746/0 (socket says 172.21.15.125:59746) 2023-11-28T11:10:23.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.085+0000 7f24f2ffd700 1 -- 172.21.15.125:0/2950880610 learned_addr learned my addr 172.21.15.125:0/2950880610 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:23.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.086+0000 7f24f27fc700 1 --2- 172.21.15.125:0/2950880610 >> v2:172.21.15.167:3300/0 conn(0x7f24f4142db0 0x7f24f413ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.086+0000 7f24f2ffd700 1 -- 172.21.15.125:0/2950880610 >> v2:172.21.15.167:3300/0 conn(0x7f24f4142db0 msgr2=0x7f24f413ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:23.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.086+0000 7f24f2ffd700 1 --2- 172.21.15.125:0/2950880610 >> v2:172.21.15.167:3300/0 conn(0x7f24f4142db0 0x7f24f413ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.086+0000 7f24f2ffd700 1 -- 172.21.15.125:0/2950880610 >> v1:172.21.15.167:6789/0 conn(0x7f24f40b1770 legacy=0x7f24f40b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:23.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.086+0000 7f24f2ffd700 1 -- 172.21.15.125:0/2950880610 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f415d100 con 0x7f24f40ce040 2023-11-28T11:10:23.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.086+0000 7f24f2ffd700 1 --2- 172.21.15.125:0/2950880610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24f40ce040 0x7f24f415d900 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f24f40cfc20 tx=0x7f24e800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa979f06e66c1cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:23.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.086+0000 7f24f1ffb700 1 -- 172.21.15.125:0/2950880610 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e800dcf0 con 0x7f24f40ce040 2023-11-28T11:10:23.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.086+0000 7f24f1ffb700 1 -- 172.21.15.125:0/2950880610 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e800de50 con 0x7f24f40ce040 2023-11-28T11:10:23.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.086+0000 7f24f1ffb700 1 -- 172.21.15.125:0/2950880610 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8004250 con 0x7f24f40ce040 2023-11-28T11:10:23.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.086+0000 7f24f96e8700 1 -- 172.21.15.125:0/2950880610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24f40ce040 msgr2=0x7f24f415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.086+0000 7f24f96e8700 1 --2- 172.21.15.125:0/2950880610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24f40ce040 0x7f24f415d900 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f24f40cfc20 tx=0x7f24e800be70 comp rx=0 tx=0).stop 2023-11-28T11:10:23.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.087+0000 7f24f96e8700 1 -- 172.21.15.125:0/2950880610 shutdown_connections 2023-11-28T11:10:23.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.087+0000 7f24f96e8700 1 --2- 172.21.15.125:0/2950880610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24f40ce040 0x7f24f415d900 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.087+0000 7f24f96e8700 1 --2- 172.21.15.125:0/2950880610 >> v2:172.21.15.167:3300/0 conn(0x7f24f4142db0 0x7f24f413ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.087+0000 7f24f96e8700 1 -- 172.21.15.125:0/2950880610 >> 172.21.15.125:0/2950880610 conn(0x7f24f406c010 msgr2=0x7f24f40cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:23.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.087+0000 7f24f96e8700 1 -- 172.21.15.125:0/2950880610 shutdown_connections 2023-11-28T11:10:23.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.087+0000 7f24f96e8700 1 -- 172.21.15.125:0/2950880610 wait complete. 2023-11-28T11:10:23.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.088+0000 7f24f96e8700 1 Processor -- start 2023-11-28T11:10:23.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.088+0000 7f24f96e8700 1 -- start start 2023-11-28T11:10:23.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f96e8700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24f40b1770 0x7f24f4157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f96e8700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24f40ce040 0x7f24f40b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f96e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24f4142db0 0x7f24f41e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f96e8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40b4920 con 0x7f24f4142db0 2023-11-28T11:10:23.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f96e8700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40b3a70 con 0x7f24f40b1770 2023-11-28T11:10:23.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f96e8700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40b3d10 con 0x7f24f40ce040 2023-11-28T11:10:23.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24f4142db0 0x7f24f41e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24f4142db0 0x7f24f41e41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59756/0 (socket says 172.21.15.125:59756) 2023-11-28T11:10:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f37fe700 1 -- 172.21.15.125:0/1742275448 learned_addr learned my addr 172.21.15.125:0/1742275448 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f2ffd700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24f40b1770 0x7f24f4157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f27fc700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24f40ce040 0x7f24f40b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f37fe700 1 -- 172.21.15.125:0/1742275448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24f40ce040 msgr2=0x7f24f40b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f37fe700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24f40ce040 0x7f24f40b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f37fe700 1 -- 172.21.15.125:0/1742275448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24f40b1770 msgr2=0x7f24f4157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f37fe700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24f40b1770 0x7f24f4157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f37fe700 1 -- 172.21.15.125:0/1742275448 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e800b7f0 con 0x7f24f4142db0 2023-11-28T11:10:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f37fe700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24f4142db0 0x7f24f41e41e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00b970 tx=0x7f24ec00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:23.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24db7fe700 1 -- 172.21.15.125:0/1742275448 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00d860 con 0x7f24f4142db0 2023-11-28T11:10:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24db7fe700 1 -- 172.21.15.125:0/1742275448 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec00d9c0 con 0x7f24f4142db0 2023-11-28T11:10:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f96e8700 1 -- 172.21.15.125:0/1742275448 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f40ce410 con 0x7f24f4142db0 2023-11-28T11:10:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24db7fe700 1 -- 172.21.15.125:0/1742275448 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00dd70 con 0x7f24f4142db0 2023-11-28T11:10:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.089+0000 7f24f96e8700 1 -- 172.21.15.125:0/1742275448 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f415d3e0 con 0x7f24f4142db0 2023-11-28T11:10:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.090+0000 7f24f96e8700 1 -- 172.21.15.125:0/1742275448 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f40ce5a0 con 0x7f24f4142db0 2023-11-28T11:10:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.091+0000 7f24db7fe700 1 -- 172.21.15.125:0/1742275448 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f24ec00e430 con 0x7f24f4142db0 2023-11-28T11:10:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.091+0000 7f24db7fe700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24e00682f0 0x7f24e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.091+0000 7f24db7fe700 1 -- 172.21.15.125:0/1742275448 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f24ec085f30 con 0x7f24f4142db0 2023-11-28T11:10:23.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.091+0000 7f24f2ffd700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24e00682f0 0x7f24e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.092+0000 7f24f2ffd700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24e00682f0 0x7f24e006a7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24e800b340 tx=0x7f24e801d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:23.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.096+0000 7f24db7fe700 1 -- 172.21.15.125:0/1742275448 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f24ec052710 con 0x7f24f4142db0 2023-11-28T11:10:23.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.281+0000 7f24f96e8700 1 -- 172.21.15.125:0/1742275448 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24f40743f0 con 0x7f24f4142db0 2023-11-28T11:10:23.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.282+0000 7f24db7fe700 1 -- 172.21.15.125:0/1742275448 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18076 (secure 0 0 0) 0x7f24ec055d30 con 0x7f24f4142db0 2023-11-28T11:10:23.284 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:23.284 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":40,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:10:19.968658+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:09:46.832058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T11:09:47.518555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.30","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:10:23.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.284+0000 7f24f96e8700 1 -- 172.21.15.125:0/1742275448 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24e00682f0 msgr2=0x7f24e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.284+0000 7f24f96e8700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24e00682f0 0x7f24e006a7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24e800b340 tx=0x7f24e801d040 comp rx=0 tx=0).stop 2023-11-28T11:10:23.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.284+0000 7f24f96e8700 1 -- 172.21.15.125:0/1742275448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24f4142db0 msgr2=0x7f24f41e41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.284+0000 7f24f96e8700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24f4142db0 0x7f24f41e41e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00b970 tx=0x7f24ec00bc80 comp rx=0 tx=0).stop 2023-11-28T11:10:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.284+0000 7f24f96e8700 1 -- 172.21.15.125:0/1742275448 shutdown_connections 2023-11-28T11:10:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.284+0000 7f24f96e8700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24f4142db0 0x7f24f41e41e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.284+0000 7f24f96e8700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24f40b1770 0x7f24f4157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.284+0000 7f24f96e8700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f24e00682f0 0x7f24e006a7a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.284+0000 7f24f96e8700 1 --2- 172.21.15.125:0/1742275448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24f40ce040 0x7f24f40b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.284+0000 7f24f96e8700 1 -- 172.21.15.125:0/1742275448 >> 172.21.15.125:0/1742275448 conn(0x7f24f406c010 msgr2=0x7f24f4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.284+0000 7f24f96e8700 1 -- 172.21.15.125:0/1742275448 shutdown_connections 2023-11-28T11:10:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.285+0000 7f24f96e8700 1 -- 172.21.15.125:0/1742275448 wait complete. 2023-11-28T11:10:23.298 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:10:23.298 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:10:23.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.416+0000 7f52a7b33700 1 Processor -- start 2023-11-28T11:10:23.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.416+0000 7f52a7b33700 1 -- start start 2023-11-28T11:10:23.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.417+0000 7f52a7b33700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52a0158cd0 0x7f52a00c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.417+0000 7f52a7b33700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52a00cd1c0 0x7f52a00cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.417+0000 7f52a7b33700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52a00ce0c0 0x7f52a015c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.417+0000 7f52a7b33700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a01590a0 con 0x7f52a00cd1c0 2023-11-28T11:10:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.417+0000 7f52a7b33700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a00718e0 con 0x7f52a00ce0c0 2023-11-28T11:10:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.417+0000 7f52a7b33700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a00ce500 con 0x7f52a0158cd0 2023-11-28T11:10:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.417+0000 7f52a50ce700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52a00cd1c0 0x7f52a00cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.417+0000 7f52a50ce700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52a00cd1c0 0x7f52a00cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59762/0 (socket says 172.21.15.125:59762) 2023-11-28T11:10:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.417+0000 7f52a50ce700 1 -- 172.21.15.125:0/3622073911 learned_addr learned my addr 172.21.15.125:0/3622073911 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a60d0700 1 --2- 172.21.15.125:0/3622073911 >> v2:172.21.15.167:3300/0 conn(0x7f52a00ce0c0 0x7f52a015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a58cf700 1 --2- 172.21.15.125:0/3622073911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52a0158cd0 0x7f52a00c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a50ce700 1 -- 172.21.15.125:0/3622073911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52a0158cd0 msgr2=0x7f52a00c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a50ce700 1 --2- 172.21.15.125:0/3622073911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52a0158cd0 0x7f52a00c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a50ce700 1 -- 172.21.15.125:0/3622073911 >> v2:172.21.15.167:3300/0 conn(0x7f52a00ce0c0 msgr2=0x7f52a015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a50ce700 1 --2- 172.21.15.125:0/3622073911 >> v2:172.21.15.167:3300/0 conn(0x7f52a00ce0c0 0x7f52a015c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a50ce700 1 -- 172.21.15.125:0/3622073911 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a006be90 con 0x7f52a00cd1c0 2023-11-28T11:10:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a50ce700 1 --2- 172.21.15.125:0/3622073911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a00cd1c0 0x7f52a00cdb80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f52a006f130 tx=0x7f529c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630ef13747c28cc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a48cd700 1 -- 172.21.15.125:0/3622073911 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00b870 con 0x7f52a00cd1c0 2023-11-28T11:10:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a48cd700 1 -- 172.21.15.125:0/3622073911 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c00b9d0 con 0x7f52a00cd1c0 2023-11-28T11:10:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a48cd700 1 -- 172.21.15.125:0/3622073911 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00bd60 con 0x7f52a00cd1c0 2023-11-28T11:10:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a7b33700 1 -- 172.21.15.125:0/3622073911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a00cd1c0 msgr2=0x7f52a00cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a7b33700 1 --2- 172.21.15.125:0/3622073911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a00cd1c0 0x7f52a00cdb80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f52a006f130 tx=0x7f529c009bd0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a7b33700 1 -- 172.21.15.125:0/3622073911 shutdown_connections 2023-11-28T11:10:23.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a7b33700 1 --2- 172.21.15.125:0/3622073911 >> v2:172.21.15.167:3300/0 conn(0x7f52a00ce0c0 0x7f52a015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a7b33700 1 --2- 172.21.15.125:0/3622073911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52a0158cd0 0x7f52a00c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a7b33700 1 --2- 172.21.15.125:0/3622073911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a00cd1c0 0x7f52a00cdb80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.418+0000 7f52a7b33700 1 -- 172.21.15.125:0/3622073911 >> 172.21.15.125:0/3622073911 conn(0x7f52a00cb660 msgr2=0x7f52a00cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:23.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.419+0000 7f52a7b33700 1 -- 172.21.15.125:0/3622073911 shutdown_connections 2023-11-28T11:10:23.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.419+0000 7f52a7b33700 1 -- 172.21.15.125:0/3622073911 wait complete. 2023-11-28T11:10:23.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.420+0000 7f52a7b33700 1 Processor -- start 2023-11-28T11:10:23.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.420+0000 7f52a7b33700 1 -- start start 2023-11-28T11:10:23.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.420+0000 7f52a7b33700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a00cd1c0 0x7f52a0142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.420+0000 7f52a7b33700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52a00ce0c0 0x7f52a00b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.420+0000 7f52a7b33700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52a0158cd0 0x7f52a00b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.420+0000 7f52a7b33700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a00c2a40 con 0x7f52a00cd1c0 2023-11-28T11:10:23.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.420+0000 7f52a7b33700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0147a00 con 0x7f52a00ce0c0 2023-11-28T11:10:23.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.420+0000 7f52a7b33700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0146df0 con 0x7f52a0158cd0 2023-11-28T11:10:23.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a58cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a00cd1c0 0x7f52a0142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a58cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a00cd1c0 0x7f52a0142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59766/0 (socket says 172.21.15.125:59766) 2023-11-28T11:10:23.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a58cf700 1 -- 172.21.15.125:0/528585612 learned_addr learned my addr 172.21.15.125:0/528585612 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:23.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a50ce700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52a00ce0c0 0x7f52a00b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a60d0700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52a0158cd0 0x7f52a00b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a58cf700 1 -- 172.21.15.125:0/528585612 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52a0158cd0 msgr2=0x7f52a00b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a58cf700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52a0158cd0 0x7f52a00b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a58cf700 1 -- 172.21.15.125:0/528585612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52a00ce0c0 msgr2=0x7f52a00b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a58cf700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52a00ce0c0 0x7f52a00b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a58cf700 1 -- 172.21.15.125:0/528585612 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c009550 con 0x7f52a00cd1c0 2023-11-28T11:10:23.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a60d0700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52a0158cd0 0x7f52a00b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:23.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a58cf700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a00cd1c0 0x7f52a0142b90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f529000e810 tx=0x7f529000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:23.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52967fc700 1 -- 172.21.15.125:0/528585612 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290013610 con 0x7f52a00cd1c0 2023-11-28T11:10:23.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52967fc700 1 -- 172.21.15.125:0/528585612 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5290013770 con 0x7f52a00cd1c0 2023-11-28T11:10:23.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a7b33700 1 -- 172.21.15.125:0/528585612 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a00cb010 con 0x7f52a00cd1c0 2023-11-28T11:10:23.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52967fc700 1 -- 172.21.15.125:0/528585612 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290013b20 con 0x7f52a00cd1c0 2023-11-28T11:10:23.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.421+0000 7f52a7b33700 1 -- 172.21.15.125:0/528585612 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a00cad30 con 0x7f52a00cd1c0 2023-11-28T11:10:23.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.422+0000 7f52a7b33700 1 -- 172.21.15.125:0/528585612 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a00cb2f0 con 0x7f52a00cd1c0 2023-11-28T11:10:23.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.423+0000 7f52967fc700 1 -- 172.21.15.125:0/528585612 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5290023070 con 0x7f52a00cd1c0 2023-11-28T11:10:23.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.423+0000 7f52967fc700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52840682f0 0x7f528406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.423+0000 7f52967fc700 1 -- 172.21.15.125:0/528585612 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f5290085970 con 0x7f52a00cd1c0 2023-11-28T11:10:23.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.423+0000 7f52a50ce700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52840682f0 0x7f528406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.423+0000 7f52a50ce700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52840682f0 0x7f528406a7a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f529c014040 tx=0x7f529c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:23.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.427+0000 7f52967fc700 1 -- 172.21.15.125:0/528585612 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5290052130 con 0x7f52a00cd1c0 2023-11-28T11:10:23.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.653+0000 7f52a7b33700 1 -- 172.21.15.125:0/528585612 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52a00b06b0 con 0x7f52a00cd1c0 2023-11-28T11:10:23.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.653+0000 7f52967fc700 1 -- 172.21.15.125:0/528585612 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f5290055750 con 0x7f52a00cd1c0 2023-11-28T11:10:23.656 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:23.656 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1240521006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1240521006},{"type":"v1","addr":"172.21.15.167:6834","nonce":1240521006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2122606110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2122606110},{"type":"v1","addr":"172.21.15.167:6835","nonce":2122606110}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5280,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/888812458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":888812458},{"type":"v1","addr":"172.21.15.125:6835","nonce":888812458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:09:48.560821+0000","modified":"2023-11-28T11:09:51.580459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/2632892245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2632892245},{"type":"v1","addr":"172.21.15.125:6837","nonce":2632892245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:10:23.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.655+0000 7f52a7b33700 1 -- 172.21.15.125:0/528585612 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52840682f0 msgr2=0x7f528406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.655+0000 7f52a7b33700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52840682f0 0x7f528406a7a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f529c014040 tx=0x7f529c008030 comp rx=0 tx=0).stop 2023-11-28T11:10:23.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.655+0000 7f52a7b33700 1 -- 172.21.15.125:0/528585612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a00cd1c0 msgr2=0x7f52a0142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.655+0000 7f52a7b33700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a00cd1c0 0x7f52a0142b90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f529000e810 tx=0x7f529000ebd0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.655+0000 7f52a7b33700 1 -- 172.21.15.125:0/528585612 shutdown_connections 2023-11-28T11:10:23.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.655+0000 7f52a7b33700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52840682f0 0x7f528406a7a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.655+0000 7f52a7b33700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52a0158cd0 0x7f52a00b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.655+0000 7f52a7b33700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52a00cd1c0 0x7f52a0142b90 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.655+0000 7f52a7b33700 1 --2- 172.21.15.125:0/528585612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52a00ce0c0 0x7f52a00b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.655+0000 7f52a7b33700 1 -- 172.21.15.125:0/528585612 >> 172.21.15.125:0/528585612 conn(0x7f52a00cb660 msgr2=0x7f52a006c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:23.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.655+0000 7f52a7b33700 1 -- 172.21.15.125:0/528585612 shutdown_connections 2023-11-28T11:10:23.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.656+0000 7f52a7b33700 1 -- 172.21.15.125:0/528585612 wait complete. 2023-11-28T11:10:23.660 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 16 2023-11-28T11:10:23.669 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:10:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.787+0000 7feb0c5c5700 1 Processor -- start 2023-11-28T11:10:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.787+0000 7feb0c5c5700 1 -- start start 2023-11-28T11:10:23.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0c5c5700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feb0406a270 0x7feb04071f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0c5c5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb040ac420 0x7feb040ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0c5c5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb040af0c0 con 0x7feb040ae520 2023-11-28T11:10:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0c5c5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb040b0590 con 0x7feb040ac420 2023-11-28T11:10:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0c5c5700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb04159280 con 0x7feb0406a270 2023-11-28T11:10:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0ab62700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feb040ac420 0x7feb040ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb09b60700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7feb040ae520 0x7feb0406a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43898/0 (socket says 172.21.15.125:43898) 2023-11-28T11:10:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb09b60700 1 -- 172.21.15.125:0/961939143 learned_addr learned my addr 172.21.15.125:0/961939143 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0a361700 1 --2- 172.21.15.125:0/961939143 >> v2:172.21.15.167:3300/0 conn(0x7feb0406a270 0x7feb04071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0ab62700 1 -- 172.21.15.125:0/961939143 >> v2:172.21.15.167:3300/0 conn(0x7feb0406a270 msgr2=0x7feb04071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0ab62700 1 --2- 172.21.15.125:0/961939143 >> v2:172.21.15.167:3300/0 conn(0x7feb0406a270 0x7feb04071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0ab62700 1 -- 172.21.15.125:0/961939143 >> v1:172.21.15.125:6789/0 conn(0x7feb040ae520 legacy=0x7feb0406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0ab62700 1 -- 172.21.15.125:0/961939143 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb040b0d10 con 0x7feb040ac420 2023-11-28T11:10:23.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0935f700 1 -- 172.21.15.125:0/961939143 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034251918 0 0) 0x7feb040af0c0 con 0x7feb040ae520 2023-11-28T11:10:23.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0ab62700 1 --2- 172.21.15.125:0/961939143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb040ac420 0x7feb040ac8a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feb040aec70 tx=0x7feafc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c770bd3e578af32 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:23.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0935f700 1 -- 172.21.15.125:0/961939143 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc00e070 con 0x7feb040ac420 2023-11-28T11:10:23.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0935f700 1 -- 172.21.15.125:0/961939143 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc00bbd0 con 0x7feb040ac420 2023-11-28T11:10:23.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.788+0000 7feb0935f700 1 -- 172.21.15.125:0/961939143 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc012430 con 0x7feb040ac420 2023-11-28T11:10:23.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.789+0000 7feb0c5c5700 1 -- 172.21.15.125:0/961939143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb040ac420 msgr2=0x7feb040ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.789+0000 7feb0c5c5700 1 --2- 172.21.15.125:0/961939143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb040ac420 0x7feb040ac8a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feb040aec70 tx=0x7feafc00b330 comp rx=0 tx=0).stop 2023-11-28T11:10:23.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.789+0000 7feb0c5c5700 1 -- 172.21.15.125:0/961939143 shutdown_connections 2023-11-28T11:10:23.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.789+0000 7feb0c5c5700 1 --2- 172.21.15.125:0/961939143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb040ac420 0x7feb040ac8a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.789+0000 7feb0c5c5700 1 --2- 172.21.15.125:0/961939143 >> v2:172.21.15.167:3300/0 conn(0x7feb0406a270 0x7feb04071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.789+0000 7feb0c5c5700 1 -- 172.21.15.125:0/961939143 >> 172.21.15.125:0/961939143 conn(0x7feb040b2fc0 msgr2=0x7feb04071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.789+0000 7feb0c5c5700 1 -- 172.21.15.125:0/961939143 shutdown_connections 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.789+0000 7feb0c5c5700 1 -- 172.21.15.125:0/961939143 wait complete. 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.790+0000 7feb0c5c5700 1 Processor -- start 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.790+0000 7feb0c5c5700 1 -- start start 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0c5c5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb0406a270 0x7feb040c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0c5c5700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb040ac420 0x7feb04098520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0c5c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb040ae520 0x7feb040cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0c5c5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb04098a60 con 0x7feb040ae520 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0c5c5700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040c40d0 con 0x7feb040ac420 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0c5c5700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb040c43b0 con 0x7feb0406a270 2023-11-28T11:10:23.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0ab62700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb040ae520 0x7feb040cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0ab62700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb040ae520 0x7feb040cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59784/0 (socket says 172.21.15.125:59784) 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0ab62700 1 -- 172.21.15.125:0/3829459502 learned_addr learned my addr 172.21.15.125:0/3829459502 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0a361700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb0406a270 0x7feb040c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb09b60700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb040ac420 0x7feb04098520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0ab62700 1 -- 172.21.15.125:0/3829459502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb0406a270 msgr2=0x7feb040c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0ab62700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb0406a270 0x7feb040c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0ab62700 1 -- 172.21.15.125:0/3829459502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb040ac420 msgr2=0x7feb04098520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0ab62700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb040ac420 0x7feb04098520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.791+0000 7feb0ab62700 1 -- 172.21.15.125:0/3829459502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc009a70 con 0x7feb040ae520 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.792+0000 7feb0ab62700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb040ae520 0x7feb040cbf00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feb04073cc0 tx=0x7feafc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.792+0000 7feafaffd700 1 -- 172.21.15.125:0/3829459502 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc012430 con 0x7feb040ae520 2023-11-28T11:10:23.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.792+0000 7feafaffd700 1 -- 172.21.15.125:0/3829459502 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc020070 con 0x7feb040ae520 2023-11-28T11:10:23.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.792+0000 7feb0c5c5700 1 -- 172.21.15.125:0/3829459502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb040afc60 con 0x7feb040ae520 2023-11-28T11:10:23.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.792+0000 7feafaffd700 1 -- 172.21.15.125:0/3829459502 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc004280 con 0x7feb040ae520 2023-11-28T11:10:23.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.792+0000 7feb0c5c5700 1 -- 172.21.15.125:0/3829459502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb04072670 con 0x7feb040ae520 2023-11-28T11:10:23.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.793+0000 7feb0c5c5700 1 -- 172.21.15.125:0/3829459502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb040aff40 con 0x7feb040ae520 2023-11-28T11:10:23.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.793+0000 7feafaffd700 1 -- 172.21.15.125:0/3829459502 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7feafc0043e0 con 0x7feb040ae520 2023-11-28T11:10:23.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.794+0000 7feafaffd700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feae80682f0 0x7feae806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:23.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.794+0000 7feafaffd700 1 -- 172.21.15.125:0/3829459502 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7feafc022070 con 0x7feb040ae520 2023-11-28T11:10:23.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.794+0000 7feb0a361700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feae80682f0 0x7feae806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:23.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.794+0000 7feb0a361700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feae80682f0 0x7feae806a7a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feb00006b20 tx=0x7feb00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:23.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:23.798+0000 7feafaffd700 1 -- 172.21.15.125:0/3829459502 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7feafc054b30 con 0x7feb040ae520 2023-11-28T11:10:24.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.026+0000 7feb0c5c5700 1 -- 172.21.15.125:0/3829459502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb0406f9f0 con 0x7feb040ae520 2023-11-28T11:10:24.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.026+0000 7feafaffd700 1 -- 172.21.15.125:0/3829459502 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4657 (secure 0 0 0) 0x7feafc025380 con 0x7feb040ae520 2023-11-28T11:10:24.028 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:24.028 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1240521006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1240521006},{"type":"v1","addr":"172.21.15.167:6834","nonce":1240521006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2122606110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2122606110},{"type":"v1","addr":"172.21.15.167:6835","nonce":2122606110}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5280,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/888812458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":888812458},{"type":"v1","addr":"172.21.15.125:6835","nonce":888812458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:09:48.560821+0000","modified":"2023-11-28T11:09:51.580459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/2632892245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2632892245},{"type":"v1","addr":"172.21.15.125:6837","nonce":2632892245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:10:24.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.028+0000 7feb0c5c5700 1 -- 172.21.15.125:0/3829459502 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feae80682f0 msgr2=0x7feae806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.028+0000 7feb0c5c5700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feae80682f0 0x7feae806a7a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feb00006b20 tx=0x7feb00008040 comp rx=0 tx=0).stop 2023-11-28T11:10:24.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.029+0000 7feb0c5c5700 1 -- 172.21.15.125:0/3829459502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb040ae520 msgr2=0x7feb040cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.029+0000 7feb0c5c5700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb040ae520 0x7feb040cbf00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feb04073cc0 tx=0x7feafc004ad0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.029+0000 7feb0c5c5700 1 -- 172.21.15.125:0/3829459502 shutdown_connections 2023-11-28T11:10:24.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.029+0000 7feb0c5c5700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb040ae520 0x7feb040cbf00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.029+0000 7feb0c5c5700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7feae80682f0 0x7feae806a7a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.029+0000 7feb0c5c5700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb0406a270 0x7feb040c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.029+0000 7feb0c5c5700 1 --2- 172.21.15.125:0/3829459502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb040ac420 0x7feb04098520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.029+0000 7feb0c5c5700 1 -- 172.21.15.125:0/3829459502 >> 172.21.15.125:0/3829459502 conn(0x7feb040b2fc0 msgr2=0x7feb040adb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:24.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.029+0000 7feb0c5c5700 1 -- 172.21.15.125:0/3829459502 shutdown_connections 2023-11-28T11:10:24.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.029+0000 7feb0c5c5700 1 -- 172.21.15.125:0/3829459502 wait complete. 2023-11-28T11:10:24.032 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 16 2023-11-28T11:10:24.042 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:10:24.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.160+0000 7f894b65c700 1 Processor -- start 2023-11-28T11:10:24.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.161+0000 7f894b65c700 1 -- start start 2023-11-28T11:10:24.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.161+0000 7f894b65c700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f894406ab10 0x7f894406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.161+0000 7f894b65c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89440cd5a0 0x7f8944160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.161+0000 7f894b65c700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89440d1ee0 con 0x7f89440b22a0 2023-11-28T11:10:24.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.161+0000 7f894b65c700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894406b420 con 0x7f894406ab10 2023-11-28T11:10:24.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.161+0000 7f894b65c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440cdb10 con 0x7f89440cd5a0 2023-11-28T11:10:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.162+0000 7f8948bf7700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89440cd5a0 0x7f8944160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.162+0000 7f89493f8700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f894406ab10 0x7f894406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.162+0000 7f89493f8700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f894406ab10 0x7f894406aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:56518/0 (socket says 172.21.15.125:56518) 2023-11-28T11:10:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.162+0000 7f89493f8700 1 -- 172.21.15.125:0/626530660 learned_addr learned my addr 172.21.15.125:0/626530660 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.162+0000 7f89493f8700 1 -- 172.21.15.125:0/626530660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89440cd5a0 msgr2=0x7f8944160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:24.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.162+0000 7f89493f8700 1 --2- 172.21.15.125:0/626530660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89440cd5a0 0x7f8944160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.162+0000 7f89493f8700 1 -- 172.21.15.125:0/626530660 >> v1:172.21.15.167:6789/0 conn(0x7f89440b22a0 legacy=0x7f8944160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.162+0000 7f89493f8700 1 -- 172.21.15.125:0/626530660 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440d1890 con 0x7f894406ab10 2023-11-28T11:10:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.162+0000 7f893bfff700 1 -- 172.21.15.125:0/626530660 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004996375 0 0) 0x7f89440d1ee0 con 0x7f89440b22a0 2023-11-28T11:10:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.162+0000 7f89493f8700 1 --2- 172.21.15.125:0/626530660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f894406ab10 0x7f894406aee0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89340098f0 tx=0x7f8934009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e04aa0e906142f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.163+0000 7f893bfff700 1 -- 172.21.15.125:0/626530660 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934011830 con 0x7f894406ab10 2023-11-28T11:10:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.163+0000 7f893bfff700 1 -- 172.21.15.125:0/626530660 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8934011990 con 0x7f894406ab10 2023-11-28T11:10:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.163+0000 7f893bfff700 1 -- 172.21.15.125:0/626530660 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934011d20 con 0x7f894406ab10 2023-11-28T11:10:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.163+0000 7f894b65c700 1 -- 172.21.15.125:0/626530660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f894406ab10 msgr2=0x7f894406aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.163+0000 7f894b65c700 1 --2- 172.21.15.125:0/626530660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f894406ab10 0x7f894406aee0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89340098f0 tx=0x7f8934009c00 comp rx=0 tx=0).stop 2023-11-28T11:10:24.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.163+0000 7f894b65c700 1 -- 172.21.15.125:0/626530660 shutdown_connections 2023-11-28T11:10:24.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.163+0000 7f894b65c700 1 --2- 172.21.15.125:0/626530660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f894406ab10 0x7f894406aee0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.163+0000 7f894b65c700 1 --2- 172.21.15.125:0/626530660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89440cd5a0 0x7f8944160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.163+0000 7f894b65c700 1 -- 172.21.15.125:0/626530660 >> 172.21.15.125:0/626530660 conn(0x7f894406c520 msgr2=0x7f894406c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:24.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.163+0000 7f894b65c700 1 -- 172.21.15.125:0/626530660 shutdown_connections 2023-11-28T11:10:24.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.163+0000 7f894b65c700 1 -- 172.21.15.125:0/626530660 wait complete. 2023-11-28T11:10:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.165+0000 7f894b65c700 1 Processor -- start 2023-11-28T11:10:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.165+0000 7f894b65c700 1 -- start start 2023-11-28T11:10:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.165+0000 7f894b65c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f894406ab10 0x7f89441552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.165+0000 7f894b65c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89440b22a0 0x7f89440c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.165+0000 7f894b65c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89440cd5a0 0x7f89441483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.165+0000 7f894b65c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8944148910 con 0x7f894406ab10 2023-11-28T11:10:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.165+0000 7f894b65c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440c8320 con 0x7f89440b22a0 2023-11-28T11:10:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.165+0000 7f894b65c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440c8600 con 0x7f89440cd5a0 2023-11-28T11:10:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.165+0000 7f89493f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f894406ab10 0x7f89441552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f89493f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f894406ab10 0x7f89441552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59792/0 (socket says 172.21.15.125:59792) 2023-11-28T11:10:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f89493f8700 1 -- 172.21.15.125:0/1413717685 learned_addr learned my addr 172.21.15.125:0/1413717685 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f8948bf7700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89440b22a0 0x7f89440c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f8949bf9700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89440cd5a0 0x7f89441483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f89493f8700 1 -- 172.21.15.125:0/1413717685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89440cd5a0 msgr2=0x7f89441483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f89493f8700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89440cd5a0 0x7f89441483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f89493f8700 1 -- 172.21.15.125:0/1413717685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89440b22a0 msgr2=0x7f89440c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f89493f8700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89440b22a0 0x7f89440c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f89493f8700 1 -- 172.21.15.125:0/1413717685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8934009550 con 0x7f894406ab10 2023-11-28T11:10:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f8948bf7700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89440b22a0 0x7f89440c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f89493f8700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f894406ab10 0x7f89441552f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8934014040 tx=0x7f8934004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f8939ffb700 1 -- 172.21.15.125:0/1413717685 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89340036a0 con 0x7f894406ab10 2023-11-28T11:10:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f8939ffb700 1 -- 172.21.15.125:0/1413717685 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893401e070 con 0x7f894406ab10 2023-11-28T11:10:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f894b65c700 1 -- 172.21.15.125:0/1413717685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894415cad0 con 0x7f894406ab10 2023-11-28T11:10:24.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f8939ffb700 1 -- 172.21.15.125:0/1413717685 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934003a20 con 0x7f894406ab10 2023-11-28T11:10:24.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.166+0000 7f894b65c700 1 -- 172.21.15.125:0/1413717685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89440d1b70 con 0x7f894406ab10 2023-11-28T11:10:24.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.167+0000 7f894b65c700 1 -- 172.21.15.125:0/1413717685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89440b1ec0 con 0x7f894406ab10 2023-11-28T11:10:24.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.168+0000 7f8939ffb700 1 -- 172.21.15.125:0/1413717685 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f893400f050 con 0x7f894406ab10 2023-11-28T11:10:24.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.168+0000 7f8939ffb700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f89280682f0 0x7f892806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.168+0000 7f8939ffb700 1 -- 172.21.15.125:0/1413717685 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f8934086d00 con 0x7f894406ab10 2023-11-28T11:10:24.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.168+0000 7f8948bf7700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f89280682f0 0x7f892806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.169+0000 7f8948bf7700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f89280682f0 0x7f892806a7a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f894415c4e0 tx=0x7f8940008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:24.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.172+0000 7f8939ffb700 1 -- 172.21.15.125:0/1413717685 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f893408a030 con 0x7f894406ab10 2023-11-28T11:10:24.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.355+0000 7f894b65c700 1 -- 172.21.15.125:0/1413717685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89440743f0 con 0x7f894406ab10 2023-11-28T11:10:24.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.356+0000 7f8939ffb700 1 -- 172.21.15.125:0/1413717685 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18076 (secure 0 0 0) 0x7f8934020020 con 0x7f894406ab10 2023-11-28T11:10:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:24.358 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":40,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:10:19.968658+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:09:46.832058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T11:09:47.518555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.30","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:10:24.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 -- 172.21.15.125:0/1413717685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f89280682f0 msgr2=0x7f892806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f89280682f0 0x7f892806a7a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f894415c4e0 tx=0x7f8940008040 comp rx=0 tx=0).stop 2023-11-28T11:10:24.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 -- 172.21.15.125:0/1413717685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f894406ab10 msgr2=0x7f89441552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f894406ab10 0x7f89441552f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8934014040 tx=0x7f8934004750 comp rx=0 tx=0).stop 2023-11-28T11:10:24.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 -- 172.21.15.125:0/1413717685 shutdown_connections 2023-11-28T11:10:24.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f89280682f0 0x7f892806a7a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89440cd5a0 0x7f89441483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f894406ab10 0x7f89441552f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 --2- 172.21.15.125:0/1413717685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89440b22a0 0x7f89440c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 -- 172.21.15.125:0/1413717685 >> 172.21.15.125:0/1413717685 conn(0x7f894406c520 msgr2=0x7f89440d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:24.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 -- 172.21.15.125:0/1413717685 shutdown_connections 2023-11-28T11:10:24.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.359+0000 7f894b65c700 1 -- 172.21.15.125:0/1413717685 wait complete. 2023-11-28T11:10:24.372 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T11:10:24.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.491+0000 7f507dd3c700 1 Processor -- start 2023-11-28T11:10:24.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.491+0000 7f507dd3c700 1 -- start start 2023-11-28T11:10:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.491+0000 7f507dd3c700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f50780cf710 0x7f50780ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.491+0000 7f507dd3c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5078071890 0x7f5078071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.491+0000 7f507dd3c700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507815cc10 con 0x7f507806a270 2023-11-28T11:10:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.491+0000 7f507dd3c700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507806c9b0 con 0x7f50780cf710 2023-11-28T11:10:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.491+0000 7f507dd3c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507806cc90 con 0x7f5078071890 2023-11-28T11:10:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.492+0000 7f50777fe700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f50780cf710 0x7f50780ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.492+0000 7f5076ffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5078071890 0x7f5078071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.492+0000 7f5077fff700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f507806a270 0x7f50780b1650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:46728/0 (socket says 172.21.15.125:46728) 2023-11-28T11:10:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.492+0000 7f5077fff700 1 -- 172.21.15.125:0/927697003 learned_addr learned my addr 172.21.15.125:0/927697003 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.492+0000 7f50777fe700 1 -- 172.21.15.125:0/927697003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5078071890 msgr2=0x7f5078071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.492+0000 7f50777fe700 1 --2- 172.21.15.125:0/927697003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5078071890 0x7f5078071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.492+0000 7f50777fe700 1 -- 172.21.15.125:0/927697003 >> v1:172.21.15.167:6789/0 conn(0x7f507806a270 legacy=0x7f50780b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.492+0000 7f50777fe700 1 -- 172.21.15.125:0/927697003 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507806cf70 con 0x7f50780cf710 2023-11-28T11:10:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.492+0000 7f50767fc700 1 -- 172.21.15.125:0/927697003 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434450061 0 0) 0x7f507815cc10 con 0x7f507806a270 2023-11-28T11:10:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.492+0000 7f50777fe700 1 --2- 172.21.15.125:0/927697003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50780cf710 0x7f50780ce740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5068009840 tx=0x7f5068009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22287e9118796f40 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.493+0000 7f50767fc700 1 -- 172.21.15.125:0/927697003 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068011830 con 0x7f50780cf710 2023-11-28T11:10:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.493+0000 7f50767fc700 1 -- 172.21.15.125:0/927697003 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068011990 con 0x7f50780cf710 2023-11-28T11:10:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.493+0000 7f50767fc700 1 -- 172.21.15.125:0/927697003 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068011d20 con 0x7f50780cf710 2023-11-28T11:10:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.493+0000 7f507dd3c700 1 -- 172.21.15.125:0/927697003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50780cf710 msgr2=0x7f50780ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.493+0000 7f507dd3c700 1 --2- 172.21.15.125:0/927697003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50780cf710 0x7f50780ce740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5068009840 tx=0x7f5068009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.493+0000 7f507dd3c700 1 -- 172.21.15.125:0/927697003 shutdown_connections 2023-11-28T11:10:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.493+0000 7f507dd3c700 1 --2- 172.21.15.125:0/927697003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50780cf710 0x7f50780ce740 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.493+0000 7f507dd3c700 1 --2- 172.21.15.125:0/927697003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5078071890 0x7f5078071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.493+0000 7f507dd3c700 1 -- 172.21.15.125:0/927697003 >> 172.21.15.125:0/927697003 conn(0x7f507806c010 msgr2=0x7f50780cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.493+0000 7f507dd3c700 1 -- 172.21.15.125:0/927697003 shutdown_connections 2023-11-28T11:10:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.493+0000 7f507dd3c700 1 -- 172.21.15.125:0/927697003 wait complete. 2023-11-28T11:10:24.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.494+0000 7f507dd3c700 1 Processor -- start 2023-11-28T11:10:24.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.494+0000 7f507dd3c700 1 -- start start 2023-11-28T11:10:24.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.495+0000 7f507dd3c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f507806a270 0x7f5078154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.495+0000 7f507dd3c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5078071890 0x7f50781f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.495+0000 7f507dd3c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50780cf710 0x7f5078151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.495+0000 7f507dd3c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50781f3150 con 0x7f507806a270 2023-11-28T11:10:24.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.495+0000 7f507dd3c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5078152330 con 0x7f50780cf710 2023-11-28T11:10:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.495+0000 7f507dd3c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5078154770 con 0x7f5078071890 2023-11-28T11:10:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.495+0000 7f50777fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f507806a270 0x7f5078154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.495+0000 7f50777fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f507806a270 0x7f5078154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59806/0 (socket says 172.21.15.125:59806) 2023-11-28T11:10:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.495+0000 7f50777fe700 1 -- 172.21.15.125:0/2208284318 learned_addr learned my addr 172.21.15.125:0/2208284318 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.495+0000 7f5076ffd700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5078071890 0x7f50781f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.495+0000 7f5077fff700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50780cf710 0x7f5078151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.496+0000 7f50777fe700 1 -- 172.21.15.125:0/2208284318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5078071890 msgr2=0x7f50781f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.496+0000 7f50777fe700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5078071890 0x7f50781f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.496+0000 7f50777fe700 1 -- 172.21.15.125:0/2208284318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50780cf710 msgr2=0x7f5078151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.496+0000 7f50777fe700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50780cf710 0x7f5078151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.496+0000 7f50777fe700 1 -- 172.21.15.125:0/2208284318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50680094a0 con 0x7f507806a270 2023-11-28T11:10:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.496+0000 7f50777fe700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f507806a270 0x7f5078154190 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f50680090b0 tx=0x7f5068004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.496+0000 7f505ffff700 1 -- 172.21.15.125:0/2208284318 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680045d0 con 0x7f507806a270 2023-11-28T11:10:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.496+0000 7f505ffff700 1 -- 172.21.15.125:0/2208284318 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506801e070 con 0x7f507806a270 2023-11-28T11:10:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.496+0000 7f505ffff700 1 -- 172.21.15.125:0/2208284318 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680038e0 con 0x7f507806a270 2023-11-28T11:10:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.496+0000 7f507dd3c700 1 -- 172.21.15.125:0/2208284318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507806d530 con 0x7f507806a270 2023-11-28T11:10:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.496+0000 7f507dd3c700 1 -- 172.21.15.125:0/2208284318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507806d250 con 0x7f507806a270 2023-11-28T11:10:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.497+0000 7f507dd3c700 1 -- 172.21.15.125:0/2208284318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507806a6f0 con 0x7f507806a270 2023-11-28T11:10:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.497+0000 7f505ffff700 1 -- 172.21.15.125:0/2208284318 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f506800f050 con 0x7f507806a270 2023-11-28T11:10:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.497+0000 7f505ffff700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f50640682f0 0x7f506406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:24.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.498+0000 7f505ffff700 1 -- 172.21.15.125:0/2208284318 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f5068086c00 con 0x7f507806a270 2023-11-28T11:10:24.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.498+0000 7f5076ffd700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f50640682f0 0x7f506406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:24.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.498+0000 7f5076ffd700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f50640682f0 0x7f506406a7a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f50780b1050 tx=0x7f506c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:24.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.502+0000 7f505ffff700 1 -- 172.21.15.125:0/2208284318 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f506808c020 con 0x7f507806a270 2023-11-28T11:10:24.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.729+0000 7f507dd3c700 1 -- 172.21.15.125:0/2208284318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f50780743f0 con 0x7f507806a270 2023-11-28T11:10:24.984 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-11-28T11:10:24.983+0000 7f87cb91a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T11:10:24.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.995+0000 7f505ffff700 1 -- 172.21.15.125:0/2208284318 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5068020020 con 0x7f507806a270 2023-11-28T11:10:24.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 -- 172.21.15.125:0/2208284318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f50640682f0 msgr2=0x7f506406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f50640682f0 0x7f506406a7a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f50780b1050 tx=0x7f506c009210 comp rx=0 tx=0).stop 2023-11-28T11:10:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 -- 172.21.15.125:0/2208284318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f507806a270 msgr2=0x7f5078154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f507806a270 0x7f5078154190 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f50680090b0 tx=0x7f5068004750 comp rx=0 tx=0).stop 2023-11-28T11:10:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 -- 172.21.15.125:0/2208284318 shutdown_connections 2023-11-28T11:10:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50780cf710 0x7f5078151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f507806a270 0x7f5078154190 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f50640682f0 0x7f506406a7a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:25.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 --2- 172.21.15.125:0/2208284318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5078071890 0x7f50781f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:25.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 -- 172.21.15.125:0/2208284318 >> 172.21.15.125:0/2208284318 conn(0x7f507806c010 msgr2=0x7f50780b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:25.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 -- 172.21.15.125:0/2208284318 shutdown_connections 2023-11-28T11:10:25.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:24.998+0000 7f507dd3c700 1 -- 172.21.15.125:0/2208284318 wait complete. 2023-11-28T11:10:25.001 INFO:teuthology.orchestra.run.smithi125.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T11:10:25.001 INFO:tasks.ceph.mds.a.smithi125.stderr: -5708> 2023-11-28T11:09:52.152+0000 7fa62231d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:10:25.016 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T11:10:25.038 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-11-28T11:10:25.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.140+0000 7f7600e43700 1 Processor -- start 2023-11-28T11:10:25.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.140+0000 7f7600e43700 1 -- start start 2023-11-28T11:10:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.141+0000 7f7600e43700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc06a270 0x7f75fc06a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.141+0000 7f7600e43700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75fc06ac10 con 0x7f75fc15c810 2023-11-28T11:10:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.141+0000 7f7600e43700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75fc160a50 con 0x7f75fc0718e0 2023-11-28T11:10:25.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.141+0000 7f7600e43700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc15cbe0 con 0x7f75fc06a270 2023-11-28T11:10:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.141+0000 7f75fa59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f75fc15c810 0x7f75fc160260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43956/0 (socket says 172.21.15.125:43956) 2023-11-28T11:10:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.141+0000 7f75fa59c700 1 -- 172.21.15.125:0/3694601122 learned_addr learned my addr 172.21.15.125:0/3694601122 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.141+0000 7f75fad9d700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc06a270 0x7f75fc06a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.141+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237081844 0 0) 0x7f75fc06ac10 con 0x7f75fc15c810 2023-11-28T11:10:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.141+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e40035b0 con 0x7f75fc15c810 2023-11-28T11:10:25.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2598937088 0 0) 0x7f75e40035b0 con 0x7f75fc15c810 2023-11-28T11:10:25.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc06a270 msgr2=0x7f75fc06a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:25.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc06a270 0x7f75fc06a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:25.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 >> v1:172.21.15.167:6789/0 conn(0x7f75fc0718e0 legacy=0x7f75fc06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:25.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc160d30 con 0x7f75fc15c810 2023-11-28T11:10:25.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f75f0001670 con 0x7f75fc15c810 2023-11-28T11:10:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 >> v1:172.21.15.125:6789/0 conn(0x7f75fc15c810 legacy=0x7f75fc160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75e4003a30 0x7f75e4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 0x7f75e4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc06a270 0x7f75e4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc15cbe0 con 0x7f75e4004850 2023-11-28T11:10:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e400bac0 con 0x7f75e4003a30 2023-11-28T11:10:25.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e400bc50 con 0x7f75fc06a270 2023-11-28T11:10:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f9d9b700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 0x7f75e4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75fa59c700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75e4003a30 0x7f75e4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75fad9d700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc06a270 0x7f75e4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f9d9b700 1 -- 172.21.15.125:0/3694601122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc06a270 msgr2=0x7f75e4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f9d9b700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc06a270 0x7f75e4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f9d9b700 1 -- 172.21.15.125:0/3694601122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75e4003a30 msgr2=0x7f75e4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f9d9b700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75e4003a30 0x7f75e4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f9d9b700 1 -- 172.21.15.125:0/3694601122 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e40035b0 con 0x7f75e4004850 2023-11-28T11:10:25.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f9d9b700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 0x7f75e4004cc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0017c0 tx=0x7f75e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4a8dc3141bd9f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:25.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0052d0 con 0x7f75e4004850 2023-11-28T11:10:25.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec005430 con 0x7f75e4004850 2023-11-28T11:10:25.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.142+0000 7f75f959a700 1 -- 172.21.15.125:0/3694601122 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0038c0 con 0x7f75e4004850 2023-11-28T11:10:25.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.143+0000 7f7600e43700 1 -- 172.21.15.125:0/3694601122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 msgr2=0x7f75e4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:25.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.143+0000 7f7600e43700 1 --2- 172.21.15.125:0/3694601122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 0x7f75e4004cc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0017c0 tx=0x7f75e4005880 comp rx=0 tx=0).stop 2023-11-28T11:10:25.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.143+0000 7f75fad9d700 1 -- 172.21.15.125:0/3694601122 reap_dead start 2023-11-28T11:10:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.143+0000 7f7600e43700 1 -- 172.21.15.125:0/3694601122 shutdown_connections 2023-11-28T11:10:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.143+0000 7f7600e43700 1 -- 172.21.15.125:0/3694601122 >> 172.21.15.125:0/3694601122 conn(0x7f75fc06c010 msgr2=0x7f75fc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.143+0000 7f7600e43700 1 -- 172.21.15.125:0/3694601122 shutdown_connections 2023-11-28T11:10:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.143+0000 7f7600e43700 1 -- 172.21.15.125:0/3694601122 wait complete. 2023-11-28T11:10:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.144+0000 7f7600e43700 1 Processor -- start 2023-11-28T11:10:25.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.144+0000 7f7600e43700 1 -- start start 2023-11-28T11:10:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f7600e43700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 0x7f75fc14a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f7600e43700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc14abe0 0x7f75fc14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f7600e43700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75fc1f5690 0x7f75fc1f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f7600e43700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0b2a00 con 0x7f75e4004850 2023-11-28T11:10:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f7600e43700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0b4fa0 con 0x7f75fc1f5690 2023-11-28T11:10:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f7600e43700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0b51f0 con 0x7f75fc14abe0 2023-11-28T11:10:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f75fa59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 0x7f75fc14a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f75fa59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 0x7f75fc14a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59844/0 (socket says 172.21.15.125:59844) 2023-11-28T11:10:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f75fa59c700 1 -- 172.21.15.125:0/3992779252 learned_addr learned my addr 172.21.15.125:0/3992779252 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f75fad9d700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75fc1f5690 0x7f75fc1f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f75f9d9b700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc14abe0 0x7f75fc14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f75fa59c700 1 -- 172.21.15.125:0/3992779252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc14abe0 msgr2=0x7f75fc14a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f75fa59c700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc14abe0 0x7f75fc14a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f75fa59c700 1 -- 172.21.15.125:0/3992779252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75fc1f5690 msgr2=0x7f75fc1f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f75fa59c700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75fc1f5690 0x7f75fc1f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f75fa59c700 1 -- 172.21.15.125:0/3992779252 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0ceb20 con 0x7f75e4004850 2023-11-28T11:10:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.145+0000 7f75fad9d700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75fc1f5690 0x7f75fc1f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.146+0000 7f75f9d9b700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc14abe0 0x7f75fc14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.146+0000 7f75fa59c700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 0x7f75fc14a050 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f75f0007290 tx=0x7f75f00075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.146+0000 7f75eaffd700 1 -- 172.21.15.125:0/3992779252 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f000f660 con 0x7f75e4004850 2023-11-28T11:10:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.146+0000 7f75eaffd700 1 -- 172.21.15.125:0/3992779252 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f000f7c0 con 0x7f75e4004850 2023-11-28T11:10:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.146+0000 7f7600e43700 1 -- 172.21.15.125:0/3992779252 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc161010 con 0x7f75e4004850 2023-11-28T11:10:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.146+0000 7f75eaffd700 1 -- 172.21.15.125:0/3992779252 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f000fb70 con 0x7f75e4004850 2023-11-28T11:10:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.146+0000 7f7600e43700 1 -- 172.21.15.125:0/3992779252 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75fc06cf90 con 0x7f75e4004850 2023-11-28T11:10:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.147+0000 7f7600e43700 1 -- 172.21.15.125:0/3992779252 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75fc0743f0 con 0x7f75e4004850 2023-11-28T11:10:25.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.147+0000 7f75eaffd700 1 -- 172.21.15.125:0/3992779252 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f75f000fcd0 con 0x7f75e4004850 2023-11-28T11:10:25.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.148+0000 7f75eaffd700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75dc0682f0 0x7f75dc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:25.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.148+0000 7f75f9d9b700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75dc0682f0 0x7f75dc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:25.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.148+0000 7f75eaffd700 1 -- 172.21.15.125:0/3992779252 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f75f0085eb0 con 0x7f75e4004850 2023-11-28T11:10:25.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.148+0000 7f75f9d9b700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75dc0682f0 0x7f75dc06a7a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0b0980 tx=0x7f75ec009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:25.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.152+0000 7f75eaffd700 1 -- 172.21.15.125:0/3992779252 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f75f0052690 con 0x7f75e4004850 2023-11-28T11:10:25.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.377+0000 7f7600e43700 1 -- 172.21.15.125:0/3992779252 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f75fc0aca00 con 0x7f75e4004850 2023-11-28T11:10:25.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:25.998+0000 7f75eaffd700 1 -- 172.21.15.125:0/3992779252 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f75f0055cb0 con 0x7f75e4004850 2023-11-28T11:10:26.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 -- 172.21.15.125:0/3992779252 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75dc0682f0 msgr2=0x7f75dc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:26.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75dc0682f0 0x7f75dc06a7a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0b0980 tx=0x7f75ec009030 comp rx=0 tx=0).stop 2023-11-28T11:10:26.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 -- 172.21.15.125:0/3992779252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 msgr2=0x7f75fc14a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:26.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 0x7f75fc14a050 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f75f0007290 tx=0x7f75f00075a0 comp rx=0 tx=0).stop 2023-11-28T11:10:26.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 -- 172.21.15.125:0/3992779252 shutdown_connections 2023-11-28T11:10:26.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75fc1f5690 0x7f75fc1f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:26.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75e4004850 0x7f75fc14a050 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:26.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75dc0682f0 0x7f75dc06a7a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:26.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 --2- 172.21.15.125:0/3992779252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75fc14abe0 0x7f75fc14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:26.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 -- 172.21.15.125:0/3992779252 >> 172.21.15.125:0/3992779252 conn(0x7f75fc06c010 msgr2=0x7f75fc1581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:26.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 -- 172.21.15.125:0/3992779252 shutdown_connections 2023-11-28T11:10:26.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.001+0000 7f7600e43700 1 -- 172.21.15.125:0/3992779252 wait complete. 2023-11-28T11:10:26.016 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T11:10:26.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.182+0000 7f1e04764700 1 Processor -- start 2023-11-28T11:10:26.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.182+0000 7f1e04764700 1 -- start start 2023-11-28T11:10:26.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e04764700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dfc15d660 0x7f1dfc071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:26.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e04764700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1dfc0cdae0 0x7f1dfc0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:26.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e04764700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc0d0b50 con 0x7f1dfc15c9d0 2023-11-28T11:10:26.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e04764700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc15cda0 con 0x7f1dfc0cdae0 2023-11-28T11:10:26.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e04764700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc15de10 con 0x7f1dfc15d660 2023-11-28T11:10:26.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e02d01700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1dfc0cdae0 0x7f1dfc0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:26.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e02d01700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1dfc0cdae0 0x7f1dfc0cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59858/0 (socket says 172.21.15.125:59858) 2023-11-28T11:10:26.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e02d01700 1 -- 172.21.15.125:0/2260975864 learned_addr learned my addr 172.21.15.125:0/2260975864 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:26.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e01cff700 1 --2- 172.21.15.125:0/2260975864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dfc15d660 0x7f1dfc071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:26.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e02d01700 1 -- 172.21.15.125:0/2260975864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dfc15d660 msgr2=0x7f1dfc071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:26.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e02d01700 1 --2- 172.21.15.125:0/2260975864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dfc15d660 0x7f1dfc071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:26.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e02d01700 1 -- 172.21.15.125:0/2260975864 >> v1:172.21.15.167:6789/0 conn(0x7f1dfc15c9d0 legacy=0x7f1dfc15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:26.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.183+0000 7f1e02d01700 1 -- 172.21.15.125:0/2260975864 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc0ce480 con 0x7f1dfc0cdae0 2023-11-28T11:10:26.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e02d01700 1 --2- 172.21.15.125:0/2260975864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dfc0cdae0 0x7f1dfc0cdf40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009e50 tx=0x7f1df400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac5b63109626c56 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:26.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e014fe700 1 -- 172.21.15.125:0/2260975864 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df400e070 con 0x7f1dfc0cdae0 2023-11-28T11:10:26.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e014fe700 1 -- 172.21.15.125:0/2260975864 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df400b9c0 con 0x7f1dfc0cdae0 2023-11-28T11:10:26.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e014fe700 1 -- 172.21.15.125:0/2260975864 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df400bd70 con 0x7f1dfc0cdae0 2023-11-28T11:10:26.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e04764700 1 -- 172.21.15.125:0/2260975864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dfc0cdae0 msgr2=0x7f1dfc0cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:26.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e04764700 1 --2- 172.21.15.125:0/2260975864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dfc0cdae0 0x7f1dfc0cdf40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009e50 tx=0x7f1df400b330 comp rx=0 tx=0).stop 2023-11-28T11:10:26.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e04764700 1 -- 172.21.15.125:0/2260975864 shutdown_connections 2023-11-28T11:10:26.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e04764700 1 --2- 172.21.15.125:0/2260975864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dfc0cdae0 0x7f1dfc0cdf40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:26.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e04764700 1 --2- 172.21.15.125:0/2260975864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dfc15d660 0x7f1dfc071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e04764700 1 -- 172.21.15.125:0/2260975864 >> 172.21.15.125:0/2260975864 conn(0x7f1dfc0b24a0 msgr2=0x7f1dfc0cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e04764700 1 -- 172.21.15.125:0/2260975864 shutdown_connections 2023-11-28T11:10:26.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.184+0000 7f1e04764700 1 -- 172.21.15.125:0/2260975864 wait complete. 2023-11-28T11:10:26.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.185+0000 7f1e04764700 1 Processor -- start 2023-11-28T11:10:26.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.186+0000 7f1e04764700 1 -- start start 2023-11-28T11:10:26.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.186+0000 7f1e04764700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dfc0cdae0 0x7f1dfc155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:26.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.186+0000 7f1e04764700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dfc15c9d0 0x7f1dfc1436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:26.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.186+0000 7f1e04764700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dfc15d660 0x7f1dfc0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:26.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.186+0000 7f1e04764700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc143bf0 con 0x7f1dfc15d660 2023-11-28T11:10:26.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.186+0000 7f1e04764700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0c9120 con 0x7f1dfc0cdae0 2023-11-28T11:10:26.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.186+0000 7f1e04764700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0c8240 con 0x7f1dfc15c9d0 2023-11-28T11:10:26.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.186+0000 7f1e02d01700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dfc15d660 0x7f1dfc0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:26.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.186+0000 7f1e02d01700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dfc15d660 0x7f1dfc0c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59864/0 (socket says 172.21.15.125:59864) 2023-11-28T11:10:26.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.186+0000 7f1e02d01700 1 -- 172.21.15.125:0/3466981613 learned_addr learned my addr 172.21.15.125:0/3466981613 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:26.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1e02500700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dfc0cdae0 0x7f1dfc155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:26.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1e01cff700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dfc15c9d0 0x7f1dfc1436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:26.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1e02d01700 1 -- 172.21.15.125:0/3466981613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dfc15c9d0 msgr2=0x7f1dfc1436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:26.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1e02d01700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dfc15c9d0 0x7f1dfc1436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:26.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1e02d01700 1 -- 172.21.15.125:0/3466981613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dfc0cdae0 msgr2=0x7f1dfc155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:26.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1e02d01700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dfc0cdae0 0x7f1dfc155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:26.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1e02d01700 1 -- 172.21.15.125:0/3466981613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df4009b30 con 0x7f1dfc15d660 2023-11-28T11:10:26.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1e02d01700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dfc15d660 0x7f1dfc0c7d00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0672a0 tx=0x7f1df4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:26.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1df2ffd700 1 -- 172.21.15.125:0/3466981613 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4004960 con 0x7f1dfc15d660 2023-11-28T11:10:26.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1df2ffd700 1 -- 172.21.15.125:0/3466981613 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df40099b0 con 0x7f1dfc15d660 2023-11-28T11:10:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1e04764700 1 -- 172.21.15.125:0/3466981613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc070cb0 con 0x7f1dfc15d660 2023-11-28T11:10:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1df2ffd700 1 -- 172.21.15.125:0/3466981613 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df401c680 con 0x7f1dfc15d660 2023-11-28T11:10:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.187+0000 7f1e04764700 1 -- 172.21.15.125:0/3466981613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc15db30 con 0x7f1dfc15d660 2023-11-28T11:10:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.188+0000 7f1e04764700 1 -- 172.21.15.125:0/3466981613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc070f90 con 0x7f1dfc15d660 2023-11-28T11:10:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.188+0000 7f1df2ffd700 1 -- 172.21.15.125:0/3466981613 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1df402c070 con 0x7f1dfc15d660 2023-11-28T11:10:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.189+0000 7f1df2ffd700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1de00682f0 0x7f1de006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.189+0000 7f1df2ffd700 1 -- 172.21.15.125:0/3466981613 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f1df4087910 con 0x7f1dfc15d660 2023-11-28T11:10:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.189+0000 7f1e02500700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1de00682f0 0x7f1de006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:26.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.189+0000 7f1e02500700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1de00682f0 0x7f1de006a7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1dec000f60 tx=0x7f1dec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:26.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.193+0000 7f1df2ffd700 1 -- 172.21.15.125:0/3466981613 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1df40540f0 con 0x7f1dfc15d660 2023-11-28T11:10:26.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:26.374+0000 7f1e04764700 1 -- 172.21.15.125:0/3466981613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1dfc0743f0 con 0x7f1dfc15d660 2023-11-28T11:10:27.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.064+0000 7f1df2ffd700 1 -- 172.21.15.125:0/3466981613 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1df4057710 con 0x7f1dfc15d660 2023-11-28T11:10:27.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 -- 172.21.15.125:0/3466981613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1de00682f0 msgr2=0x7f1de006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:27.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1de00682f0 0x7f1de006a7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1dec000f60 tx=0x7f1dec009040 comp rx=0 tx=0).stop 2023-11-28T11:10:27.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 -- 172.21.15.125:0/3466981613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dfc15d660 msgr2=0x7f1dfc0c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:27.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dfc15d660 0x7f1dfc0c7d00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0672a0 tx=0x7f1df4004ad0 comp rx=0 tx=0).stop 2023-11-28T11:10:27.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 -- 172.21.15.125:0/3466981613 shutdown_connections 2023-11-28T11:10:27.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dfc15d660 0x7f1dfc0c7d00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:27.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dfc0cdae0 0x7f1dfc155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:27.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1de00682f0 0x7f1de006a7a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:27.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 --2- 172.21.15.125:0/3466981613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dfc15c9d0 0x7f1dfc1436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:27.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 -- 172.21.15.125:0/3466981613 >> 172.21.15.125:0/3466981613 conn(0x7f1dfc0b24a0 msgr2=0x7f1dfc0c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:27.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 -- 172.21.15.125:0/3466981613 shutdown_connections 2023-11-28T11:10:27.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.068+0000 7f1e04764700 1 -- 172.21.15.125:0/3466981613 wait complete. 2023-11-28T11:10:27.071 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' removed 2023-11-28T11:10:27.085 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T11:10:27.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.213+0000 7fdbef1ad700 1 Processor -- start 2023-11-28T11:10:27.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.213+0000 7fdbef1ad700 1 -- start start 2023-11-28T11:10:27.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbef1ad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbe815cc50 0x7fdbe80af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:27.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbef1ad700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 0x7fdbe8070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:27.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbef1ad700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe80cf3e0 con 0x7fdbe8071150 2023-11-28T11:10:27.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbef1ad700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe80715d0 con 0x7fdbe815cc50 2023-11-28T11:10:27.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbef1ad700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80cd800 con 0x7fdbe8161160 2023-11-28T11:10:27.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbecf49700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbe815cc50 0x7fdbe80af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:27.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbed74a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdbe8071150 0x7fdbe80c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43996/0 (socket says 172.21.15.125:43996) 2023-11-28T11:10:27.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbed74a700 1 -- 172.21.15.125:0/606716404 learned_addr learned my addr 172.21.15.125:0/606716404 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:27.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbe7fff700 1 --2- 172.21.15.125:0/606716404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 0x7fdbe8070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:27.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbecf49700 1 -- 172.21.15.125:0/606716404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 msgr2=0x7fdbe8070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:27.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbecf49700 1 --2- 172.21.15.125:0/606716404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 0x7fdbe8070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:27.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbecf49700 1 -- 172.21.15.125:0/606716404 >> v1:172.21.15.125:6789/0 conn(0x7fdbe8071150 legacy=0x7fdbe80c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:27.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbecf49700 1 -- 172.21.15.125:0/606716404 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80cdae0 con 0x7fdbe815cc50 2023-11-28T11:10:27.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbe77fe700 1 -- 172.21.15.125:0/606716404 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983051809 0 0) 0x7fdbe80cf3e0 con 0x7fdbe8071150 2023-11-28T11:10:27.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.214+0000 7fdbe7fff700 1 --2- 172.21.15.125:0/606716404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 0x7fdbe8070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:27.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbecf49700 1 --2- 172.21.15.125:0/606716404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe815cc50 0x7fdbe80af1f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009840 tx=0x7fdbdc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50e5610ec32fef2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:27.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbe77fe700 1 -- 172.21.15.125:0/606716404 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc011830 con 0x7fdbe815cc50 2023-11-28T11:10:27.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbe77fe700 1 -- 172.21.15.125:0/606716404 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc011990 con 0x7fdbe815cc50 2023-11-28T11:10:27.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbe77fe700 1 -- 172.21.15.125:0/606716404 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc011d20 con 0x7fdbe815cc50 2023-11-28T11:10:27.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbef1ad700 1 -- 172.21.15.125:0/606716404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe815cc50 msgr2=0x7fdbe80af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:27.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbef1ad700 1 --2- 172.21.15.125:0/606716404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe815cc50 0x7fdbe80af1f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009840 tx=0x7fdbdc009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:27.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbef1ad700 1 -- 172.21.15.125:0/606716404 shutdown_connections 2023-11-28T11:10:27.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbef1ad700 1 --2- 172.21.15.125:0/606716404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe815cc50 0x7fdbe80af1f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:27.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbef1ad700 1 --2- 172.21.15.125:0/606716404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 0x7fdbe8070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:27.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbef1ad700 1 -- 172.21.15.125:0/606716404 >> 172.21.15.125:0/606716404 conn(0x7fdbe80cfc30 msgr2=0x7fdbe80d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:27.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbef1ad700 1 -- 172.21.15.125:0/606716404 shutdown_connections 2023-11-28T11:10:27.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.215+0000 7fdbef1ad700 1 -- 172.21.15.125:0/606716404 wait complete. 2023-11-28T11:10:27.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.216+0000 7fdbef1ad700 1 Processor -- start 2023-11-28T11:10:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.216+0000 7fdbef1ad700 1 -- start start 2023-11-28T11:10:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.217+0000 7fdbef1ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe8071150 0x7fdbe815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.217+0000 7fdbef1ad700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe815cc50 0x7fdbe815f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.217+0000 7fdbef1ad700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 0x7fdbe81f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.217+0000 7fdbef1ad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe815b870 con 0x7fdbe8071150 2023-11-28T11:10:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.217+0000 7fdbef1ad700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe815f9c0 con 0x7fdbe815cc50 2023-11-28T11:10:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.217+0000 7fdbef1ad700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe815e3e0 con 0x7fdbe8161160 2023-11-28T11:10:27.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.217+0000 7fdbecf49700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe8071150 0x7fdbe815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:27.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.217+0000 7fdbecf49700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe8071150 0x7fdbe815ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59874/0 (socket says 172.21.15.125:59874) 2023-11-28T11:10:27.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.217+0000 7fdbecf49700 1 -- 172.21.15.125:0/793234772 learned_addr learned my addr 172.21.15.125:0/793234772 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:27.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbe7fff700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe815cc50 0x7fdbe815f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:27.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbed74a700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 0x7fdbe81f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:27.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbecf49700 1 -- 172.21.15.125:0/793234772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 msgr2=0x7fdbe81f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:27.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbecf49700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 0x7fdbe81f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:27.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbecf49700 1 -- 172.21.15.125:0/793234772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe815cc50 msgr2=0x7fdbe815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:27.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbecf49700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe815cc50 0x7fdbe815f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbecf49700 1 -- 172.21.15.125:0/793234772 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc0094a0 con 0x7fdbe8071150 2023-11-28T11:10:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbe7fff700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe815cc50 0x7fdbe815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbed74a700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 0x7fdbe81f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbecf49700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe8071150 0x7fdbe815ae60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0090b0 tx=0x7fdbdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbe57fa700 1 -- 172.21.15.125:0/793234772 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0038a0 con 0x7fdbe8071150 2023-11-28T11:10:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbe57fa700 1 -- 172.21.15.125:0/793234772 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc01f070 con 0x7fdbe8071150 2023-11-28T11:10:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbe57fa700 1 -- 172.21.15.125:0/793234772 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc003c60 con 0x7fdbe8071150 2023-11-28T11:10:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbef1ad700 1 -- 172.21.15.125:0/793234772 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe81616b0 con 0x7fdbe8071150 2023-11-28T11:10:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.218+0000 7fdbef1ad700 1 -- 172.21.15.125:0/793234772 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe80cdf70 con 0x7fdbe8071150 2023-11-28T11:10:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.219+0000 7fdbef1ad700 1 -- 172.21.15.125:0/793234772 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe80cf610 con 0x7fdbe8071150 2023-11-28T11:10:27.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.219+0000 7fdbe57fa700 1 -- 172.21.15.125:0/793234772 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdbdc00f050 con 0x7fdbe8071150 2023-11-28T11:10:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.220+0000 7fdbe57fa700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbcc0682f0 0x7fdbcc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.220+0000 7fdbe57fa700 1 -- 172.21.15.125:0/793234772 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5739+0+0 (secure 0 0 0) 0x7fdbdc021070 con 0x7fdbe8071150 2023-11-28T11:10:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.220+0000 7fdbe7fff700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbcc0682f0 0x7fdbcc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.220+0000 7fdbe7fff700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbcc0682f0 0x7fdbcc06a7a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdbe806b2b0 tx=0x7fdbd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:27.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.224+0000 7fdbe57fa700 1 -- 172.21.15.125:0/793234772 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdbdc054050 con 0x7fdbe8071150 2023-11-28T11:10:27.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:27.407+0000 7fdbef1ad700 1 -- 172.21.15.125:0/793234772 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdbe80c6230 con 0x7fdbe8071150 2023-11-28T11:10:28.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.071+0000 7fdbe57fa700 1 -- 172.21.15.125:0/793234772 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdbdc057670 con 0x7fdbe8071150 2023-11-28T11:10:28.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.076+0000 7fdbef1ad700 1 -- 172.21.15.125:0/793234772 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbcc0682f0 msgr2=0x7fdbcc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.076+0000 7fdbef1ad700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbcc0682f0 0x7fdbcc06a7a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdbe806b2b0 tx=0x7fdbd4008040 comp rx=0 tx=0).stop 2023-11-28T11:10:28.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.076+0000 7fdbef1ad700 1 -- 172.21.15.125:0/793234772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe8071150 msgr2=0x7fdbe815ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.076+0000 7fdbef1ad700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe8071150 0x7fdbe815ae60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0090b0 tx=0x7fdbdc004750 comp rx=0 tx=0).stop 2023-11-28T11:10:28.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.077+0000 7fdbef1ad700 1 -- 172.21.15.125:0/793234772 shutdown_connections 2023-11-28T11:10:28.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.077+0000 7fdbef1ad700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdbcc0682f0 0x7fdbcc06a7a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.077+0000 7fdbef1ad700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbe8161160 0x7fdbe81f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.077+0000 7fdbef1ad700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe8071150 0x7fdbe815ae60 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.077+0000 7fdbef1ad700 1 --2- 172.21.15.125:0/793234772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe815cc50 0x7fdbe815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.077+0000 7fdbef1ad700 1 -- 172.21.15.125:0/793234772 >> 172.21.15.125:0/793234772 conn(0x7fdbe80cfc30 msgr2=0x7fdbe80b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:28.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.077+0000 7fdbef1ad700 1 -- 172.21.15.125:0/793234772 shutdown_connections 2023-11-28T11:10:28.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.077+0000 7fdbef1ad700 1 -- 172.21.15.125:0/793234772 wait complete. 2023-11-28T11:10:28.080 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' removed 2023-11-28T11:10:28.094 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T11:10:28.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.221+0000 7f4a8e740700 1 Processor -- start 2023-11-28T11:10:28.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.221+0000 7f4a8e740700 1 -- start start 2023-11-28T11:10:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.221+0000 7f4a8e740700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4a8815a590 0x7f4a8806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.221+0000 7f4a8e740700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8806cb50 0x7f4a8806a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.221+0000 7f4a8e740700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a880cd480 con 0x7f4a880b50d0 2023-11-28T11:10:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.221+0000 7f4a8e740700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a880cd760 con 0x7f4a8815a590 2023-11-28T11:10:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.221+0000 7f4a8e740700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880cda40 con 0x7f4a8806cb50 2023-11-28T11:10:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a87fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4a8815a590 0x7f4a8806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a877fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4a880b50d0 0x7f4a8806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44008/0 (socket says 172.21.15.125:44008) 2023-11-28T11:10:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a877fe700 1 -- 172.21.15.125:0/2224141678 learned_addr learned my addr 172.21.15.125:0/2224141678 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a87fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4a8815a590 0x7f4a8806b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59882/0 (socket says 172.21.15.125:59882) 2023-11-28T11:10:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a8ccdd700 1 --2- 172.21.15.125:0/2224141678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8806cb50 0x7f4a8806a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a87fff700 1 -- 172.21.15.125:0/2224141678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8806cb50 msgr2=0x7f4a8806a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a87fff700 1 --2- 172.21.15.125:0/2224141678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8806cb50 0x7f4a8806a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a87fff700 1 -- 172.21.15.125:0/2224141678 >> v1:172.21.15.125:6789/0 conn(0x7f4a880b50d0 legacy=0x7f4a8806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a87fff700 1 -- 172.21.15.125:0/2224141678 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a880cdd20 con 0x7f4a8815a590 2023-11-28T11:10:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a86ffd700 1 -- 172.21.15.125:0/2224141678 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175679704 0 0) 0x7f4a880cd480 con 0x7f4a880b50d0 2023-11-28T11:10:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a87fff700 1 --2- 172.21.15.125:0/2224141678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a8815a590 0x7f4a8806b5b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009840 tx=0x7f4a78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409e419a29520d65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a86ffd700 1 -- 172.21.15.125:0/2224141678 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78011830 con 0x7f4a8815a590 2023-11-28T11:10:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a86ffd700 1 -- 172.21.15.125:0/2224141678 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a78011990 con 0x7f4a8815a590 2023-11-28T11:10:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.222+0000 7f4a86ffd700 1 -- 172.21.15.125:0/2224141678 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78011d20 con 0x7f4a8815a590 2023-11-28T11:10:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.223+0000 7f4a8e740700 1 -- 172.21.15.125:0/2224141678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a8815a590 msgr2=0x7f4a8806b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.223+0000 7f4a8e740700 1 --2- 172.21.15.125:0/2224141678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a8815a590 0x7f4a8806b5b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009840 tx=0x7f4a78009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:28.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.223+0000 7f4a8e740700 1 -- 172.21.15.125:0/2224141678 shutdown_connections 2023-11-28T11:10:28.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.223+0000 7f4a8e740700 1 --2- 172.21.15.125:0/2224141678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8806cb50 0x7f4a8806a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.223+0000 7f4a8e740700 1 --2- 172.21.15.125:0/2224141678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a8815a590 0x7f4a8806b5b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.223+0000 7f4a8e740700 1 -- 172.21.15.125:0/2224141678 >> 172.21.15.125:0/2224141678 conn(0x7f4a880cf400 msgr2=0x7f4a880cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:28.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.223+0000 7f4a8e740700 1 -- 172.21.15.125:0/2224141678 shutdown_connections 2023-11-28T11:10:28.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.223+0000 7f4a8e740700 1 -- 172.21.15.125:0/2224141678 wait complete. 2023-11-28T11:10:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.224+0000 7f4a8e740700 1 Processor -- start 2023-11-28T11:10:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.224+0000 7f4a8e740700 1 -- start start 2023-11-28T11:10:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a8e740700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a8806cb50 0x7f4a881ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a8e740700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a880b50d0 0x7f4a881550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a8e740700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8815a590 0x7f4a8815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a8e740700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a881f34f0 con 0x7f4a880b50d0 2023-11-28T11:10:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a8e740700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880b26d0 con 0x7f4a8806cb50 2023-11-28T11:10:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a8e740700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880b29b0 con 0x7f4a8815a590 2023-11-28T11:10:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a880b50d0 0x7f4a881550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a880b50d0 0x7f4a881550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59890/0 (socket says 172.21.15.125:59890) 2023-11-28T11:10:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a877fe700 1 -- 172.21.15.125:0/3605538957 learned_addr learned my addr 172.21.15.125:0/3605538957 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a87fff700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a8806cb50 0x7f4a881ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a8ccdd700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8815a590 0x7f4a8815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a877fe700 1 -- 172.21.15.125:0/3605538957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8815a590 msgr2=0x7f4a8815c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a877fe700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8815a590 0x7f4a8815c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a877fe700 1 -- 172.21.15.125:0/3605538957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a8806cb50 msgr2=0x7f4a881ef6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a877fe700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a8806cb50 0x7f4a881ef6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.225+0000 7f4a877fe700 1 -- 172.21.15.125:0/3605538957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780094a0 con 0x7f4a880b50d0 2023-11-28T11:10:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.226+0000 7f4a877fe700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a880b50d0 0x7f4a881550a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c520 tx=0x7f4a7c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.226+0000 7f4a84ff9700 1 -- 172.21.15.125:0/3605538957 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c004c80 con 0x7f4a880b50d0 2023-11-28T11:10:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.226+0000 7f4a84ff9700 1 -- 172.21.15.125:0/3605538957 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7c004e00 con 0x7f4a880b50d0 2023-11-28T11:10:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.226+0000 7f4a84ff9700 1 -- 172.21.15.125:0/3605538957 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c007310 con 0x7f4a880b50d0 2023-11-28T11:10:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.226+0000 7f4a8e740700 1 -- 172.21.15.125:0/3605538957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8806baf0 con 0x7f4a880b50d0 2023-11-28T11:10:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.226+0000 7f4a8e740700 1 -- 172.21.15.125:0/3605538957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a880ce000 con 0x7f4a880b50d0 2023-11-28T11:10:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.227+0000 7f4a8e740700 1 -- 172.21.15.125:0/3605538957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8815a960 con 0x7f4a880b50d0 2023-11-28T11:10:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.227+0000 7f4a84ff9700 1 -- 172.21.15.125:0/3605538957 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4a7c01a020 con 0x7f4a880b50d0 2023-11-28T11:10:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.227+0000 7f4a84ff9700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4a740682f0 0x7f4a7406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.227+0000 7f4a84ff9700 1 -- 172.21.15.125:0/3605538957 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4a7c085460 con 0x7f4a880b50d0 2023-11-28T11:10:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.228+0000 7f4a87fff700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4a740682f0 0x7f4a7406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.228+0000 7f4a87fff700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4a740682f0 0x7f4a7406a7a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4a780090b0 tx=0x7f4a7801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:28.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.232+0000 7f4a84ff9700 1 -- 172.21.15.125:0/3605538957 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4a7c051fc0 con 0x7f4a880b50d0 2023-11-28T11:10:28.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.417+0000 7f4a8e740700 1 -- 172.21.15.125:0/3605538957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4a881f3630 con 0x7f4a880b50d0 2023-11-28T11:10:28.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.420+0000 7f4a84ff9700 1 -- 172.21.15.125:0/3605538957 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4a7c0555e0 con 0x7f4a880b50d0 2023-11-28T11:10:28.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.422+0000 7f4a8e740700 1 -- 172.21.15.125:0/3605538957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4a740682f0 msgr2=0x7f4a7406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.422+0000 7f4a8e740700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4a740682f0 0x7f4a7406a7a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4a780090b0 tx=0x7f4a7801c040 comp rx=0 tx=0).stop 2023-11-28T11:10:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.422+0000 7f4a8e740700 1 -- 172.21.15.125:0/3605538957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a880b50d0 msgr2=0x7f4a881550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.422+0000 7f4a8e740700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a880b50d0 0x7f4a881550a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c520 tx=0x7f4a7c00c830 comp rx=0 tx=0).stop 2023-11-28T11:10:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.422+0000 7f4a8e740700 1 -- 172.21.15.125:0/3605538957 shutdown_connections 2023-11-28T11:10:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.422+0000 7f4a8e740700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4a740682f0 0x7f4a7406a7a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.422+0000 7f4a8e740700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8815a590 0x7f4a8815c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.422+0000 7f4a8e740700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a8806cb50 0x7f4a881ef6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.422+0000 7f4a8e740700 1 --2- 172.21.15.125:0/3605538957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a880b50d0 0x7f4a881550a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.423+0000 7f4a8e740700 1 -- 172.21.15.125:0/3605538957 >> 172.21.15.125:0/3605538957 conn(0x7f4a880cf400 msgr2=0x7f4a880b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.423+0000 7f4a8e740700 1 -- 172.21.15.125:0/3605538957 shutdown_connections 2023-11-28T11:10:28.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.423+0000 7f4a8e740700 1 -- 172.21.15.125:0/3605538957 wait complete. 2023-11-28T11:10:28.436 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-28T11:10:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.554+0000 7fc9a92fc700 1 Processor -- start 2023-11-28T11:10:28.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.554+0000 7fc9a92fc700 1 -- start start 2023-11-28T11:10:28.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.555+0000 7fc9a92fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9a415e010 0x7fc9a40ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:28.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.555+0000 7fc9a92fc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a415af30 con 0x7fc9a406e400 2023-11-28T11:10:28.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.555+0000 7fc9a92fc700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a415ef40 con 0x7fc9a40d15f0 2023-11-28T11:10:28.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.555+0000 7fc9a92fc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a415a9d0 con 0x7fc9a415e010 2023-11-28T11:10:28.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.555+0000 7fc9a37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9a415e010 0x7fc9a40ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:28.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.555+0000 7fc9a2ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc9a406e400 0x7fc9a406e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44020/0 (socket says 172.21.15.125:44020) 2023-11-28T11:10:28.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.555+0000 7fc9a2ffd700 1 -- 172.21.15.125:0/11848733 learned_addr learned my addr 172.21.15.125:0/11848733 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a37fe700 1 -- 172.21.15.125:0/11848733 >> v1:172.21.15.167:6789/0 conn(0x7fc9a40d15f0 legacy=0x7fc9a415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a37fe700 1 -- 172.21.15.125:0/11848733 >> v1:172.21.15.125:6789/0 conn(0x7fc9a406e400 legacy=0x7fc9a406e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a37fe700 1 -- 172.21.15.125:0/11848733 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a415e980 con 0x7fc9a415e010 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a1ffb700 1 -- 172.21.15.125:0/11848733 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174931726 0 0) 0x7fc9a415af30 con 0x7fc9a406e400 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a37fe700 1 --2- 172.21.15.125:0/11848733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a415e010 0x7fc9a40ce970 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009d90 tx=0x7fc99c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214e6dc5c2d8710d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a1ffb700 1 -- 172.21.15.125:0/11848733 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00e070 con 0x7fc9a415e010 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a1ffb700 1 -- 172.21.15.125:0/11848733 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c00bb90 con 0x7fc9a415e010 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a1ffb700 1 -- 172.21.15.125:0/11848733 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c003a20 con 0x7fc9a415e010 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a92fc700 1 -- 172.21.15.125:0/11848733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a415e010 msgr2=0x7fc9a40ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a92fc700 1 --2- 172.21.15.125:0/11848733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a415e010 0x7fc9a40ce970 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009d90 tx=0x7fc99c00b330 comp rx=0 tx=0).stop 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a92fc700 1 -- 172.21.15.125:0/11848733 shutdown_connections 2023-11-28T11:10:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a92fc700 1 --2- 172.21.15.125:0/11848733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a415e010 0x7fc9a40ce970 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a92fc700 1 -- 172.21.15.125:0/11848733 >> 172.21.15.125:0/11848733 conn(0x7fc9a406a270 msgr2=0x7fc9a406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a92fc700 1 -- 172.21.15.125:0/11848733 shutdown_connections 2023-11-28T11:10:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.556+0000 7fc9a92fc700 1 -- 172.21.15.125:0/11848733 wait complete. 2023-11-28T11:10:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.558+0000 7fc9a92fc700 1 Processor -- start 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.558+0000 7fc9a92fc700 1 -- start start 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a92fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a406e400 0x7fc9a41508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a92fc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9a40d15f0 0x7fc9a40b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a92fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a415e010 0x7fc9a41efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a92fc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a4159570 con 0x7fc9a415e010 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a92fc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a4158ef0 con 0x7fc9a406e400 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a92fc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a41526a0 con 0x7fc9a40d15f0 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a415e010 0x7fc9a41efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a415e010 0x7fc9a41efaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59906/0 (socket says 172.21.15.125:59906) 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a37fe700 1 -- 172.21.15.125:0/4065613326 learned_addr learned my addr 172.21.15.125:0/4065613326 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a2ffd700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a406e400 0x7fc9a41508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a37fe700 1 -- 172.21.15.125:0/4065613326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9a40d15f0 msgr2=0x7fc9a40b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a37fe700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9a40d15f0 0x7fc9a40b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a37fe700 1 -- 172.21.15.125:0/4065613326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a406e400 msgr2=0x7fc9a41508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a37fe700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a406e400 0x7fc9a41508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a37fe700 1 -- 172.21.15.125:0/4065613326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c009a70 con 0x7fc9a415e010 2023-11-28T11:10:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a2ffd700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a406e400 0x7fc9a41508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a37fe700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a415e010 0x7fc9a41efaa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40b6eb0 tx=0x7fc99c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc99b7fe700 1 -- 172.21.15.125:0/4065613326 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c012630 con 0x7fc9a415e010 2023-11-28T11:10:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc99b7fe700 1 -- 172.21.15.125:0/4065613326 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c0127b0 con 0x7fc9a415e010 2023-11-28T11:10:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a92fc700 1 -- 172.21.15.125:0/4065613326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a415abc0 con 0x7fc9a415e010 2023-11-28T11:10:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc99b7fe700 1 -- 172.21.15.125:0/4065613326 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c012b60 con 0x7fc9a415e010 2023-11-28T11:10:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.559+0000 7fc9a92fc700 1 -- 172.21.15.125:0/4065613326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a415ec60 con 0x7fc9a415e010 2023-11-28T11:10:28.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.560+0000 7fc9a92fc700 1 -- 172.21.15.125:0/4065613326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a415e490 con 0x7fc9a415e010 2023-11-28T11:10:28.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.561+0000 7fc99b7fe700 1 -- 172.21.15.125:0/4065613326 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc99c012cc0 con 0x7fc9a415e010 2023-11-28T11:10:28.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.561+0000 7fc99b7fe700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc9840682f0 0x7fc98406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:28.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.561+0000 7fc99b7fe700 1 -- 172.21.15.125:0/4065613326 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc99c0881a0 con 0x7fc9a415e010 2023-11-28T11:10:28.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.561+0000 7fc9a2ffd700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc9840682f0 0x7fc98406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:28.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.562+0000 7fc9a2ffd700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc9840682f0 0x7fc98406a7a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc98c007fd0 tx=0x7fc98c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:28.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.565+0000 7fc99b7fe700 1 -- 172.21.15.125:0/4065613326 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc99c054d00 con 0x7fc9a415e010 2023-11-28T11:10:28.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:28.826+0000 7fc9a92fc700 1 -- 172.21.15.125:0/4065613326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7fc9a40743f0 con 0x7fc9a415e010 2023-11-28T11:10:29.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.073+0000 7fc99b7fe700 1 -- 172.21.15.125:0/4065613326 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v119) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc99c058320 con 0x7fc9a415e010 2023-11-28T11:10:29.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.076+0000 7fc9a92fc700 1 -- 172.21.15.125:0/4065613326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc9840682f0 msgr2=0x7fc98406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:29.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.076+0000 7fc9a92fc700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc9840682f0 0x7fc98406a7a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc98c007fd0 tx=0x7fc98c009040 comp rx=0 tx=0).stop 2023-11-28T11:10:29.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.076+0000 7fc9a92fc700 1 -- 172.21.15.125:0/4065613326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a415e010 msgr2=0x7fc9a41efaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:29.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.076+0000 7fc9a92fc700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a415e010 0x7fc9a41efaa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40b6eb0 tx=0x7fc99c004ad0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.077+0000 7fc9a92fc700 1 -- 172.21.15.125:0/4065613326 shutdown_connections 2023-11-28T11:10:29.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.077+0000 7fc9a92fc700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9a415e010 0x7fc9a41efaa0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.077+0000 7fc9a92fc700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a406e400 0x7fc9a41508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.077+0000 7fc9a92fc700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc9840682f0 0x7fc98406a7a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.077+0000 7fc9a92fc700 1 --2- 172.21.15.125:0/4065613326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9a40d15f0 0x7fc9a40b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.077+0000 7fc9a92fc700 1 -- 172.21.15.125:0/4065613326 >> 172.21.15.125:0/4065613326 conn(0x7fc9a406a270 msgr2=0x7fc9a40cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:29.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.077+0000 7fc9a92fc700 1 -- 172.21.15.125:0/4065613326 shutdown_connections 2023-11-28T11:10:29.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.077+0000 7fc9a92fc700 1 -- 172.21.15.125:0/4065613326 wait complete. 2023-11-28T11:10:29.092 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-11-28T11:10:29.092 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2023-11-28T11:10:29.092 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:10:29.092 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-28T11:10:29.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.211+0000 7f284d79b700 1 Processor -- start 2023-11-28T11:10:29.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.212+0000 7f284d79b700 1 -- start start 2023-11-28T11:10:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.212+0000 7f284d79b700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f28480b0880 0x7f284806b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.212+0000 7f284d79b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2848072180 0x7f28480aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.212+0000 7f284d79b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28480af070 0x7f28480af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.212+0000 7f284d79b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2848072620 con 0x7f2848072180 2023-11-28T11:10:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.212+0000 7f284d79b700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28480b43f0 con 0x7f28480b0880 2023-11-28T11:10:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.212+0000 7f284d79b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28480b46d0 con 0x7f28480af070 2023-11-28T11:10:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.212+0000 7f28467fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2848072180 0x7f28480aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:29.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.212+0000 7f28467fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2848072180 0x7f28480aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59910/0 (socket says 172.21.15.125:59910) 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.212+0000 7f28467fc700 1 -- 172.21.15.125:0/2854560629 learned_addr learned my addr 172.21.15.125:0/2854560629 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f2846ffd700 1 --2- 172.21.15.125:0/2854560629 >> v2:172.21.15.167:3300/0 conn(0x7f28480b0880 0x7f284806b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f28467fc700 1 -- 172.21.15.125:0/2854560629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28480af070 msgr2=0x7f28480af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f28477fe700 1 --2- 172.21.15.125:0/2854560629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28480af070 0x7f28480af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f28467fc700 1 --2- 172.21.15.125:0/2854560629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28480af070 0x7f28480af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f28467fc700 1 -- 172.21.15.125:0/2854560629 >> v2:172.21.15.167:3300/0 conn(0x7f28480b0880 msgr2=0x7f284806b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f28467fc700 1 --2- 172.21.15.125:0/2854560629 >> v2:172.21.15.167:3300/0 conn(0x7f28480b0880 0x7f284806b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f28467fc700 1 -- 172.21.15.125:0/2854560629 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28480b4d00 con 0x7f2848072180 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f2846ffd700 1 --2- 172.21.15.125:0/2854560629 >> v2:172.21.15.167:3300/0 conn(0x7f28480b0880 0x7f284806b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f28477fe700 1 --2- 172.21.15.125:0/2854560629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28480af070 0x7f28480af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f28467fc700 1 --2- 172.21.15.125:0/2854560629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2848072180 0x7f28480aeb30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f284806efd0 tx=0x7f2838009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e869ebe9e25ab02d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:29.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f2845ffb700 1 -- 172.21.15.125:0/2854560629 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283800b870 con 0x7f2848072180 2023-11-28T11:10:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f2845ffb700 1 -- 172.21.15.125:0/2854560629 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283800b9d0 con 0x7f2848072180 2023-11-28T11:10:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.213+0000 7f2845ffb700 1 -- 172.21.15.125:0/2854560629 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283800bd60 con 0x7f2848072180 2023-11-28T11:10:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.214+0000 7f284d79b700 1 -- 172.21.15.125:0/2854560629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2848072180 msgr2=0x7f28480aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.214+0000 7f284d79b700 1 --2- 172.21.15.125:0/2854560629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2848072180 0x7f28480aeb30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f284806efd0 tx=0x7f2838009bd0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.214+0000 7f284d79b700 1 -- 172.21.15.125:0/2854560629 shutdown_connections 2023-11-28T11:10:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.214+0000 7f284d79b700 1 --2- 172.21.15.125:0/2854560629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28480af070 0x7f28480af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.214+0000 7f284d79b700 1 --2- 172.21.15.125:0/2854560629 >> v2:172.21.15.167:3300/0 conn(0x7f28480b0880 0x7f284806b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.214+0000 7f284d79b700 1 --2- 172.21.15.125:0/2854560629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2848072180 0x7f28480aeb30 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.214+0000 7f284d79b700 1 -- 172.21.15.125:0/2854560629 >> 172.21.15.125:0/2854560629 conn(0x7f28480b2fc0 msgr2=0x7f2848071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.214+0000 7f284d79b700 1 -- 172.21.15.125:0/2854560629 shutdown_connections 2023-11-28T11:10:29.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.214+0000 7f284d79b700 1 -- 172.21.15.125:0/2854560629 wait complete. 2023-11-28T11:10:29.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.215+0000 7f284d79b700 1 Processor -- start 2023-11-28T11:10:29.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.215+0000 7f284d79b700 1 -- start start 2023-11-28T11:10:29.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f284d79b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2848072180 0x7f28481f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f284d79b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28480af070 0x7f28480c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f284d79b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28480b0880 0x7f284815e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f284d79b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28480c7be0 con 0x7f28480af070 2023-11-28T11:10:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f284d79b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28480c6fd0 con 0x7f28480b0880 2023-11-28T11:10:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f284d79b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28480c72b0 con 0x7f2848072180 2023-11-28T11:10:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f28467fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28480af070 0x7f28480c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f28467fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28480af070 0x7f28480c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59918/0 (socket says 172.21.15.125:59918) 2023-11-28T11:10:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f28467fc700 1 -- 172.21.15.125:0/1306751191 learned_addr learned my addr 172.21.15.125:0/1306751191 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f2846ffd700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2848072180 0x7f28481f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f28477fe700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28480b0880 0x7f284815e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:29.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f28467fc700 1 -- 172.21.15.125:0/1306751191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2848072180 msgr2=0x7f28481f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f28467fc700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2848072180 0x7f28481f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f28467fc700 1 -- 172.21.15.125:0/1306751191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28480b0880 msgr2=0x7f284815e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f28467fc700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28480b0880 0x7f284815e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f28467fc700 1 -- 172.21.15.125:0/1306751191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2838009550 con 0x7f28480af070 2023-11-28T11:10:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f28477fe700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28480b0880 0x7f284815e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f28467fc700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28480af070 0x7f28480c8c70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2838014040 tx=0x7f2838004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f282f7fe700 1 -- 172.21.15.125:0/1306751191 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838004520 con 0x7f28480af070 2023-11-28T11:10:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f282f7fe700 1 -- 172.21.15.125:0/1306751191 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283801e070 con 0x7f28480af070 2023-11-28T11:10:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f284d79b700 1 -- 172.21.15.125:0/1306751191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28480b49b0 con 0x7f28480af070 2023-11-28T11:10:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.216+0000 7f282f7fe700 1 -- 172.21.15.125:0/1306751191 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28380038e0 con 0x7f28480af070 2023-11-28T11:10:29.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.217+0000 7f284d79b700 1 -- 172.21.15.125:0/1306751191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28480b4fe0 con 0x7f28480af070 2023-11-28T11:10:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.217+0000 7f284d79b700 1 -- 172.21.15.125:0/1306751191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28480b0c50 con 0x7f28480af070 2023-11-28T11:10:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.218+0000 7f282f7fe700 1 -- 172.21.15.125:0/1306751191 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f283800f050 con 0x7f28480af070 2023-11-28T11:10:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.218+0000 7f282f7fe700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28340682f0 0x7f283406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.218+0000 7f282f7fe700 1 -- 172.21.15.125:0/1306751191 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2838020070 con 0x7f28480af070 2023-11-28T11:10:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.218+0000 7f2846ffd700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28340682f0 0x7f283406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.219+0000 7f2846ffd700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28340682f0 0x7f283406a7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f283c006fd0 tx=0x7f283c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:29.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.222+0000 7f282f7fe700 1 -- 172.21.15.125:0/1306751191 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2838053ba0 con 0x7f28480af070 2023-11-28T11:10:29.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:29.479+0000 7f284d79b700 1 -- 172.21.15.125:0/1306751191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f28480c7f70 con 0x7f28480af070 2023-11-28T11:10:30.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.076+0000 7f282f7fe700 1 -- 172.21.15.125:0/1306751191 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v120) v1 ==== 152+0+0 (secure 0 0 0) 0x7f28480c7f70 con 0x7f28480af070 2023-11-28T11:10:30.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.078+0000 7f284d79b700 1 -- 172.21.15.125:0/1306751191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28340682f0 msgr2=0x7f283406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:30.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.078+0000 7f284d79b700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28340682f0 0x7f283406a7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f283c006fd0 tx=0x7f283c008040 comp rx=0 tx=0).stop 2023-11-28T11:10:30.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.078+0000 7f284d79b700 1 -- 172.21.15.125:0/1306751191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28480af070 msgr2=0x7f28480c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:30.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.078+0000 7f284d79b700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28480af070 0x7f28480c8c70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2838014040 tx=0x7f2838004750 comp rx=0 tx=0).stop 2023-11-28T11:10:30.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.079+0000 7f284d79b700 1 -- 172.21.15.125:0/1306751191 shutdown_connections 2023-11-28T11:10:30.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.079+0000 7f284d79b700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28480b0880 0x7f284815e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.079+0000 7f284d79b700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f28340682f0 0x7f283406a7a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.079+0000 7f284d79b700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2848072180 0x7f28481f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.079+0000 7f284d79b700 1 --2- 172.21.15.125:0/1306751191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28480af070 0x7f28480c8c70 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.079+0000 7f284d79b700 1 -- 172.21.15.125:0/1306751191 >> 172.21.15.125:0/1306751191 conn(0x7f28480b2fc0 msgr2=0x7f28481e76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:30.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.079+0000 7f284d79b700 1 -- 172.21.15.125:0/1306751191 shutdown_connections 2023-11-28T11:10:30.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.079+0000 7f284d79b700 1 -- 172.21.15.125:0/1306751191 wait complete. 2023-11-28T11:10:30.095 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T11:10:30.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.222+0000 7fbaa4bed700 1 Processor -- start 2023-11-28T11:10:30.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.222+0000 7fbaa4bed700 1 -- start start 2023-11-28T11:10:30.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fbaa4bed700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 0x7fbaa00b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fbaa4bed700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbaa00af0a0 0x7fbaa015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fbaa4bed700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa0159ec0 con 0x7fbaa01599b0 2023-11-28T11:10:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fbaa4bed700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa00b1f60 con 0x7fbaa00af0a0 2023-11-28T11:10:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fbaa4bed700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa015d8a0 con 0x7fbaa00b1650 2023-11-28T11:10:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fba9ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbaa00af0a0 0x7fbaa015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fba9ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbaa00af0a0 0x7fbaa015a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59928/0 (socket says 172.21.15.125:59928) 2023-11-28T11:10:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fba9ed9d700 1 -- 172.21.15.125:0/3311378737 learned_addr learned my addr 172.21.15.125:0/3311378737 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fba9e59c700 1 --2- 172.21.15.125:0/3311378737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 0x7fbaa00b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fba9ed9d700 1 -- 172.21.15.125:0/3311378737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 msgr2=0x7fbaa00b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fba9ed9d700 1 --2- 172.21.15.125:0/3311378737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 0x7fbaa00b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fba9ed9d700 1 -- 172.21.15.125:0/3311378737 >> v1:172.21.15.167:6789/0 conn(0x7fbaa01599b0 legacy=0x7fbaa015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fba9ed9d700 1 -- 172.21.15.125:0/3311378737 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa015db80 con 0x7fbaa00af0a0 2023-11-28T11:10:30.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.223+0000 7fba9e59c700 1 --2- 172.21.15.125:0/3311378737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 0x7fbaa00b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fba9ed9d700 1 --2- 172.21.15.125:0/3311378737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa00af0a0 0x7fbaa015a350 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fba9800d150 tx=0x7fba9800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14e6004fbcda738 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fba9d59a700 1 -- 172.21.15.125:0/3311378737 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98010070 con 0x7fbaa00af0a0 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fba9d59a700 1 -- 172.21.15.125:0/3311378737 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800ddc0 con 0x7fbaa00af0a0 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fba9d59a700 1 -- 172.21.15.125:0/3311378737 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800b310 con 0x7fbaa00af0a0 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fbaa4bed700 1 -- 172.21.15.125:0/3311378737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa00af0a0 msgr2=0x7fbaa015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fbaa4bed700 1 --2- 172.21.15.125:0/3311378737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa00af0a0 0x7fbaa015a350 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fba9800d150 tx=0x7fba9800d460 comp rx=0 tx=0).stop 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fbaa4bed700 1 -- 172.21.15.125:0/3311378737 shutdown_connections 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fbaa4bed700 1 --2- 172.21.15.125:0/3311378737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa00af0a0 0x7fbaa015a350 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fbaa4bed700 1 --2- 172.21.15.125:0/3311378737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 0x7fbaa00b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fbaa4bed700 1 -- 172.21.15.125:0/3311378737 >> 172.21.15.125:0/3311378737 conn(0x7fbaa006c010 msgr2=0x7fbaa00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fbaa4bed700 1 -- 172.21.15.125:0/3311378737 shutdown_connections 2023-11-28T11:10:30.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.224+0000 7fbaa4bed700 1 -- 172.21.15.125:0/3311378737 wait complete. 2023-11-28T11:10:30.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.226+0000 7fbaa4bed700 1 Processor -- start 2023-11-28T11:10:30.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.226+0000 7fbaa4bed700 1 -- start start 2023-11-28T11:10:30.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.226+0000 7fbaa4bed700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbaa00af0a0 0x7fbaa01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.226+0000 7fbaa4bed700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 0x7fbaa00c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.226+0000 7fbaa4bed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa00afe40 0x7fbaa00b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.226+0000 7fbaa4bed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00b2a90 con 0x7fbaa00afe40 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.226+0000 7fbaa4bed700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00c3700 con 0x7fbaa00af0a0 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.226+0000 7fbaa4bed700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00c3fa0 con 0x7fbaa00b1650 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa00afe40 0x7fbaa00b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa00afe40 0x7fbaa00b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59934/0 (socket says 172.21.15.125:59934) 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9ed9d700 1 -- 172.21.15.125:0/839627551 learned_addr learned my addr 172.21.15.125:0/839627551 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9e59c700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbaa00af0a0 0x7fbaa01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9dd9b700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 0x7fbaa00c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9ed9d700 1 -- 172.21.15.125:0/839627551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 msgr2=0x7fbaa00c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9ed9d700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 0x7fbaa00c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9ed9d700 1 -- 172.21.15.125:0/839627551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbaa00af0a0 msgr2=0x7fbaa01555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9ed9d700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbaa00af0a0 0x7fbaa01555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9ed9d700 1 -- 172.21.15.125:0/839627551 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9800bd40 con 0x7fbaa00afe40 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9dd9b700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 0x7fbaa00c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba9ed9d700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa00afe40 0x7fbaa00b02c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00708b0 tx=0x7fba98004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba8effd700 1 -- 172.21.15.125:0/839627551 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800bbc0 con 0x7fbaa00afe40 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba8effd700 1 -- 172.21.15.125:0/839627551 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800b4c0 con 0x7fbaa00afe40 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fbaa4bed700 1 -- 172.21.15.125:0/839627551 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa015a890 con 0x7fbaa00afe40 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fba8effd700 1 -- 172.21.15.125:0/839627551 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98004040 con 0x7fbaa00afe40 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.227+0000 7fbaa4bed700 1 -- 172.21.15.125:0/839627551 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa015de60 con 0x7fbaa00afe40 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.228+0000 7fbaa4bed700 1 -- 172.21.15.125:0/839627551 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa015aa20 con 0x7fbaa00afe40 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.229+0000 7fba8effd700 1 -- 172.21.15.125:0/839627551 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fba9802d070 con 0x7fbaa00afe40 2023-11-28T11:10:30.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.229+0000 7fba8effd700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fba800682f0 0x7fba8006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.229+0000 7fba8effd700 1 -- 172.21.15.125:0/839627551 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fba98089180 con 0x7fbaa00afe40 2023-11-28T11:10:30.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.229+0000 7fba9e59c700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fba800682f0 0x7fba8006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.229+0000 7fba9e59c700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fba800682f0 0x7fba8006a7a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fba94006fd0 tx=0x7fba94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:30.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.233+0000 7fba8effd700 1 -- 172.21.15.125:0/839627551 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fba98055c80 con 0x7fbaa00afe40 2023-11-28T11:10:30.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.416+0000 7fbaa4bed700 1 -- 172.21.15.125:0/839627551 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbaa00743f0 con 0x7fbaa00afe40 2023-11-28T11:10:30.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.421+0000 7fba8effd700 1 -- 172.21.15.125:0/839627551 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fba980592a0 con 0x7fbaa00afe40 2023-11-28T11:10:30.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 -- 172.21.15.125:0/839627551 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fba800682f0 msgr2=0x7fba8006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:30.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fba800682f0 0x7fba8006a7a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fba94006fd0 tx=0x7fba94008040 comp rx=0 tx=0).stop 2023-11-28T11:10:30.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 -- 172.21.15.125:0/839627551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa00afe40 msgr2=0x7fbaa00b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa00afe40 0x7fbaa00b02c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00708b0 tx=0x7fba98004ad0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 -- 172.21.15.125:0/839627551 shutdown_connections 2023-11-28T11:10:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa00afe40 0x7fbaa00b02c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbaa00af0a0 0x7fbaa01555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fba800682f0 0x7fba8006a7a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 --2- 172.21.15.125:0/839627551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbaa00b1650 0x7fbaa00c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 -- 172.21.15.125:0/839627551 >> 172.21.15.125:0/839627551 conn(0x7fbaa006c010 msgr2=0x7fbaa0070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:30.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 -- 172.21.15.125:0/839627551 shutdown_connections 2023-11-28T11:10:30.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.423+0000 7fbaa4bed700 1 -- 172.21.15.125:0/839627551 wait complete. 2023-11-28T11:10:30.437 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:10:30.438 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:10:30.480 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:10:30.526 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:10:30.526 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:10:30.526 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:10:30.544 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16093 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T11:10:30.544 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:10:30.544 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:10:30.584 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:10:30.584 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:10:30.585 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:10:30.602 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16093 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T11:10:30.602 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:10:30.602 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:10:30.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:10:30.643 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T11:10:30.644 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:10:30.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.762+0000 7fee470d0700 1 Processor -- start 2023-11-28T11:10:30.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.762+0000 7fee470d0700 1 -- start start 2023-11-28T11:10:30.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.763+0000 7fee470d0700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fee4006ab10 0x7fee4006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.763+0000 7fee470d0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee400cd5a0 0x7fee40160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.763+0000 7fee470d0700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee400d1ee0 con 0x7fee400b22a0 2023-11-28T11:10:30.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.763+0000 7fee470d0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4006b420 con 0x7fee400cd5a0 2023-11-28T11:10:30.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.763+0000 7fee470d0700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee400cdb10 con 0x7fee4006ab10 2023-11-28T11:10:30.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.763+0000 7fee3ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee400cd5a0 0x7fee40160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.763+0000 7fee3ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee400cd5a0 0x7fee40160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59938/0 (socket says 172.21.15.125:59938) 2023-11-28T11:10:30.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.763+0000 7fee3ffff700 1 -- 172.21.15.125:0/1622518892 learned_addr learned my addr 172.21.15.125:0/1622518892 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:30.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.763+0000 7fee44e6c700 1 --2- 172.21.15.125:0/1622518892 >> v2:172.21.15.167:3300/0 conn(0x7fee4006ab10 0x7fee4006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee3ffff700 1 -- 172.21.15.125:0/1622518892 >> v2:172.21.15.167:3300/0 conn(0x7fee4006ab10 msgr2=0x7fee4006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:30.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee3ffff700 1 --2- 172.21.15.125:0/1622518892 >> v2:172.21.15.167:3300/0 conn(0x7fee4006ab10 0x7fee4006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee3ffff700 1 -- 172.21.15.125:0/1622518892 >> v1:172.21.15.167:6789/0 conn(0x7fee400b22a0 legacy=0x7fee40160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:30.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee3ffff700 1 -- 172.21.15.125:0/1622518892 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee400d1890 con 0x7fee400cd5a0 2023-11-28T11:10:30.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee3ffff700 1 --2- 172.21.15.125:0/1622518892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee400cd5a0 0x7fee40160300 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fee400d0cb0 tx=0x7fee2c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49686249227915ff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:30.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee3f7fe700 1 -- 172.21.15.125:0/1622518892 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c00b870 con 0x7fee400cd5a0 2023-11-28T11:10:30.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee3f7fe700 1 -- 172.21.15.125:0/1622518892 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c00b9d0 con 0x7fee400cd5a0 2023-11-28T11:10:30.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee3f7fe700 1 -- 172.21.15.125:0/1622518892 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c00bd60 con 0x7fee400cd5a0 2023-11-28T11:10:30.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee470d0700 1 -- 172.21.15.125:0/1622518892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee400cd5a0 msgr2=0x7fee40160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:30.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee470d0700 1 --2- 172.21.15.125:0/1622518892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee400cd5a0 0x7fee40160300 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fee400d0cb0 tx=0x7fee2c009bd0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee470d0700 1 -- 172.21.15.125:0/1622518892 shutdown_connections 2023-11-28T11:10:30.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee470d0700 1 --2- 172.21.15.125:0/1622518892 >> v2:172.21.15.167:3300/0 conn(0x7fee4006ab10 0x7fee4006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee470d0700 1 --2- 172.21.15.125:0/1622518892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee400cd5a0 0x7fee40160300 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee470d0700 1 -- 172.21.15.125:0/1622518892 >> 172.21.15.125:0/1622518892 conn(0x7fee4006c520 msgr2=0x7fee4006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:30.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee470d0700 1 -- 172.21.15.125:0/1622518892 shutdown_connections 2023-11-28T11:10:30.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.764+0000 7fee470d0700 1 -- 172.21.15.125:0/1622518892 wait complete. 2023-11-28T11:10:30.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.766+0000 7fee470d0700 1 Processor -- start 2023-11-28T11:10:30.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.766+0000 7fee470d0700 1 -- start start 2023-11-28T11:10:30.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.766+0000 7fee470d0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee4006ab10 0x7fee400cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.766+0000 7fee470d0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee400b22a0 0x7fee40154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.766+0000 7fee470d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee400cd5a0 0x7fee401f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.766+0000 7fee470d0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee40154b60 con 0x7fee400cd5a0 2023-11-28T11:10:30.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.766+0000 7fee470d0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee400c7c00 con 0x7fee400b22a0 2023-11-28T11:10:30.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.766+0000 7fee470d0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee400c84a0 con 0x7fee4006ab10 2023-11-28T11:10:30.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee4566d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee400cd5a0 0x7fee401f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee4566d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee400cd5a0 0x7fee401f2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59948/0 (socket says 172.21.15.125:59948) 2023-11-28T11:10:30.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee4566d700 1 -- 172.21.15.125:0/3486560806 learned_addr learned my addr 172.21.15.125:0/3486560806 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:30.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee3ffff700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee400b22a0 0x7fee40154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee44e6c700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee4006ab10 0x7fee400cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee4566d700 1 -- 172.21.15.125:0/3486560806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee4006ab10 msgr2=0x7fee400cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:30.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee4566d700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee4006ab10 0x7fee400cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee4566d700 1 -- 172.21.15.125:0/3486560806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee400b22a0 msgr2=0x7fee40154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:30.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee4566d700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee400b22a0 0x7fee40154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:30.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee4566d700 1 -- 172.21.15.125:0/3486560806 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c009550 con 0x7fee400cd5a0 2023-11-28T11:10:30.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee4566d700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee400cd5a0 0x7fee401f2e40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fee3800cc50 tx=0x7fee3800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:30.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee3d7fa700 1 -- 172.21.15.125:0/3486560806 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38003c00 con 0x7fee400cd5a0 2023-11-28T11:10:30.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee3d7fa700 1 -- 172.21.15.125:0/3486560806 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38003d60 con 0x7fee400cd5a0 2023-11-28T11:10:30.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee470d0700 1 -- 172.21.15.125:0/3486560806 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4015cad0 con 0x7fee400cd5a0 2023-11-28T11:10:30.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee3d7fa700 1 -- 172.21.15.125:0/3486560806 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3800aab0 con 0x7fee400cd5a0 2023-11-28T11:10:30.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.767+0000 7fee470d0700 1 -- 172.21.15.125:0/3486560806 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee400d1b70 con 0x7fee400cd5a0 2023-11-28T11:10:30.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.768+0000 7fee470d0700 1 -- 172.21.15.125:0/3486560806 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee400b1ec0 con 0x7fee400cd5a0 2023-11-28T11:10:30.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.768+0000 7fee3d7fa700 1 -- 172.21.15.125:0/3486560806 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fee38010050 con 0x7fee400cd5a0 2023-11-28T11:10:30.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.769+0000 7fee3d7fa700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fee240682f0 0x7fee2406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:30.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.769+0000 7fee3d7fa700 1 -- 172.21.15.125:0/3486560806 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fee380857c0 con 0x7fee400cd5a0 2023-11-28T11:10:30.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.769+0000 7fee44e6c700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fee240682f0 0x7fee2406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:30.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.769+0000 7fee44e6c700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fee240682f0 0x7fee2406a7a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fee400cb330 tx=0x7fee34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:30.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.773+0000 7fee3d7fa700 1 -- 172.21.15.125:0/3486560806 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fee38052320 con 0x7fee400cd5a0 2023-11-28T11:10:30.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.998+0000 7fee470d0700 1 -- 172.21.15.125:0/3486560806 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee400c8610 con 0x7fee400cd5a0 2023-11-28T11:10:31.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:30.998+0000 7fee3d7fa700 1 -- 172.21.15.125:0/3486560806 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fee38055940 con 0x7fee400cd5a0 2023-11-28T11:10:31.000 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:31.001 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1240521006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1240521006},{"type":"v1","addr":"172.21.15.167:6834","nonce":1240521006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2122606110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2122606110},{"type":"v1","addr":"172.21.15.167:6835","nonce":2122606110}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5280,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/888812458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":888812458},{"type":"v1","addr":"172.21.15.125:6835","nonce":888812458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/496586267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":496586267},{"type":"v1","addr":"172.21.15.125:6837","nonce":496586267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-11-28T11:10:31.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 -- 172.21.15.125:0/3486560806 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fee240682f0 msgr2=0x7fee2406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fee240682f0 0x7fee2406a7a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fee400cb330 tx=0x7fee34008040 comp rx=0 tx=0).stop 2023-11-28T11:10:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 -- 172.21.15.125:0/3486560806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee400cd5a0 msgr2=0x7fee401f2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee400cd5a0 0x7fee401f2e40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fee3800cc50 tx=0x7fee3800cf60 comp rx=0 tx=0).stop 2023-11-28T11:10:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 -- 172.21.15.125:0/3486560806 shutdown_connections 2023-11-28T11:10:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee400cd5a0 0x7fee401f2e40 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fee240682f0 0x7fee2406a7a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee4006ab10 0x7fee400cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 --2- 172.21.15.125:0/3486560806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee400b22a0 0x7fee40154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 -- 172.21.15.125:0/3486560806 >> 172.21.15.125:0/3486560806 conn(0x7fee4006c520 msgr2=0x7fee400b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 -- 172.21.15.125:0/3486560806 shutdown_connections 2023-11-28T11:10:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.001+0000 7fee470d0700 1 -- 172.21.15.125:0/3486560806 wait complete. 2023-11-28T11:10:31.004 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 18 2023-11-28T11:10:31.015 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:10:31.015 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T11:10:31.015 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T11:10:31.015 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:10:31.015 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:10:31.015 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T11:10:31.016 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T11:10:31.016 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:10:31.016 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:10:31.016 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T11:10:31.016 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T11:10:31.017 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:10:31.017 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:10:31.017 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T11:10:31.017 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T11:10:31.017 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:10:31.025 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T11:10:31.025 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:10:31.026 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T11:10:31.026 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:10:31.027 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T11:10:31.027 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:10:31.028 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T11:10:31.028 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:10:31.068 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:10:31.069 DEBUG:teuthology.parallel:result is None 2023-11-28T11:10:31.070 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:10:31.071 DEBUG:teuthology.parallel:result is None 2023-11-28T11:10:31.071 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:10:31.071 DEBUG:teuthology.parallel:result is None 2023-11-28T11:10:31.077 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:10:31.077 DEBUG:teuthology.parallel:result is None 2023-11-28T11:10:31.077 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T11:10:31.147 INFO:tasks.ceph.mds.c.smithi125.stdout:starting mds.c at 2023-11-28T11:10:31.147 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-11-28T11:10:31.169 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2023-11-28T11:10:31.170 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2023-11-28T11:10:31.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.206+0000 7fd5cd777700 1 Processor -- start 2023-11-28T11:10:31.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.207+0000 7fd5cd777700 1 -- start start 2023-11-28T11:10:31.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.207+0000 7fd5cd777700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd5c80b0540 0x7fd5c80b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:31.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.207+0000 7fd5cd777700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80c9b00 0x7fd5c81598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:31.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.207+0000 7fd5cd777700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c815cf40 con 0x7fd5c80adf30 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.207+0000 7fd5cd777700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c80b0e50 con 0x7fd5c80b0540 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.207+0000 7fd5cd777700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c815ddc0 con 0x7fd5c80c9b00 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.207+0000 7fd5c77fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd5c80adf30 0x7fd5c815d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44102/0 (socket says 172.21.15.125:44102) 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.207+0000 7fd5c77fe700 1 -- 172.21.15.125:0/148779384 learned_addr learned my addr 172.21.15.125:0/148779384 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133659352 0 0) 0x7fd5c815cf40 con 0x7fd5c80adf30 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c6ffd700 1 --2- 172.21.15.125:0/148779384 >> v2:172.21.15.167:3300/0 conn(0x7fd5c80b0540 0x7fd5c80b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c67fc700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80c9b00 0x7fd5c81598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b00035b0 con 0x7fd5c80adf30 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1010531846 0 0) 0x7fd5b00035b0 con 0x7fd5c80adf30 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80c9b00 msgr2=0x7fd5c81598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80c9b00 0x7fd5c81598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 >> v2:172.21.15.167:3300/0 conn(0x7fd5c80b0540 msgr2=0x7fd5c80b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 --2- 172.21.15.125:0/148779384 >> v2:172.21.15.167:3300/0 conn(0x7fd5c80b0540 0x7fd5c80b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c815a1c0 con 0x7fd5c80adf30 2023-11-28T11:10:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fd5b8001670 con 0x7fd5c80adf30 2023-11-28T11:10:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 >> v1:172.21.15.125:6789/0 conn(0x7fd5c80adf30 legacy=0x7fd5c815d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80c9b00 0x7fd5b0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b0003f80 0x7fd5b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b0004d90 0x7fd5b0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80b0e50 con 0x7fd5b0004d90 2023-11-28T11:10:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c815ddc0 con 0x7fd5b0003f80 2023-11-28T11:10:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b000ba40 con 0x7fd5c80c9b00 2023-11-28T11:10:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c77fe700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b0004d90 0x7fd5b0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c6ffd700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80c9b00 0x7fd5b0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c67fc700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b0003f80 0x7fd5b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c6ffd700 1 -- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b0003f80 msgr2=0x7fd5b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c6ffd700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5b0003f80 0x7fd5b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c6ffd700 1 -- 172.21.15.125:0/148779384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b0004d90 msgr2=0x7fd5b0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c6ffd700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b0004d90 0x7fd5b0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c6ffd700 1 -- 172.21.15.125:0/148779384 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b00035b0 con 0x7fd5c80c9b00 2023-11-28T11:10:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.208+0000 7fd5c77fe700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b0004d90 0x7fd5b0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:10:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.209+0000 7fd5c6ffd700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80c9b00 0x7fd5b0003a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009fc0 tx=0x7fd5b0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18dba1401300b7a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.209+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000ebd0 con 0x7fd5c80c9b00 2023-11-28T11:10:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.209+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c000f040 con 0x7fd5c80c9b00 2023-11-28T11:10:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.209+0000 7fd5c5ffb700 1 -- 172.21.15.125:0/148779384 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0014480 con 0x7fd5c80c9b00 2023-11-28T11:10:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.209+0000 7fd5cd777700 1 -- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80c9b00 msgr2=0x7fd5b0003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.209+0000 7fd5cd777700 1 --2- 172.21.15.125:0/148779384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80c9b00 0x7fd5b0003a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009fc0 tx=0x7fd5b0005880 comp rx=0 tx=0).stop 2023-11-28T11:10:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.209+0000 7fd5c77fe700 1 -- 172.21.15.125:0/148779384 reap_dead start 2023-11-28T11:10:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.209+0000 7fd5cd777700 1 -- 172.21.15.125:0/148779384 shutdown_connections 2023-11-28T11:10:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.209+0000 7fd5cd777700 1 -- 172.21.15.125:0/148779384 >> 172.21.15.125:0/148779384 conn(0x7fd5c80cb540 msgr2=0x7fd5c80cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.209+0000 7fd5cd777700 1 -- 172.21.15.125:0/148779384 shutdown_connections 2023-11-28T11:10:31.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.209+0000 7fd5cd777700 1 -- 172.21.15.125:0/148779384 wait complete. 2023-11-28T11:10:31.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.211+0000 7fd5cd777700 1 Processor -- start 2023-11-28T11:10:31.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.211+0000 7fd5cd777700 1 -- start start 2023-11-28T11:10:31.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.211+0000 7fd5cd777700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80c9b00 0x7fd5c8158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:31.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.211+0000 7fd5cd777700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80b4000 0x7fd5c8148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:31.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.211+0000 7fd5cd777700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c81f3720 0x7fd5c81f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:31.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.211+0000 7fd5cd777700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8158a70 con 0x7fd5c80c9b00 2023-11-28T11:10:31.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5cd777700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81f40e0 con 0x7fd5c81f3720 2023-11-28T11:10:31.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5cd777700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80b1fe0 con 0x7fd5c80b4000 2023-11-28T11:10:31.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5c6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80c9b00 0x7fd5c8158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5c6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80c9b00 0x7fd5c8158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59990/0 (socket says 172.21.15.125:59990) 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5c6ffd700 1 -- 172.21.15.125:0/2579043837 learned_addr learned my addr 172.21.15.125:0/2579043837 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5c67fc700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80b4000 0x7fd5c8148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5c77fe700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c81f3720 0x7fd5c81f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5c6ffd700 1 -- 172.21.15.125:0/2579043837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80b4000 msgr2=0x7fd5c8148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5c6ffd700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80b4000 0x7fd5c8148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5c6ffd700 1 -- 172.21.15.125:0/2579043837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c81f3720 msgr2=0x7fd5c81f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5c6ffd700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c81f3720 0x7fd5c81f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5c6ffd700 1 -- 172.21.15.125:0/2579043837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c815a780 con 0x7fd5c80c9b00 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5c6ffd700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80c9b00 0x7fd5c8158530 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000eed0 tx=0x7fd5c0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5af7fe700 1 -- 172.21.15.125:0/2579043837 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0004450 con 0x7fd5c80c9b00 2023-11-28T11:10:31.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5af7fe700 1 -- 172.21.15.125:0/2579043837 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c0003e90 con 0x7fd5c80c9b00 2023-11-28T11:10:31.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5cd777700 1 -- 172.21.15.125:0/2579043837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c815a4a0 con 0x7fd5c80c9b00 2023-11-28T11:10:31.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5af7fe700 1 -- 172.21.15.125:0/2579043837 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00047f0 con 0x7fd5c80c9b00 2023-11-28T11:10:31.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.212+0000 7fd5cd777700 1 -- 172.21.15.125:0/2579043837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c815d190 con 0x7fd5c80c9b00 2023-11-28T11:10:31.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.213+0000 7fd5cd777700 1 -- 172.21.15.125:0/2579043837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c8158300 con 0x7fd5c80c9b00 2023-11-28T11:10:31.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.213+0000 7fd5af7fe700 1 -- 172.21.15.125:0/2579043837 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd5c002e020 con 0x7fd5c80c9b00 2023-11-28T11:10:31.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.214+0000 7fd5af7fe700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd5b4068320 0x7fd5b406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:31.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.214+0000 7fd5c67fc700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd5b4068320 0x7fd5b406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:31.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.214+0000 7fd5af7fe700 1 -- 172.21.15.125:0/2579043837 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd5c0087a70 con 0x7fd5c80c9b00 2023-11-28T11:10:31.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.214+0000 7fd5c67fc700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd5b4068320 0x7fd5b406a7d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd5c81584e0 tx=0x7fd5bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:31.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.218+0000 7fd5af7fe700 1 -- 172.21.15.125:0/2579043837 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd5c0054570 con 0x7fd5c80c9b00 2023-11-28T11:10:31.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:31.414+0000 7fd5cd777700 1 -- 172.21.15.125:0/2579043837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd5c80743f0 con 0x7fd5c80c9b00 2023-11-28T11:10:32.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.207+0000 7fd5af7fe700 1 -- 172.21.15.125:0/2579043837 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd5c0057b90 con 0x7fd5c80c9b00 2023-11-28T11:10:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 -- 172.21.15.125:0/2579043837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd5b4068320 msgr2=0x7fd5b406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd5b4068320 0x7fd5b406a7d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd5c81584e0 tx=0x7fd5bc008040 comp rx=0 tx=0).stop 2023-11-28T11:10:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 -- 172.21.15.125:0/2579043837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80c9b00 msgr2=0x7fd5c8158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80c9b00 0x7fd5c8158530 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000eed0 tx=0x7fd5c0009750 comp rx=0 tx=0).stop 2023-11-28T11:10:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 -- 172.21.15.125:0/2579043837 shutdown_connections 2023-11-28T11:10:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c81f3720 0x7fd5c81f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c80c9b00 0x7fd5c8158530 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd5b4068320 0x7fd5b406a7d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 --2- 172.21.15.125:0/2579043837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c80b4000 0x7fd5c8148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 -- 172.21.15.125:0/2579043837 >> 172.21.15.125:0/2579043837 conn(0x7fd5c80cb540 msgr2=0x7fd5c8159040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 -- 172.21.15.125:0/2579043837 shutdown_connections 2023-11-28T11:10:32.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.210+0000 7fd5cd777700 1 -- 172.21.15.125:0/2579043837 wait complete. 2023-11-28T11:10:32.213 INFO:teuthology.orchestra.run.smithi125.stderr: removed all blocklist entries 2023-11-28T11:10:32.227 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T11:10:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.351+0000 7f8f90a77700 1 Processor -- start 2023-11-28T11:10:32.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.351+0000 7f8f90a77700 1 -- start start 2023-11-28T11:10:32.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.352+0000 7f8f90a77700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8f8c06e400 0x7f8f8c0b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.352+0000 7f8f90a77700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8c06e900 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.352+0000 7f8f90a77700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8c160390 con 0x7f8f8c160e70 2023-11-28T11:10:32.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.352+0000 7f8f90a77700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8c160670 con 0x7f8f8c06e400 2023-11-28T11:10:32.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.352+0000 7f8f89d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8f8c06e400 0x7f8f8c0b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.352+0000 7f8f8a59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8f8c0d0c60 0x7f8f8c0d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44124/0 (socket says 172.21.15.125:44124) 2023-11-28T11:10:32.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.352+0000 7f8f8a59c700 1 -- 172.21.15.125:0/2667648343 learned_addr learned my addr 172.21.15.125:0/2667648343 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:32.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.352+0000 7f8f89d9b700 1 -- 172.21.15.125:0/2667648343 >> v1:172.21.15.167:6789/0 conn(0x7f8f8c160e70 legacy=0x7f8f8c15c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.352+0000 7f8f89d9b700 1 -- 172.21.15.125:0/2667648343 >> v1:172.21.15.125:6789/0 conn(0x7f8f8c0d0c60 legacy=0x7f8f8c0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.352+0000 7f8f8959a700 1 -- 172.21.15.125:0/2667648343 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998460786 0 0) 0x7f8f8c06e900 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.352+0000 7f8f89d9b700 1 -- 172.21.15.125:0/2667648343 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c160950 con 0x7f8f8c06e400 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.353+0000 7f8f89d9b700 1 --2- 172.21.15.125:0/2667648343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f8c06e400 0x7f8f8c0b5be0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009840 tx=0x7f8f7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ddeeee6b6e7bff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.353+0000 7f8f8959a700 1 -- 172.21.15.125:0/2667648343 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c004230 con 0x7f8f8c06e400 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.353+0000 7f8f8959a700 1 -- 172.21.15.125:0/2667648343 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c004390 con 0x7f8f8c06e400 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.353+0000 7f8f8959a700 1 -- 172.21.15.125:0/2667648343 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0036a0 con 0x7f8f8c06e400 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.353+0000 7f8f90a77700 1 -- 172.21.15.125:0/2667648343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f8c06e400 msgr2=0x7f8f8c0b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.353+0000 7f8f90a77700 1 --2- 172.21.15.125:0/2667648343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f8c06e400 0x7f8f8c0b5be0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009840 tx=0x7f8f7c009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.353+0000 7f8f90a77700 1 -- 172.21.15.125:0/2667648343 shutdown_connections 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.353+0000 7f8f90a77700 1 --2- 172.21.15.125:0/2667648343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f8c06e400 0x7f8f8c0b5be0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.353+0000 7f8f90a77700 1 -- 172.21.15.125:0/2667648343 >> 172.21.15.125:0/2667648343 conn(0x7f8f8c06a270 msgr2=0x7f8f8c06a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:32.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.353+0000 7f8f90a77700 1 -- 172.21.15.125:0/2667648343 shutdown_connections 2023-11-28T11:10:32.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.353+0000 7f8f90a77700 1 -- 172.21.15.125:0/2667648343 wait complete. 2023-11-28T11:10:32.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.355+0000 7f8f90a77700 1 Processor -- start 2023-11-28T11:10:32.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.355+0000 7f8f90a77700 1 -- start start 2023-11-28T11:10:32.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.355+0000 7f8f90a77700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f8c06e400 0x7f8f8c1f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.355+0000 7f8f90a77700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f8c0d0c60 0x7f8f8c14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.355+0000 7f8f90a77700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f8c160e70 0x7f8f8c0b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.355+0000 7f8f90a77700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c1f3310 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.355+0000 7f8f90a77700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c0b2120 con 0x7f8f8c06e400 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.355+0000 7f8f90a77700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c1f35b0 con 0x7f8f8c160e70 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f89d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f8c0d0c60 0x7f8f8c14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f89d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f8c0d0c60 0x7f8f8c14b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60008/0 (socket says 172.21.15.125:60008) 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f89d9b700 1 -- 172.21.15.125:0/3014858674 learned_addr learned my addr 172.21.15.125:0/3014858674 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f8ad9d700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f8c160e70 0x7f8f8c0b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f8a59c700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f8c06e400 0x7f8f8c1f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f89d9b700 1 -- 172.21.15.125:0/3014858674 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f8c160e70 msgr2=0x7f8f8c0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f89d9b700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f8c160e70 0x7f8f8c0b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f89d9b700 1 -- 172.21.15.125:0/3014858674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f8c06e400 msgr2=0x7f8f8c1f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f89d9b700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f8c06e400 0x7f8f8c1f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f89d9b700 1 -- 172.21.15.125:0/3014858674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c0094a0 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f8a59c700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f8c06e400 0x7f8f8c1f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f89d9b700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f8c0d0c60 0x7f8f8c14b880 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0090b0 tx=0x7f8f7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f7affd700 1 -- 172.21.15.125:0/3014858674 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c011830 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f7affd700 1 -- 172.21.15.125:0/3014858674 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c01e070 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f7affd700 1 -- 172.21.15.125:0/3014858674 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c011bf0 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f90a77700 1 -- 172.21.15.125:0/3014858674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8c15d080 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.356+0000 7f8f90a77700 1 -- 172.21.15.125:0/3014858674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8c0d0740 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.357+0000 7f8f90a77700 1 -- 172.21.15.125:0/3014858674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8c15d210 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.358+0000 7f8f7affd700 1 -- 172.21.15.125:0/3014858674 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8f7c017020 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.358+0000 7f8f7affd700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8f6c0682f0 0x7f8f6c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.358+0000 7f8f7affd700 1 -- 172.21.15.125:0/3014858674 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8f7c086cd0 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.358+0000 7f8f8a59c700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8f6c0682f0 0x7f8f6c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.359+0000 7f8f8a59c700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8f6c0682f0 0x7f8f6c06a7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8f80000f60 tx=0x7f8f80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:32.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.362+0000 7f8f7affd700 1 -- 172.21.15.125:0/3014858674 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8f7c053880 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.619+0000 7f8f90a77700 1 -- 172.21.15.125:0/3014858674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8f8c0743f0 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.620+0000 7f8f7affd700 1 -- 172.21.15.125:0/3014858674 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f8f7c020090 con 0x7f8f8c0d0c60 2023-11-28T11:10:32.622 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:32.622 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:10:32.622 INFO:teuthology.orchestra.run.smithi125.stdout: "auth_dump": [ 2023-11-28T11:10:32.622 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.622 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.a", 2023-11-28T11:10:32.622 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlKEkAABAAXjMnHGmTU8Gdre/P6kooJw==", 2023-11-28T11:10:32.622 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.622 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:10:32.622 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:10:32.622 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.b", 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlxhVJDBAAxVivRKj7W5EO227bsIQ1dA==", 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.623 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.c", 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVltF09BxAAjhpf029IQe6awVbeYEV8qQ==", 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.624 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.d", 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVl3cCKExAAWAOqQnPUf3vKABnsfyJTKQ==", 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.0", 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD6yWVlZHGALxAAwg7519g4L+22B6q8avNECw==", 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.625 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:10:32.626 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:10:32.626 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.626 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.626 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.626 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.626 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.1", 2023-11-28T11:10:32.626 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD9yWVlxElTLxAAWU/HwnR+qTecCapxOKTCBQ==", 2023-11-28T11:10:32.626 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.626 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:10:32.626 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:10:32.626 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.627 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.627 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.627 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.627 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.2", 2023-11-28T11:10:32.627 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAAymVllpzBLhAA1iR/VKxQoh+ekp0oO6Ku2g==", 2023-11-28T11:10:32.627 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.627 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:10:32.627 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:10:32.627 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.627 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.627 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.3", 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADymVl9jx+LhAAG+PnOiHMTWVr0p98muHA1Q==", 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.4", 2023-11-28T11:10:32.628 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAJymVlCGY+NxAAO5zScvdHMyOEFJcLjlY6qQ==", 2023-11-28T11:10:32.629 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.629 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:10:32.629 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:10:32.629 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.629 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.629 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.629 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.629 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.5", 2023-11-28T11:10:32.629 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAMymVlkPG0NxAAL9zxg4JfD/Gm7bVEY8aEzA==", 2023-11-28T11:10:32.629 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.629 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:10:32.630 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:10:32.630 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.630 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.630 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.630 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.630 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.6", 2023-11-28T11:10:32.630 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAPymVlh0cjNxAACCUdBgzqGw/yMw7P5RKBlQ==", 2023-11-28T11:10:32.630 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.630 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:10:32.630 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:10:32.630 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.7", 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQASymVltqqRNhAACw31V5Uw92UYbsoOFAt4NA==", 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.631 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.632 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.0", 2023-11-28T11:10:32.632 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlAiP9FxAAuKva+izyr8tPFad19nH2Pg==", 2023-11-28T11:10:32.632 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.632 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:10:32.632 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow r", 2023-11-28T11:10:32.632 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-28T11:10:32.632 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.632 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.632 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.632 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.1", 2023-11-28T11:10:32.632 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlcuuuHhAAxxFaW2Ya8S/0QqSKt6+irw==", 2023-11-28T11:10:32.633 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.633 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:10:32.633 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-11-28T11:10:32.633 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-11-28T11:10:32.633 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-11-28T11:10:32.633 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.633 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.633 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.633 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.2", 2023-11-28T11:10:32.633 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlzC5aGxAA+1p7VO2KIABIvIQUxsEpkw==", 2023-11-28T11:10:32.633 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.3", 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVl0A9rJBAAbjYfiY1Ya0jOeM20lriemg==", 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:10:32.634 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-11-28T11:10:32.635 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-11-28T11:10:32.635 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-11-28T11:10:32.635 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.635 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.635 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.635 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.admin", 2023-11-28T11:10:32.635 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD2yWVlAxDCHhAAbGHarjun9Ha0bFjpBnroEA==", 2023-11-28T11:10:32.635 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.635 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-11-28T11:10:32.635 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:10:32.635 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.x", 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD2yWVlf7E9OBAAT4ET3xArqHRvXN3Y+fN/hQ==", 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.636 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:32.637 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:32.637 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.y", 2023-11-28T11:10:32.637 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD2yWVldPhFNBAA/wTA2fq+CmRAx3pWX82SkA==", 2023-11-28T11:10:32.637 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:10:32.637 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-11-28T11:10:32.637 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-11-28T11:10:32.637 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:10:32.637 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.637 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:32.637 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-11-28T11:10:32.637 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:10:32.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 -- 172.21.15.125:0/3014858674 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8f6c0682f0 msgr2=0x7f8f6c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8f6c0682f0 0x7f8f6c06a7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8f80000f60 tx=0x7f8f80009040 comp rx=0 tx=0).stop 2023-11-28T11:10:32.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 -- 172.21.15.125:0/3014858674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f8c0d0c60 msgr2=0x7f8f8c14b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f8c0d0c60 0x7f8f8c14b880 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0090b0 tx=0x7f8f7c004750 comp rx=0 tx=0).stop 2023-11-28T11:10:32.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 -- 172.21.15.125:0/3014858674 shutdown_connections 2023-11-28T11:10:32.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8f6c0682f0 0x7f8f6c06a7a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f8c160e70 0x7f8f8c0b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f8c06e400 0x7f8f8c1f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 --2- 172.21.15.125:0/3014858674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f8c0d0c60 0x7f8f8c14b880 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 -- 172.21.15.125:0/3014858674 >> 172.21.15.125:0/3014858674 conn(0x7f8f8c06a270 msgr2=0x7f8f8c151340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:32.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 -- 172.21.15.125:0/3014858674 shutdown_connections 2023-11-28T11:10:32.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.622+0000 7f8f90a77700 1 -- 172.21.15.125:0/3014858674 wait complete. 2023-11-28T11:10:32.640 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:10:32.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.759+0000 7f9755d74700 1 Processor -- start 2023-11-28T11:10:32.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.759+0000 7f9755d74700 1 -- start start 2023-11-28T11:10:32.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f9755d74700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f97500b1770 0x7f97500b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f9755d74700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975015e010 con 0x7f9750142db0 2023-11-28T11:10:32.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f9755d74700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975013fc90 con 0x7f97500ce040 2023-11-28T11:10:32.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f9755d74700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975013f480 con 0x7f97500b1770 2023-11-28T11:10:32.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9750142db0 0x7f975013ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44138/0 (socket says 172.21.15.125:44138) 2023-11-28T11:10:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974effd700 1 -- 172.21.15.125:0/704279951 learned_addr learned my addr 172.21.15.125:0/704279951 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303595608 0 0) 0x7f9744001110 con 0x7f9750142db0 2023-11-28T11:10:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97380035b0 con 0x7f9750142db0 2023-11-28T11:10:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974ffff700 1 --2- 172.21.15.125:0/704279951 >> v2:172.21.15.167:3300/0 conn(0x7f97500b1770 0x7f97500b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825579319 0 0) 0x7f97380035b0 con 0x7f9750142db0 2023-11-28T11:10:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 >> v2:172.21.15.167:3300/0 conn(0x7f97500b1770 msgr2=0x7f97500b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 --2- 172.21.15.125:0/704279951 >> v2:172.21.15.167:3300/0 conn(0x7f97500b1770 0x7f97500b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 >> v1:172.21.15.167:6789/0 conn(0x7f97500ce040 legacy=0x7f975015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500b20d0 con 0x7f9750142db0 2023-11-28T11:10:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f9744001800 con 0x7f9750142db0 2023-11-28T11:10:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 >> v1:172.21.15.125:6789/0 conn(0x7f9750142db0 legacy=0x7f975013ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 0x7f9738003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9738004850 0x7f9738004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9738005200 0x7f973800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975013f480 con 0x7f9738003a00 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973800c190 con 0x7f9738004850 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973800c350 con 0x7f9738005200 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974f7fe700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 0x7f9738003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974effd700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9738004850 0x7f9738004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974ffff700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9738005200 0x7f973800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974f7fe700 1 -- 172.21.15.125:0/704279951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9738005200 msgr2=0x7f973800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974f7fe700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9738005200 0x7f973800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974f7fe700 1 -- 172.21.15.125:0/704279951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9738004850 msgr2=0x7f9738004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:32.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974f7fe700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9738004850 0x7f9738004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974f7fe700 1 -- 172.21.15.125:0/704279951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380035b0 con 0x7f9738003a00 2023-11-28T11:10:32.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974ffff700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9738005200 0x7f973800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:32.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974effd700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9738004850 0x7f9738004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:32.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974ffff700 1 -- 172.21.15.125:0/704279951 reap_dead start 2023-11-28T11:10:32.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974f7fe700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 0x7f9738003e10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9740007fd0 tx=0x7f9738005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a7006fbf818778 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:32.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400052d0 con 0x7f9738003a00 2023-11-28T11:10:32.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740005430 con 0x7f9738003a00 2023-11-28T11:10:32.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.761+0000 7f974e7fc700 1 -- 172.21.15.125:0/704279951 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400038c0 con 0x7f9738003a00 2023-11-28T11:10:32.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.762+0000 7f9755d74700 1 -- 172.21.15.125:0/704279951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 msgr2=0x7f9738003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.762+0000 7f9755d74700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 0x7f9738003e10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9740007fd0 tx=0x7f9738005880 comp rx=0 tx=0).stop 2023-11-28T11:10:32.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.762+0000 7f9755d74700 1 -- 172.21.15.125:0/704279951 shutdown_connections 2023-11-28T11:10:32.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.762+0000 7f9755d74700 1 --2- 172.21.15.125:0/704279951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 0x7f9738003e10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.762+0000 7f9755d74700 1 -- 172.21.15.125:0/704279951 >> 172.21.15.125:0/704279951 conn(0x7f975006c010 msgr2=0x7f97500cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:32.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.762+0000 7f9755d74700 1 -- 172.21.15.125:0/704279951 shutdown_connections 2023-11-28T11:10:32.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.762+0000 7f9755d74700 1 -- 172.21.15.125:0/704279951 wait complete. 2023-11-28T11:10:32.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.763+0000 7f9755d74700 1 Processor -- start 2023-11-28T11:10:32.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.763+0000 7f9755d74700 1 -- start start 2023-11-28T11:10:32.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.764+0000 7f9755d74700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 0x7f975015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.764+0000 7f9755d74700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97500b4f20 0x7f975015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.764+0000 7f9755d74700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975014b770 0x7f975014bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.764+0000 7f9755d74700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975014c120 con 0x7f9738003a00 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.764+0000 7f9755d74700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97500c7ac0 con 0x7f97500b4f20 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.764+0000 7f9755d74700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975015aa70 con 0x7f975014b770 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.764+0000 7f974f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 0x7f975015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f974f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 0x7f975015a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60024/0 (socket says 172.21.15.125:60024) 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f974f7fe700 1 -- 172.21.15.125:0/3821761917 learned_addr learned my addr 172.21.15.125:0/3821761917 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f974effd700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97500b4f20 0x7f975015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f974f7fe700 1 -- 172.21.15.125:0/3821761917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975014b770 msgr2=0x7f975014bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f974ffff700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975014b770 0x7f975014bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f974f7fe700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975014b770 0x7f975014bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f974f7fe700 1 -- 172.21.15.125:0/3821761917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97500b4f20 msgr2=0x7f975015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f974f7fe700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97500b4f20 0x7f975015c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f974f7fe700 1 -- 172.21.15.125:0/3821761917 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975013f9b0 con 0x7f9738003a00 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f974effd700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97500b4f20 0x7f975015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f974f7fe700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 0x7f975015a530 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9740015040 tx=0x7f9740001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f9737fff700 1 -- 172.21.15.125:0/3821761917 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740001290 con 0x7f9738003a00 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f9737fff700 1 -- 172.21.15.125:0/3821761917 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740006860 con 0x7f9738003a00 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f9737fff700 1 -- 172.21.15.125:0/3821761917 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740006c10 con 0x7f9738003a00 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f9755d74700 1 -- 172.21.15.125:0/3821761917 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975013f6d0 con 0x7f9738003a00 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.765+0000 7f9755d74700 1 -- 172.21.15.125:0/3821761917 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975015d100 con 0x7f9738003a00 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.766+0000 7f9755d74700 1 -- 172.21.15.125:0/3821761917 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97500c7920 con 0x7f9738003a00 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.766+0000 7f9737fff700 1 -- 172.21.15.125:0/3821761917 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9740010050 con 0x7f9738003a00 2023-11-28T11:10:32.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.767+0000 7f9737fff700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f973c068320 0x7f973c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:32.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.767+0000 7f9737fff700 1 -- 172.21.15.125:0/3821761917 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9740086550 con 0x7f9738003a00 2023-11-28T11:10:32.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.767+0000 7f974effd700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f973c068320 0x7f973c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:32.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.767+0000 7f974effd700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f973c068320 0x7f973c06a7d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9744001270 tx=0x7f97440012e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:32.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.771+0000 7f9737fff700 1 -- 172.21.15.125:0/3821761917 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f97500c7920 con 0x7f9738003a00 2023-11-28T11:10:32.818 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:10:32.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:10:32.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.960+0000 7f9755d74700 1 -- 172.21.15.125:0/3821761917 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97500c7920 con 0x7f9738003a00 2023-11-28T11:10:32.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.961+0000 7f9737fff700 1 -- 172.21.15.125:0/3821761917 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+14315 (secure 0 0 0) 0x7f97500c7920 con 0x7f9738003a00 2023-11-28T11:10:32.962 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:32.962 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":48,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:10:32.196407+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:10:32.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 -- 172.21.15.125:0/3821761917 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f973c068320 msgr2=0x7f973c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f973c068320 0x7f973c06a7d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9744001270 tx=0x7f97440012e0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 -- 172.21.15.125:0/3821761917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 msgr2=0x7f975015a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:32.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 0x7f975015a530 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9740015040 tx=0x7f9740001120 comp rx=0 tx=0).stop 2023-11-28T11:10:32.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 -- 172.21.15.125:0/3821761917 shutdown_connections 2023-11-28T11:10:32.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f973c068320 0x7f973c06a7d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975014b770 0x7f975014bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9738003a00 0x7f975015a530 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 --2- 172.21.15.125:0/3821761917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97500b4f20 0x7f975015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:32.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 -- 172.21.15.125:0/3821761917 >> 172.21.15.125:0/3821761917 conn(0x7f975006c010 msgr2=0x7f97500ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:32.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 -- 172.21.15.125:0/3821761917 shutdown_connections 2023-11-28T11:10:32.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:32.963+0000 7f9755d74700 1 -- 172.21.15.125:0/3821761917 wait complete. 2023-11-28T11:10:32.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:10:32.977 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:10:33.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.098+0000 7f0048693700 1 Processor -- start 2023-11-28T11:10:33.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.098+0000 7f0048693700 1 -- start start 2023-11-28T11:10:33.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.099+0000 7f0048693700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0040160cb0 0x7f004006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.099+0000 7f0048693700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f004006b050 0x7f00400d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.099+0000 7f0048693700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400d2d30 con 0x7f004015c8c0 2023-11-28T11:10:33.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.099+0000 7f0048693700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004006b4d0 con 0x7f004006b050 2023-11-28T11:10:33.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.099+0000 7f0048693700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00400d0b40 con 0x7f0040160cb0 2023-11-28T11:10:33.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.099+0000 7f0046c30700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f004006b050 0x7f00400d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.099+0000 7f004642f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f004015c8c0 0x7f00400b5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44156/0 (socket says 172.21.15.125:44156) 2023-11-28T11:10:33.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.099+0000 7f004642f700 1 -- 172.21.15.125:0/728388283 learned_addr learned my addr 172.21.15.125:0/728388283 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:33.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.099+0000 7f0045c2e700 1 --2- 172.21.15.125:0/728388283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0040160cb0 0x7f004006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f0046c30700 1 -- 172.21.15.125:0/728388283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0040160cb0 msgr2=0x7f004006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:33.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f0046c30700 1 --2- 172.21.15.125:0/728388283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0040160cb0 0x7f004006ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f0046c30700 1 -- 172.21.15.125:0/728388283 >> v1:172.21.15.125:6789/0 conn(0x7f004015c8c0 legacy=0x7f00400b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f004542d700 1 -- 172.21.15.125:0/728388283 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24658294 0 0) 0x7f003c001110 con 0x7f004015c8c0 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f0046c30700 1 -- 172.21.15.125:0/728388283 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00400d2a50 con 0x7f004006b050 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f0046c30700 1 --2- 172.21.15.125:0/728388283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f004006b050 0x7f00400d0fd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0038009d90 tx=0x7f003800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08415a69d480a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f004542d700 1 -- 172.21.15.125:0/728388283 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800e070 con 0x7f004006b050 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f004542d700 1 -- 172.21.15.125:0/728388283 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003800bbd0 con 0x7f004006b050 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f004542d700 1 -- 172.21.15.125:0/728388283 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038012430 con 0x7f004006b050 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f0048693700 1 -- 172.21.15.125:0/728388283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f004006b050 msgr2=0x7f00400d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f0048693700 1 --2- 172.21.15.125:0/728388283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f004006b050 0x7f00400d0fd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0038009d90 tx=0x7f003800b330 comp rx=0 tx=0).stop 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f0048693700 1 -- 172.21.15.125:0/728388283 shutdown_connections 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f0048693700 1 --2- 172.21.15.125:0/728388283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f004006b050 0x7f00400d0fd0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f0048693700 1 --2- 172.21.15.125:0/728388283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0040160cb0 0x7f004006ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.100+0000 7f0048693700 1 -- 172.21.15.125:0/728388283 >> 172.21.15.125:0/728388283 conn(0x7f004006c520 msgr2=0x7f004006c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:33.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.101+0000 7f0048693700 1 -- 172.21.15.125:0/728388283 shutdown_connections 2023-11-28T11:10:33.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.101+0000 7f0048693700 1 -- 172.21.15.125:0/728388283 wait complete. 2023-11-28T11:10:33.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.102+0000 7f0048693700 1 Processor -- start 2023-11-28T11:10:33.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.102+0000 7f0048693700 1 -- start start 2023-11-28T11:10:33.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.102+0000 7f0048693700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f004006b050 0x7f00400c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.102+0000 7f0048693700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004015c8c0 0x7f004015ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.102+0000 7f0048693700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0040160cb0 0x7f0040153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.102+0000 7f0048693700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00400c7630 con 0x7f0040160cb0 2023-11-28T11:10:33.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0048693700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00400c7910 con 0x7f004015c8c0 2023-11-28T11:10:33.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0048693700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00400c7bf0 con 0x7f004006b050 2023-11-28T11:10:33.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0046c30700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0040160cb0 0x7f0040153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0046c30700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0040160cb0 0x7f0040153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60042/0 (socket says 172.21.15.125:60042) 2023-11-28T11:10:33.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0046c30700 1 -- 172.21.15.125:0/1033531135 learned_addr learned my addr 172.21.15.125:0/1033531135 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:33.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f004642f700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f004006b050 0x7f00400c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0045c2e700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004015c8c0 0x7f004015ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0046c30700 1 -- 172.21.15.125:0/1033531135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f004006b050 msgr2=0x7f00400c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0046c30700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f004006b050 0x7f00400c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0046c30700 1 -- 172.21.15.125:0/1033531135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004015c8c0 msgr2=0x7f004015ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0046c30700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004015c8c0 0x7f004015ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0046c30700 1 -- 172.21.15.125:0/1033531135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038009a70 con 0x7f0040160cb0 2023-11-28T11:10:33.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f004642f700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f004006b050 0x7f00400c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:33.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0046c30700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0040160cb0 0x7f0040153610 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f00400d0af0 tx=0x7f0038004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:33.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0036ffd700 1 -- 172.21.15.125:0/1033531135 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038012430 con 0x7f0040160cb0 2023-11-28T11:10:33.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0036ffd700 1 -- 172.21.15.125:0/1033531135 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0038020070 con 0x7f0040160cb0 2023-11-28T11:10:33.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0048693700 1 -- 172.21.15.125:0/1033531135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00400cda40 con 0x7f0040160cb0 2023-11-28T11:10:33.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0036ffd700 1 -- 172.21.15.125:0/1033531135 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038004280 con 0x7f0040160cb0 2023-11-28T11:10:33.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.103+0000 7f0048693700 1 -- 172.21.15.125:0/1033531135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00400cd760 con 0x7f0040160cb0 2023-11-28T11:10:33.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.104+0000 7f0048693700 1 -- 172.21.15.125:0/1033531135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0040161120 con 0x7f0040160cb0 2023-11-28T11:10:33.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.104+0000 7f0036ffd700 1 -- 172.21.15.125:0/1033531135 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f00380043e0 con 0x7f0040160cb0 2023-11-28T11:10:33.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.105+0000 7f0036ffd700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f00240682f0 0x7f002406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.105+0000 7f0036ffd700 1 -- 172.21.15.125:0/1033531135 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0038022070 con 0x7f0040160cb0 2023-11-28T11:10:33.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.105+0000 7f004642f700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f00240682f0 0x7f002406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.105+0000 7f004642f700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f00240682f0 0x7f002406a7a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f003c000f60 tx=0x7f003c007ae0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:33.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.110+0000 7f0036ffd700 1 -- 172.21.15.125:0/1033531135 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0038054d00 con 0x7f0040160cb0 2023-11-28T11:10:33.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.292+0000 7f0048693700 1 -- 172.21.15.125:0/1033531135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0040067d70 con 0x7f0040160cb0 2023-11-28T11:10:33.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.292+0000 7f0036ffd700 1 -- 172.21.15.125:0/1033531135 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0038025380 con 0x7f0040160cb0 2023-11-28T11:10:33.294 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:10:33.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.294+0000 7f0048693700 1 -- 172.21.15.125:0/1033531135 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f00240682f0 msgr2=0x7f002406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.294+0000 7f0048693700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f00240682f0 0x7f002406a7a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f003c000f60 tx=0x7f003c007ae0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.294+0000 7f0048693700 1 -- 172.21.15.125:0/1033531135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0040160cb0 msgr2=0x7f0040153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.294+0000 7f0048693700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0040160cb0 0x7f0040153610 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f00400d0af0 tx=0x7f0038004ad0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.295+0000 7f0048693700 1 -- 172.21.15.125:0/1033531135 shutdown_connections 2023-11-28T11:10:33.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.295+0000 7f0048693700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0040160cb0 0x7f0040153610 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.295+0000 7f0048693700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f00240682f0 0x7f002406a7a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.295+0000 7f0048693700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f004006b050 0x7f00400c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.295+0000 7f0048693700 1 --2- 172.21.15.125:0/1033531135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004015c8c0 0x7f004015ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.295+0000 7f0048693700 1 -- 172.21.15.125:0/1033531135 >> 172.21.15.125:0/1033531135 conn(0x7f004006c520 msgr2=0x7f00400cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:33.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.295+0000 7f0048693700 1 -- 172.21.15.125:0/1033531135 shutdown_connections 2023-11-28T11:10:33.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.295+0000 7f0048693700 1 -- 172.21.15.125:0/1033531135 wait complete. 2023-11-28T11:10:33.308 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:10:33.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a9adb700 1 Processor -- start 2023-11-28T11:10:33.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a9adb700 1 -- start start 2023-11-28T11:10:33.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a9adb700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9a415c810 0x7fa9a4160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a9adb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9a40718e0 0x7fa9a406c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a9adb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a41607a0 con 0x7fa9a406cdc0 2023-11-28T11:10:33.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a9adb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a415cbe0 con 0x7fa9a40718e0 2023-11-28T11:10:33.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a9adb700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a4160a50 con 0x7fa9a415c810 2023-11-28T11:10:33.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9a40718e0 0x7fa9a406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa9a406cdc0 0x7fa9a406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44172/0 (socket says 172.21.15.125:44172) 2023-11-28T11:10:33.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a3fff700 1 -- 172.21.15.125:0/2683959087 learned_addr learned my addr 172.21.15.125:0/2683959087 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:33.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a37fe700 1 --2- 172.21.15.125:0/2683959087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9a415c810 0x7fa9a4160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a27fc700 1 -- 172.21.15.125:0/2683959087 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956122920 0 0) 0x7fa9a41607a0 con 0x7fa9a406cdc0 2023-11-28T11:10:33.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a27fc700 1 -- 172.21.15.125:0/2683959087 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa98c0035b0 con 0x7fa9a406cdc0 2023-11-28T11:10:33.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a2ffd700 1 -- 172.21.15.125:0/2683959087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9a415c810 msgr2=0x7fa9a4160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:33.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a2ffd700 1 --2- 172.21.15.125:0/2683959087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9a415c810 0x7fa9a4160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a2ffd700 1 -- 172.21.15.125:0/2683959087 >> v1:172.21.15.125:6789/0 conn(0x7fa9a406cdc0 legacy=0x7fa9a406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a2ffd700 1 -- 172.21.15.125:0/2683959087 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a4160d30 con 0x7fa9a40718e0 2023-11-28T11:10:33.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a2ffd700 1 --2- 172.21.15.125:0/2683959087 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a40718e0 0x7fa9a406c880 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa994009840 tx=0x7fa994009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba8737771cb5b51 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:33.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a27fc700 1 -- 172.21.15.125:0/2683959087 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994011830 con 0x7fa9a40718e0 2023-11-28T11:10:33.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a27fc700 1 -- 172.21.15.125:0/2683959087 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa994011990 con 0x7fa9a40718e0 2023-11-28T11:10:33.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.431+0000 7fa9a27fc700 1 -- 172.21.15.125:0/2683959087 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994011d20 con 0x7fa9a40718e0 2023-11-28T11:10:33.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.432+0000 7fa9a9adb700 1 -- 172.21.15.125:0/2683959087 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a40718e0 msgr2=0x7fa9a406c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.432+0000 7fa9a9adb700 1 --2- 172.21.15.125:0/2683959087 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a40718e0 0x7fa9a406c880 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa994009840 tx=0x7fa994009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:33.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.432+0000 7fa9a9adb700 1 -- 172.21.15.125:0/2683959087 shutdown_connections 2023-11-28T11:10:33.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.432+0000 7fa9a9adb700 1 --2- 172.21.15.125:0/2683959087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9a415c810 0x7fa9a4160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.432+0000 7fa9a9adb700 1 --2- 172.21.15.125:0/2683959087 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a40718e0 0x7fa9a406c880 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.432+0000 7fa9a9adb700 1 -- 172.21.15.125:0/2683959087 >> 172.21.15.125:0/2683959087 conn(0x7fa9a406c010 msgr2=0x7fa9a40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:33.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.432+0000 7fa9a9adb700 1 -- 172.21.15.125:0/2683959087 shutdown_connections 2023-11-28T11:10:33.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.432+0000 7fa9a9adb700 1 -- 172.21.15.125:0/2683959087 wait complete. 2023-11-28T11:10:33.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.434+0000 7fa9a9adb700 1 Processor -- start 2023-11-28T11:10:33.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.434+0000 7fa9a9adb700 1 -- start start 2023-11-28T11:10:33.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a9adb700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a406cdc0 0x7fa9a41f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a9adb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a40718e0 0x7fa9a41f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a9adb700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9a415c810 0x7fa9a40b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a9adb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a415dd70 con 0x7fa9a40718e0 2023-11-28T11:10:33.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a9adb700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a414bd50 con 0x7fa9a406cdc0 2023-11-28T11:10:33.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a9adb700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40b5450 con 0x7fa9a415c810 2023-11-28T11:10:33.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a40718e0 0x7fa9a41f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a40718e0 0x7fa9a41f5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60054/0 (socket says 172.21.15.125:60054) 2023-11-28T11:10:33.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a2ffd700 1 -- 172.21.15.125:0/250760345 learned_addr learned my addr 172.21.15.125:0/250760345 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:33.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a3fff700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9a415c810 0x7fa9a40b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a37fe700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a406cdc0 0x7fa9a41f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a2ffd700 1 -- 172.21.15.125:0/250760345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9a415c810 msgr2=0x7fa9a40b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a2ffd700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9a415c810 0x7fa9a40b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a2ffd700 1 -- 172.21.15.125:0/250760345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a406cdc0 msgr2=0x7fa9a41f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a2ffd700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a406cdc0 0x7fa9a41f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a2ffd700 1 -- 172.21.15.125:0/250760345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9940094a0 con 0x7fa9a40718e0 2023-11-28T11:10:33.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a2ffd700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a40718e0 0x7fa9a41f5be0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa994009fd0 tx=0x7fa994004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:33.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa98bfff700 1 -- 172.21.15.125:0/250760345 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9940036a0 con 0x7fa9a40718e0 2023-11-28T11:10:33.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa98bfff700 1 -- 172.21.15.125:0/250760345 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99401f070 con 0x7fa9a40718e0 2023-11-28T11:10:33.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a9adb700 1 -- 172.21.15.125:0/250760345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a40ceb20 con 0x7fa9a40718e0 2023-11-28T11:10:33.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa98bfff700 1 -- 172.21.15.125:0/250760345 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994003a60 con 0x7fa9a40718e0 2023-11-28T11:10:33.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.435+0000 7fa9a9adb700 1 -- 172.21.15.125:0/250760345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a4161010 con 0x7fa9a40718e0 2023-11-28T11:10:33.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.436+0000 7fa9a9adb700 1 -- 172.21.15.125:0/250760345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a40ce740 con 0x7fa9a40718e0 2023-11-28T11:10:33.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.437+0000 7fa98bfff700 1 -- 172.21.15.125:0/250760345 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa99400f050 con 0x7fa9a40718e0 2023-11-28T11:10:33.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.437+0000 7fa98bfff700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9900682f0 0x7fa99006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.437+0000 7fa98bfff700 1 -- 172.21.15.125:0/250760345 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa994021070 con 0x7fa9a40718e0 2023-11-28T11:10:33.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.437+0000 7fa9a37fe700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9900682f0 0x7fa99006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.438+0000 7fa9a37fe700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9900682f0 0x7fa99006a7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa99800b9b0 tx=0x7fa998008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:33.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.442+0000 7fa98bfff700 1 -- 172.21.15.125:0/250760345 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa994053df0 con 0x7fa9a40718e0 2023-11-28T11:10:33.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.623+0000 7fa9a9adb700 1 -- 172.21.15.125:0/250760345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9a415e4a0 con 0x7fa9a40718e0 2023-11-28T11:10:33.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.623+0000 7fa98bfff700 1 -- 172.21.15.125:0/250760345 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v48) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9a415e4a0 con 0x7fa9a40718e0 2023-11-28T11:10:33.625 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:10:33.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 -- 172.21.15.125:0/250760345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9900682f0 msgr2=0x7fa99006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9900682f0 0x7fa99006a7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa99800b9b0 tx=0x7fa998008040 comp rx=0 tx=0).stop 2023-11-28T11:10:33.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 -- 172.21.15.125:0/250760345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a40718e0 msgr2=0x7fa9a41f5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a40718e0 0x7fa9a41f5be0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa994009fd0 tx=0x7fa994004750 comp rx=0 tx=0).stop 2023-11-28T11:10:33.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 -- 172.21.15.125:0/250760345 shutdown_connections 2023-11-28T11:10:33.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa9900682f0 0x7fa99006a7a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9a415c810 0x7fa9a40b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a406cdc0 0x7fa9a41f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 --2- 172.21.15.125:0/250760345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9a40718e0 0x7fa9a41f5be0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 -- 172.21.15.125:0/250760345 >> 172.21.15.125:0/250760345 conn(0x7fa9a406c010 msgr2=0x7fa9a40cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:33.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 -- 172.21.15.125:0/250760345 shutdown_connections 2023-11-28T11:10:33.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.625+0000 7fa9a9adb700 1 -- 172.21.15.125:0/250760345 wait complete. 2023-11-28T11:10:33.639 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:10:33.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.758+0000 7f65dbd62700 1 Processor -- start 2023-11-28T11:10:33.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.758+0000 7f65dbd62700 1 -- start start 2023-11-28T11:10:33.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65dbd62700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d415cc80 0x7f65d406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65dbd62700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f65d406e3a0 0x7f65d4070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65dbd62700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d40b1810 con 0x7f65d406a270 2023-11-28T11:10:33.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65dbd62700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40b2490 con 0x7f65d406e3a0 2023-11-28T11:10:33.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65dbd62700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40b1af0 con 0x7f65d415cc80 2023-11-28T11:10:33.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d9afe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f65d406a270 0x7f65d406a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44184/0 (socket says 172.21.15.125:44184) 2023-11-28T11:10:33.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d9afe700 1 -- 172.21.15.125:0/2708269185 learned_addr learned my addr 172.21.15.125:0/2708269185 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:33.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427086082 0 0) 0x7f65d40b1810 con 0x7f65d406a270 2023-11-28T11:10:33.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65c00035b0 con 0x7f65d406a270 2023-11-28T11:10:33.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d92fd700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d415cc80 0x7f65d406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65da2ff700 1 --2- 172.21.15.125:0/2708269185 >> v2:172.21.15.167:3300/0 conn(0x7f65d406e3a0 0x7f65d4070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4111795120 0 0) 0x7f65c00035b0 con 0x7f65d406a270 2023-11-28T11:10:33.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d415cc80 msgr2=0x7f65d406de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:33.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d415cc80 0x7f65d406de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 >> v2:172.21.15.167:3300/0 conn(0x7f65d406e3a0 msgr2=0x7f65d4070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:33.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 --2- 172.21.15.125:0/2708269185 >> v2:172.21.15.167:3300/0 conn(0x7f65d406e3a0 0x7f65d4070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d40b1dd0 con 0x7f65d406a270 2023-11-28T11:10:33.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f65c4001670 con 0x7f65d406a270 2023-11-28T11:10:33.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65da2ff700 1 --2- 172.21.15.125:0/2708269185 >> v2:172.21.15.167:3300/0 conn(0x7f65d406e3a0 0x7f65d4070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:33.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 >> v1:172.21.15.125:6789/0 conn(0x7f65d406a270 legacy=0x7f65d406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 0x7f65c0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c0004850 0x7f65c0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d415cc80 0x7f65c0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40b2490 con 0x7f65c0003a00 2023-11-28T11:10:33.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40b1af0 con 0x7f65c0004850 2023-11-28T11:10:33.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c000bb40 con 0x7f65d415cc80 2023-11-28T11:10:33.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d9afe700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 0x7f65c0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d92fd700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c0004850 0x7f65c0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65da2ff700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d415cc80 0x7f65c0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d9afe700 1 -- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d415cc80 msgr2=0x7f65c0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:33.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d9afe700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d415cc80 0x7f65c0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d9afe700 1 -- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c0004850 msgr2=0x7f65c0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:33.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d9afe700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c0004850 0x7f65c0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d9afe700 1 -- 172.21.15.125:0/2708269185 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c00035b0 con 0x7f65c0003a00 2023-11-28T11:10:33.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d92fd700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c0004850 0x7f65c0004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:33.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d9afe700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 0x7f65c0003e10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c2f0 tx=0x7f65c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eed86bb5c9d42da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:33.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4007c40 con 0x7f65c0003a00 2023-11-28T11:10:33.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c400ce30 con 0x7f65c0003a00 2023-11-28T11:10:33.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.759+0000 7f65d8afc700 1 -- 172.21.15.125:0/2708269185 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4005ba0 con 0x7f65c0003a00 2023-11-28T11:10:33.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.760+0000 7f65dbd62700 1 -- 172.21.15.125:0/2708269185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 msgr2=0x7f65c0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.760+0000 7f65dbd62700 1 --2- 172.21.15.125:0/2708269185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 0x7f65c0003e10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c2f0 tx=0x7f65c0005880 comp rx=0 tx=0).stop 2023-11-28T11:10:33.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.760+0000 7f65da2ff700 1 -- 172.21.15.125:0/2708269185 reap_dead start 2023-11-28T11:10:33.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.760+0000 7f65dbd62700 1 -- 172.21.15.125:0/2708269185 shutdown_connections 2023-11-28T11:10:33.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.760+0000 7f65dbd62700 1 -- 172.21.15.125:0/2708269185 >> 172.21.15.125:0/2708269185 conn(0x7f65d406c010 msgr2=0x7f65d40cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.760+0000 7f65dbd62700 1 -- 172.21.15.125:0/2708269185 shutdown_connections 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.760+0000 7f65dbd62700 1 -- 172.21.15.125:0/2708269185 wait complete. 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.761+0000 7f65dbd62700 1 Processor -- start 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.761+0000 7f65dbd62700 1 -- start start 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65dbd62700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 0x7f65d40afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65dbd62700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d40b1320 0x7f65d4146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65dbd62700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d40b4660 0x7f65d40b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65dbd62700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40b5010 con 0x7f65c0003a00 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65dbd62700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40b0e90 con 0x7f65d40b1320 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65dbd62700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40b0280 con 0x7f65d40b4660 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65d9afe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 0x7f65d40afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65d9afe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 0x7f65d40afca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60072/0 (socket says 172.21.15.125:60072) 2023-11-28T11:10:33.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65d9afe700 1 -- 172.21.15.125:0/3841258159 learned_addr learned my addr 172.21.15.125:0/3841258159 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:33.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65d9afe700 1 -- 172.21.15.125:0/3841258159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d40b4660 msgr2=0x7f65d40b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65d92fd700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d40b1320 0x7f65d4146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65da2ff700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d40b4660 0x7f65d40b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65d9afe700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d40b4660 0x7f65d40b4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65d9afe700 1 -- 172.21.15.125:0/3841258159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d40b1320 msgr2=0x7f65d4146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65d9afe700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d40b1320 0x7f65d4146050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.762+0000 7f65d9afe700 1 -- 172.21.15.125:0/3841258159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d406e7e0 con 0x7f65c0003a00 2023-11-28T11:10:33.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.763+0000 7f65d9afe700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 0x7f65d40afca0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c8e0 tx=0x7f65d4153d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:33.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.763+0000 7f65ca7fc700 1 -- 172.21.15.125:0/3841258159 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40070d0 con 0x7f65c0003a00 2023-11-28T11:10:33.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.763+0000 7f65ca7fc700 1 -- 172.21.15.125:0/3841258159 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c4007250 con 0x7f65c0003a00 2023-11-28T11:10:33.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.763+0000 7f65dbd62700 1 -- 172.21.15.125:0/3841258159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d40b20b0 con 0x7f65c0003a00 2023-11-28T11:10:33.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.763+0000 7f65ca7fc700 1 -- 172.21.15.125:0/3841258159 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4007600 con 0x7f65c0003a00 2023-11-28T11:10:33.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.763+0000 7f65dbd62700 1 -- 172.21.15.125:0/3841258159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d415daa0 con 0x7f65c0003a00 2023-11-28T11:10:33.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.764+0000 7f65dbd62700 1 -- 172.21.15.125:0/3841258159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d406a640 con 0x7f65c0003a00 2023-11-28T11:10:33.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.764+0000 7f65ca7fc700 1 -- 172.21.15.125:0/3841258159 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f65c4024030 con 0x7f65c0003a00 2023-11-28T11:10:33.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.764+0000 7f65ca7fc700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f65b80682f0 0x7f65b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:33.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.765+0000 7f65ca7fc700 1 -- 172.21.15.125:0/3841258159 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f65c4086770 con 0x7f65c0003a00 2023-11-28T11:10:33.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.765+0000 7f65d92fd700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f65b80682f0 0x7f65b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:33.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.765+0000 7f65d92fd700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f65b80682f0 0x7f65b806a7a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f65d41f5de0 tx=0x7f65d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:33.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.769+0000 7f65ca7fc700 1 -- 172.21.15.125:0/3841258159 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f65c40533e0 con 0x7f65c0003a00 2023-11-28T11:10:33.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.952+0000 7f65dbd62700 1 -- 172.21.15.125:0/3841258159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f65d40743f0 con 0x7f65c0003a00 2023-11-28T11:10:33.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.952+0000 7f65ca7fc700 1 -- 172.21.15.125:0/3841258159 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+126 (secure 0 0 0) 0x7f65c4007da0 con 0x7f65c0003a00 2023-11-28T11:10:33.954 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:33.954 INFO:teuthology.orchestra.run.smithi125.stdout:[ 2023-11-28T11:10:33.954 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:33.955 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 1, 2023-11-28T11:10:33.955 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": ".mgr" 2023-11-28T11:10:33.955 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:33.955 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:33.955 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 2, 2023-11-28T11:10:33.955 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": "rbd" 2023-11-28T11:10:33.955 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:33.955 INFO:teuthology.orchestra.run.smithi125.stdout:] 2023-11-28T11:10:33.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 -- 172.21.15.125:0/3841258159 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f65b80682f0 msgr2=0x7f65b806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f65b80682f0 0x7f65b806a7a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f65d41f5de0 tx=0x7f65d0008040 comp rx=0 tx=0).stop 2023-11-28T11:10:33.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 -- 172.21.15.125:0/3841258159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 msgr2=0x7f65d40afca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:33.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 0x7f65d40afca0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c8e0 tx=0x7f65d4153d30 comp rx=0 tx=0).stop 2023-11-28T11:10:33.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 -- 172.21.15.125:0/3841258159 shutdown_connections 2023-11-28T11:10:33.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f65b80682f0 0x7f65b806a7a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65d40b4660 0x7f65d40b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65c0003a00 0x7f65d40afca0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 --2- 172.21.15.125:0/3841258159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d40b1320 0x7f65d4146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:33.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 -- 172.21.15.125:0/3841258159 >> 172.21.15.125:0/3841258159 conn(0x7f65d406c010 msgr2=0x7f65d406d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:33.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 -- 172.21.15.125:0/3841258159 shutdown_connections 2023-11-28T11:10:33.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:33.954+0000 7f65dbd62700 1 -- 172.21.15.125:0/3841258159 wait complete. 2023-11-28T11:10:33.968 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:10:33.968 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:10:34.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.090+0000 7f7a35845700 1 Processor -- start 2023-11-28T11:10:34.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.090+0000 7f7a35845700 1 -- start start 2023-11-28T11:10:34.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a35845700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7a300b22e0 0x7f7a300d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:34.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a35845700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7a300d1270 0x7f7a300b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:34.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a35845700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a300b32b0 con 0x7f7a3015cce0 2023-11-28T11:10:34.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a35845700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a300d1690 con 0x7f7a300d1270 2023-11-28T11:10:34.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a35845700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a300b26e0 con 0x7f7a300b22e0 2023-11-28T11:10:34.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a2f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7a300d1270 0x7f7a300b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:34.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a2effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7a3015cce0 0x7f7a300b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44204/0 (socket says 172.21.15.125:44204) 2023-11-28T11:10:34.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a2effd700 1 -- 172.21.15.125:0/470655741 learned_addr learned my addr 172.21.15.125:0/470655741 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:34.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a2e7fc700 1 --2- 172.21.15.125:0/470655741 >> v2:172.21.15.167:3300/0 conn(0x7f7a300b22e0 0x7f7a300d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:34.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a2f7fe700 1 -- 172.21.15.125:0/470655741 >> v2:172.21.15.167:3300/0 conn(0x7f7a300b22e0 msgr2=0x7f7a300d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:34.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a2f7fe700 1 --2- 172.21.15.125:0/470655741 >> v2:172.21.15.167:3300/0 conn(0x7f7a300b22e0 0x7f7a300d0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:34.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a2f7fe700 1 -- 172.21.15.125:0/470655741 >> v1:172.21.15.125:6789/0 conn(0x7f7a3015cce0 legacy=0x7f7a300b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:34.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a2f7fe700 1 -- 172.21.15.125:0/470655741 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a300b1e60 con 0x7f7a300d1270 2023-11-28T11:10:34.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.091+0000 7f7a2dffb700 1 -- 172.21.15.125:0/470655741 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126742709 0 0) 0x7f7a300b32b0 con 0x7f7a3015cce0 2023-11-28T11:10:34.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a2f7fe700 1 --2- 172.21.15.125:0/470655741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a300d1270 0x7f7a300b3740 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7a3006d450 tx=0x7f7a2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47485b92a200ef3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:34.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a2dffb700 1 -- 172.21.15.125:0/470655741 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2800e070 con 0x7f7a300d1270 2023-11-28T11:10:34.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a2dffb700 1 -- 172.21.15.125:0/470655741 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2800bbd0 con 0x7f7a300d1270 2023-11-28T11:10:34.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a2dffb700 1 -- 172.21.15.125:0/470655741 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28012430 con 0x7f7a300d1270 2023-11-28T11:10:34.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a35845700 1 -- 172.21.15.125:0/470655741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a300d1270 msgr2=0x7f7a300b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:34.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a35845700 1 --2- 172.21.15.125:0/470655741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a300d1270 0x7f7a300b3740 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7a3006d450 tx=0x7f7a2800b330 comp rx=0 tx=0).stop 2023-11-28T11:10:34.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a35845700 1 -- 172.21.15.125:0/470655741 shutdown_connections 2023-11-28T11:10:34.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a35845700 1 --2- 172.21.15.125:0/470655741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a300d1270 0x7f7a300b3740 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:34.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a35845700 1 --2- 172.21.15.125:0/470655741 >> v2:172.21.15.167:3300/0 conn(0x7f7a300b22e0 0x7f7a300d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:34.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a35845700 1 -- 172.21.15.125:0/470655741 >> 172.21.15.125:0/470655741 conn(0x7f7a3009c4d0 msgr2=0x7f7a300d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:34.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a35845700 1 -- 172.21.15.125:0/470655741 shutdown_connections 2023-11-28T11:10:34.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.092+0000 7f7a35845700 1 -- 172.21.15.125:0/470655741 wait complete. 2023-11-28T11:10:34.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.094+0000 7f7a35845700 1 Processor -- start 2023-11-28T11:10:34.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.094+0000 7f7a35845700 1 -- start start 2023-11-28T11:10:34.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a35845700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a300d1270 0x7f7a300b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:34.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a35845700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3015cce0 0x7f7a30156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:34.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a35845700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a30154100 0x7f7a300b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:34.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a35845700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300b5b10 con 0x7f7a30154100 2023-11-28T11:10:34.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a35845700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300b5840 con 0x7f7a3015cce0 2023-11-28T11:10:34.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a35845700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300cf3a0 con 0x7f7a300d1270 2023-11-28T11:10:34.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a30154100 0x7f7a300b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:34.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a30154100 0x7f7a300b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60090/0 (socket says 172.21.15.125:60090) 2023-11-28T11:10:34.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a2f7fe700 1 -- 172.21.15.125:0/2668833849 learned_addr learned my addr 172.21.15.125:0/2668833849 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:34.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a2e7fc700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3015cce0 0x7f7a30156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:34.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a2effd700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a300d1270 0x7f7a300b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:34.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a2f7fe700 1 -- 172.21.15.125:0/2668833849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a300d1270 msgr2=0x7f7a300b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:34.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a2f7fe700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a300d1270 0x7f7a300b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:34.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a2f7fe700 1 -- 172.21.15.125:0/2668833849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3015cce0 msgr2=0x7f7a30156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:34.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a2f7fe700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3015cce0 0x7f7a30156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:34.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a2f7fe700 1 -- 172.21.15.125:0/2668833849 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a28009a70 con 0x7f7a30154100 2023-11-28T11:10:34.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.095+0000 7f7a2f7fe700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a30154100 0x7f7a300b3740 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7a3008b500 tx=0x7f7a28004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:34.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.097+0000 7f7a17fff700 1 -- 172.21.15.125:0/2668833849 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28012430 con 0x7f7a30154100 2023-11-28T11:10:34.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.097+0000 7f7a35845700 1 -- 172.21.15.125:0/2668833849 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a300b2c60 con 0x7f7a30154100 2023-11-28T11:10:34.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.097+0000 7f7a17fff700 1 -- 172.21.15.125:0/2668833849 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a28020070 con 0x7f7a30154100 2023-11-28T11:10:34.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.097+0000 7f7a17fff700 1 -- 172.21.15.125:0/2668833849 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28004280 con 0x7f7a30154100 2023-11-28T11:10:34.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.097+0000 7f7a35845700 1 -- 172.21.15.125:0/2668833849 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a300b2980 con 0x7f7a30154100 2023-11-28T11:10:34.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.098+0000 7f7a35845700 1 -- 172.21.15.125:0/2668833849 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a300b2f40 con 0x7f7a30154100 2023-11-28T11:10:34.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.098+0000 7f7a17fff700 1 -- 172.21.15.125:0/2668833849 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7a2802e070 con 0x7f7a30154100 2023-11-28T11:10:34.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.098+0000 7f7a17fff700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a1c0682f0 0x7f7a1c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:34.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.098+0000 7f7a17fff700 1 -- 172.21.15.125:0/2668833849 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7a28022070 con 0x7f7a30154100 2023-11-28T11:10:34.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.098+0000 7f7a2effd700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a1c0682f0 0x7f7a1c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:34.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.099+0000 7f7a2effd700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a1c0682f0 0x7f7a1c06a7a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7a24007fd0 tx=0x7f7a24007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:34.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.103+0000 7f7a17fff700 1 -- 172.21.15.125:0/2668833849 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7a280541a0 con 0x7f7a30154100 2023-11-28T11:10:34.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:34.288+0000 7f7a35845700 1 -- 172.21.15.125:0/2668833849 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7a300743f0 con 0x7f7a30154100 2023-11-28T11:10:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.105+0000 7f7a17fff700 1 -- 172.21.15.125:0/2668833849 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7a280577c0 con 0x7f7a30154100 2023-11-28T11:10:35.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.109+0000 7f7a35845700 1 -- 172.21.15.125:0/2668833849 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a1c0682f0 msgr2=0x7f7a1c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:35.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.109+0000 7f7a35845700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a1c0682f0 0x7f7a1c06a7a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7a24007fd0 tx=0x7f7a24007de0 comp rx=0 tx=0).stop 2023-11-28T11:10:35.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.109+0000 7f7a35845700 1 -- 172.21.15.125:0/2668833849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a30154100 msgr2=0x7f7a300b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:35.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.109+0000 7f7a35845700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a30154100 0x7f7a300b3740 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7a3008b500 tx=0x7f7a28004ad0 comp rx=0 tx=0).stop 2023-11-28T11:10:35.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.109+0000 7f7a35845700 1 -- 172.21.15.125:0/2668833849 shutdown_connections 2023-11-28T11:10:35.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.109+0000 7f7a35845700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a30154100 0x7f7a300b3740 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:35.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.109+0000 7f7a35845700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a1c0682f0 0x7f7a1c06a7a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:35.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.109+0000 7f7a35845700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a300d1270 0x7f7a300b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:35.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.110+0000 7f7a35845700 1 --2- 172.21.15.125:0/2668833849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3015cce0 0x7f7a30156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:35.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.110+0000 7f7a35845700 1 -- 172.21.15.125:0/2668833849 >> 172.21.15.125:0/2668833849 conn(0x7f7a3009c4d0 msgr2=0x7f7a3015afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:35.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.110+0000 7f7a35845700 1 -- 172.21.15.125:0/2668833849 shutdown_connections 2023-11-28T11:10:35.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.110+0000 7f7a35845700 1 -- 172.21.15.125:0/2668833849 wait complete. 2023-11-28T11:10:35.113 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' created 2023-11-28T11:10:35.126 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:10:35.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.259+0000 7fef8ab9c700 1 Processor -- start 2023-11-28T11:10:35.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.259+0000 7fef8ab9c700 1 -- start start 2023-11-28T11:10:35.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.260+0000 7fef8ab9c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef8406a980 0x7fef840ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:35.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.260+0000 7fef8ab9c700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fef84071890 0x7fef84071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:35.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.260+0000 7fef8ab9c700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8415cc10 con 0x7fef840cf710 2023-11-28T11:10:35.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.260+0000 7fef8ab9c700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8406c9b0 con 0x7fef84071890 2023-11-28T11:10:35.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.260+0000 7fef8ab9c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8406cc90 con 0x7fef8406a980 2023-11-28T11:10:35.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.260+0000 7fef89139700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fef84071890 0x7fef84071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:35.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.260+0000 7fef83fff700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef8406a980 0x7fef840ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:35.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.260+0000 7fef88938700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fef840cf710 0x7fef8406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:47020/0 (socket says 172.21.15.125:47020) 2023-11-28T11:10:35.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.260+0000 7fef88938700 1 -- 172.21.15.125:0/4001393113 learned_addr learned my addr 172.21.15.125:0/4001393113 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:35.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.261+0000 7fef89139700 1 -- 172.21.15.125:0/4001393113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef8406a980 msgr2=0x7fef840ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:35.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.261+0000 7fef89139700 1 --2- 172.21.15.125:0/4001393113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef8406a980 0x7fef840ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:35.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.261+0000 7fef89139700 1 -- 172.21.15.125:0/4001393113 >> v1:172.21.15.167:6789/0 conn(0x7fef840cf710 legacy=0x7fef8406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:35.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.261+0000 7fef89139700 1 -- 172.21.15.125:0/4001393113 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8406cf70 con 0x7fef84071890 2023-11-28T11:10:35.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.261+0000 7fef83fff700 1 --2- 172.21.15.125:0/4001393113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef8406a980 0x7fef840ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:10:35.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.261+0000 7fef89139700 1 --2- 172.21.15.125:0/4001393113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef84071890 0x7fef84071220 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef74009840 tx=0x7fef74009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e42b533620322ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:35.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.261+0000 7fef837fe700 1 -- 172.21.15.125:0/4001393113 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74011830 con 0x7fef84071890 2023-11-28T11:10:35.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.261+0000 7fef837fe700 1 -- 172.21.15.125:0/4001393113 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef74011990 con 0x7fef84071890 2023-11-28T11:10:35.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.261+0000 7fef837fe700 1 -- 172.21.15.125:0/4001393113 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74011d20 con 0x7fef84071890 2023-11-28T11:10:35.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.262+0000 7fef8ab9c700 1 -- 172.21.15.125:0/4001393113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef84071890 msgr2=0x7fef84071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:35.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.262+0000 7fef8ab9c700 1 --2- 172.21.15.125:0/4001393113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef84071890 0x7fef84071220 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef74009840 tx=0x7fef74009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:35.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.262+0000 7fef8ab9c700 1 -- 172.21.15.125:0/4001393113 shutdown_connections 2023-11-28T11:10:35.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.262+0000 7fef8ab9c700 1 --2- 172.21.15.125:0/4001393113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef84071890 0x7fef84071220 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:35.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.262+0000 7fef8ab9c700 1 --2- 172.21.15.125:0/4001393113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef8406a980 0x7fef840ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:35.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.262+0000 7fef8ab9c700 1 -- 172.21.15.125:0/4001393113 >> 172.21.15.125:0/4001393113 conn(0x7fef8406c010 msgr2=0x7fef840cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:35.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.262+0000 7fef8ab9c700 1 -- 172.21.15.125:0/4001393113 shutdown_connections 2023-11-28T11:10:35.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.262+0000 7fef8ab9c700 1 -- 172.21.15.125:0/4001393113 wait complete. 2023-11-28T11:10:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.263+0000 7fef8ab9c700 1 Processor -- start 2023-11-28T11:10:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.263+0000 7fef8ab9c700 1 -- start start 2023-11-28T11:10:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef8ab9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8406a980 0x7fef840c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef8ab9c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef84071890 0x7fef8415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef8ab9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef840cf710 0x7fef840cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef8ab9c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8415e220 con 0x7fef8406a980 2023-11-28T11:10:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef8ab9c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef840cc9e0 con 0x7fef840cf710 2023-11-28T11:10:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef8ab9c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8415e410 con 0x7fef84071890 2023-11-28T11:10:35.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef88938700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8406a980 0x7fef840c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef88938700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8406a980 0x7fef840c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60096/0 (socket says 172.21.15.125:60096) 2023-11-28T11:10:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef88938700 1 -- 172.21.15.125:0/141075624 learned_addr learned my addr 172.21.15.125:0/141075624 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef83fff700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef84071890 0x7fef8415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef89139700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef840cf710 0x7fef840cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef88938700 1 -- 172.21.15.125:0/141075624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef84071890 msgr2=0x7fef8415dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef88938700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef84071890 0x7fef8415dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:35.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef88938700 1 -- 172.21.15.125:0/141075624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef840cf710 msgr2=0x7fef840cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef88938700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef840cf710 0x7fef840cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.264+0000 7fef88938700 1 -- 172.21.15.125:0/141075624 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0094a0 con 0x7fef8406a980 2023-11-28T11:10:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.265+0000 7fef88938700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8406a980 0x7fef840c7260 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00caa0 tx=0x7fef7c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.265+0000 7fef817fa700 1 -- 172.21.15.125:0/141075624 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00a9a0 con 0x7fef8406a980 2023-11-28T11:10:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.265+0000 7fef817fa700 1 -- 172.21.15.125:0/141075624 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c00ab00 con 0x7fef8406a980 2023-11-28T11:10:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.265+0000 7fef8ab9c700 1 -- 172.21.15.125:0/141075624 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef740094a0 con 0x7fef8406a980 2023-11-28T11:10:35.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.265+0000 7fef817fa700 1 -- 172.21.15.125:0/141075624 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00ae90 con 0x7fef8406a980 2023-11-28T11:10:35.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.265+0000 7fef8ab9c700 1 -- 172.21.15.125:0/141075624 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8406d530 con 0x7fef8406a980 2023-11-28T11:10:35.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.266+0000 7fef8ab9c700 1 -- 172.21.15.125:0/141075624 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8406d250 con 0x7fef8406a980 2023-11-28T11:10:35.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.267+0000 7fef817fa700 1 -- 172.21.15.125:0/141075624 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fef7c019030 con 0x7fef8406a980 2023-11-28T11:10:35.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.267+0000 7fef817fa700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fef640682f0 0x7fef6406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:35.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.267+0000 7fef817fa700 1 -- 172.21.15.125:0/141075624 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fef7c085910 con 0x7fef8406a980 2023-11-28T11:10:35.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.267+0000 7fef83fff700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fef640682f0 0x7fef6406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:35.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.268+0000 7fef83fff700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fef640682f0 0x7fef6406a7a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fef840adf80 tx=0x7fef6c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:35.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.271+0000 7fef817fa700 1 -- 172.21.15.125:0/141075624 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fef7c0524b0 con 0x7fef8406a980 2023-11-28T11:10:35.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:35.452+0000 7fef8ab9c700 1 -- 172.21.15.125:0/141075624 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fef84160480 con 0x7fef8406a980 2023-11-28T11:10:36.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.112+0000 7fef817fa700 1 -- 172.21.15.125:0/141075624 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7fef7c0170d0 con 0x7fef8406a980 2023-11-28T11:10:36.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.117+0000 7fef8ab9c700 1 -- 172.21.15.125:0/141075624 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fef640682f0 msgr2=0x7fef6406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.117+0000 7fef8ab9c700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fef640682f0 0x7fef6406a7a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fef840adf80 tx=0x7fef6c009210 comp rx=0 tx=0).stop 2023-11-28T11:10:36.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.117+0000 7fef8ab9c700 1 -- 172.21.15.125:0/141075624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8406a980 msgr2=0x7fef840c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.117+0000 7fef8ab9c700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8406a980 0x7fef840c7260 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00caa0 tx=0x7fef7c00cdb0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.119+0000 7fef8ab9c700 1 -- 172.21.15.125:0/141075624 shutdown_connections 2023-11-28T11:10:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.119+0000 7fef8ab9c700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef840cf710 0x7fef840cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.119+0000 7fef8ab9c700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef8406a980 0x7fef840c7260 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.119+0000 7fef8ab9c700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fef640682f0 0x7fef6406a7a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.119+0000 7fef8ab9c700 1 --2- 172.21.15.125:0/141075624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef84071890 0x7fef8415dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.119+0000 7fef8ab9c700 1 -- 172.21.15.125:0/141075624 >> 172.21.15.125:0/141075624 conn(0x7fef8406c010 msgr2=0x7fef8415c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:36.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.120+0000 7fef8ab9c700 1 -- 172.21.15.125:0/141075624 shutdown_connections 2023-11-28T11:10:36.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.120+0000 7fef8ab9c700 1 -- 172.21.15.125:0/141075624 wait complete. 2023-11-28T11:10:36.129 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' created 2023-11-28T11:10:36.145 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:10:36.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.270+0000 7f4c4bbf9700 1 Processor -- start 2023-11-28T11:10:36.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.271+0000 7f4c4bbf9700 1 -- start start 2023-11-28T11:10:36.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.271+0000 7f4c4bbf9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c4415c810 0x7f4c44160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.271+0000 7f4c4bbf9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4c4406a270 0x7f4c4406a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.271+0000 7f4c4bbf9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4406ac10 con 0x7f4c440718e0 2023-11-28T11:10:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.271+0000 7f4c4bbf9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4415cbe0 con 0x7f4c4406a270 2023-11-28T11:10:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.271+0000 7f4c4bbf9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c441607a0 con 0x7f4c4415c810 2023-11-28T11:10:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c4a196700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4c4406a270 0x7f4c4406a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c49194700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4c440718e0 0x7f4c4406c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44228/0 (socket says 172.21.15.125:44228) 2023-11-28T11:10:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c49194700 1 -- 172.21.15.125:0/1555983916 learned_addr learned my addr 172.21.15.125:0/1555983916 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c49995700 1 --2- 172.21.15.125:0/1555983916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c4415c810 0x7f4c44160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c4a196700 1 -- 172.21.15.125:0/1555983916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c4415c810 msgr2=0x7f4c44160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c4a196700 1 --2- 172.21.15.125:0/1555983916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c4415c810 0x7f4c44160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c4a196700 1 -- 172.21.15.125:0/1555983916 >> v1:172.21.15.125:6789/0 conn(0x7f4c440718e0 legacy=0x7f4c4406c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c4a196700 1 -- 172.21.15.125:0/1555983916 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c44160a50 con 0x7f4c4406a270 2023-11-28T11:10:36.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c48993700 1 -- 172.21.15.125:0/1555983916 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3213620939 0 0) 0x7f4c4406ac10 con 0x7f4c440718e0 2023-11-28T11:10:36.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c49995700 1 --2- 172.21.15.125:0/1555983916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c4415c810 0x7f4c44160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:36.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c4a196700 1 --2- 172.21.15.125:0/1555983916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c4406a270 0x7f4c4406a6d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009d90 tx=0x7f4c3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ccbf42d111af2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:36.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c48993700 1 -- 172.21.15.125:0/1555983916 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00e070 con 0x7f4c4406a270 2023-11-28T11:10:36.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c48993700 1 -- 172.21.15.125:0/1555983916 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c00bbd0 con 0x7f4c4406a270 2023-11-28T11:10:36.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.272+0000 7f4c48993700 1 -- 172.21.15.125:0/1555983916 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c012430 con 0x7f4c4406a270 2023-11-28T11:10:36.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.273+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/1555983916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c4406a270 msgr2=0x7f4c4406a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.273+0000 7f4c4bbf9700 1 --2- 172.21.15.125:0/1555983916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c4406a270 0x7f4c4406a6d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009d90 tx=0x7f4c3c00b330 comp rx=0 tx=0).stop 2023-11-28T11:10:36.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.273+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/1555983916 shutdown_connections 2023-11-28T11:10:36.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.273+0000 7f4c4bbf9700 1 --2- 172.21.15.125:0/1555983916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c4406a270 0x7f4c4406a6d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.273+0000 7f4c4bbf9700 1 --2- 172.21.15.125:0/1555983916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c4415c810 0x7f4c44160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.273+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/1555983916 >> 172.21.15.125:0/1555983916 conn(0x7f4c4406c010 msgr2=0x7f4c440cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:36.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.273+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/1555983916 shutdown_connections 2023-11-28T11:10:36.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.273+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/1555983916 wait complete. 2023-11-28T11:10:36.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.274+0000 7f4c4bbf9700 1 Processor -- start 2023-11-28T11:10:36.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.274+0000 7f4c4bbf9700 1 -- start start 2023-11-28T11:10:36.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4bbf9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c4406a270 0x7f4c44150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4bbf9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c440718e0 0x7f4c441529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4bbf9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c4415c810 0x7f4c44152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4bbf9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c441507b0 con 0x7f4c4415c810 2023-11-28T11:10:36.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4bbf9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44157bd0 con 0x7f4c4406a270 2023-11-28T11:10:36.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4bbf9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44157eb0 con 0x7f4c440718e0 2023-11-28T11:10:36.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4a196700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c4415c810 0x7f4c44152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4a196700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c4415c810 0x7f4c44152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60114/0 (socket says 172.21.15.125:60114) 2023-11-28T11:10:36.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4a196700 1 -- 172.21.15.125:0/3057725079 learned_addr learned my addr 172.21.15.125:0/3057725079 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:36.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c49194700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c440718e0 0x7f4c441529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c49995700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c4406a270 0x7f4c44150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4a196700 1 -- 172.21.15.125:0/3057725079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c440718e0 msgr2=0x7f4c441529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4a196700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c440718e0 0x7f4c441529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4a196700 1 -- 172.21.15.125:0/3057725079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c4406a270 msgr2=0x7f4c44150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4a196700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c4406a270 0x7f4c44150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4a196700 1 -- 172.21.15.125:0/3057725079 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c009a70 con 0x7f4c4415c810 2023-11-28T11:10:36.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c49194700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c440718e0 0x7f4c441529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:36.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4a196700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c4415c810 0x7f4c44152ee0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4c44067450 tx=0x7f4c3c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:36.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c3a7fc700 1 -- 172.21.15.125:0/3057725079 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c003ea0 con 0x7f4c4415c810 2023-11-28T11:10:36.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c3a7fc700 1 -- 172.21.15.125:0/3057725079 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c020070 con 0x7f4c4415c810 2023-11-28T11:10:36.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c3a7fc700 1 -- 172.21.15.125:0/3057725079 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c004280 con 0x7f4c4415c810 2023-11-28T11:10:36.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.275+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/3057725079 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c44161010 con 0x7f4c4415c810 2023-11-28T11:10:36.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.276+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/3057725079 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c44160d30 con 0x7f4c4415c810 2023-11-28T11:10:36.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.276+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/3057725079 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c440ceb20 con 0x7f4c4415c810 2023-11-28T11:10:36.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.277+0000 7f4c3a7fc700 1 -- 172.21.15.125:0/3057725079 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4c3c02e070 con 0x7f4c4415c810 2023-11-28T11:10:36.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.277+0000 7f4c3a7fc700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4c280682f0 0x7f4c2806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.277+0000 7f4c3a7fc700 1 -- 172.21.15.125:0/3057725079 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f4c3c022070 con 0x7f4c4415c810 2023-11-28T11:10:36.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.277+0000 7f4c49995700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4c280682f0 0x7f4c2806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.278+0000 7f4c49995700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4c280682f0 0x7f4c2806a7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4c34006fd0 tx=0x7f4c34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:36.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.282+0000 7f4c3a7fc700 1 -- 172.21.15.125:0/3057725079 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4c3c054410 con 0x7f4c4415c810 2023-11-28T11:10:36.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.507+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/3057725079 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4c440743f0 con 0x7f4c4415c810 2023-11-28T11:10:36.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.515+0000 7f4c3a7fc700 1 -- 172.21.15.125:0/3057725079 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4c3c02c0c0 con 0x7f4c4415c810 2023-11-28T11:10:36.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.519+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/3057725079 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4c280682f0 msgr2=0x7f4c2806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.519+0000 7f4c4bbf9700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4c280682f0 0x7f4c2806a7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4c34006fd0 tx=0x7f4c34008040 comp rx=0 tx=0).stop 2023-11-28T11:10:36.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.519+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/3057725079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c4415c810 msgr2=0x7f4c44152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.519+0000 7f4c4bbf9700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c4415c810 0x7f4c44152ee0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4c44067450 tx=0x7f4c3c004ad0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.520+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/3057725079 shutdown_connections 2023-11-28T11:10:36.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.520+0000 7f4c4bbf9700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c4415c810 0x7f4c44152ee0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.520+0000 7f4c4bbf9700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c4406a270 0x7f4c44150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.520+0000 7f4c4bbf9700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4c280682f0 0x7f4c2806a7a0 secure :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4c34006fd0 tx=0x7f4c34008040 comp rx=0 tx=0).stop 2023-11-28T11:10:36.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.520+0000 7f4c4bbf9700 1 --2- 172.21.15.125:0/3057725079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c440718e0 0x7f4c441529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.520+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/3057725079 >> 172.21.15.125:0/3057725079 conn(0x7f4c4406c010 msgr2=0x7f4c44154500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:36.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.523+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/3057725079 shutdown_connections 2023-11-28T11:10:36.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.525+0000 7f4c4bbf9700 1 -- 172.21.15.125:0/3057725079 wait complete. 2023-11-28T11:10:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:new fs with metadata pool 7 and data pool 8 2023-11-28T11:10:36.546 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:10:36.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.666+0000 7f1e712f9700 1 Processor -- start 2023-11-28T11:10:36.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.666+0000 7f1e712f9700 1 -- start start 2023-11-28T11:10:36.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e712f9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e6c142db0 0x7f1e6c13ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e712f9700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e6c0b1770 0x7f1e6c0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e712f9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c15e010 con 0x7f1e6c0ce040 2023-11-28T11:10:36.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e712f9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c13fc90 con 0x7f1e6c142db0 2023-11-28T11:10:36.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e712f9700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0b20d0 con 0x7f1e6c0b1770 2023-11-28T11:10:36.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e6a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e6c142db0 0x7f1e6c13ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e6affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1e6c0ce040 0x7f1e6c15d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44258/0 (socket says 172.21.15.125:44258) 2023-11-28T11:10:36.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e6affd700 1 -- 172.21.15.125:0/2419833199 learned_addr learned my addr 172.21.15.125:0/2419833199 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:36.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e6a7fc700 1 -- 172.21.15.125:0/2419833199 >> v2:172.21.15.167:3300/0 conn(0x7f1e6c0b1770 msgr2=0x7f1e6c0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e6b7fe700 1 --2- 172.21.15.125:0/2419833199 >> v2:172.21.15.167:3300/0 conn(0x7f1e6c0b1770 0x7f1e6c0b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e6a7fc700 1 --2- 172.21.15.125:0/2419833199 >> v2:172.21.15.167:3300/0 conn(0x7f1e6c0b1770 0x7f1e6c0b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e69ffb700 1 -- 172.21.15.125:0/2419833199 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745395869 0 0) 0x7f1e60001110 con 0x7f1e6c0ce040 2023-11-28T11:10:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.667+0000 7f1e6a7fc700 1 -- 172.21.15.125:0/2419833199 >> v1:172.21.15.125:6789/0 conn(0x7f1e6c0ce040 legacy=0x7f1e6c15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e6a7fc700 1 -- 172.21.15.125:0/2419833199 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c13f6d0 con 0x7f1e6c142db0 2023-11-28T11:10:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e6b7fe700 1 --2- 172.21.15.125:0/2419833199 >> v2:172.21.15.167:3300/0 conn(0x7f1e6c0b1770 0x7f1e6c0b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e6a7fc700 1 --2- 172.21.15.125:0/2419833199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6c142db0 0x7f1e6c13ed70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c142cd0 tx=0x7f1e5c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf45acbdf1c778c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e69ffb700 1 -- 172.21.15.125:0/2419833199 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c011830 con 0x7f1e6c142db0 2023-11-28T11:10:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e69ffb700 1 -- 172.21.15.125:0/2419833199 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c011990 con 0x7f1e6c142db0 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e69ffb700 1 -- 172.21.15.125:0/2419833199 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c011d20 con 0x7f1e6c142db0 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e712f9700 1 -- 172.21.15.125:0/2419833199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6c142db0 msgr2=0x7f1e6c13ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e712f9700 1 --2- 172.21.15.125:0/2419833199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6c142db0 0x7f1e6c13ed70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c142cd0 tx=0x7f1e5c009b20 comp rx=0 tx=0).stop 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e712f9700 1 -- 172.21.15.125:0/2419833199 shutdown_connections 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e712f9700 1 --2- 172.21.15.125:0/2419833199 >> v2:172.21.15.167:3300/0 conn(0x7f1e6c0b1770 0x7f1e6c0b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e712f9700 1 --2- 172.21.15.125:0/2419833199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6c142db0 0x7f1e6c13ed70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e712f9700 1 -- 172.21.15.125:0/2419833199 >> 172.21.15.125:0/2419833199 conn(0x7f1e6c06c010 msgr2=0x7f1e6c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e712f9700 1 -- 172.21.15.125:0/2419833199 shutdown_connections 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.668+0000 7f1e712f9700 1 -- 172.21.15.125:0/2419833199 wait complete. 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.670+0000 7f1e712f9700 1 Processor -- start 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.670+0000 7f1e712f9700 1 -- start start 2023-11-28T11:10:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.670+0000 7f1e712f9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6c0b1770 0x7f1e6c154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.670+0000 7f1e712f9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6c0ce040 0x7f1e6c158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.670+0000 7f1e712f9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e6c142db0 0x7f1e6c15c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e712f9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c155000 con 0x7f1e6c0ce040 2023-11-28T11:10:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e712f9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0c6350 con 0x7f1e6c142db0 2023-11-28T11:10:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e712f9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c158aa0 con 0x7f1e6c0b1770 2023-11-28T11:10:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6c0ce040 0x7f1e6c158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6c0ce040 0x7f1e6c158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60142/0 (socket says 172.21.15.125:60142) 2023-11-28T11:10:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6a7fc700 1 -- 172.21.15.125:0/3124590910 learned_addr learned my addr 172.21.15.125:0/3124590910 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6b7fe700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e6c142db0 0x7f1e6c15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6affd700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6c0b1770 0x7f1e6c154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6a7fc700 1 -- 172.21.15.125:0/3124590910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6c0b1770 msgr2=0x7f1e6c154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6a7fc700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6c0b1770 0x7f1e6c154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6a7fc700 1 -- 172.21.15.125:0/3124590910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e6c142db0 msgr2=0x7f1e6c15c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6a7fc700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e6c142db0 0x7f1e6c15c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6a7fc700 1 -- 172.21.15.125:0/3124590910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c0094a0 con 0x7f1e6c0ce040 2023-11-28T11:10:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6b7fe700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e6c142db0 0x7f1e6c15c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6affd700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6c0b1770 0x7f1e6c154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e6a7fc700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6c0ce040 0x7f1e6c158560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c000c00 tx=0x7f1e5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e537fe700 1 -- 172.21.15.125:0/3124590910 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0036a0 con 0x7f1e6c0ce040 2023-11-28T11:10:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e537fe700 1 -- 172.21.15.125:0/3124590910 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c003800 con 0x7f1e6c0ce040 2023-11-28T11:10:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e537fe700 1 -- 172.21.15.125:0/3124590910 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c003b90 con 0x7f1e6c0ce040 2023-11-28T11:10:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e712f9700 1 -- 172.21.15.125:0/3124590910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c15d100 con 0x7f1e6c0ce040 2023-11-28T11:10:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.671+0000 7f1e712f9700 1 -- 172.21.15.125:0/3124590910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c13f9b0 con 0x7f1e6c0ce040 2023-11-28T11:10:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.672+0000 7f1e712f9700 1 -- 172.21.15.125:0/3124590910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c15d3e0 con 0x7f1e6c0ce040 2023-11-28T11:10:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.673+0000 7f1e537fe700 1 -- 172.21.15.125:0/3124590910 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1e5c00f050 con 0x7f1e6c0ce040 2023-11-28T11:10:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.673+0000 7f1e537fe700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e580682f0 0x7f1e5806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.673+0000 7f1e537fe700 1 -- 172.21.15.125:0/3124590910 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e5c087100 con 0x7f1e6c0ce040 2023-11-28T11:10:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.673+0000 7f1e6affd700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e580682f0 0x7f1e5806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.673+0000 7f1e6affd700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e580682f0 0x7f1e5806a7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1e60007fd0 tx=0x7f1e60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:36.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.677+0000 7f1e537fe700 1 -- 172.21.15.125:0/3124590910 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1e5c053960 con 0x7f1e6c0ce040 2023-11-28T11:10:36.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.863+0000 7f1e712f9700 1 -- 172.21.15.125:0/3124590910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e6c0743f0 con 0x7f1e6c0ce040 2023-11-28T11:10:36.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.864+0000 7f1e537fe700 1 -- 172.21.15.125:0/3124590910 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18040 (secure 0 0 0) 0x7f1e5c056f80 con 0x7f1e6c0ce040 2023-11-28T11:10:36.865 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:36.865 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":51,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:10:36.508642+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:10:34.306816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T11:10:35.470755+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:10:36.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 -- 172.21.15.125:0/3124590910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e580682f0 msgr2=0x7f1e5806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e580682f0 0x7f1e5806a7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1e60007fd0 tx=0x7f1e60009040 comp rx=0 tx=0).stop 2023-11-28T11:10:36.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 -- 172.21.15.125:0/3124590910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6c0ce040 msgr2=0x7f1e6c158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:36.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6c0ce040 0x7f1e6c158560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c000c00 tx=0x7f1e5c004750 comp rx=0 tx=0).stop 2023-11-28T11:10:36.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 -- 172.21.15.125:0/3124590910 shutdown_connections 2023-11-28T11:10:36.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e6c142db0 0x7f1e6c15c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1e580682f0 0x7f1e5806a7a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e6c0b1770 0x7f1e6c154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 --2- 172.21.15.125:0/3124590910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e6c0ce040 0x7f1e6c158560 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:36.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 -- 172.21.15.125:0/3124590910 >> 172.21.15.125:0/3124590910 conn(0x7f1e6c06c010 msgr2=0x7f1e6c0cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:36.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 -- 172.21.15.125:0/3124590910 shutdown_connections 2023-11-28T11:10:36.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:36.867+0000 7f1e712f9700 1 -- 172.21.15.125:0/3124590910 wait complete. 2023-11-28T11:10:36.880 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:10:37.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.000+0000 7f2cb3629700 1 Processor -- start 2023-11-28T11:10:37.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.000+0000 7f2cb3629700 1 -- start start 2023-11-28T11:10:37.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb3629700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cac06a270 0x7f2cac06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb3629700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2cac15cc80 0x7f2cac06de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb3629700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac06ab80 con 0x7f2cac06e3a0 2023-11-28T11:10:37.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb3629700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac0b2490 con 0x7f2cac15cc80 2023-11-28T11:10:37.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb3629700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0b1810 con 0x7f2cac06a270 2023-11-28T11:10:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb0bc4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2cac15cc80 0x7f2cac06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb0bc4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2cac15cc80 0x7f2cac06de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60148/0 (socket says 172.21.15.125:60148) 2023-11-28T11:10:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb0bc4700 1 -- 172.21.15.125:0/2248972905 learned_addr learned my addr 172.21.15.125:0/2248972905 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb0bc4700 1 -- 172.21.15.125:0/2248972905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cac06a270 msgr2=0x7f2cac06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb13c5700 1 --2- 172.21.15.125:0/2248972905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cac06a270 0x7f2cac06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb0bc4700 1 --2- 172.21.15.125:0/2248972905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cac06a270 0x7f2cac06a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb0bc4700 1 -- 172.21.15.125:0/2248972905 >> v1:172.21.15.167:6789/0 conn(0x7f2cac06e3a0 legacy=0x7f2cac06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb0bc4700 1 -- 172.21.15.125:0/2248972905 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac0b1af0 con 0x7f2cac15cc80 2023-11-28T11:10:37.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb13c5700 1 --2- 172.21.15.125:0/2248972905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cac06a270 0x7f2cac06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.001+0000 7f2cb0bc4700 1 --2- 172.21.15.125:0/2248972905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cac15cc80 0x7f2cac06de60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80098f0 tx=0x7f2ca8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0e7fa15181ef3c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.002+0000 7f2ca3fff700 1 -- 172.21.15.125:0/2248972905 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8004230 con 0x7f2cac15cc80 2023-11-28T11:10:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.002+0000 7f2ca3fff700 1 -- 172.21.15.125:0/2248972905 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca8004390 con 0x7f2cac15cc80 2023-11-28T11:10:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.002+0000 7f2ca3fff700 1 -- 172.21.15.125:0/2248972905 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80036a0 con 0x7f2cac15cc80 2023-11-28T11:10:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.002+0000 7f2cb3629700 1 -- 172.21.15.125:0/2248972905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cac15cc80 msgr2=0x7f2cac06de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.002+0000 7f2cb3629700 1 --2- 172.21.15.125:0/2248972905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cac15cc80 0x7f2cac06de60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80098f0 tx=0x7f2ca8009c00 comp rx=0 tx=0).stop 2023-11-28T11:10:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.002+0000 7f2cb3629700 1 -- 172.21.15.125:0/2248972905 shutdown_connections 2023-11-28T11:10:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.002+0000 7f2cb3629700 1 --2- 172.21.15.125:0/2248972905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cac06a270 0x7f2cac06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.002+0000 7f2cb3629700 1 --2- 172.21.15.125:0/2248972905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cac15cc80 0x7f2cac06de60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.002+0000 7f2cb3629700 1 -- 172.21.15.125:0/2248972905 >> 172.21.15.125:0/2248972905 conn(0x7f2cac06c010 msgr2=0x7f2cac0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:37.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.002+0000 7f2cb3629700 1 -- 172.21.15.125:0/2248972905 shutdown_connections 2023-11-28T11:10:37.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.002+0000 7f2cb3629700 1 -- 172.21.15.125:0/2248972905 wait complete. 2023-11-28T11:10:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.003+0000 7f2cb3629700 1 Processor -- start 2023-11-28T11:10:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.003+0000 7f2cb3629700 1 -- start start 2023-11-28T11:10:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.004+0000 7f2cb3629700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cac06a270 0x7f2cac1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.004+0000 7f2cb3629700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cac06e3a0 0x7f2cac0b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.004+0000 7f2cb3629700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cac15cc80 0x7f2cac0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.004+0000 7f2cb3629700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac15ea70 con 0x7f2cac06a270 2023-11-28T11:10:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.004+0000 7f2cb3629700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0b3ba0 con 0x7f2cac15cc80 2023-11-28T11:10:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.004+0000 7f2cb3629700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac15de60 con 0x7f2cac06e3a0 2023-11-28T11:10:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.004+0000 7f2cb13c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cac06a270 0x7f2cac1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.004+0000 7f2cb13c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cac06a270 0x7f2cac1528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60154/0 (socket says 172.21.15.125:60154) 2023-11-28T11:10:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.004+0000 7f2cb13c5700 1 -- 172.21.15.125:0/335748388 learned_addr learned my addr 172.21.15.125:0/335748388 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.004+0000 7f2cb0bc4700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cac06e3a0 0x7f2cac0b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.004+0000 7f2cb1bc6700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cac15cc80 0x7f2cac0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2cb13c5700 1 -- 172.21.15.125:0/335748388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cac06e3a0 msgr2=0x7f2cac0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2cb13c5700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cac06e3a0 0x7f2cac0b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2cb13c5700 1 -- 172.21.15.125:0/335748388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cac15cc80 msgr2=0x7f2cac0cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2cb13c5700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cac15cc80 0x7f2cac0cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2cb13c5700 1 -- 172.21.15.125:0/335748388 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8009550 con 0x7f2cac06a270 2023-11-28T11:10:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2cb1bc6700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cac15cc80 0x7f2cac0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2cb13c5700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cac06a270 0x7f2cac1528d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00c7f0 tx=0x7f2c9c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:37.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2ca1ffb700 1 -- 172.21.15.125:0/335748388 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c011800 con 0x7f2cac06a270 2023-11-28T11:10:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2ca1ffb700 1 -- 172.21.15.125:0/335748388 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c011960 con 0x7f2cac06a270 2023-11-28T11:10:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2cb3629700 1 -- 172.21.15.125:0/335748388 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac0b20b0 con 0x7f2cac06a270 2023-11-28T11:10:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2ca1ffb700 1 -- 172.21.15.125:0/335748388 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c011cf0 con 0x7f2cac06a270 2023-11-28T11:10:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.005+0000 7f2cb3629700 1 -- 172.21.15.125:0/335748388 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cac0b1dd0 con 0x7f2cac06a270 2023-11-28T11:10:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.006+0000 7f2cb3629700 1 -- 172.21.15.125:0/335748388 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cac06e7e0 con 0x7f2cac06a270 2023-11-28T11:10:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.006+0000 7f2ca1ffb700 1 -- 172.21.15.125:0/335748388 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2c9c021070 con 0x7f2cac06a270 2023-11-28T11:10:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.006+0000 7f2ca1ffb700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c900682f0 0x7f2c9006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.007+0000 7f2cb0bc4700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c900682f0 0x7f2c9006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.007+0000 7f2ca1ffb700 1 -- 172.21.15.125:0/335748388 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c9c085ac0 con 0x7f2cac06a270 2023-11-28T11:10:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.007+0000 7f2cb0bc4700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c900682f0 0x7f2c9006a7a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009130 tx=0x7f2ca8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:37.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.011+0000 7f2ca1ffb700 1 -- 172.21.15.125:0/335748388 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2c9c0522a0 con 0x7f2cac06a270 2023-11-28T11:10:37.096 INFO:tasks.ceph.mds.a.smithi125.stderr:2023-11-28T11:10:37.096+0000 7fd6b2ac7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:10:37.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.194+0000 7f2cb3629700 1 -- 172.21.15.125:0/335748388 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cac0743f0 con 0x7f2cac06a270 2023-11-28T11:10:37.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.195+0000 7f2ca1ffb700 1 -- 172.21.15.125:0/335748388 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18040 (secure 0 0 0) 0x7f2c9c01f020 con 0x7f2cac06a270 2023-11-28T11:10:37.196 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:37.196 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":51,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:10:36.508642+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:10:34.306816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T11:10:35.470755+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:10:37.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 -- 172.21.15.125:0/335748388 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c900682f0 msgr2=0x7f2c9006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:37.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c900682f0 0x7f2c9006a7a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009130 tx=0x7f2ca8008030 comp rx=0 tx=0).stop 2023-11-28T11:10:37.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 -- 172.21.15.125:0/335748388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cac06a270 msgr2=0x7f2cac1528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:37.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cac06a270 0x7f2cac1528d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00c7f0 tx=0x7f2c9c00cb00 comp rx=0 tx=0).stop 2023-11-28T11:10:37.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 -- 172.21.15.125:0/335748388 shutdown_connections 2023-11-28T11:10:37.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cac15cc80 0x7f2cac0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cac06a270 0x7f2cac1528d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c900682f0 0x7f2c9006a7a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 --2- 172.21.15.125:0/335748388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cac06e3a0 0x7f2cac0b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 -- 172.21.15.125:0/335748388 >> 172.21.15.125:0/335748388 conn(0x7f2cac06c010 msgr2=0x7f2cac0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:37.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 -- 172.21.15.125:0/335748388 shutdown_connections 2023-11-28T11:10:37.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.197+0000 7f2cb3629700 1 -- 172.21.15.125:0/335748388 wait complete. 2023-11-28T11:10:37.210 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:10:37.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.332+0000 7f18d8f22700 1 Processor -- start 2023-11-28T11:10:37.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.332+0000 7f18d8f22700 1 -- start start 2023-11-28T11:10:37.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.333+0000 7f18d8f22700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d40b1650 0x7f18d40b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.333+0000 7f18d8f22700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f18d41599b0 0x7f18d415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.333+0000 7f18d8f22700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18d40af0a0 0x7f18d415a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.333+0000 7f18d8f22700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d4159ec0 con 0x7f18d40af0a0 2023-11-28T11:10:37.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.333+0000 7f18d8f22700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d40b1f60 con 0x7f18d41599b0 2023-11-28T11:10:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.333+0000 7f18d8f22700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d415d8a0 con 0x7f18d40b1650 2023-11-28T11:10:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.333+0000 7f18d2d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18d40af0a0 0x7f18d415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.333+0000 7f18d2d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18d40af0a0 0x7f18d415a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60166/0 (socket says 172.21.15.125:60166) 2023-11-28T11:10:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.333+0000 7f18d2d9d700 1 -- 172.21.15.125:0/3422506203 learned_addr learned my addr 172.21.15.125:0/3422506203 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.333+0000 7f18d259c700 1 --2- 172.21.15.125:0/3422506203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d40b1650 0x7f18d40b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.333+0000 7f18d1d9b700 1 --2- 172.21.15.125:0/3422506203 >> v2:172.21.15.167:3300/0 conn(0x7f18d41599b0 0x7f18d415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d2d9d700 1 -- 172.21.15.125:0/3422506203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d40b1650 msgr2=0x7f18d40b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d2d9d700 1 --2- 172.21.15.125:0/3422506203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d40b1650 0x7f18d40b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d2d9d700 1 -- 172.21.15.125:0/3422506203 >> v2:172.21.15.167:3300/0 conn(0x7f18d41599b0 msgr2=0x7f18d415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d2d9d700 1 --2- 172.21.15.125:0/3422506203 >> v2:172.21.15.167:3300/0 conn(0x7f18d41599b0 0x7f18d415d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d2d9d700 1 -- 172.21.15.125:0/3422506203 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d415db80 con 0x7f18d40af0a0 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d2d9d700 1 --2- 172.21.15.125:0/3422506203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18d40af0a0 0x7f18d415a350 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f18d40708e0 tx=0x7f18cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5c989d4ade1a57 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d159a700 1 -- 172.21.15.125:0/3422506203 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00e070 con 0x7f18d40af0a0 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d159a700 1 -- 172.21.15.125:0/3422506203 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc00b9c0 con 0x7f18d40af0a0 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d159a700 1 -- 172.21.15.125:0/3422506203 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00bd70 con 0x7f18d40af0a0 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d8f22700 1 -- 172.21.15.125:0/3422506203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18d40af0a0 msgr2=0x7f18d415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d8f22700 1 --2- 172.21.15.125:0/3422506203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18d40af0a0 0x7f18d415a350 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f18d40708e0 tx=0x7f18cc00b330 comp rx=0 tx=0).stop 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d8f22700 1 -- 172.21.15.125:0/3422506203 shutdown_connections 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d8f22700 1 --2- 172.21.15.125:0/3422506203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18d40af0a0 0x7f18d415a350 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d8f22700 1 --2- 172.21.15.125:0/3422506203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d40b1650 0x7f18d40b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d8f22700 1 --2- 172.21.15.125:0/3422506203 >> v2:172.21.15.167:3300/0 conn(0x7f18d41599b0 0x7f18d415d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.334+0000 7f18d8f22700 1 -- 172.21.15.125:0/3422506203 >> 172.21.15.125:0/3422506203 conn(0x7f18d406c010 msgr2=0x7f18d40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:37.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.335+0000 7f18d8f22700 1 -- 172.21.15.125:0/3422506203 shutdown_connections 2023-11-28T11:10:37.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.335+0000 7f18d8f22700 1 -- 172.21.15.125:0/3422506203 wait complete. 2023-11-28T11:10:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.336+0000 7f18d8f22700 1 Processor -- start 2023-11-28T11:10:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.336+0000 7f18d8f22700 1 -- start start 2023-11-28T11:10:37.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d8f22700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d40af0a0 0x7f18d4157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d8f22700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18d40b1650 0x7f18d40b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d8f22700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18d41581f0 0x7f18d40af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d8f22700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40b5410 con 0x7f18d41581f0 2023-11-28T11:10:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d8f22700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4157fb0 con 0x7f18d40b1650 2023-11-28T11:10:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d8f22700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40cbb40 con 0x7f18d40af0a0 2023-11-28T11:10:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18d41581f0 0x7f18d40af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18d41581f0 0x7f18d40af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60172/0 (socket says 172.21.15.125:60172) 2023-11-28T11:10:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d2d9d700 1 -- 172.21.15.125:0/2501927829 learned_addr learned my addr 172.21.15.125:0/2501927829 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:37.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d1d9b700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18d40b1650 0x7f18d40b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d259c700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d40af0a0 0x7f18d4157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d2d9d700 1 -- 172.21.15.125:0/2501927829 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d40af0a0 msgr2=0x7f18d4157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d2d9d700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d40af0a0 0x7f18d4157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d2d9d700 1 -- 172.21.15.125:0/2501927829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18d40b1650 msgr2=0x7f18d40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d2d9d700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18d40b1650 0x7f18d40b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d2d9d700 1 -- 172.21.15.125:0/2501927829 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc009b30 con 0x7f18d41581f0 2023-11-28T11:10:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d2d9d700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18d41581f0 0x7f18d40af910 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f18d40708b0 tx=0x7f18cc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18c2ffd700 1 -- 172.21.15.125:0/2501927829 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc004250 con 0x7f18d41581f0 2023-11-28T11:10:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18c2ffd700 1 -- 172.21.15.125:0/2501927829 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc0043d0 con 0x7f18d41581f0 2023-11-28T11:10:37.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d8f22700 1 -- 172.21.15.125:0/2501927829 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d415d590 con 0x7f18d41581f0 2023-11-28T11:10:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18c2ffd700 1 -- 172.21.15.125:0/2501927829 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc004780 con 0x7f18d41581f0 2023-11-28T11:10:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.337+0000 7f18d8f22700 1 -- 172.21.15.125:0/2501927829 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d415de60 con 0x7f18d41581f0 2023-11-28T11:10:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.338+0000 7f18d8f22700 1 -- 172.21.15.125:0/2501927829 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d415a890 con 0x7f18d41581f0 2023-11-28T11:10:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.339+0000 7f18c2ffd700 1 -- 172.21.15.125:0/2501927829 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f18cc02b070 con 0x7f18d41581f0 2023-11-28T11:10:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.339+0000 7f18c2ffd700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18b40682f0 0x7f18b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.339+0000 7f18c2ffd700 1 -- 172.21.15.125:0/2501927829 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f18cc086d30 con 0x7f18d41581f0 2023-11-28T11:10:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.339+0000 7f18d259c700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18b40682f0 0x7f18b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:37.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.339+0000 7f18d259c700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18b40682f0 0x7f18b406a7a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f18d4158ba0 tx=0x7f18c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:37.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.343+0000 7f18c2ffd700 1 -- 172.21.15.125:0/2501927829 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f18cc053590 con 0x7f18d41581f0 2023-11-28T11:10:37.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:37.571+0000 7f18d8f22700 1 -- 172.21.15.125:0/2501927829 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f18d40b5550 con 0x7f18d41581f0 2023-11-28T11:10:38.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.515+0000 7f18c2ffd700 1 -- 172.21.15.125:0/2501927829 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7f18d40b5550 con 0x7f18d41581f0 2023-11-28T11:10:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 -- 172.21.15.125:0/2501927829 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18b40682f0 msgr2=0x7f18b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18b40682f0 0x7f18b406a7a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f18d4158ba0 tx=0x7f18c8008040 comp rx=0 tx=0).stop 2023-11-28T11:10:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 -- 172.21.15.125:0/2501927829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18d41581f0 msgr2=0x7f18d40af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18d41581f0 0x7f18d40af910 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f18d40708b0 tx=0x7f18cc004ad0 comp rx=0 tx=0).stop 2023-11-28T11:10:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 -- 172.21.15.125:0/2501927829 shutdown_connections 2023-11-28T11:10:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18d41581f0 0x7f18d40af910 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18b40682f0 0x7f18b406a7a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d40af0a0 0x7f18d4157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:38.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 --2- 172.21.15.125:0/2501927829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18d40b1650 0x7f18d40b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:38.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 -- 172.21.15.125:0/2501927829 >> 172.21.15.125:0/2501927829 conn(0x7f18d406c010 msgr2=0x7f18d4158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:38.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 -- 172.21.15.125:0/2501927829 shutdown_connections 2023-11-28T11:10:38.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.519+0000 7f18d8f22700 1 -- 172.21.15.125:0/2501927829 wait complete. 2023-11-28T11:10:38.534 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T11:10:38.535 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:10:38.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.663+0000 7fe3e30ca700 1 Processor -- start 2023-11-28T11:10:38.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.663+0000 7fe3e30ca700 1 -- start start 2023-11-28T11:10:38.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.664+0000 7fe3e30ca700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe3dc0718e0 0x7fe3dc06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:38.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.664+0000 7fe3e30ca700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe3dc06cdc0 0x7fe3dc06a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:38.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.664+0000 7fe3e30ca700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3dc160a50 con 0x7fe3dc15c810 2023-11-28T11:10:38.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.664+0000 7fe3e30ca700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc15cbe0 con 0x7fe3dc06cdc0 2023-11-28T11:10:38.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.664+0000 7fe3e30ca700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc160d30 con 0x7fe3dc0718e0 2023-11-28T11:10:38.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.664+0000 7fe3e1667700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe3dc06cdc0 0x7fe3dc06a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:38.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.664+0000 7fe3e1667700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe3dc06cdc0 0x7fe3dc06a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60180/0 (socket says 172.21.15.125:60180) 2023-11-28T11:10:38.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.664+0000 7fe3e1667700 1 -- 172.21.15.125:0/2331970676 learned_addr learned my addr 172.21.15.125:0/2331970676 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:38.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.665+0000 7fe3dbfff700 1 --2- 172.21.15.125:0/2331970676 >> v2:172.21.15.167:3300/0 conn(0x7fe3dc0718e0 0x7fe3dc06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:38.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.665+0000 7fe3e1667700 1 -- 172.21.15.125:0/2331970676 >> v2:172.21.15.167:3300/0 conn(0x7fe3dc0718e0 msgr2=0x7fe3dc06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:38.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.665+0000 7fe3e1667700 1 --2- 172.21.15.125:0/2331970676 >> v2:172.21.15.167:3300/0 conn(0x7fe3dc0718e0 0x7fe3dc06c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:38.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.665+0000 7fe3e1667700 1 -- 172.21.15.125:0/2331970676 >> v1:172.21.15.167:6789/0 conn(0x7fe3dc15c810 legacy=0x7fe3dc160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:38.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.665+0000 7fe3e1667700 1 -- 172.21.15.125:0/2331970676 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc161010 con 0x7fe3dc06cdc0 2023-11-28T11:10:38.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.665+0000 7fe3e1667700 1 --2- 172.21.15.125:0/2331970676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3dc06cdc0 0x7fe3dc06a270 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009e50 tx=0x7fe3d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07576307d716ba7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:38.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.665+0000 7fe3db7fe700 1 -- 172.21.15.125:0/2331970676 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400e070 con 0x7fe3dc06cdc0 2023-11-28T11:10:38.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.665+0000 7fe3db7fe700 1 -- 172.21.15.125:0/2331970676 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d4003a20 con 0x7fe3dc06cdc0 2023-11-28T11:10:38.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.665+0000 7fe3db7fe700 1 -- 172.21.15.125:0/2331970676 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4003dd0 con 0x7fe3dc06cdc0 2023-11-28T11:10:38.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.666+0000 7fe3e30ca700 1 -- 172.21.15.125:0/2331970676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3dc06cdc0 msgr2=0x7fe3dc06a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:38.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.666+0000 7fe3e30ca700 1 --2- 172.21.15.125:0/2331970676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3dc06cdc0 0x7fe3dc06a270 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009e50 tx=0x7fe3d400b330 comp rx=0 tx=0).stop 2023-11-28T11:10:38.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.666+0000 7fe3e30ca700 1 -- 172.21.15.125:0/2331970676 shutdown_connections 2023-11-28T11:10:38.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.666+0000 7fe3e30ca700 1 --2- 172.21.15.125:0/2331970676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3dc06cdc0 0x7fe3dc06a270 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:38.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.666+0000 7fe3e30ca700 1 --2- 172.21.15.125:0/2331970676 >> v2:172.21.15.167:3300/0 conn(0x7fe3dc0718e0 0x7fe3dc06c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:38.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.666+0000 7fe3e30ca700 1 -- 172.21.15.125:0/2331970676 >> 172.21.15.125:0/2331970676 conn(0x7fe3dc06c010 msgr2=0x7fe3dc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:38.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.666+0000 7fe3e30ca700 1 -- 172.21.15.125:0/2331970676 shutdown_connections 2023-11-28T11:10:38.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.666+0000 7fe3e30ca700 1 -- 172.21.15.125:0/2331970676 wait complete. 2023-11-28T11:10:38.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.667+0000 7fe3e30ca700 1 Processor -- start 2023-11-28T11:10:38.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.667+0000 7fe3e30ca700 1 -- start start 2023-11-28T11:10:38.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e30ca700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3dc06cdc0 0x7fe3dc1f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:38.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e30ca700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3dc0718e0 0x7fe3dc1ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e30ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3dc15c810 0x7fe3dc157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e30ca700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc158260 con 0x7fe3dc15c810 2023-11-28T11:10:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e30ca700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc1f2710 con 0x7fe3dc0718e0 2023-11-28T11:10:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e30ca700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc1f29f0 con 0x7fe3dc06cdc0 2023-11-28T11:10:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e1667700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3dc15c810 0x7fe3dc157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e1667700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3dc15c810 0x7fe3dc157260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60186/0 (socket says 172.21.15.125:60186) 2023-11-28T11:10:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e1667700 1 -- 172.21.15.125:0/3696964985 learned_addr learned my addr 172.21.15.125:0/3696964985 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3dbfff700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3dc0718e0 0x7fe3dc1ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e0e66700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3dc06cdc0 0x7fe3dc1f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:38.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e1667700 1 -- 172.21.15.125:0/3696964985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3dc06cdc0 msgr2=0x7fe3dc1f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:38.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e1667700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3dc06cdc0 0x7fe3dc1f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:38.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e1667700 1 -- 172.21.15.125:0/3696964985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3dc0718e0 msgr2=0x7fe3dc1ef7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:38.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e1667700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3dc0718e0 0x7fe3dc1ef7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:38.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e1667700 1 -- 172.21.15.125:0/3696964985 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d4009b30 con 0x7fe3dc15c810 2023-11-28T11:10:38.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e1667700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3dc15c810 0x7fe3dc157260 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4004000 tx=0x7fe3d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:38.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3d97fa700 1 -- 172.21.15.125:0/3696964985 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4004440 con 0x7fe3dc15c810 2023-11-28T11:10:38.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3d97fa700 1 -- 172.21.15.125:0/3696964985 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d40045c0 con 0x7fe3dc15c810 2023-11-28T11:10:38.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3d97fa700 1 -- 172.21.15.125:0/3696964985 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4004970 con 0x7fe3dc15c810 2023-11-28T11:10:38.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.668+0000 7fe3e30ca700 1 -- 172.21.15.125:0/3696964985 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3dc0ce740 con 0x7fe3dc15c810 2023-11-28T11:10:38.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.669+0000 7fe3e30ca700 1 -- 172.21.15.125:0/3696964985 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc0ceb20 con 0x7fe3dc15c810 2023-11-28T11:10:38.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.669+0000 7fe3e30ca700 1 -- 172.21.15.125:0/3696964985 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3dc0ce8d0 con 0x7fe3dc15c810 2023-11-28T11:10:38.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.670+0000 7fe3d97fa700 1 -- 172.21.15.125:0/3696964985 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe3d4022030 con 0x7fe3dc15c810 2023-11-28T11:10:38.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.670+0000 7fe3d97fa700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3c00682f0 0x7fe3c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:38.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.670+0000 7fe3d97fa700 1 -- 172.21.15.125:0/3696964985 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3d4086f20 con 0x7fe3dc15c810 2023-11-28T11:10:38.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.670+0000 7fe3e0e66700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3c00682f0 0x7fe3c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:38.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.671+0000 7fe3e0e66700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3c00682f0 0x7fe3c006a7a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009960 tx=0x7fe3d00090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:38.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.674+0000 7fe3d97fa700 1 -- 172.21.15.125:0/3696964985 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe3d40b85e0 con 0x7fe3dc15c810 2023-11-28T11:10:38.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:38.902+0000 7fe3e30ca700 1 -- 172.21.15.125:0/3696964985 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe3dc0743f0 con 0x7fe3dc15c810 2023-11-28T11:10:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.520+0000 7fe3d97fa700 1 -- 172.21.15.125:0/3696964985 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe3d40170c0 con 0x7fe3dc15c810 2023-11-28T11:10:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 -- 172.21.15.125:0/3696964985 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3c00682f0 msgr2=0x7fe3c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3c00682f0 0x7fe3c006a7a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009960 tx=0x7fe3d00090e0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 -- 172.21.15.125:0/3696964985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3dc15c810 msgr2=0x7fe3dc157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3dc15c810 0x7fe3dc157260 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4004000 tx=0x7fe3d4004ad0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 -- 172.21.15.125:0/3696964985 shutdown_connections 2023-11-28T11:10:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3dc15c810 0x7fe3dc157260 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe3c00682f0 0x7fe3c006a7a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3dc06cdc0 0x7fe3dc1f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 --2- 172.21.15.125:0/3696964985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3dc0718e0 0x7fe3dc1ef7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 -- 172.21.15.125:0/3696964985 >> 172.21.15.125:0/3696964985 conn(0x7fe3dc06c010 msgr2=0x7fe3dc0b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:39.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 -- 172.21.15.125:0/3696964985 shutdown_connections 2023-11-28T11:10:39.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.522+0000 7fe3e30ca700 1 -- 172.21.15.125:0/3696964985 wait complete. 2023-11-28T11:10:39.536 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:10:39.537 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:10:39.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.661+0000 7fb2635ee700 1 Processor -- start 2023-11-28T11:10:39.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.662+0000 7fb2635ee700 1 -- start start 2023-11-28T11:10:39.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.662+0000 7fb2635ee700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb25c06a270 0x7fb25c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:39.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.662+0000 7fb2635ee700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb25c06e570 0x7fb25c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:39.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.662+0000 7fb2635ee700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25c06ab80 con 0x7fb25c15cc80 2023-11-28T11:10:39.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.662+0000 7fb2635ee700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25c0b2490 con 0x7fb25c06a270 2023-11-28T11:10:39.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.662+0000 7fb2635ee700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c0b1810 con 0x7fb25c06e570 2023-11-28T11:10:39.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.662+0000 7fb26138a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb25c06a270 0x7fb25c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:39.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.662+0000 7fb26138a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb25c06a270 0x7fb25c06a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60190/0 (socket says 172.21.15.125:60190) 2023-11-28T11:10:39.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.663+0000 7fb26138a700 1 -- 172.21.15.125:0/638513012 learned_addr learned my addr 172.21.15.125:0/638513012 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:39.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.663+0000 7fb261b8b700 1 --2- 172.21.15.125:0/638513012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb25c06e570 0x7fb25c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:39.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.663+0000 7fb26138a700 1 -- 172.21.15.125:0/638513012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb25c06e570 msgr2=0x7fb25c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:39.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.663+0000 7fb26138a700 1 --2- 172.21.15.125:0/638513012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb25c06e570 0x7fb25c070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.663+0000 7fb26138a700 1 -- 172.21.15.125:0/638513012 >> v1:172.21.15.167:6789/0 conn(0x7fb25c15cc80 legacy=0x7fb25c06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:39.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.663+0000 7fb26138a700 1 -- 172.21.15.125:0/638513012 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c0b1af0 con 0x7fb25c06a270 2023-11-28T11:10:39.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.663+0000 7fb261b8b700 1 --2- 172.21.15.125:0/638513012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb25c06e570 0x7fb25c070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:39.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.663+0000 7fb26138a700 1 --2- 172.21.15.125:0/638513012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb25c06a270 0x7fb25c06a640 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0098f0 tx=0x7fb24c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f5487046f8eba2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:39.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.663+0000 7fb253fff700 1 -- 172.21.15.125:0/638513012 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c004230 con 0x7fb25c06a270 2023-11-28T11:10:39.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.663+0000 7fb253fff700 1 -- 172.21.15.125:0/638513012 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c004390 con 0x7fb25c06a270 2023-11-28T11:10:39.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.663+0000 7fb253fff700 1 -- 172.21.15.125:0/638513012 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0036a0 con 0x7fb25c06a270 2023-11-28T11:10:39.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.664+0000 7fb2635ee700 1 -- 172.21.15.125:0/638513012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb25c06a270 msgr2=0x7fb25c06a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:39.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.664+0000 7fb2635ee700 1 --2- 172.21.15.125:0/638513012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb25c06a270 0x7fb25c06a640 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0098f0 tx=0x7fb24c009c00 comp rx=0 tx=0).stop 2023-11-28T11:10:39.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.664+0000 7fb2635ee700 1 -- 172.21.15.125:0/638513012 shutdown_connections 2023-11-28T11:10:39.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.664+0000 7fb2635ee700 1 --2- 172.21.15.125:0/638513012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb25c06a270 0x7fb25c06a640 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.664+0000 7fb2635ee700 1 --2- 172.21.15.125:0/638513012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb25c06e570 0x7fb25c070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.664+0000 7fb2635ee700 1 -- 172.21.15.125:0/638513012 >> 172.21.15.125:0/638513012 conn(0x7fb25c06c010 msgr2=0x7fb25c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:39.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.664+0000 7fb2635ee700 1 -- 172.21.15.125:0/638513012 shutdown_connections 2023-11-28T11:10:39.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.664+0000 7fb2635ee700 1 -- 172.21.15.125:0/638513012 wait complete. 2023-11-28T11:10:39.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.665+0000 7fb2635ee700 1 Processor -- start 2023-11-28T11:10:39.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.665+0000 7fb2635ee700 1 -- start start 2023-11-28T11:10:39.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb2635ee700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb25c06a270 0x7fb25c0c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:39.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb2635ee700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb25c06e570 0x7fb25c0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:39.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb2635ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb25c15cc80 0x7fb25c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:39.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb2635ee700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c0b4b80 con 0x7fb25c15cc80 2023-11-28T11:10:39.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb2635ee700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c0b54e0 con 0x7fb25c06a270 2023-11-28T11:10:39.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb2635ee700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c0c63c0 con 0x7fb25c06e570 2023-11-28T11:10:39.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb261b8b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb25c15cc80 0x7fb25c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:39.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb261b8b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb25c15cc80 0x7fb25c15b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60200/0 (socket says 172.21.15.125:60200) 2023-11-28T11:10:39.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb261b8b700 1 -- 172.21.15.125:0/1244480971 learned_addr learned my addr 172.21.15.125:0/1244480971 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:39.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb26138a700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb25c06a270 0x7fb25c0c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:39.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb260b89700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb25c06e570 0x7fb25c0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:39.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb261b8b700 1 -- 172.21.15.125:0/1244480971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb25c06e570 msgr2=0x7fb25c0b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:39.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb261b8b700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb25c06e570 0x7fb25c0b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb261b8b700 1 -- 172.21.15.125:0/1244480971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb25c06a270 msgr2=0x7fb25c0c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:39.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb261b8b700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb25c06a270 0x7fb25c0c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb261b8b700 1 -- 172.21.15.125:0/1244480971 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c009550 con 0x7fb25c15cc80 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb261b8b700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb25c15cc80 0x7fb25c15b880 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb25400cd80 tx=0x7fb25400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb251ffb700 1 -- 172.21.15.125:0/1244480971 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400ae70 con 0x7fb25c15cc80 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb251ffb700 1 -- 172.21.15.125:0/1244480971 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25400f480 con 0x7fb25c15cc80 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb2635ee700 1 -- 172.21.15.125:0/1244480971 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25c0b20b0 con 0x7fb25c15cc80 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.666+0000 7fb251ffb700 1 -- 172.21.15.125:0/1244480971 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400f850 con 0x7fb25c15cc80 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.667+0000 7fb2635ee700 1 -- 172.21.15.125:0/1244480971 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25c0b1dd0 con 0x7fb25c15cc80 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.668+0000 7fb2635ee700 1 -- 172.21.15.125:0/1244480971 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25c15daa0 con 0x7fb25c15cc80 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.668+0000 7fb251ffb700 1 -- 172.21.15.125:0/1244480971 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb254009030 con 0x7fb25c15cc80 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.668+0000 7fb251ffb700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb2400682f0 0x7fb24006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.668+0000 7fb251ffb700 1 -- 172.21.15.125:0/1244480971 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb254086490 con 0x7fb25c15cc80 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.668+0000 7fb26138a700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb2400682f0 0x7fb24006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:39.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.669+0000 7fb26138a700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb2400682f0 0x7fb24006a7a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009130 tx=0x7fb24c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:39.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.672+0000 7fb251ffb700 1 -- 172.21.15.125:0/1244480971 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb254052cf0 con 0x7fb25c15cc80 2023-11-28T11:10:39.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.896+0000 7fb2635ee700 1 -- 172.21.15.125:0/1244480971 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb25c0b4cc0 con 0x7fb25c15cc80 2023-11-28T11:10:39.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.897+0000 7fb251ffb700 1 -- 172.21.15.125:0/1244480971 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fb25c0b4cc0 con 0x7fb25c15cc80 2023-11-28T11:10:39.897 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:39.898 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/991177251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":991177251},{"type":"v1","addr":"172.21.15.167:6834","nonce":991177251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/289069328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":289069328},{"type":"v1","addr":"172.21.15.167:6835","nonce":289069328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3275492587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3275492587},{"type":"v1","addr":"172.21.15.125:6836","nonce":3275492587}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:10:36.508959+0000","modified":"2023-11-28T11:10:39.516894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5775":{"gid":5775,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3179120009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":3179120009},{"type":"v1","addr":"172.21.15.125:6837","nonce":3179120009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:10:39.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 -- 172.21.15.125:0/1244480971 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb2400682f0 msgr2=0x7fb24006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb2400682f0 0x7fb24006a7a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009130 tx=0x7fb24c008030 comp rx=0 tx=0).stop 2023-11-28T11:10:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 -- 172.21.15.125:0/1244480971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb25c15cc80 msgr2=0x7fb25c15b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb25c15cc80 0x7fb25c15b880 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb25400cd80 tx=0x7fb25400a560 comp rx=0 tx=0).stop 2023-11-28T11:10:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 -- 172.21.15.125:0/1244480971 shutdown_connections 2023-11-28T11:10:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb25c15cc80 0x7fb25c15b880 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb25c06a270 0x7fb25c0c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb2400682f0 0x7fb24006a7a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 --2- 172.21.15.125:0/1244480971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb25c06e570 0x7fb25c0b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 -- 172.21.15.125:0/1244480971 >> 172.21.15.125:0/1244480971 conn(0x7fb25c06c010 msgr2=0x7fb25c159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:39.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 -- 172.21.15.125:0/1244480971 shutdown_connections 2023-11-28T11:10:39.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:39.899+0000 7fb2635ee700 1 -- 172.21.15.125:0/1244480971 wait complete. 2023-11-28T11:10:39.901 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 23 2023-11-28T11:10:39.911 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:10:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.030+0000 7f111cd62700 1 Processor -- start 2023-11-28T11:10:40.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.030+0000 7f111cd62700 1 -- start start 2023-11-28T11:10:40.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.031+0000 7f111cd62700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f11180d0c60 0x7f11180b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.031+0000 7f111cd62700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111806e900 con 0x7f1118160e70 2023-11-28T11:10:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.031+0000 7f111cd62700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1118160390 con 0x7f111806e400 2023-11-28T11:10:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.031+0000 7f111cd62700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1118160670 con 0x7f11180d0c60 2023-11-28T11:10:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.031+0000 7f1116d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1118160e70 0x7f111815c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44332/0 (socket says 172.21.15.125:44332) 2023-11-28T11:10:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.031+0000 7f1116d9d700 1 -- 172.21.15.125:0/2924340456 learned_addr learned my addr 172.21.15.125:0/2924340456 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814966174 0 0) 0x7f111806e900 con 0x7f1118160e70 2023-11-28T11:10:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111659c700 1 --2- 172.21.15.125:0/2924340456 >> v2:172.21.15.167:3300/0 conn(0x7f11180d0c60 0x7f11180b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11000035b0 con 0x7f1118160e70 2023-11-28T11:10:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2514200786 0 0) 0x7f11000035b0 con 0x7f1118160e70 2023-11-28T11:10:40.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 >> v2:172.21.15.167:3300/0 conn(0x7f11180d0c60 msgr2=0x7f11180b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:40.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 --2- 172.21.15.125:0/2924340456 >> v2:172.21.15.167:3300/0 conn(0x7f11180d0c60 0x7f11180b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 >> v1:172.21.15.167:6789/0 conn(0x7f111806e400 legacy=0x7f11180d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118160950 con 0x7f1118160e70 2023-11-28T11:10:40.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f11100019f0 con 0x7f1118160e70 2023-11-28T11:10:40.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 >> v1:172.21.15.125:6789/0 conn(0x7f1118160e70 legacy=0x7f111815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 --2- 172.21.15.125:0/2924340456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1100003a00 0x7f1100003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 --2- 172.21.15.125:0/2924340456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1100004850 0x7f1100004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 --2- 172.21.15.125:0/2924340456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 0x7f110000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1118160670 con 0x7f1100005200 2023-11-28T11:10:40.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110000c080 con 0x7f1100004850 2023-11-28T11:10:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110000c240 con 0x7f1100003a00 2023-11-28T11:10:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f1116d9d700 1 --2- 172.21.15.125:0/2924340456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 0x7f110000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f111659c700 1 --2- 172.21.15.125:0/2924340456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1100003a00 0x7f1100003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f1115d9b700 1 --2- 172.21.15.125:0/2924340456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1100004850 0x7f1100004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f1116d9d700 1 -- 172.21.15.125:0/2924340456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1100003a00 msgr2=0x7f1100003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f1116d9d700 1 --2- 172.21.15.125:0/2924340456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1100003a00 0x7f1100003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f1116d9d700 1 -- 172.21.15.125:0/2924340456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1100004850 msgr2=0x7f1100004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f1116d9d700 1 --2- 172.21.15.125:0/2924340456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1100004850 0x7f1100004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f1116d9d700 1 -- 172.21.15.125:0/2924340456 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000035b0 con 0x7f1100005200 2023-11-28T11:10:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.032+0000 7f1116d9d700 1 -- 172.21.15.125:0/2924340456 reap_dead start 2023-11-28T11:10:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.033+0000 7f1116d9d700 1 --2- 172.21.15.125:0/2924340456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 0x7f110000ba10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f111000a800 tx=0x7f1100005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c920e943fb665b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.033+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111000a2f0 con 0x7f1100005200 2023-11-28T11:10:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.033+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1110012600 con 0x7f1100005200 2023-11-28T11:10:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.033+0000 7f111559a700 1 -- 172.21.15.125:0/2924340456 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11100129b0 con 0x7f1100005200 2023-11-28T11:10:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.033+0000 7f111cd62700 1 -- 172.21.15.125:0/2924340456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 msgr2=0x7f110000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.033+0000 7f111cd62700 1 --2- 172.21.15.125:0/2924340456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 0x7f110000ba10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f111000a800 tx=0x7f1100005880 comp rx=0 tx=0).stop 2023-11-28T11:10:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.033+0000 7f111cd62700 1 -- 172.21.15.125:0/2924340456 shutdown_connections 2023-11-28T11:10:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.033+0000 7f111cd62700 1 --2- 172.21.15.125:0/2924340456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 0x7f110000ba10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.033+0000 7f111cd62700 1 -- 172.21.15.125:0/2924340456 >> 172.21.15.125:0/2924340456 conn(0x7f111806a270 msgr2=0x7f111806a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.033+0000 7f111cd62700 1 -- 172.21.15.125:0/2924340456 shutdown_connections 2023-11-28T11:10:40.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.033+0000 7f111cd62700 1 -- 172.21.15.125:0/2924340456 wait complete. 2023-11-28T11:10:40.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.035+0000 7f111cd62700 1 Processor -- start 2023-11-28T11:10:40.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.035+0000 7f111cd62700 1 -- start start 2023-11-28T11:10:40.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.035+0000 7f111cd62700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 0x7f111814b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.035+0000 7f111cd62700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f111806c500 0x7f111806c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.035+0000 7f111cd62700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11180cd4b0 0x7f11180cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.035+0000 7f111cd62700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111806ceb0 con 0x7f1100005200 2023-11-28T11:10:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.035+0000 7f111cd62700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11180ce2a0 con 0x7f111806c500 2023-11-28T11:10:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.035+0000 7f111cd62700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11180ce580 con 0x7f11180cd4b0 2023-11-28T11:10:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.035+0000 7f111659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 0x7f111814b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.035+0000 7f111659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 0x7f111814b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60216/0 (socket says 172.21.15.125:60216) 2023-11-28T11:10:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.035+0000 7f111659c700 1 -- 172.21.15.125:0/4048813878 learned_addr learned my addr 172.21.15.125:0/4048813878 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f1116d9d700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11180cd4b0 0x7f11180cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f1115d9b700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f111806c500 0x7f111806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f111659c700 1 -- 172.21.15.125:0/4048813878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11180cd4b0 msgr2=0x7f11180cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f111659c700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11180cd4b0 0x7f11180cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f111659c700 1 -- 172.21.15.125:0/4048813878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f111806c500 msgr2=0x7f111806c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f111659c700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f111806c500 0x7f111806c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f111659c700 1 -- 172.21.15.125:0/4048813878 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11180b5be0 con 0x7f1100005200 2023-11-28T11:10:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f1115d9b700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f111806c500 0x7f111806c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f111659c700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 0x7f111814b880 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f110c0119a0 tx=0x7f110c011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f1106ffd700 1 -- 172.21.15.125:0/4048813878 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c00f940 con 0x7f1100005200 2023-11-28T11:10:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f1106ffd700 1 -- 172.21.15.125:0/4048813878 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c00faa0 con 0x7f1100005200 2023-11-28T11:10:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f111cd62700 1 -- 172.21.15.125:0/4048813878 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11180d0740 con 0x7f1100005200 2023-11-28T11:10:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f1106ffd700 1 -- 172.21.15.125:0/4048813878 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c00fe30 con 0x7f1100005200 2023-11-28T11:10:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.036+0000 7f111cd62700 1 -- 172.21.15.125:0/4048813878 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11180b5d70 con 0x7f1100005200 2023-11-28T11:10:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.037+0000 7f111cd62700 1 -- 172.21.15.125:0/4048813878 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11180743f0 con 0x7f1100005200 2023-11-28T11:10:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.038+0000 7f1106ffd700 1 -- 172.21.15.125:0/4048813878 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f110c014440 con 0x7f1100005200 2023-11-28T11:10:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.038+0000 7f1106ffd700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f10f80682f0 0x7f10f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.038+0000 7f1115d9b700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f10f80682f0 0x7f10f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.038+0000 7f1106ffd700 1 -- 172.21.15.125:0/4048813878 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f110c0865e0 con 0x7f1100005200 2023-11-28T11:10:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.039+0000 7f1115d9b700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f10f80682f0 0x7f10f806a7a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1108000c00 tx=0x7f1108009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.042+0000 7f1106ffd700 1 -- 172.21.15.125:0/4048813878 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f110c052d50 con 0x7f1100005200 2023-11-28T11:10:40.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.226+0000 7f111cd62700 1 -- 172.21.15.125:0/4048813878 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11180d0150 con 0x7f1100005200 2023-11-28T11:10:40.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.227+0000 7f1106ffd700 1 -- 172.21.15.125:0/4048813878 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18027 (secure 0 0 0) 0x7f110c056370 con 0x7f1100005200 2023-11-28T11:10:40.227 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:40.228 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":52,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:10:37.510643+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:10:34.306816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T11:10:35.470755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:10:40.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 -- 172.21.15.125:0/4048813878 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f10f80682f0 msgr2=0x7f10f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f10f80682f0 0x7f10f806a7a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1108000c00 tx=0x7f1108009040 comp rx=0 tx=0).stop 2023-11-28T11:10:40.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 -- 172.21.15.125:0/4048813878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 msgr2=0x7f111814b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 0x7f111814b880 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f110c0119a0 tx=0x7f110c011d60 comp rx=0 tx=0).stop 2023-11-28T11:10:40.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 -- 172.21.15.125:0/4048813878 shutdown_connections 2023-11-28T11:10:40.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f10f80682f0 0x7f10f806a7a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11180cd4b0 0x7f11180cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1100005200 0x7f111814b880 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 --2- 172.21.15.125:0/4048813878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f111806c500 0x7f111806c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 -- 172.21.15.125:0/4048813878 >> 172.21.15.125:0/4048813878 conn(0x7f111806a270 msgr2=0x7f111815f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:40.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 -- 172.21.15.125:0/4048813878 shutdown_connections 2023-11-28T11:10:40.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.229+0000 7f111cd62700 1 -- 172.21.15.125:0/4048813878 wait complete. 2023-11-28T11:10:40.242 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:10:40.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:10:40.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.362+0000 7f01af6cb700 1 Processor -- start 2023-11-28T11:10:40.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.362+0000 7f01af6cb700 1 -- start start 2023-11-28T11:10:40.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.363+0000 7f01af6cb700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f01a8142db0 0x7f01a813ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.363+0000 7f01af6cb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a815e010 con 0x7f01a80b1770 2023-11-28T11:10:40.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.363+0000 7f01af6cb700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a813fc90 con 0x7f01a80ce040 2023-11-28T11:10:40.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.363+0000 7f01af6cb700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a813f6d0 con 0x7f01a8142db0 2023-11-28T11:10:40.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.363+0000 7f01adc68700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f01a80b1770 0x7f01a80b1b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44352/0 (socket says 172.21.15.125:44352) 2023-11-28T11:10:40.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.363+0000 7f01adc68700 1 -- 172.21.15.125:0/1048263577 learned_addr learned my addr 172.21.15.125:0/1048263577 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:40.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.363+0000 7f01acc66700 1 --2- 172.21.15.125:0/1048263577 >> v2:172.21.15.167:3300/0 conn(0x7f01a8142db0 0x7f01a813ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.363+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797418583 0 0) 0x7f01a0001490 con 0x7f01a80b1770 2023-11-28T11:10:40.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.363+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01940035b0 con 0x7f01a80b1770 2023-11-28T11:10:40.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2490454870 0 0) 0x7f01940035b0 con 0x7f01a80b1770 2023-11-28T11:10:40.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 >> v2:172.21.15.167:3300/0 conn(0x7f01a8142db0 msgr2=0x7f01a813ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:40.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 --2- 172.21.15.125:0/1048263577 >> v2:172.21.15.167:3300/0 conn(0x7f01a8142db0 0x7f01a813ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 >> v1:172.21.15.167:6789/0 conn(0x7f01a80ce040 legacy=0x7f01a815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a813f9b0 con 0x7f01a80b1770 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f01a0001b80 con 0x7f01a80b1770 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 >> v1:172.21.15.125:6789/0 conn(0x7f01a80b1770 legacy=0x7f01a80b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0194003a00 0x7f0194003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0194004850 0x7f0194004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 0x7f019400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a813f6d0 con 0x7f0194005200 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019400c080 con 0x7f0194003a00 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019400c240 con 0x7f0194004850 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f01adc68700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 0x7f019400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f01acc66700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0194004850 0x7f0194004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f01ad467700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0194003a00 0x7f0194003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f01adc68700 1 -- 172.21.15.125:0/1048263577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0194004850 msgr2=0x7f0194004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f01adc68700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0194004850 0x7f0194004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f01adc68700 1 -- 172.21.15.125:0/1048263577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0194003a00 msgr2=0x7f0194003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f01adc68700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0194003a00 0x7f0194003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f01adc68700 1 -- 172.21.15.125:0/1048263577 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01940035b0 con 0x7f0194005200 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f01ad467700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0194003a00 0x7f0194003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f01adc68700 1 -- 172.21.15.125:0/1048263577 reap_dead start 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f01adc68700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 0x7f019400ba10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f01a000a830 tx=0x7f0194005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d71aedd6f8aea0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000a490 con 0x7f0194005200 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a0012600 con 0x7f0194005200 2023-11-28T11:10:40.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.364+0000 7f019ffff700 1 -- 172.21.15.125:0/1048263577 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0012990 con 0x7f0194005200 2023-11-28T11:10:40.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.365+0000 7f01af6cb700 1 -- 172.21.15.125:0/1048263577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 msgr2=0x7f019400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.365+0000 7f01af6cb700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 0x7f019400ba10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f01a000a830 tx=0x7f0194005880 comp rx=0 tx=0).stop 2023-11-28T11:10:40.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.365+0000 7f01af6cb700 1 -- 172.21.15.125:0/1048263577 shutdown_connections 2023-11-28T11:10:40.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.365+0000 7f01af6cb700 1 --2- 172.21.15.125:0/1048263577 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 0x7f019400ba10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.365+0000 7f01af6cb700 1 -- 172.21.15.125:0/1048263577 >> 172.21.15.125:0/1048263577 conn(0x7f01a806c010 msgr2=0x7f01a80cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:40.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.365+0000 7f01af6cb700 1 -- 172.21.15.125:0/1048263577 shutdown_connections 2023-11-28T11:10:40.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.365+0000 7f01af6cb700 1 -- 172.21.15.125:0/1048263577 wait complete. 2023-11-28T11:10:40.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.366+0000 7f01af6cb700 1 Processor -- start 2023-11-28T11:10:40.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.366+0000 7f01af6cb700 1 -- start start 2023-11-28T11:10:40.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01af6cb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 0x7f01a81e3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01af6cb700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a815c790 0x7f01a815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01af6cb700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a8154f30 0x7f01a806a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01af6cb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81f2740 con 0x7f0194005200 2023-11-28T11:10:40.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01af6cb700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a815b6f0 con 0x7f01a8154f30 2023-11-28T11:10:40.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01af6cb700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a815b9d0 con 0x7f01a815c790 2023-11-28T11:10:40.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01ad467700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 0x7f01a81e3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01ad467700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 0x7f01a81e3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60236/0 (socket says 172.21.15.125:60236) 2023-11-28T11:10:40.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01ad467700 1 -- 172.21.15.125:0/142542271 learned_addr learned my addr 172.21.15.125:0/142542271 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:40.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01ad467700 1 -- 172.21.15.125:0/142542271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a815c790 msgr2=0x7f01a815ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01acc66700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a815c790 0x7f01a815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01adc68700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a8154f30 0x7f01a806a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01ad467700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a815c790 0x7f01a815ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01ad467700 1 -- 172.21.15.125:0/142542271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a8154f30 msgr2=0x7f01a806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01ad467700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a8154f30 0x7f01a806a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01ad467700 1 -- 172.21.15.125:0/142542271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a815d3e0 con 0x7f0194005200 2023-11-28T11:10:40.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.367+0000 7f01ad467700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 0x7f01a81e3920 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f019800e550 tx=0x7f019800e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:40.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.368+0000 7f019dffb700 1 -- 172.21.15.125:0/142542271 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980052e0 con 0x7f0194005200 2023-11-28T11:10:40.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.368+0000 7f019dffb700 1 -- 172.21.15.125:0/142542271 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0198005440 con 0x7f0194005200 2023-11-28T11:10:40.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.368+0000 7f01af6cb700 1 -- 172.21.15.125:0/142542271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a815d100 con 0x7f0194005200 2023-11-28T11:10:40.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.368+0000 7f019dffb700 1 -- 172.21.15.125:0/142542271 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980038a0 con 0x7f0194005200 2023-11-28T11:10:40.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.368+0000 7f01af6cb700 1 -- 172.21.15.125:0/142542271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a80ce410 con 0x7f0194005200 2023-11-28T11:10:40.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.369+0000 7f01af6cb700 1 -- 172.21.15.125:0/142542271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a815c5e0 con 0x7f0194005200 2023-11-28T11:10:40.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.369+0000 7f019dffb700 1 -- 172.21.15.125:0/142542271 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f019801b030 con 0x7f0194005200 2023-11-28T11:10:40.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.369+0000 7f019dffb700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f018c0682f0 0x7f018c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.369+0000 7f019dffb700 1 -- 172.21.15.125:0/142542271 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0198085220 con 0x7f0194005200 2023-11-28T11:10:40.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.370+0000 7f01acc66700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f018c0682f0 0x7f018c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.370+0000 7f01acc66700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f018c0682f0 0x7f018c06a7a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f01a8142130 tx=0x7f01a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:40.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.374+0000 7f019dffb700 1 -- 172.21.15.125:0/142542271 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f019804d5e0 con 0x7f0194005200 2023-11-28T11:10:40.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.554+0000 7f01af6cb700 1 -- 172.21.15.125:0/142542271 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01a80743f0 con 0x7f018c0682f0 2023-11-28T11:10:40.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.562+0000 7f019dffb700 1 -- 172.21.15.125:0/142542271 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304153 (secure 0 0 0) 0x7f01a80743f0 con 0x7f018c0682f0 2023-11-28T11:10:40.566 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 -- 172.21.15.125:0/142542271 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f018c0682f0 msgr2=0x7f018c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f018c0682f0 0x7f018c06a7a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f01a8142130 tx=0x7f01a4008040 comp rx=0 tx=0).stop 2023-11-28T11:10:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 -- 172.21.15.125:0/142542271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 msgr2=0x7f01a81e3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 0x7f01a81e3920 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f019800e550 tx=0x7f019800e910 comp rx=0 tx=0).stop 2023-11-28T11:10:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 -- 172.21.15.125:0/142542271 shutdown_connections 2023-11-28T11:10:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a8154f30 0x7f01a806a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0194005200 0x7f01a81e3920 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f018c0682f0 0x7f018c06a7a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 --2- 172.21.15.125:0/142542271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a815c790 0x7f01a815ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 -- 172.21.15.125:0/142542271 >> 172.21.15.125:0/142542271 conn(0x7f01a806c010 msgr2=0x7f01a80ca830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:40.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 -- 172.21.15.125:0/142542271 shutdown_connections 2023-11-28T11:10:40.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.565+0000 7f01af6cb700 1 -- 172.21.15.125:0/142542271 wait complete. 2023-11-28T11:10:40.570 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:10:40.578 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-11-28T11:10:39.647519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590514,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":120,"acting":120,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":73836,"kb_used_data":5804,"kb_used_omap":0,"kb_used_meta":67968,"kb_avail":754900884,"statfs":{"total":773094113280,"available":773018505216,"internally_reserved":0,"allocated":5943296,"data_stored":3201036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69599232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":146,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.543967"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514648+0000","last_change":"2023-11-28T11:10:36.524056+0000","last_active":"2023-11-28T11:10:37.514648+0000","last_peered":"2023-11-28T11:10:37.514648+0000","last_clean":"2023-11-28T11:10:37.514648+0000","last_became_active":"2023-11-28T11:10:36.523831+0000","last_became_peered":"2023-11-28T11:10:36.523831+0000","last_unstale":"2023-11-28T11:10:37.514648+0000","last_undegraded":"2023-11-28T11:10:37.514648+0000","last_fullsized":"2023-11-28T11:10:37.514648+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514850+0000","last_change":"2023-11-28T11:10:36.524534+0000","last_active":"2023-11-28T11:10:37.514850+0000","last_peered":"2023-11-28T11:10:37.514850+0000","last_clean":"2023-11-28T11:10:37.514850+0000","last_became_active":"2023-11-28T11:10:36.524236+0000","last_became_peered":"2023-11-28T11:10:36.524236+0000","last_unstale":"2023-11-28T11:10:37.514850+0000","last_undegraded":"2023-11-28T11:10:37.514850+0000","last_fullsized":"2023-11-28T11:10:37.514850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:58.155221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515248+0000","last_change":"2023-11-28T11:10:36.526236+0000","last_active":"2023-11-28T11:10:37.515248+0000","last_peered":"2023-11-28T11:10:37.515248+0000","last_clean":"2023-11-28T11:10:37.515248+0000","last_became_active":"2023-11-28T11:10:36.525526+0000","last_became_peered":"2023-11-28T11:10:36.525526+0000","last_unstale":"2023-11-28T11:10:37.515248+0000","last_undegraded":"2023-11-28T11:10:37.515248+0000","last_fullsized":"2023-11-28T11:10:37.515248+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:27.654161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514746+0000","last_change":"2023-11-28T11:10:36.528064+0000","last_active":"2023-11-28T11:10:37.514746+0000","last_peered":"2023-11-28T11:10:37.514746+0000","last_clean":"2023-11-28T11:10:37.514746+0000","last_became_active":"2023-11-28T11:10:36.527767+0000","last_became_peered":"2023-11-28T11:10:36.527767+0000","last_unstale":"2023-11-28T11:10:37.514746+0000","last_undegraded":"2023-11-28T11:10:37.514746+0000","last_fullsized":"2023-11-28T11:10:37.514746+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:20.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514469+0000","last_change":"2023-11-28T11:10:36.526839+0000","last_active":"2023-11-28T11:10:37.514469+0000","last_peered":"2023-11-28T11:10:37.514469+0000","last_clean":"2023-11-28T11:10:37.514469+0000","last_became_active":"2023-11-28T11:10:36.526583+0000","last_became_peered":"2023-11-28T11:10:36.526583+0000","last_unstale":"2023-11-28T11:10:37.514469+0000","last_undegraded":"2023-11-28T11:10:37.514469+0000","last_fullsized":"2023-11-28T11:10:37.514469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:31.375598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514646+0000","last_change":"2023-11-28T11:10:36.529010+0000","last_active":"2023-11-28T11:10:37.514646+0000","last_peered":"2023-11-28T11:10:37.514646+0000","last_clean":"2023-11-28T11:10:37.514646+0000","last_became_active":"2023-11-28T11:10:36.528687+0000","last_became_peered":"2023-11-28T11:10:36.528687+0000","last_unstale":"2023-11-28T11:10:37.514646+0000","last_undegraded":"2023-11-28T11:10:37.514646+0000","last_fullsized":"2023-11-28T11:10:37.514646+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:50.593011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515454+0000","last_change":"2023-11-28T11:10:36.532181+0000","last_active":"2023-11-28T11:10:37.515454+0000","last_peered":"2023-11-28T11:10:37.515454+0000","last_clean":"2023-11-28T11:10:37.515454+0000","last_became_active":"2023-11-28T11:10:36.531946+0000","last_became_peered":"2023-11-28T11:10:36.531946+0000","last_unstale":"2023-11-28T11:10:37.515454+0000","last_undegraded":"2023-11-28T11:10:37.515454+0000","last_fullsized":"2023-11-28T11:10:37.515454+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:34.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141761+0000","last_change":"2023-11-28T11:10:36.522452+0000","last_active":"2023-11-28T11:10:38.141761+0000","last_peered":"2023-11-28T11:10:38.141761+0000","last_clean":"2023-11-28T11:10:38.141761+0000","last_became_active":"2023-11-28T11:10:36.522201+0000","last_became_peered":"2023-11-28T11:10:36.522201+0000","last_unstale":"2023-11-28T11:10:38.141761+0000","last_undegraded":"2023-11-28T11:10:38.141761+0000","last_fullsized":"2023-11-28T11:10:38.141761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:59:58.033544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514287+0000","last_change":"2023-11-28T11:10:36.534554+0000","last_active":"2023-11-28T11:10:37.514287+0000","last_peered":"2023-11-28T11:10:37.514287+0000","last_clean":"2023-11-28T11:10:37.514287+0000","last_became_active":"2023-11-28T11:10:36.534313+0000","last_became_peered":"2023-11-28T11:10:36.534313+0000","last_unstale":"2023-11-28T11:10:37.514287+0000","last_undegraded":"2023-11-28T11:10:37.514287+0000","last_fullsized":"2023-11-28T11:10:37.514287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:33.764839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515060+0000","last_change":"2023-11-28T11:10:36.525581+0000","last_active":"2023-11-28T11:10:37.515060+0000","last_peered":"2023-11-28T11:10:37.515060+0000","last_clean":"2023-11-28T11:10:37.515060+0000","last_became_active":"2023-11-28T11:10:36.525315+0000","last_became_peered":"2023-11-28T11:10:36.525315+0000","last_unstale":"2023-11-28T11:10:37.515060+0000","last_undegraded":"2023-11-28T11:10:37.515060+0000","last_fullsized":"2023-11-28T11:10:37.515060+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:12.836764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514618+0000","last_change":"2023-11-28T11:10:36.527490+0000","last_active":"2023-11-28T11:10:37.514618+0000","last_peered":"2023-11-28T11:10:37.514618+0000","last_clean":"2023-11-28T11:10:37.514618+0000","last_became_active":"2023-11-28T11:10:36.527219+0000","last_became_peered":"2023-11-28T11:10:36.527219+0000","last_unstale":"2023-11-28T11:10:37.514618+0000","last_undegraded":"2023-11-28T11:10:37.514618+0000","last_fullsized":"2023-11-28T11:10:37.514618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514163+0000","last_change":"2023-11-28T11:10:36.532971+0000","last_active":"2023-11-28T11:10:37.514163+0000","last_peered":"2023-11-28T11:10:37.514163+0000","last_clean":"2023-11-28T11:10:37.514163+0000","last_became_active":"2023-11-28T11:10:36.532729+0000","last_became_peered":"2023-11-28T11:10:36.532729+0000","last_unstale":"2023-11-28T11:10:37.514163+0000","last_undegraded":"2023-11-28T11:10:37.514163+0000","last_fullsized":"2023-11-28T11:10:37.514163+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:20.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515693+0000","last_change":"2023-11-28T11:10:36.528593+0000","last_active":"2023-11-28T11:10:37.515693+0000","last_peered":"2023-11-28T11:10:37.515693+0000","last_clean":"2023-11-28T11:10:37.515693+0000","last_became_active":"2023-11-28T11:10:36.528202+0000","last_became_peered":"2023-11-28T11:10:36.528202+0000","last_unstale":"2023-11-28T11:10:37.515693+0000","last_undegraded":"2023-11-28T11:10:37.515693+0000","last_fullsized":"2023-11-28T11:10:37.515693+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:23.935065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514945+0000","last_change":"2023-11-28T11:10:36.524381+0000","last_active":"2023-11-28T11:10:37.514945+0000","last_peered":"2023-11-28T11:10:37.514945+0000","last_clean":"2023-11-28T11:10:37.514945+0000","last_became_active":"2023-11-28T11:10:36.524095+0000","last_became_peered":"2023-11-28T11:10:36.524095+0000","last_unstale":"2023-11-28T11:10:37.514945+0000","last_undegraded":"2023-11-28T11:10:37.514945+0000","last_fullsized":"2023-11-28T11:10:37.514945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515238+0000","last_change":"2023-11-28T11:10:36.533836+0000","last_active":"2023-11-28T11:10:37.515238+0000","last_peered":"2023-11-28T11:10:37.515238+0000","last_clean":"2023-11-28T11:10:37.515238+0000","last_became_active":"2023-11-28T11:10:36.533560+0000","last_became_peered":"2023-11-28T11:10:36.533560+0000","last_unstale":"2023-11-28T11:10:37.515238+0000","last_undegraded":"2023-11-28T11:10:37.515238+0000","last_fullsized":"2023-11-28T11:10:37.515238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:25.315412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141535+0000","last_change":"2023-11-28T11:10:36.528419+0000","last_active":"2023-11-28T11:10:38.141535+0000","last_peered":"2023-11-28T11:10:38.141535+0000","last_clean":"2023-11-28T11:10:38.141535+0000","last_became_active":"2023-11-28T11:10:36.527321+0000","last_became_peered":"2023-11-28T11:10:36.527321+0000","last_unstale":"2023-11-28T11:10:38.141535+0000","last_undegraded":"2023-11-28T11:10:38.141535+0000","last_fullsized":"2023-11-28T11:10:38.141535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:06.424953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514471+0000","last_change":"2023-11-28T11:10:36.525552+0000","last_active":"2023-11-28T11:10:37.514471+0000","last_peered":"2023-11-28T11:10:37.514471+0000","last_clean":"2023-11-28T11:10:37.514471+0000","last_became_active":"2023-11-28T11:10:36.525301+0000","last_became_peered":"2023-11-28T11:10:36.525301+0000","last_unstale":"2023-11-28T11:10:37.514471+0000","last_undegraded":"2023-11-28T11:10:37.514471+0000","last_fullsized":"2023-11-28T11:10:37.514471+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:57.807839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515621+0000","last_change":"2023-11-28T11:10:36.538677+0000","last_active":"2023-11-28T11:10:37.515621+0000","last_peered":"2023-11-28T11:10:37.515621+0000","last_clean":"2023-11-28T11:10:37.515621+0000","last_became_active":"2023-11-28T11:10:36.538336+0000","last_became_peered":"2023-11-28T11:10:36.538336+0000","last_unstale":"2023-11-28T11:10:37.515621+0000","last_undegraded":"2023-11-28T11:10:37.515621+0000","last_fullsized":"2023-11-28T11:10:37.515621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:04.544184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515008+0000","last_change":"2023-11-28T11:10:36.535214+0000","last_active":"2023-11-28T11:10:37.515008+0000","last_peered":"2023-11-28T11:10:37.515008+0000","last_clean":"2023-11-28T11:10:37.515008+0000","last_became_active":"2023-11-28T11:10:36.534981+0000","last_became_peered":"2023-11-28T11:10:36.534981+0000","last_unstale":"2023-11-28T11:10:37.515008+0000","last_undegraded":"2023-11-28T11:10:37.515008+0000","last_fullsized":"2023-11-28T11:10:37.515008+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:19.190582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514668+0000","last_change":"2023-11-28T11:10:36.528010+0000","last_active":"2023-11-28T11:10:37.514668+0000","last_peered":"2023-11-28T11:10:37.514668+0000","last_clean":"2023-11-28T11:10:37.514668+0000","last_became_active":"2023-11-28T11:10:36.527719+0000","last_became_peered":"2023-11-28T11:10:36.527719+0000","last_unstale":"2023-11-28T11:10:37.514668+0000","last_undegraded":"2023-11-28T11:10:37.514668+0000","last_fullsized":"2023-11-28T11:10:37.514668+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:58.531465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514890+0000","last_change":"2023-11-28T11:10:36.522035+0000","last_active":"2023-11-28T11:10:37.514890+0000","last_peered":"2023-11-28T11:10:37.514890+0000","last_clean":"2023-11-28T11:10:37.514890+0000","last_became_active":"2023-11-28T11:10:36.521763+0000","last_became_peered":"2023-11-28T11:10:36.521763+0000","last_unstale":"2023-11-28T11:10:37.514890+0000","last_undegraded":"2023-11-28T11:10:37.514890+0000","last_fullsized":"2023-11-28T11:10:37.514890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514820+0000","last_change":"2023-11-28T11:10:36.528832+0000","last_active":"2023-11-28T11:10:37.514820+0000","last_peered":"2023-11-28T11:10:37.514820+0000","last_clean":"2023-11-28T11:10:37.514820+0000","last_became_active":"2023-11-28T11:10:36.528558+0000","last_became_peered":"2023-11-28T11:10:36.528558+0000","last_unstale":"2023-11-28T11:10:37.514820+0000","last_undegraded":"2023-11-28T11:10:37.514820+0000","last_fullsized":"2023-11-28T11:10:37.514820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:28.375662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514434+0000","last_change":"2023-11-28T11:10:36.524969+0000","last_active":"2023-11-28T11:10:37.514434+0000","last_peered":"2023-11-28T11:10:37.514434+0000","last_clean":"2023-11-28T11:10:37.514434+0000","last_became_active":"2023-11-28T11:10:36.524710+0000","last_became_peered":"2023-11-28T11:10:36.524710+0000","last_unstale":"2023-11-28T11:10:37.514434+0000","last_undegraded":"2023-11-28T11:10:37.514434+0000","last_fullsized":"2023-11-28T11:10:37.514434+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:02:40.345280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515505+0000","last_change":"2023-11-28T11:10:36.133446+0000","last_active":"2023-11-28T11:10:37.515505+0000","last_peered":"2023-11-28T11:10:37.515505+0000","last_clean":"2023-11-28T11:10:37.515505+0000","last_became_active":"2023-11-28T11:10:36.133184+0000","last_became_peered":"2023-11-28T11:10:36.133184+0000","last_unstale":"2023-11-28T11:10:37.515505+0000","last_undegraded":"2023-11-28T11:10:37.515505+0000","last_fullsized":"2023-11-28T11:10:37.515505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:13.129227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515095+0000","last_change":"2023-11-28T11:10:36.133435+0000","last_active":"2023-11-28T11:10:37.515095+0000","last_peered":"2023-11-28T11:10:37.515095+0000","last_clean":"2023-11-28T11:10:37.515095+0000","last_became_active":"2023-11-28T11:10:36.133156+0000","last_became_peered":"2023-11-28T11:10:36.133156+0000","last_unstale":"2023-11-28T11:10:37.515095+0000","last_undegraded":"2023-11-28T11:10:37.515095+0000","last_fullsized":"2023-11-28T11:10:37.515095+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:32.589064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514762+0000","last_change":"2023-11-28T11:10:36.119665+0000","last_active":"2023-11-28T11:10:37.514762+0000","last_peered":"2023-11-28T11:10:37.514762+0000","last_clean":"2023-11-28T11:10:37.514762+0000","last_became_active":"2023-11-28T11:10:36.117416+0000","last_became_peered":"2023-11-28T11:10:36.117416+0000","last_unstale":"2023-11-28T11:10:37.514762+0000","last_undegraded":"2023-11-28T11:10:37.514762+0000","last_fullsized":"2023-11-28T11:10:37.514762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:33.877212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515023+0000","last_change":"2023-11-28T11:10:36.523569+0000","last_active":"2023-11-28T11:10:37.515023+0000","last_peered":"2023-11-28T11:10:37.515023+0000","last_clean":"2023-11-28T11:10:37.515023+0000","last_became_active":"2023-11-28T11:10:36.523302+0000","last_became_peered":"2023-11-28T11:10:36.523302+0000","last_unstale":"2023-11-28T11:10:37.515023+0000","last_undegraded":"2023-11-28T11:10:37.515023+0000","last_fullsized":"2023-11-28T11:10:37.515023+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:48.693779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514850+0000","last_change":"2023-11-28T11:10:36.528489+0000","last_active":"2023-11-28T11:10:37.514850+0000","last_peered":"2023-11-28T11:10:37.514850+0000","last_clean":"2023-11-28T11:10:37.514850+0000","last_became_active":"2023-11-28T11:10:36.528196+0000","last_became_peered":"2023-11-28T11:10:36.528196+0000","last_unstale":"2023-11-28T11:10:37.514850+0000","last_undegraded":"2023-11-28T11:10:37.514850+0000","last_fullsized":"2023-11-28T11:10:37.514850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.833897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514973+0000","last_change":"2023-11-28T11:10:36.126539+0000","last_active":"2023-11-28T11:10:37.514973+0000","last_peered":"2023-11-28T11:10:37.514973+0000","last_clean":"2023-11-28T11:10:37.514973+0000","last_became_active":"2023-11-28T11:10:36.126227+0000","last_became_peered":"2023-11-28T11:10:36.126227+0000","last_unstale":"2023-11-28T11:10:37.514973+0000","last_undegraded":"2023-11-28T11:10:37.514973+0000","last_fullsized":"2023-11-28T11:10:37.514973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:28.022412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515008+0000","last_change":"2023-11-28T11:10:36.123501+0000","last_active":"2023-11-28T11:10:37.515008+0000","last_peered":"2023-11-28T11:10:37.515008+0000","last_clean":"2023-11-28T11:10:37.515008+0000","last_became_active":"2023-11-28T11:10:36.122933+0000","last_became_peered":"2023-11-28T11:10:36.122933+0000","last_unstale":"2023-11-28T11:10:37.515008+0000","last_undegraded":"2023-11-28T11:10:37.515008+0000","last_fullsized":"2023-11-28T11:10:37.515008+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:32.757363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514980+0000","last_change":"2023-11-28T11:10:36.524201+0000","last_active":"2023-11-28T11:10:37.514980+0000","last_peered":"2023-11-28T11:10:37.514980+0000","last_clean":"2023-11-28T11:10:37.514980+0000","last_became_active":"2023-11-28T11:10:36.521915+0000","last_became_peered":"2023-11-28T11:10:36.521915+0000","last_unstale":"2023-11-28T11:10:37.514980+0000","last_undegraded":"2023-11-28T11:10:37.514980+0000","last_fullsized":"2023-11-28T11:10:37.514980+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:19:19.207096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514992+0000","last_change":"2023-11-28T11:10:36.136502+0000","last_active":"2023-11-28T11:10:37.514992+0000","last_peered":"2023-11-28T11:10:37.514992+0000","last_clean":"2023-11-28T11:10:37.514992+0000","last_became_active":"2023-11-28T11:10:36.136213+0000","last_became_peered":"2023-11-28T11:10:36.136213+0000","last_unstale":"2023-11-28T11:10:37.514992+0000","last_undegraded":"2023-11-28T11:10:37.514992+0000","last_fullsized":"2023-11-28T11:10:37.514992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:28.022412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514858+0000","last_change":"2023-11-28T11:10:36.118915+0000","last_active":"2023-11-28T11:10:37.514858+0000","last_peered":"2023-11-28T11:10:37.514858+0000","last_clean":"2023-11-28T11:10:37.514858+0000","last_became_active":"2023-11-28T11:10:36.118661+0000","last_became_peered":"2023-11-28T11:10:36.118661+0000","last_unstale":"2023-11-28T11:10:37.514858+0000","last_undegraded":"2023-11-28T11:10:37.514858+0000","last_fullsized":"2023-11-28T11:10:37.514858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:30.368123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515289+0000","last_change":"2023-11-28T11:10:36.528346+0000","last_active":"2023-11-28T11:10:37.515289+0000","last_peered":"2023-11-28T11:10:37.515289+0000","last_clean":"2023-11-28T11:10:37.515289+0000","last_became_active":"2023-11-28T11:10:36.528097+0000","last_became_peered":"2023-11-28T11:10:36.528097+0000","last_unstale":"2023-11-28T11:10:37.515289+0000","last_undegraded":"2023-11-28T11:10:37.515289+0000","last_fullsized":"2023-11-28T11:10:37.515289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:33.646649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515092+0000","last_change":"2023-11-28T11:10:36.123367+0000","last_active":"2023-11-28T11:10:37.515092+0000","last_peered":"2023-11-28T11:10:37.515092+0000","last_clean":"2023-11-28T11:10:37.515092+0000","last_became_active":"2023-11-28T11:10:36.122981+0000","last_became_peered":"2023-11-28T11:10:36.122981+0000","last_unstale":"2023-11-28T11:10:37.515092+0000","last_undegraded":"2023-11-28T11:10:37.515092+0000","last_fullsized":"2023-11-28T11:10:37.515092+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:33:27.881264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515752+0000","last_change":"2023-11-28T11:10:36.528470+0000","last_active":"2023-11-28T11:10:37.515752+0000","last_peered":"2023-11-28T11:10:37.515752+0000","last_clean":"2023-11-28T11:10:37.515752+0000","last_became_active":"2023-11-28T11:10:36.527851+0000","last_became_peered":"2023-11-28T11:10:36.527851+0000","last_unstale":"2023-11-28T11:10:37.515752+0000","last_undegraded":"2023-11-28T11:10:37.515752+0000","last_fullsized":"2023-11-28T11:10:37.515752+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:10.382472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515505+0000","last_change":"2023-11-28T11:10:36.126441+0000","last_active":"2023-11-28T11:10:37.515505+0000","last_peered":"2023-11-28T11:10:37.515505+0000","last_clean":"2023-11-28T11:10:37.515505+0000","last_became_active":"2023-11-28T11:10:36.125967+0000","last_became_peered":"2023-11-28T11:10:36.125967+0000","last_unstale":"2023-11-28T11:10:37.515505+0000","last_undegraded":"2023-11-28T11:10:37.515505+0000","last_fullsized":"2023-11-28T11:10:37.515505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:08.438167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514473+0000","last_change":"2023-11-28T11:10:36.531244+0000","last_active":"2023-11-28T11:10:37.514473+0000","last_peered":"2023-11-28T11:10:37.514473+0000","last_clean":"2023-11-28T11:10:37.514473+0000","last_became_active":"2023-11-28T11:10:36.530978+0000","last_became_peered":"2023-11-28T11:10:36.530978+0000","last_unstale":"2023-11-28T11:10:37.514473+0000","last_undegraded":"2023-11-28T11:10:37.514473+0000","last_fullsized":"2023-11-28T11:10:37.514473+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.833897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141759+0000","last_change":"2023-11-28T11:10:36.123203+0000","last_active":"2023-11-28T11:10:38.141759+0000","last_peered":"2023-11-28T11:10:38.141759+0000","last_clean":"2023-11-28T11:10:38.141759+0000","last_became_active":"2023-11-28T11:10:36.122988+0000","last_became_peered":"2023-11-28T11:10:36.122988+0000","last_unstale":"2023-11-28T11:10:38.141759+0000","last_undegraded":"2023-11-28T11:10:38.141759+0000","last_fullsized":"2023-11-28T11:10:38.141759+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:33.478864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514472+0000","last_change":"2023-11-28T11:10:36.524080+0000","last_active":"2023-11-28T11:10:37.514472+0000","last_peered":"2023-11-28T11:10:37.514472+0000","last_clean":"2023-11-28T11:10:37.514472+0000","last_became_active":"2023-11-28T11:10:36.523831+0000","last_became_peered":"2023-11-28T11:10:36.523831+0000","last_unstale":"2023-11-28T11:10:37.514472+0000","last_undegraded":"2023-11-28T11:10:37.514472+0000","last_fullsized":"2023-11-28T11:10:37.514472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514367+0000","last_change":"2023-11-28T11:10:36.136094+0000","last_active":"2023-11-28T11:10:37.514367+0000","last_peered":"2023-11-28T11:10:37.514367+0000","last_clean":"2023-11-28T11:10:37.514367+0000","last_became_active":"2023-11-28T11:10:36.135780+0000","last_became_peered":"2023-11-28T11:10:36.135780+0000","last_unstale":"2023-11-28T11:10:37.514367+0000","last_undegraded":"2023-11-28T11:10:37.514367+0000","last_fullsized":"2023-11-28T11:10:37.514367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:08.762868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515424+0000","last_change":"2023-11-28T11:10:36.529075+0000","last_active":"2023-11-28T11:10:37.515424+0000","last_peered":"2023-11-28T11:10:37.515424+0000","last_clean":"2023-11-28T11:10:37.515424+0000","last_became_active":"2023-11-28T11:10:36.528708+0000","last_became_peered":"2023-11-28T11:10:36.528708+0000","last_unstale":"2023-11-28T11:10:37.515424+0000","last_undegraded":"2023-11-28T11:10:37.515424+0000","last_fullsized":"2023-11-28T11:10:37.515424+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514729+0000","last_change":"2023-11-28T11:10:36.136681+0000","last_active":"2023-11-28T11:10:37.514729+0000","last_peered":"2023-11-28T11:10:37.514729+0000","last_clean":"2023-11-28T11:10:37.514729+0000","last_became_active":"2023-11-28T11:10:36.136334+0000","last_became_peered":"2023-11-28T11:10:36.136334+0000","last_unstale":"2023-11-28T11:10:37.514729+0000","last_undegraded":"2023-11-28T11:10:37.514729+0000","last_fullsized":"2023-11-28T11:10:37.514729+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:32.757363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514740+0000","last_change":"2023-11-28T11:10:36.527508+0000","last_active":"2023-11-28T11:10:37.514740+0000","last_peered":"2023-11-28T11:10:37.514740+0000","last_clean":"2023-11-28T11:10:37.514740+0000","last_became_active":"2023-11-28T11:10:36.527266+0000","last_became_peered":"2023-11-28T11:10:36.527266+0000","last_unstale":"2023-11-28T11:10:37.514740+0000","last_undegraded":"2023-11-28T11:10:37.514740+0000","last_fullsized":"2023-11-28T11:10:37.514740+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:42.678837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141490+0000","last_change":"2023-11-28T11:10:36.118325+0000","last_active":"2023-11-28T11:10:38.141490+0000","last_peered":"2023-11-28T11:10:38.141490+0000","last_clean":"2023-11-28T11:10:38.141490+0000","last_became_active":"2023-11-28T11:10:36.117983+0000","last_became_peered":"2023-11-28T11:10:36.117983+0000","last_unstale":"2023-11-28T11:10:38.141490+0000","last_undegraded":"2023-11-28T11:10:38.141490+0000","last_fullsized":"2023-11-28T11:10:38.141490+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:25.568140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515333+0000","last_change":"2023-11-28T11:10:36.527082+0000","last_active":"2023-11-28T11:10:37.515333+0000","last_peered":"2023-11-28T11:10:37.515333+0000","last_clean":"2023-11-28T11:10:37.515333+0000","last_became_active":"2023-11-28T11:10:36.526836+0000","last_became_peered":"2023-11-28T11:10:36.526836+0000","last_unstale":"2023-11-28T11:10:37.515333+0000","last_undegraded":"2023-11-28T11:10:37.515333+0000","last_fullsized":"2023-11-28T11:10:37.515333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:51.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515629+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:10:37.515629+0000","last_peered":"2023-11-28T11:10:37.515629+0000","last_clean":"2023-11-28T11:10:37.515629+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:10:37.515629+0000","last_undegraded":"2023-11-28T11:10:37.515629+0000","last_fullsized":"2023-11-28T11:10:37.515629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T11:10:31.512272+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:10:31.512272+0000","last_peered":"2023-11-28T11:10:31.512272+0000","last_clean":"2023-11-28T11:10:31.512272+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:10:31.512272+0000","last_undegraded":"2023-11-28T11:10:31.512272+0000","last_fullsized":"2023-11-28T11:10:31.512272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515180+0000","last_change":"2023-11-28T11:10:36.126778+0000","last_active":"2023-11-28T11:10:37.515180+0000","last_peered":"2023-11-28T11:10:37.515180+0000","last_clean":"2023-11-28T11:10:37.515180+0000","last_became_active":"2023-11-28T11:10:36.126275+0000","last_became_peered":"2023-11-28T11:10:36.126275+0000","last_unstale":"2023-11-28T11:10:37.515180+0000","last_undegraded":"2023-11-28T11:10:37.515180+0000","last_fullsized":"2023-11-28T11:10:37.515180+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:04.198577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141619+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:10:38.141619+0000","last_peered":"2023-11-28T11:10:38.141619+0000","last_clean":"2023-11-28T11:10:38.141619+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:10:38.141619+0000","last_undegraded":"2023-11-28T11:10:38.141619+0000","last_fullsized":"2023-11-28T11:10:38.141619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515501+0000","last_change":"2023-11-28T11:10:36.119977+0000","last_active":"2023-11-28T11:10:37.515501+0000","last_peered":"2023-11-28T11:10:37.515501+0000","last_clean":"2023-11-28T11:10:37.515501+0000","last_became_active":"2023-11-28T11:10:36.117081+0000","last_became_peered":"2023-11-28T11:10:36.117081+0000","last_unstale":"2023-11-28T11:10:37.515501+0000","last_undegraded":"2023-11-28T11:10:37.515501+0000","last_fullsized":"2023-11-28T11:10:37.515501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:08.312145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T11:10:31.512270+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:10:31.512270+0000","last_peered":"2023-11-28T11:10:31.512270+0000","last_clean":"2023-11-28T11:10:31.512270+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:10:31.512270+0000","last_undegraded":"2023-11-28T11:10:31.512270+0000","last_fullsized":"2023-11-28T11:10:31.512270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.513577+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:10:36.513577+0000","last_peered":"2023-11-28T11:10:36.513577+0000","last_clean":"2023-11-28T11:10:36.513577+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:10:36.513577+0000","last_undegraded":"2023-11-28T11:10:36.513577+0000","last_fullsized":"2023-11-28T11:10:36.513577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514556+0000","last_change":"2023-11-28T11:10:36.529294+0000","last_active":"2023-11-28T11:10:37.514556+0000","last_peered":"2023-11-28T11:10:37.514556+0000","last_clean":"2023-11-28T11:10:37.514556+0000","last_became_active":"2023-11-28T11:10:36.529051+0000","last_became_peered":"2023-11-28T11:10:36.529051+0000","last_unstale":"2023-11-28T11:10:37.514556+0000","last_undegraded":"2023-11-28T11:10:37.514556+0000","last_fullsized":"2023-11-28T11:10:37.514556+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:09.319621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515058+0000","last_change":"2023-11-28T11:10:36.124673+0000","last_active":"2023-11-28T11:10:37.515058+0000","last_peered":"2023-11-28T11:10:37.515058+0000","last_clean":"2023-11-28T11:10:37.515058+0000","last_became_active":"2023-11-28T11:10:36.124359+0000","last_became_peered":"2023-11-28T11:10:36.124359+0000","last_unstale":"2023-11-28T11:10:37.515058+0000","last_undegraded":"2023-11-28T11:10:37.515058+0000","last_fullsized":"2023-11-28T11:10:37.515058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:34.374591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.513691+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:10:36.513691+0000","last_peered":"2023-11-28T11:10:36.513691+0000","last_clean":"2023-11-28T11:10:36.513691+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:10:36.513691+0000","last_undegraded":"2023-11-28T11:10:36.513691+0000","last_fullsized":"2023-11-28T11:10:36.513691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515099+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:10:37.515099+0000","last_peered":"2023-11-28T11:10:37.515099+0000","last_clean":"2023-11-28T11:10:37.515099+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:10:37.515099+0000","last_undegraded":"2023-11-28T11:10:37.515099+0000","last_fullsized":"2023-11-28T11:10:37.515099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515046+0000","last_change":"2023-11-28T11:10:36.528366+0000","last_active":"2023-11-28T11:10:37.515046+0000","last_peered":"2023-11-28T11:10:37.515046+0000","last_clean":"2023-11-28T11:10:37.515046+0000","last_became_active":"2023-11-28T11:10:36.528119+0000","last_became_peered":"2023-11-28T11:10:36.528119+0000","last_unstale":"2023-11-28T11:10:37.515046+0000","last_undegraded":"2023-11-28T11:10:37.515046+0000","last_fullsized":"2023-11-28T11:10:37.515046+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:05.763064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.519077+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:10:36.519077+0000","last_peered":"2023-11-28T11:10:36.519077+0000","last_clean":"2023-11-28T11:10:36.519077+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:10:36.519077+0000","last_undegraded":"2023-11-28T11:10:36.519077+0000","last_fullsized":"2023-11-28T11:10:36.519077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T11:10:31.512848+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:10:31.512848+0000","last_peered":"2023-11-28T11:10:31.512848+0000","last_clean":"2023-11-28T11:10:31.512848+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:10:31.512848+0000","last_undegraded":"2023-11-28T11:10:31.512848+0000","last_fullsized":"2023-11-28T11:10:31.512848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":146,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":32,"acting":32,"num_store_stats":4},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10284,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361556,"statfs":{"total":96636764160,"available":96626233344,"internally_reserved":0,"allocated":1216512,"data_stored":856083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.40000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71799999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.69899999999999995,"15min":0.72199999999999998},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.73899999999999999,"15min":0.76600000000000001},"min":{"1min":0.39700000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82999999999999996,"5min":5.532,"15min":5.532},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.66700000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70499999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67800000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.39500000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.43099999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75800000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.438,"5min":0.437,"15min":0.437},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.501},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.995,"15min":0.995},"last":0.54900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8688,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363152,"statfs":{"total":96636764160,"available":96627867648,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.503,"15min":0.49299999999999999},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.74199999999999999,"15min":0.77600000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65900000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.434},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.74199999999999999,"15min":0.77000000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79500000000000004,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.70699999999999996,"15min":0.73199999999999998},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71699999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.746,"15min":0.77800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72199999999999998,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.48999999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52300000000000002,"15min":0.51800000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.875,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66000000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":1.137,"15min":1.137},"last":0.61099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9000,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362840,"statfs":{"total":96636764160,"available":96627548160,"internally_reserved":0,"allocated":622592,"data_stored":265751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33100000000000002,"15min":0.33500000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.41799999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.496},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.22,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.55500000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33400000000000002,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44700000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.36299999999999999,"15min":0.36599999999999999},"min":{"1min":0.23599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48799999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.54300000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.504,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.63,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82199999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.78500000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78200000000000003,"5min":0.999,"15min":0.999},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.036,"15min":1.036},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84499999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10156,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361684,"statfs":{"total":96636764160,"available":96626364416,"internally_reserved":0,"allocated":1216512,"data_stored":856015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.33900000000000002},"min":{"1min":0.23899999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54200000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32900000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.22600000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.44500000000000001,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.316},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.439,"15min":0.45400000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.58499999999999996,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.309},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.51600000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.35399999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.872,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77500000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":3.298,"15min":3.298},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.72099999999999997,"15min":0.74399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85699999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.56100000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84399999999999997,"5min":0.877,"15min":0.877},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8940,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362900,"statfs":{"total":96636764160,"available":96627609600,"internally_reserved":0,"allocated":626688,"data_stored":267139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.317},"min":{"1min":0.26500000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.47999999999999998,"5min":0.503,"15min":0.503},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36199999999999999,"15min":0.35599999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.503,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.435}]},{"osd":1,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34200000000000003,"15min":0.33600000000000002},"min":{"1min":0.29599999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.504,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.33900000000000002},"min":{"1min":0.26900000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54600000000000004,"5min":1.002,"15min":1.002},"last":0.37}]},{"osd":3,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35499999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.374,"15min":0.36799999999999999},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51600000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73499999999999999,"5min":0.875,"15min":0.875},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.504},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.75600000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52700000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73499999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46000000000000002}]},{"osd":7,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.44800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.80800000000000005,"5min":1.05,"15min":1.05},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.751,"5min":1.222,"15min":1.222},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8944,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362896,"statfs":{"total":96636764160,"available":96627605504,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.36099999999999999,"15min":0.36799999999999999},"min":{"1min":0.22700000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.435,"5min":1.365,"15min":1.365},"last":0.253},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.66300000000000003,"15min":0.72299999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41599999999999998,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.26400000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.73599999999999999,"15min":0.80300000000000005},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45300000000000001,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.39800000000000002,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.44,"5min":1.448,"15min":1.448},"last":0.30399999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.42099999999999999,"15min":0.434},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.52100000000000002,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42499999999999999,"15min":0.42599999999999999},"min":{"1min":0.29099999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.298,"5min":1.474,"15min":1.474},"last":0.39600000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.85499999999999998,"15min":0.90100000000000002},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.94399999999999995,"15min":1.004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.94299999999999995,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.93899999999999995,"15min":0.996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.996,"5min":12.994,"15min":12.994},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.95399999999999996,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.90800000000000003,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97799999999999998,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.97899999999999998,"15min":1.038},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.05,"5min":12.932,"15min":12.932},"last":0.56499999999999995}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.91200000000000003,"15min":0.96199999999999997},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.038,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":8944,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362896,"statfs":{"total":96636764160,"available":96627605504,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.68500000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65500000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52500000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68500000000000005,"5min":0.747,"15min":0.747},"last":0.57799999999999996}]},{"osd":3,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69299999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67000000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.622},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.749}]},{"osd":6,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73099999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72499999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8880,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362960,"statfs":{"total":96636764160,"available":96627671040,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.522,"15min":1.522},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76700000000000002,"5min":1.452,"15min":1.452},"last":0.40400000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76700000000000002,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.442},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.69599999999999995,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68799999999999994,"5min":1.032,"15min":1.032},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":2.282,"15min":2.282},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":1.401,"15min":1.401},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":1.478,"15min":1.478},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.498}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68400000000000005,"15min":0.69699999999999995},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83499999999999996,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.51100000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":2.444,"15min":2.444},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.441,"5min":0.44,"15min":0.44},"max":{"1min":0.90300000000000002,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:10:40.588 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:10:40.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.740+0000 7fc36ac78700 1 Processor -- start 2023-11-28T11:10:40.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.740+0000 7fc36ac78700 1 -- start start 2023-11-28T11:10:40.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.740+0000 7fc36ac78700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640ce040 0x7fc36415d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.740+0000 7fc36ac78700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc364142db0 0x7fc36413ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.740+0000 7fc36ac78700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36413fc90 con 0x7fc3640b1770 2023-11-28T11:10:40.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.740+0000 7fc36ac78700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36413f6d0 con 0x7fc364142db0 2023-11-28T11:10:40.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.740+0000 7fc36ac78700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36413f9b0 con 0x7fc3640ce040 2023-11-28T11:10:40.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc369215700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc3640b1770 0x7fc36413cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44372/0 (socket says 172.21.15.125:44372) 2023-11-28T11:10:40.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc369215700 1 -- 172.21.15.125:0/3927167516 learned_addr learned my addr 172.21.15.125:0/3927167516 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:40.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc368a14700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640ce040 0x7fc36415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc363fff700 1 --2- 172.21.15.125:0/3927167516 >> v2:172.21.15.167:3300/0 conn(0x7fc364142db0 0x7fc36413ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872397278 0 0) 0x7fc36413fc90 con 0x7fc3640b1770 2023-11-28T11:10:40.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3540035b0 con 0x7fc3640b1770 2023-11-28T11:10:40.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1382274102 0 0) 0x7fc3540035b0 con 0x7fc3640b1770 2023-11-28T11:10:40.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640ce040 msgr2=0x7fc36415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:40.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640ce040 0x7fc36415d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 >> v2:172.21.15.167:3300/0 conn(0x7fc364142db0 msgr2=0x7fc36413ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:40.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 --2- 172.21.15.125:0/3927167516 >> v2:172.21.15.167:3300/0 conn(0x7fc364142db0 0x7fc36413ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36415d100 con 0x7fc3640b1770 2023-11-28T11:10:40.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fc35c0019f0 con 0x7fc3640b1770 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 >> v1:172.21.15.125:6789/0 conn(0x7fc3640b1770 legacy=0x7fc36413cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc354003a00 0x7fc354003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354004430 0x7fc3540048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640ce040 0x7fc354004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36413f6d0 con 0x7fc354003a00 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36413f9b0 con 0x7fc354004430 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35400ba10 con 0x7fc3640ce040 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc368a14700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc354003a00 0x7fc354003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc363fff700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354004430 0x7fc3540048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.741+0000 7fc369215700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640ce040 0x7fc354004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc368a14700 1 -- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640ce040 msgr2=0x7fc354004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:40.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc368a14700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640ce040 0x7fc354004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc368a14700 1 -- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354004430 msgr2=0x7fc3540048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:40.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc368a14700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354004430 0x7fc3540048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc368a14700 1 -- 172.21.15.125:0/3927167516 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3540035b0 con 0x7fc354003a00 2023-11-28T11:10:40.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc363fff700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354004430 0x7fc3540048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:40.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc368a14700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc354003a00 0x7fc354003e10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc358009b60 tx=0x7fc354005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82746126c35d19fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:40.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35800e6c0 con 0x7fc354003a00 2023-11-28T11:10:40.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35800e820 con 0x7fc354003a00 2023-11-28T11:10:40.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc3637fe700 1 -- 172.21.15.125:0/3927167516 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35800eb90 con 0x7fc354003a00 2023-11-28T11:10:40.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc36ac78700 1 -- 172.21.15.125:0/3927167516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc354003a00 msgr2=0x7fc354003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc36ac78700 1 --2- 172.21.15.125:0/3927167516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc354003a00 0x7fc354003e10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc358009b60 tx=0x7fc354005880 comp rx=0 tx=0).stop 2023-11-28T11:10:40.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc369215700 1 -- 172.21.15.125:0/3927167516 reap_dead start 2023-11-28T11:10:40.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc36ac78700 1 -- 172.21.15.125:0/3927167516 shutdown_connections 2023-11-28T11:10:40.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc36ac78700 1 -- 172.21.15.125:0/3927167516 >> 172.21.15.125:0/3927167516 conn(0x7fc36406c010 msgr2=0x7fc3640cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:40.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc36ac78700 1 -- 172.21.15.125:0/3927167516 shutdown_connections 2023-11-28T11:10:40.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.742+0000 7fc36ac78700 1 -- 172.21.15.125:0/3927167516 wait complete. 2023-11-28T11:10:40.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.744+0000 7fc36ac78700 1 Processor -- start 2023-11-28T11:10:40.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.744+0000 7fc36ac78700 1 -- start start 2023-11-28T11:10:40.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.744+0000 7fc36ac78700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354003a00 0x7fc364151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.744+0000 7fc36ac78700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640c9350 0x7fc3640c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc36ac78700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3640ca320 0x7fc3640ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc36ac78700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640cad00 con 0x7fc3640ca320 2023-11-28T11:10:40.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc36ac78700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640c8140 con 0x7fc354003a00 2023-11-28T11:10:40.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc36ac78700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640c7cb0 con 0x7fc3640c9350 2023-11-28T11:10:40.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc369215700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3640ca320 0x7fc3640ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc369215700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3640ca320 0x7fc3640ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60260/0 (socket says 172.21.15.125:60260) 2023-11-28T11:10:40.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc369215700 1 -- 172.21.15.125:0/325049897 learned_addr learned my addr 172.21.15.125:0/325049897 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:40.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc369215700 1 -- 172.21.15.125:0/325049897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640c9350 msgr2=0x7fc3640c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc369215700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640c9350 0x7fc3640c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc369215700 1 -- 172.21.15.125:0/325049897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354003a00 msgr2=0x7fc364151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc369215700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354003a00 0x7fc364151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc369215700 1 -- 172.21.15.125:0/325049897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640ce410 con 0x7fc3640ca320 2023-11-28T11:10:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc369215700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3640ca320 0x7fc3640ca7c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc35c001330 tx=0x7fc35c007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc3617fa700 1 -- 172.21.15.125:0/325049897 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00eeb0 con 0x7fc3640ca320 2023-11-28T11:10:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc3617fa700 1 -- 172.21.15.125:0/325049897 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c012450 con 0x7fc3640ca320 2023-11-28T11:10:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc36ac78700 1 -- 172.21.15.125:0/325049897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36415d3e0 con 0x7fc3640ca320 2023-11-28T11:10:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc3617fa700 1 -- 172.21.15.125:0/325049897 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c012820 con 0x7fc3640ca320 2023-11-28T11:10:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.745+0000 7fc36ac78700 1 -- 172.21.15.125:0/325049897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3640ce5a0 con 0x7fc3640ca320 2023-11-28T11:10:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.746+0000 7fc36ac78700 1 -- 172.21.15.125:0/325049897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3640ced70 con 0x7fc3640ca320 2023-11-28T11:10:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.747+0000 7fc3617fa700 1 -- 172.21.15.125:0/325049897 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc35c012980 con 0x7fc3640ca320 2023-11-28T11:10:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.747+0000 7fc3617fa700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3480682f0 0x7fc34806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.747+0000 7fc3617fa700 1 -- 172.21.15.125:0/325049897 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc35c0880a0 con 0x7fc3640ca320 2023-11-28T11:10:40.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.747+0000 7fc368a14700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3480682f0 0x7fc34806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.747+0000 7fc368a14700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3480682f0 0x7fc34806a7a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc358000c00 tx=0x7fc358013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:40.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.751+0000 7fc3617fa700 1 -- 172.21.15.125:0/325049897 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc35c054900 con 0x7fc3640ca320 2023-11-28T11:10:40.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.930+0000 7fc36ac78700 1 -- 172.21.15.125:0/325049897 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3640c7e20 con 0x7fc3480682f0 2023-11-28T11:10:40.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.938+0000 7fc3617fa700 1 -- 172.21.15.125:0/325049897 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304153 (secure 0 0 0) 0x7fc3640c7e20 con 0x7fc3480682f0 2023-11-28T11:10:40.942 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:40.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.941+0000 7fc36ac78700 1 -- 172.21.15.125:0/325049897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3480682f0 msgr2=0x7fc34806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.941+0000 7fc36ac78700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3480682f0 0x7fc34806a7a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc358000c00 tx=0x7fc358013000 comp rx=0 tx=0).stop 2023-11-28T11:10:40.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.941+0000 7fc36ac78700 1 -- 172.21.15.125:0/325049897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3640ca320 msgr2=0x7fc3640ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:40.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.941+0000 7fc36ac78700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3640ca320 0x7fc3640ca7c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc35c001330 tx=0x7fc35c007c90 comp rx=0 tx=0).stop 2023-11-28T11:10:40.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.941+0000 7fc36ac78700 1 -- 172.21.15.125:0/325049897 shutdown_connections 2023-11-28T11:10:40.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.941+0000 7fc36ac78700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3640ca320 0x7fc3640ca7c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.941+0000 7fc36ac78700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354003a00 0x7fc364151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.941+0000 7fc36ac78700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3480682f0 0x7fc34806a7a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.941+0000 7fc36ac78700 1 --2- 172.21.15.125:0/325049897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3640c9350 0x7fc3640c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:40.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.941+0000 7fc36ac78700 1 -- 172.21.15.125:0/325049897 >> 172.21.15.125:0/325049897 conn(0x7fc36406c010 msgr2=0x7fc3641581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:40.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.942+0000 7fc36ac78700 1 -- 172.21.15.125:0/325049897 shutdown_connections 2023-11-28T11:10:40.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:40.942+0000 7fc36ac78700 1 -- 172.21.15.125:0/325049897 wait complete. 2023-11-28T11:10:40.946 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:10:40.954 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-11-28T11:10:39.647519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590514,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":120,"acting":120,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":73836,"kb_used_data":5804,"kb_used_omap":0,"kb_used_meta":67968,"kb_avail":754900884,"statfs":{"total":773094113280,"available":773018505216,"internally_reserved":0,"allocated":5943296,"data_stored":3201036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69599232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":146,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.543967"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514648+0000","last_change":"2023-11-28T11:10:36.524056+0000","last_active":"2023-11-28T11:10:37.514648+0000","last_peered":"2023-11-28T11:10:37.514648+0000","last_clean":"2023-11-28T11:10:37.514648+0000","last_became_active":"2023-11-28T11:10:36.523831+0000","last_became_peered":"2023-11-28T11:10:36.523831+0000","last_unstale":"2023-11-28T11:10:37.514648+0000","last_undegraded":"2023-11-28T11:10:37.514648+0000","last_fullsized":"2023-11-28T11:10:37.514648+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514850+0000","last_change":"2023-11-28T11:10:36.524534+0000","last_active":"2023-11-28T11:10:37.514850+0000","last_peered":"2023-11-28T11:10:37.514850+0000","last_clean":"2023-11-28T11:10:37.514850+0000","last_became_active":"2023-11-28T11:10:36.524236+0000","last_became_peered":"2023-11-28T11:10:36.524236+0000","last_unstale":"2023-11-28T11:10:37.514850+0000","last_undegraded":"2023-11-28T11:10:37.514850+0000","last_fullsized":"2023-11-28T11:10:37.514850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:58.155221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515248+0000","last_change":"2023-11-28T11:10:36.526236+0000","last_active":"2023-11-28T11:10:37.515248+0000","last_peered":"2023-11-28T11:10:37.515248+0000","last_clean":"2023-11-28T11:10:37.515248+0000","last_became_active":"2023-11-28T11:10:36.525526+0000","last_became_peered":"2023-11-28T11:10:36.525526+0000","last_unstale":"2023-11-28T11:10:37.515248+0000","last_undegraded":"2023-11-28T11:10:37.515248+0000","last_fullsized":"2023-11-28T11:10:37.515248+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:27.654161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514746+0000","last_change":"2023-11-28T11:10:36.528064+0000","last_active":"2023-11-28T11:10:37.514746+0000","last_peered":"2023-11-28T11:10:37.514746+0000","last_clean":"2023-11-28T11:10:37.514746+0000","last_became_active":"2023-11-28T11:10:36.527767+0000","last_became_peered":"2023-11-28T11:10:36.527767+0000","last_unstale":"2023-11-28T11:10:37.514746+0000","last_undegraded":"2023-11-28T11:10:37.514746+0000","last_fullsized":"2023-11-28T11:10:37.514746+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:20.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514469+0000","last_change":"2023-11-28T11:10:36.526839+0000","last_active":"2023-11-28T11:10:37.514469+0000","last_peered":"2023-11-28T11:10:37.514469+0000","last_clean":"2023-11-28T11:10:37.514469+0000","last_became_active":"2023-11-28T11:10:36.526583+0000","last_became_peered":"2023-11-28T11:10:36.526583+0000","last_unstale":"2023-11-28T11:10:37.514469+0000","last_undegraded":"2023-11-28T11:10:37.514469+0000","last_fullsized":"2023-11-28T11:10:37.514469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:31.375598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514646+0000","last_change":"2023-11-28T11:10:36.529010+0000","last_active":"2023-11-28T11:10:37.514646+0000","last_peered":"2023-11-28T11:10:37.514646+0000","last_clean":"2023-11-28T11:10:37.514646+0000","last_became_active":"2023-11-28T11:10:36.528687+0000","last_became_peered":"2023-11-28T11:10:36.528687+0000","last_unstale":"2023-11-28T11:10:37.514646+0000","last_undegraded":"2023-11-28T11:10:37.514646+0000","last_fullsized":"2023-11-28T11:10:37.514646+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:50.593011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515454+0000","last_change":"2023-11-28T11:10:36.532181+0000","last_active":"2023-11-28T11:10:37.515454+0000","last_peered":"2023-11-28T11:10:37.515454+0000","last_clean":"2023-11-28T11:10:37.515454+0000","last_became_active":"2023-11-28T11:10:36.531946+0000","last_became_peered":"2023-11-28T11:10:36.531946+0000","last_unstale":"2023-11-28T11:10:37.515454+0000","last_undegraded":"2023-11-28T11:10:37.515454+0000","last_fullsized":"2023-11-28T11:10:37.515454+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:34.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141761+0000","last_change":"2023-11-28T11:10:36.522452+0000","last_active":"2023-11-28T11:10:38.141761+0000","last_peered":"2023-11-28T11:10:38.141761+0000","last_clean":"2023-11-28T11:10:38.141761+0000","last_became_active":"2023-11-28T11:10:36.522201+0000","last_became_peered":"2023-11-28T11:10:36.522201+0000","last_unstale":"2023-11-28T11:10:38.141761+0000","last_undegraded":"2023-11-28T11:10:38.141761+0000","last_fullsized":"2023-11-28T11:10:38.141761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:59:58.033544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514287+0000","last_change":"2023-11-28T11:10:36.534554+0000","last_active":"2023-11-28T11:10:37.514287+0000","last_peered":"2023-11-28T11:10:37.514287+0000","last_clean":"2023-11-28T11:10:37.514287+0000","last_became_active":"2023-11-28T11:10:36.534313+0000","last_became_peered":"2023-11-28T11:10:36.534313+0000","last_unstale":"2023-11-28T11:10:37.514287+0000","last_undegraded":"2023-11-28T11:10:37.514287+0000","last_fullsized":"2023-11-28T11:10:37.514287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:33.764839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515060+0000","last_change":"2023-11-28T11:10:36.525581+0000","last_active":"2023-11-28T11:10:37.515060+0000","last_peered":"2023-11-28T11:10:37.515060+0000","last_clean":"2023-11-28T11:10:37.515060+0000","last_became_active":"2023-11-28T11:10:36.525315+0000","last_became_peered":"2023-11-28T11:10:36.525315+0000","last_unstale":"2023-11-28T11:10:37.515060+0000","last_undegraded":"2023-11-28T11:10:37.515060+0000","last_fullsized":"2023-11-28T11:10:37.515060+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:12.836764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514618+0000","last_change":"2023-11-28T11:10:36.527490+0000","last_active":"2023-11-28T11:10:37.514618+0000","last_peered":"2023-11-28T11:10:37.514618+0000","last_clean":"2023-11-28T11:10:37.514618+0000","last_became_active":"2023-11-28T11:10:36.527219+0000","last_became_peered":"2023-11-28T11:10:36.527219+0000","last_unstale":"2023-11-28T11:10:37.514618+0000","last_undegraded":"2023-11-28T11:10:37.514618+0000","last_fullsized":"2023-11-28T11:10:37.514618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514163+0000","last_change":"2023-11-28T11:10:36.532971+0000","last_active":"2023-11-28T11:10:37.514163+0000","last_peered":"2023-11-28T11:10:37.514163+0000","last_clean":"2023-11-28T11:10:37.514163+0000","last_became_active":"2023-11-28T11:10:36.532729+0000","last_became_peered":"2023-11-28T11:10:36.532729+0000","last_unstale":"2023-11-28T11:10:37.514163+0000","last_undegraded":"2023-11-28T11:10:37.514163+0000","last_fullsized":"2023-11-28T11:10:37.514163+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:20.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515693+0000","last_change":"2023-11-28T11:10:36.528593+0000","last_active":"2023-11-28T11:10:37.515693+0000","last_peered":"2023-11-28T11:10:37.515693+0000","last_clean":"2023-11-28T11:10:37.515693+0000","last_became_active":"2023-11-28T11:10:36.528202+0000","last_became_peered":"2023-11-28T11:10:36.528202+0000","last_unstale":"2023-11-28T11:10:37.515693+0000","last_undegraded":"2023-11-28T11:10:37.515693+0000","last_fullsized":"2023-11-28T11:10:37.515693+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:23.935065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514945+0000","last_change":"2023-11-28T11:10:36.524381+0000","last_active":"2023-11-28T11:10:37.514945+0000","last_peered":"2023-11-28T11:10:37.514945+0000","last_clean":"2023-11-28T11:10:37.514945+0000","last_became_active":"2023-11-28T11:10:36.524095+0000","last_became_peered":"2023-11-28T11:10:36.524095+0000","last_unstale":"2023-11-28T11:10:37.514945+0000","last_undegraded":"2023-11-28T11:10:37.514945+0000","last_fullsized":"2023-11-28T11:10:37.514945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515238+0000","last_change":"2023-11-28T11:10:36.533836+0000","last_active":"2023-11-28T11:10:37.515238+0000","last_peered":"2023-11-28T11:10:37.515238+0000","last_clean":"2023-11-28T11:10:37.515238+0000","last_became_active":"2023-11-28T11:10:36.533560+0000","last_became_peered":"2023-11-28T11:10:36.533560+0000","last_unstale":"2023-11-28T11:10:37.515238+0000","last_undegraded":"2023-11-28T11:10:37.515238+0000","last_fullsized":"2023-11-28T11:10:37.515238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:25.315412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141535+0000","last_change":"2023-11-28T11:10:36.528419+0000","last_active":"2023-11-28T11:10:38.141535+0000","last_peered":"2023-11-28T11:10:38.141535+0000","last_clean":"2023-11-28T11:10:38.141535+0000","last_became_active":"2023-11-28T11:10:36.527321+0000","last_became_peered":"2023-11-28T11:10:36.527321+0000","last_unstale":"2023-11-28T11:10:38.141535+0000","last_undegraded":"2023-11-28T11:10:38.141535+0000","last_fullsized":"2023-11-28T11:10:38.141535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:06.424953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514471+0000","last_change":"2023-11-28T11:10:36.525552+0000","last_active":"2023-11-28T11:10:37.514471+0000","last_peered":"2023-11-28T11:10:37.514471+0000","last_clean":"2023-11-28T11:10:37.514471+0000","last_became_active":"2023-11-28T11:10:36.525301+0000","last_became_peered":"2023-11-28T11:10:36.525301+0000","last_unstale":"2023-11-28T11:10:37.514471+0000","last_undegraded":"2023-11-28T11:10:37.514471+0000","last_fullsized":"2023-11-28T11:10:37.514471+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:57.807839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515621+0000","last_change":"2023-11-28T11:10:36.538677+0000","last_active":"2023-11-28T11:10:37.515621+0000","last_peered":"2023-11-28T11:10:37.515621+0000","last_clean":"2023-11-28T11:10:37.515621+0000","last_became_active":"2023-11-28T11:10:36.538336+0000","last_became_peered":"2023-11-28T11:10:36.538336+0000","last_unstale":"2023-11-28T11:10:37.515621+0000","last_undegraded":"2023-11-28T11:10:37.515621+0000","last_fullsized":"2023-11-28T11:10:37.515621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:04.544184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515008+0000","last_change":"2023-11-28T11:10:36.535214+0000","last_active":"2023-11-28T11:10:37.515008+0000","last_peered":"2023-11-28T11:10:37.515008+0000","last_clean":"2023-11-28T11:10:37.515008+0000","last_became_active":"2023-11-28T11:10:36.534981+0000","last_became_peered":"2023-11-28T11:10:36.534981+0000","last_unstale":"2023-11-28T11:10:37.515008+0000","last_undegraded":"2023-11-28T11:10:37.515008+0000","last_fullsized":"2023-11-28T11:10:37.515008+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:19.190582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514668+0000","last_change":"2023-11-28T11:10:36.528010+0000","last_active":"2023-11-28T11:10:37.514668+0000","last_peered":"2023-11-28T11:10:37.514668+0000","last_clean":"2023-11-28T11:10:37.514668+0000","last_became_active":"2023-11-28T11:10:36.527719+0000","last_became_peered":"2023-11-28T11:10:36.527719+0000","last_unstale":"2023-11-28T11:10:37.514668+0000","last_undegraded":"2023-11-28T11:10:37.514668+0000","last_fullsized":"2023-11-28T11:10:37.514668+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:58.531465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514890+0000","last_change":"2023-11-28T11:10:36.522035+0000","last_active":"2023-11-28T11:10:37.514890+0000","last_peered":"2023-11-28T11:10:37.514890+0000","last_clean":"2023-11-28T11:10:37.514890+0000","last_became_active":"2023-11-28T11:10:36.521763+0000","last_became_peered":"2023-11-28T11:10:36.521763+0000","last_unstale":"2023-11-28T11:10:37.514890+0000","last_undegraded":"2023-11-28T11:10:37.514890+0000","last_fullsized":"2023-11-28T11:10:37.514890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514820+0000","last_change":"2023-11-28T11:10:36.528832+0000","last_active":"2023-11-28T11:10:37.514820+0000","last_peered":"2023-11-28T11:10:37.514820+0000","last_clean":"2023-11-28T11:10:37.514820+0000","last_became_active":"2023-11-28T11:10:36.528558+0000","last_became_peered":"2023-11-28T11:10:36.528558+0000","last_unstale":"2023-11-28T11:10:37.514820+0000","last_undegraded":"2023-11-28T11:10:37.514820+0000","last_fullsized":"2023-11-28T11:10:37.514820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:28.375662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514434+0000","last_change":"2023-11-28T11:10:36.524969+0000","last_active":"2023-11-28T11:10:37.514434+0000","last_peered":"2023-11-28T11:10:37.514434+0000","last_clean":"2023-11-28T11:10:37.514434+0000","last_became_active":"2023-11-28T11:10:36.524710+0000","last_became_peered":"2023-11-28T11:10:36.524710+0000","last_unstale":"2023-11-28T11:10:37.514434+0000","last_undegraded":"2023-11-28T11:10:37.514434+0000","last_fullsized":"2023-11-28T11:10:37.514434+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:02:40.345280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515505+0000","last_change":"2023-11-28T11:10:36.133446+0000","last_active":"2023-11-28T11:10:37.515505+0000","last_peered":"2023-11-28T11:10:37.515505+0000","last_clean":"2023-11-28T11:10:37.515505+0000","last_became_active":"2023-11-28T11:10:36.133184+0000","last_became_peered":"2023-11-28T11:10:36.133184+0000","last_unstale":"2023-11-28T11:10:37.515505+0000","last_undegraded":"2023-11-28T11:10:37.515505+0000","last_fullsized":"2023-11-28T11:10:37.515505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:13.129227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515095+0000","last_change":"2023-11-28T11:10:36.133435+0000","last_active":"2023-11-28T11:10:37.515095+0000","last_peered":"2023-11-28T11:10:37.515095+0000","last_clean":"2023-11-28T11:10:37.515095+0000","last_became_active":"2023-11-28T11:10:36.133156+0000","last_became_peered":"2023-11-28T11:10:36.133156+0000","last_unstale":"2023-11-28T11:10:37.515095+0000","last_undegraded":"2023-11-28T11:10:37.515095+0000","last_fullsized":"2023-11-28T11:10:37.515095+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:32.589064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514762+0000","last_change":"2023-11-28T11:10:36.119665+0000","last_active":"2023-11-28T11:10:37.514762+0000","last_peered":"2023-11-28T11:10:37.514762+0000","last_clean":"2023-11-28T11:10:37.514762+0000","last_became_active":"2023-11-28T11:10:36.117416+0000","last_became_peered":"2023-11-28T11:10:36.117416+0000","last_unstale":"2023-11-28T11:10:37.514762+0000","last_undegraded":"2023-11-28T11:10:37.514762+0000","last_fullsized":"2023-11-28T11:10:37.514762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:33.877212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515023+0000","last_change":"2023-11-28T11:10:36.523569+0000","last_active":"2023-11-28T11:10:37.515023+0000","last_peered":"2023-11-28T11:10:37.515023+0000","last_clean":"2023-11-28T11:10:37.515023+0000","last_became_active":"2023-11-28T11:10:36.523302+0000","last_became_peered":"2023-11-28T11:10:36.523302+0000","last_unstale":"2023-11-28T11:10:37.515023+0000","last_undegraded":"2023-11-28T11:10:37.515023+0000","last_fullsized":"2023-11-28T11:10:37.515023+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:48.693779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514850+0000","last_change":"2023-11-28T11:10:36.528489+0000","last_active":"2023-11-28T11:10:37.514850+0000","last_peered":"2023-11-28T11:10:37.514850+0000","last_clean":"2023-11-28T11:10:37.514850+0000","last_became_active":"2023-11-28T11:10:36.528196+0000","last_became_peered":"2023-11-28T11:10:36.528196+0000","last_unstale":"2023-11-28T11:10:37.514850+0000","last_undegraded":"2023-11-28T11:10:37.514850+0000","last_fullsized":"2023-11-28T11:10:37.514850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.833897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514973+0000","last_change":"2023-11-28T11:10:36.126539+0000","last_active":"2023-11-28T11:10:37.514973+0000","last_peered":"2023-11-28T11:10:37.514973+0000","last_clean":"2023-11-28T11:10:37.514973+0000","last_became_active":"2023-11-28T11:10:36.126227+0000","last_became_peered":"2023-11-28T11:10:36.126227+0000","last_unstale":"2023-11-28T11:10:37.514973+0000","last_undegraded":"2023-11-28T11:10:37.514973+0000","last_fullsized":"2023-11-28T11:10:37.514973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:28.022412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515008+0000","last_change":"2023-11-28T11:10:36.123501+0000","last_active":"2023-11-28T11:10:37.515008+0000","last_peered":"2023-11-28T11:10:37.515008+0000","last_clean":"2023-11-28T11:10:37.515008+0000","last_became_active":"2023-11-28T11:10:36.122933+0000","last_became_peered":"2023-11-28T11:10:36.122933+0000","last_unstale":"2023-11-28T11:10:37.515008+0000","last_undegraded":"2023-11-28T11:10:37.515008+0000","last_fullsized":"2023-11-28T11:10:37.515008+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:32.757363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514980+0000","last_change":"2023-11-28T11:10:36.524201+0000","last_active":"2023-11-28T11:10:37.514980+0000","last_peered":"2023-11-28T11:10:37.514980+0000","last_clean":"2023-11-28T11:10:37.514980+0000","last_became_active":"2023-11-28T11:10:36.521915+0000","last_became_peered":"2023-11-28T11:10:36.521915+0000","last_unstale":"2023-11-28T11:10:37.514980+0000","last_undegraded":"2023-11-28T11:10:37.514980+0000","last_fullsized":"2023-11-28T11:10:37.514980+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:19:19.207096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514992+0000","last_change":"2023-11-28T11:10:36.136502+0000","last_active":"2023-11-28T11:10:37.514992+0000","last_peered":"2023-11-28T11:10:37.514992+0000","last_clean":"2023-11-28T11:10:37.514992+0000","last_became_active":"2023-11-28T11:10:36.136213+0000","last_became_peered":"2023-11-28T11:10:36.136213+0000","last_unstale":"2023-11-28T11:10:37.514992+0000","last_undegraded":"2023-11-28T11:10:37.514992+0000","last_fullsized":"2023-11-28T11:10:37.514992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:28.022412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514858+0000","last_change":"2023-11-28T11:10:36.118915+0000","last_active":"2023-11-28T11:10:37.514858+0000","last_peered":"2023-11-28T11:10:37.514858+0000","last_clean":"2023-11-28T11:10:37.514858+0000","last_became_active":"2023-11-28T11:10:36.118661+0000","last_became_peered":"2023-11-28T11:10:36.118661+0000","last_unstale":"2023-11-28T11:10:37.514858+0000","last_undegraded":"2023-11-28T11:10:37.514858+0000","last_fullsized":"2023-11-28T11:10:37.514858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:30.368123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515289+0000","last_change":"2023-11-28T11:10:36.528346+0000","last_active":"2023-11-28T11:10:37.515289+0000","last_peered":"2023-11-28T11:10:37.515289+0000","last_clean":"2023-11-28T11:10:37.515289+0000","last_became_active":"2023-11-28T11:10:36.528097+0000","last_became_peered":"2023-11-28T11:10:36.528097+0000","last_unstale":"2023-11-28T11:10:37.515289+0000","last_undegraded":"2023-11-28T11:10:37.515289+0000","last_fullsized":"2023-11-28T11:10:37.515289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:33.646649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515092+0000","last_change":"2023-11-28T11:10:36.123367+0000","last_active":"2023-11-28T11:10:37.515092+0000","last_peered":"2023-11-28T11:10:37.515092+0000","last_clean":"2023-11-28T11:10:37.515092+0000","last_became_active":"2023-11-28T11:10:36.122981+0000","last_became_peered":"2023-11-28T11:10:36.122981+0000","last_unstale":"2023-11-28T11:10:37.515092+0000","last_undegraded":"2023-11-28T11:10:37.515092+0000","last_fullsized":"2023-11-28T11:10:37.515092+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:33:27.881264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515752+0000","last_change":"2023-11-28T11:10:36.528470+0000","last_active":"2023-11-28T11:10:37.515752+0000","last_peered":"2023-11-28T11:10:37.515752+0000","last_clean":"2023-11-28T11:10:37.515752+0000","last_became_active":"2023-11-28T11:10:36.527851+0000","last_became_peered":"2023-11-28T11:10:36.527851+0000","last_unstale":"2023-11-28T11:10:37.515752+0000","last_undegraded":"2023-11-28T11:10:37.515752+0000","last_fullsized":"2023-11-28T11:10:37.515752+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:10.382472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515505+0000","last_change":"2023-11-28T11:10:36.126441+0000","last_active":"2023-11-28T11:10:37.515505+0000","last_peered":"2023-11-28T11:10:37.515505+0000","last_clean":"2023-11-28T11:10:37.515505+0000","last_became_active":"2023-11-28T11:10:36.125967+0000","last_became_peered":"2023-11-28T11:10:36.125967+0000","last_unstale":"2023-11-28T11:10:37.515505+0000","last_undegraded":"2023-11-28T11:10:37.515505+0000","last_fullsized":"2023-11-28T11:10:37.515505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:08.438167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514473+0000","last_change":"2023-11-28T11:10:36.531244+0000","last_active":"2023-11-28T11:10:37.514473+0000","last_peered":"2023-11-28T11:10:37.514473+0000","last_clean":"2023-11-28T11:10:37.514473+0000","last_became_active":"2023-11-28T11:10:36.530978+0000","last_became_peered":"2023-11-28T11:10:36.530978+0000","last_unstale":"2023-11-28T11:10:37.514473+0000","last_undegraded":"2023-11-28T11:10:37.514473+0000","last_fullsized":"2023-11-28T11:10:37.514473+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.833897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141759+0000","last_change":"2023-11-28T11:10:36.123203+0000","last_active":"2023-11-28T11:10:38.141759+0000","last_peered":"2023-11-28T11:10:38.141759+0000","last_clean":"2023-11-28T11:10:38.141759+0000","last_became_active":"2023-11-28T11:10:36.122988+0000","last_became_peered":"2023-11-28T11:10:36.122988+0000","last_unstale":"2023-11-28T11:10:38.141759+0000","last_undegraded":"2023-11-28T11:10:38.141759+0000","last_fullsized":"2023-11-28T11:10:38.141759+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:33.478864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514472+0000","last_change":"2023-11-28T11:10:36.524080+0000","last_active":"2023-11-28T11:10:37.514472+0000","last_peered":"2023-11-28T11:10:37.514472+0000","last_clean":"2023-11-28T11:10:37.514472+0000","last_became_active":"2023-11-28T11:10:36.523831+0000","last_became_peered":"2023-11-28T11:10:36.523831+0000","last_unstale":"2023-11-28T11:10:37.514472+0000","last_undegraded":"2023-11-28T11:10:37.514472+0000","last_fullsized":"2023-11-28T11:10:37.514472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514367+0000","last_change":"2023-11-28T11:10:36.136094+0000","last_active":"2023-11-28T11:10:37.514367+0000","last_peered":"2023-11-28T11:10:37.514367+0000","last_clean":"2023-11-28T11:10:37.514367+0000","last_became_active":"2023-11-28T11:10:36.135780+0000","last_became_peered":"2023-11-28T11:10:36.135780+0000","last_unstale":"2023-11-28T11:10:37.514367+0000","last_undegraded":"2023-11-28T11:10:37.514367+0000","last_fullsized":"2023-11-28T11:10:37.514367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:08.762868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515424+0000","last_change":"2023-11-28T11:10:36.529075+0000","last_active":"2023-11-28T11:10:37.515424+0000","last_peered":"2023-11-28T11:10:37.515424+0000","last_clean":"2023-11-28T11:10:37.515424+0000","last_became_active":"2023-11-28T11:10:36.528708+0000","last_became_peered":"2023-11-28T11:10:36.528708+0000","last_unstale":"2023-11-28T11:10:37.515424+0000","last_undegraded":"2023-11-28T11:10:37.515424+0000","last_fullsized":"2023-11-28T11:10:37.515424+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514729+0000","last_change":"2023-11-28T11:10:36.136681+0000","last_active":"2023-11-28T11:10:37.514729+0000","last_peered":"2023-11-28T11:10:37.514729+0000","last_clean":"2023-11-28T11:10:37.514729+0000","last_became_active":"2023-11-28T11:10:36.136334+0000","last_became_peered":"2023-11-28T11:10:36.136334+0000","last_unstale":"2023-11-28T11:10:37.514729+0000","last_undegraded":"2023-11-28T11:10:37.514729+0000","last_fullsized":"2023-11-28T11:10:37.514729+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:32.757363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514740+0000","last_change":"2023-11-28T11:10:36.527508+0000","last_active":"2023-11-28T11:10:37.514740+0000","last_peered":"2023-11-28T11:10:37.514740+0000","last_clean":"2023-11-28T11:10:37.514740+0000","last_became_active":"2023-11-28T11:10:36.527266+0000","last_became_peered":"2023-11-28T11:10:36.527266+0000","last_unstale":"2023-11-28T11:10:37.514740+0000","last_undegraded":"2023-11-28T11:10:37.514740+0000","last_fullsized":"2023-11-28T11:10:37.514740+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:42.678837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141490+0000","last_change":"2023-11-28T11:10:36.118325+0000","last_active":"2023-11-28T11:10:38.141490+0000","last_peered":"2023-11-28T11:10:38.141490+0000","last_clean":"2023-11-28T11:10:38.141490+0000","last_became_active":"2023-11-28T11:10:36.117983+0000","last_became_peered":"2023-11-28T11:10:36.117983+0000","last_unstale":"2023-11-28T11:10:38.141490+0000","last_undegraded":"2023-11-28T11:10:38.141490+0000","last_fullsized":"2023-11-28T11:10:38.141490+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:25.568140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515333+0000","last_change":"2023-11-28T11:10:36.527082+0000","last_active":"2023-11-28T11:10:37.515333+0000","last_peered":"2023-11-28T11:10:37.515333+0000","last_clean":"2023-11-28T11:10:37.515333+0000","last_became_active":"2023-11-28T11:10:36.526836+0000","last_became_peered":"2023-11-28T11:10:36.526836+0000","last_unstale":"2023-11-28T11:10:37.515333+0000","last_undegraded":"2023-11-28T11:10:37.515333+0000","last_fullsized":"2023-11-28T11:10:37.515333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:51.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515629+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:10:37.515629+0000","last_peered":"2023-11-28T11:10:37.515629+0000","last_clean":"2023-11-28T11:10:37.515629+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:10:37.515629+0000","last_undegraded":"2023-11-28T11:10:37.515629+0000","last_fullsized":"2023-11-28T11:10:37.515629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T11:10:31.512272+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:10:31.512272+0000","last_peered":"2023-11-28T11:10:31.512272+0000","last_clean":"2023-11-28T11:10:31.512272+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:10:31.512272+0000","last_undegraded":"2023-11-28T11:10:31.512272+0000","last_fullsized":"2023-11-28T11:10:31.512272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515180+0000","last_change":"2023-11-28T11:10:36.126778+0000","last_active":"2023-11-28T11:10:37.515180+0000","last_peered":"2023-11-28T11:10:37.515180+0000","last_clean":"2023-11-28T11:10:37.515180+0000","last_became_active":"2023-11-28T11:10:36.126275+0000","last_became_peered":"2023-11-28T11:10:36.126275+0000","last_unstale":"2023-11-28T11:10:37.515180+0000","last_undegraded":"2023-11-28T11:10:37.515180+0000","last_fullsized":"2023-11-28T11:10:37.515180+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:04.198577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141619+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:10:38.141619+0000","last_peered":"2023-11-28T11:10:38.141619+0000","last_clean":"2023-11-28T11:10:38.141619+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:10:38.141619+0000","last_undegraded":"2023-11-28T11:10:38.141619+0000","last_fullsized":"2023-11-28T11:10:38.141619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515501+0000","last_change":"2023-11-28T11:10:36.119977+0000","last_active":"2023-11-28T11:10:37.515501+0000","last_peered":"2023-11-28T11:10:37.515501+0000","last_clean":"2023-11-28T11:10:37.515501+0000","last_became_active":"2023-11-28T11:10:36.117081+0000","last_became_peered":"2023-11-28T11:10:36.117081+0000","last_unstale":"2023-11-28T11:10:37.515501+0000","last_undegraded":"2023-11-28T11:10:37.515501+0000","last_fullsized":"2023-11-28T11:10:37.515501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:08.312145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T11:10:31.512270+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:10:31.512270+0000","last_peered":"2023-11-28T11:10:31.512270+0000","last_clean":"2023-11-28T11:10:31.512270+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:10:31.512270+0000","last_undegraded":"2023-11-28T11:10:31.512270+0000","last_fullsized":"2023-11-28T11:10:31.512270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.513577+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:10:36.513577+0000","last_peered":"2023-11-28T11:10:36.513577+0000","last_clean":"2023-11-28T11:10:36.513577+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:10:36.513577+0000","last_undegraded":"2023-11-28T11:10:36.513577+0000","last_fullsized":"2023-11-28T11:10:36.513577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514556+0000","last_change":"2023-11-28T11:10:36.529294+0000","last_active":"2023-11-28T11:10:37.514556+0000","last_peered":"2023-11-28T11:10:37.514556+0000","last_clean":"2023-11-28T11:10:37.514556+0000","last_became_active":"2023-11-28T11:10:36.529051+0000","last_became_peered":"2023-11-28T11:10:36.529051+0000","last_unstale":"2023-11-28T11:10:37.514556+0000","last_undegraded":"2023-11-28T11:10:37.514556+0000","last_fullsized":"2023-11-28T11:10:37.514556+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:09.319621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515058+0000","last_change":"2023-11-28T11:10:36.124673+0000","last_active":"2023-11-28T11:10:37.515058+0000","last_peered":"2023-11-28T11:10:37.515058+0000","last_clean":"2023-11-28T11:10:37.515058+0000","last_became_active":"2023-11-28T11:10:36.124359+0000","last_became_peered":"2023-11-28T11:10:36.124359+0000","last_unstale":"2023-11-28T11:10:37.515058+0000","last_undegraded":"2023-11-28T11:10:37.515058+0000","last_fullsized":"2023-11-28T11:10:37.515058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:34.374591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.513691+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:10:36.513691+0000","last_peered":"2023-11-28T11:10:36.513691+0000","last_clean":"2023-11-28T11:10:36.513691+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:10:36.513691+0000","last_undegraded":"2023-11-28T11:10:36.513691+0000","last_fullsized":"2023-11-28T11:10:36.513691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515099+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:10:37.515099+0000","last_peered":"2023-11-28T11:10:37.515099+0000","last_clean":"2023-11-28T11:10:37.515099+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:10:37.515099+0000","last_undegraded":"2023-11-28T11:10:37.515099+0000","last_fullsized":"2023-11-28T11:10:37.515099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515046+0000","last_change":"2023-11-28T11:10:36.528366+0000","last_active":"2023-11-28T11:10:37.515046+0000","last_peered":"2023-11-28T11:10:37.515046+0000","last_clean":"2023-11-28T11:10:37.515046+0000","last_became_active":"2023-11-28T11:10:36.528119+0000","last_became_peered":"2023-11-28T11:10:36.528119+0000","last_unstale":"2023-11-28T11:10:37.515046+0000","last_undegraded":"2023-11-28T11:10:37.515046+0000","last_fullsized":"2023-11-28T11:10:37.515046+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:05.763064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.519077+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:10:36.519077+0000","last_peered":"2023-11-28T11:10:36.519077+0000","last_clean":"2023-11-28T11:10:36.519077+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:10:36.519077+0000","last_undegraded":"2023-11-28T11:10:36.519077+0000","last_fullsized":"2023-11-28T11:10:36.519077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T11:10:31.512848+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:10:31.512848+0000","last_peered":"2023-11-28T11:10:31.512848+0000","last_clean":"2023-11-28T11:10:31.512848+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:10:31.512848+0000","last_undegraded":"2023-11-28T11:10:31.512848+0000","last_fullsized":"2023-11-28T11:10:31.512848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":146,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":32,"acting":32,"num_store_stats":4},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10284,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361556,"statfs":{"total":96636764160,"available":96626233344,"internally_reserved":0,"allocated":1216512,"data_stored":856083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.40000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71799999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.69899999999999995,"15min":0.72199999999999998},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.73899999999999999,"15min":0.76600000000000001},"min":{"1min":0.39700000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82999999999999996,"5min":5.532,"15min":5.532},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.66700000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70499999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67800000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.39500000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.43099999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75800000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.438,"5min":0.437,"15min":0.437},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.501},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.995,"15min":0.995},"last":0.54900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8688,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363152,"statfs":{"total":96636764160,"available":96627867648,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.503,"15min":0.49299999999999999},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.74199999999999999,"15min":0.77600000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65900000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.434},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.74199999999999999,"15min":0.77000000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79500000000000004,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.70699999999999996,"15min":0.73199999999999998},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71699999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.746,"15min":0.77800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72199999999999998,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.48999999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52300000000000002,"15min":0.51800000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.875,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66000000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":1.137,"15min":1.137},"last":0.61099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9000,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362840,"statfs":{"total":96636764160,"available":96627548160,"internally_reserved":0,"allocated":622592,"data_stored":265751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33100000000000002,"15min":0.33500000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.41799999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.496},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.22,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.55500000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33400000000000002,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44700000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.36299999999999999,"15min":0.36599999999999999},"min":{"1min":0.23599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48799999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.54300000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.504,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.63,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82199999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.78500000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78200000000000003,"5min":0.999,"15min":0.999},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.036,"15min":1.036},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84499999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10156,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361684,"statfs":{"total":96636764160,"available":96626364416,"internally_reserved":0,"allocated":1216512,"data_stored":856015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.33900000000000002},"min":{"1min":0.23899999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54200000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32900000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.22600000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.44500000000000001,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.316},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.439,"15min":0.45400000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.58499999999999996,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.309},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.51600000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.35399999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.872,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77500000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":3.298,"15min":3.298},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.72099999999999997,"15min":0.74399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85699999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.56100000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84399999999999997,"5min":0.877,"15min":0.877},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8940,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362900,"statfs":{"total":96636764160,"available":96627609600,"internally_reserved":0,"allocated":626688,"data_stored":267139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.317},"min":{"1min":0.26500000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.47999999999999998,"5min":0.503,"15min":0.503},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36199999999999999,"15min":0.35599999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.503,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.435}]},{"osd":1,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34200000000000003,"15min":0.33600000000000002},"min":{"1min":0.29599999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.504,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.33900000000000002},"min":{"1min":0.26900000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54600000000000004,"5min":1.002,"15min":1.002},"last":0.37}]},{"osd":3,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35499999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.374,"15min":0.36799999999999999},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51600000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73499999999999999,"5min":0.875,"15min":0.875},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.504},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.75600000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52700000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73499999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46000000000000002}]},{"osd":7,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.44800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.80800000000000005,"5min":1.05,"15min":1.05},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.751,"5min":1.222,"15min":1.222},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8944,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362896,"statfs":{"total":96636764160,"available":96627605504,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.36099999999999999,"15min":0.36799999999999999},"min":{"1min":0.22700000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.435,"5min":1.365,"15min":1.365},"last":0.253},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.66300000000000003,"15min":0.72299999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41599999999999998,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.26400000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.73599999999999999,"15min":0.80300000000000005},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45300000000000001,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.39800000000000002,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.44,"5min":1.448,"15min":1.448},"last":0.30399999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.42099999999999999,"15min":0.434},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.52100000000000002,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42499999999999999,"15min":0.42599999999999999},"min":{"1min":0.29099999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.298,"5min":1.474,"15min":1.474},"last":0.39600000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.85499999999999998,"15min":0.90100000000000002},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.94399999999999995,"15min":1.004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.94299999999999995,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.93899999999999995,"15min":0.996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.996,"5min":12.994,"15min":12.994},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.95399999999999996,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.90800000000000003,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97799999999999998,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.97899999999999998,"15min":1.038},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.05,"5min":12.932,"15min":12.932},"last":0.56499999999999995}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.91200000000000003,"15min":0.96199999999999997},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.038,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":8944,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362896,"statfs":{"total":96636764160,"available":96627605504,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.68500000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65500000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52500000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68500000000000005,"5min":0.747,"15min":0.747},"last":0.57799999999999996}]},{"osd":3,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69299999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67000000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.622},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.749}]},{"osd":6,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73099999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72499999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8880,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362960,"statfs":{"total":96636764160,"available":96627671040,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.522,"15min":1.522},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76700000000000002,"5min":1.452,"15min":1.452},"last":0.40400000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76700000000000002,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.442},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.69599999999999995,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68799999999999994,"5min":1.032,"15min":1.032},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":2.282,"15min":2.282},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":1.401,"15min":1.401},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":1.478,"15min":1.478},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.498}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68400000000000005,"15min":0.69699999999999995},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83499999999999996,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.51100000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":2.444,"15min":2.444},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.441,"5min":0.44,"15min":0.44},"max":{"1min":0.90300000000000002,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:10:40.959 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:10:41.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.113+0000 7fa90b284700 1 Processor -- start 2023-11-28T11:10:41.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.113+0000 7fa90b284700 1 -- start start 2023-11-28T11:10:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa90b284700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa90406feb0 0x7fa9040cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa90b284700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9040b4b00 0x7fa9040cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa90b284700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9040b4fc0 con 0x7fa9040ced70 2023-11-28T11:10:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa90b284700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa904159c30 con 0x7fa9040b4b00 2023-11-28T11:10:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa90b284700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040b05e0 con 0x7fa90406feb0 2023-11-28T11:10:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa909821700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9040b4b00 0x7fa9040cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa909020700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa9040ced70 0x7fa9040b43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44388/0 (socket says 172.21.15.125:44388) 2023-11-28T11:10:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa909020700 1 -- 172.21.15.125:0/3853780278 learned_addr learned my addr 172.21.15.125:0/3853780278 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa90881f700 1 --2- 172.21.15.125:0/3853780278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa90406feb0 0x7fa9040cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa909821700 1 -- 172.21.15.125:0/3853780278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa90406feb0 msgr2=0x7fa9040cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa909821700 1 --2- 172.21.15.125:0/3853780278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa90406feb0 0x7fa9040cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa909821700 1 -- 172.21.15.125:0/3853780278 >> v1:172.21.15.125:6789/0 conn(0x7fa9040ced70 legacy=0x7fa9040b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa909821700 1 -- 172.21.15.125:0/3853780278 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040b08c0 con 0x7fa9040b4b00 2023-11-28T11:10:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa8fbfff700 1 -- 172.21.15.125:0/3853780278 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104274234 0 0) 0x7fa9040b4fc0 con 0x7fa9040ced70 2023-11-28T11:10:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa90881f700 1 --2- 172.21.15.125:0/3853780278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa90406feb0 0x7fa9040cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa909821700 1 --2- 172.21.15.125:0/3853780278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9040b4b00 0x7fa9040cd710 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc009d90 tx=0x7fa8fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494ef23c96c84cc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.114+0000 7fa8fbfff700 1 -- 172.21.15.125:0/3853780278 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc00e070 con 0x7fa9040b4b00 2023-11-28T11:10:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.115+0000 7fa8fbfff700 1 -- 172.21.15.125:0/3853780278 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc00bbd0 con 0x7fa9040b4b00 2023-11-28T11:10:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.115+0000 7fa8fbfff700 1 -- 172.21.15.125:0/3853780278 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc012430 con 0x7fa9040b4b00 2023-11-28T11:10:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.115+0000 7fa90b284700 1 -- 172.21.15.125:0/3853780278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9040b4b00 msgr2=0x7fa9040cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.115+0000 7fa90b284700 1 --2- 172.21.15.125:0/3853780278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9040b4b00 0x7fa9040cd710 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc009d90 tx=0x7fa8fc00b330 comp rx=0 tx=0).stop 2023-11-28T11:10:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.115+0000 7fa90b284700 1 -- 172.21.15.125:0/3853780278 shutdown_connections 2023-11-28T11:10:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.115+0000 7fa90b284700 1 --2- 172.21.15.125:0/3853780278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9040b4b00 0x7fa9040cd710 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.115+0000 7fa90b284700 1 --2- 172.21.15.125:0/3853780278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa90406feb0 0x7fa9040cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.115+0000 7fa90b284700 1 -- 172.21.15.125:0/3853780278 >> 172.21.15.125:0/3853780278 conn(0x7fa9040b2fc0 msgr2=0x7fa904071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.115+0000 7fa90b284700 1 -- 172.21.15.125:0/3853780278 shutdown_connections 2023-11-28T11:10:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.115+0000 7fa90b284700 1 -- 172.21.15.125:0/3853780278 wait complete. 2023-11-28T11:10:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.116+0000 7fa90b284700 1 Processor -- start 2023-11-28T11:10:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.116+0000 7fa90b284700 1 -- start start 2023-11-28T11:10:41.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90b284700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90406feb0 0x7fa9040c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90b284700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9040b4b00 0x7fa904098470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90b284700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9040ced70 0x7fa9040cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90b284700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa904098b30 con 0x7fa9040b4b00 2023-11-28T11:10:41.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90b284700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa904094710 con 0x7fa90406feb0 2023-11-28T11:10:41.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90b284700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040949f0 con 0x7fa9040ced70 2023-11-28T11:10:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90881f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9040b4b00 0x7fa904098470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90881f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9040b4b00 0x7fa904098470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60270/0 (socket says 172.21.15.125:60270) 2023-11-28T11:10:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90881f700 1 -- 172.21.15.125:0/2824791781 learned_addr learned my addr 172.21.15.125:0/2824791781 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa909821700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9040ced70 0x7fa9040cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa909020700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90406feb0 0x7fa9040c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90881f700 1 -- 172.21.15.125:0/2824791781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9040ced70 msgr2=0x7fa9040cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90881f700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9040ced70 0x7fa9040cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90881f700 1 -- 172.21.15.125:0/2824791781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90406feb0 msgr2=0x7fa9040c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.117+0000 7fa90881f700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90406feb0 0x7fa9040c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.118+0000 7fa90881f700 1 -- 172.21.15.125:0/2824791781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc009a70 con 0x7fa9040b4b00 2023-11-28T11:10:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.118+0000 7fa90881f700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9040b4b00 0x7fa904098470 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400c750 tx=0x7fa8f400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.118+0000 7fa8f9ffb700 1 -- 172.21.15.125:0/2824791781 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4011800 con 0x7fa9040b4b00 2023-11-28T11:10:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.118+0000 7fa8f9ffb700 1 -- 172.21.15.125:0/2824791781 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4011960 con 0x7fa9040b4b00 2023-11-28T11:10:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.118+0000 7fa90b284700 1 -- 172.21.15.125:0/2824791781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9040b5260 con 0x7fa9040b4b00 2023-11-28T11:10:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.118+0000 7fa8f9ffb700 1 -- 172.21.15.125:0/2824791781 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4011cd0 con 0x7fa9040b4b00 2023-11-28T11:10:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.118+0000 7fa90b284700 1 -- 172.21.15.125:0/2824791781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9040b0ba0 con 0x7fa9040b4b00 2023-11-28T11:10:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.119+0000 7fa90b284700 1 -- 172.21.15.125:0/2824791781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90406b280 con 0x7fa9040b4b00 2023-11-28T11:10:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.119+0000 7fa8f9ffb700 1 -- 172.21.15.125:0/2824791781 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa8f4020070 con 0x7fa9040b4b00 2023-11-28T11:10:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.119+0000 7fa8f9ffb700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8e80682f0 0x7fa8e806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.120+0000 7fa8f9ffb700 1 -- 172.21.15.125:0/2824791781 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8f4085ad0 con 0x7fa9040b4b00 2023-11-28T11:10:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.120+0000 7fa909020700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8e80682f0 0x7fa8e806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.120+0000 7fa909020700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8e80682f0 0x7fa8e806a7a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa900000f60 tx=0x7fa900007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:41.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.124+0000 7fa8f9ffb700 1 -- 172.21.15.125:0/2824791781 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa8f4052330 con 0x7fa9040b4b00 2023-11-28T11:10:41.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.301+0000 7fa90b284700 1 -- 172.21.15.125:0/2824791781 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa904094b60 con 0x7fa8e80682f0 2023-11-28T11:10:41.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.309+0000 7fa8f9ffb700 1 -- 172.21.15.125:0/2824791781 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304153 (secure 0 0 0) 0x7fa904094b60 con 0x7fa8e80682f0 2023-11-28T11:10:41.313 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 -- 172.21.15.125:0/2824791781 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8e80682f0 msgr2=0x7fa8e806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8e80682f0 0x7fa8e806a7a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa900000f60 tx=0x7fa900007c90 comp rx=0 tx=0).stop 2023-11-28T11:10:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 -- 172.21.15.125:0/2824791781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9040b4b00 msgr2=0x7fa904098470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9040b4b00 0x7fa904098470 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400c750 tx=0x7fa8f400cb10 comp rx=0 tx=0).stop 2023-11-28T11:10:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 -- 172.21.15.125:0/2824791781 shutdown_connections 2023-11-28T11:10:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa8e80682f0 0x7fa8e806a7a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9040ced70 0x7fa9040cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90406feb0 0x7fa9040c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 --2- 172.21.15.125:0/2824791781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9040b4b00 0x7fa904098470 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 -- 172.21.15.125:0/2824791781 >> 172.21.15.125:0/2824791781 conn(0x7fa9040b2fc0 msgr2=0x7fa90406d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 -- 172.21.15.125:0/2824791781 shutdown_connections 2023-11-28T11:10:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.312+0000 7fa90b284700 1 -- 172.21.15.125:0/2824791781 wait complete. 2023-11-28T11:10:41.317 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:10:41.324 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-11-28T11:10:39.647519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590514,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":120,"acting":120,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":73836,"kb_used_data":5804,"kb_used_omap":0,"kb_used_meta":67968,"kb_avail":754900884,"statfs":{"total":773094113280,"available":773018505216,"internally_reserved":0,"allocated":5943296,"data_stored":3201036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69599232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":146,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.543967"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514648+0000","last_change":"2023-11-28T11:10:36.524056+0000","last_active":"2023-11-28T11:10:37.514648+0000","last_peered":"2023-11-28T11:10:37.514648+0000","last_clean":"2023-11-28T11:10:37.514648+0000","last_became_active":"2023-11-28T11:10:36.523831+0000","last_became_peered":"2023-11-28T11:10:36.523831+0000","last_unstale":"2023-11-28T11:10:37.514648+0000","last_undegraded":"2023-11-28T11:10:37.514648+0000","last_fullsized":"2023-11-28T11:10:37.514648+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514850+0000","last_change":"2023-11-28T11:10:36.524534+0000","last_active":"2023-11-28T11:10:37.514850+0000","last_peered":"2023-11-28T11:10:37.514850+0000","last_clean":"2023-11-28T11:10:37.514850+0000","last_became_active":"2023-11-28T11:10:36.524236+0000","last_became_peered":"2023-11-28T11:10:36.524236+0000","last_unstale":"2023-11-28T11:10:37.514850+0000","last_undegraded":"2023-11-28T11:10:37.514850+0000","last_fullsized":"2023-11-28T11:10:37.514850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:58.155221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515248+0000","last_change":"2023-11-28T11:10:36.526236+0000","last_active":"2023-11-28T11:10:37.515248+0000","last_peered":"2023-11-28T11:10:37.515248+0000","last_clean":"2023-11-28T11:10:37.515248+0000","last_became_active":"2023-11-28T11:10:36.525526+0000","last_became_peered":"2023-11-28T11:10:36.525526+0000","last_unstale":"2023-11-28T11:10:37.515248+0000","last_undegraded":"2023-11-28T11:10:37.515248+0000","last_fullsized":"2023-11-28T11:10:37.515248+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:27.654161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514746+0000","last_change":"2023-11-28T11:10:36.528064+0000","last_active":"2023-11-28T11:10:37.514746+0000","last_peered":"2023-11-28T11:10:37.514746+0000","last_clean":"2023-11-28T11:10:37.514746+0000","last_became_active":"2023-11-28T11:10:36.527767+0000","last_became_peered":"2023-11-28T11:10:36.527767+0000","last_unstale":"2023-11-28T11:10:37.514746+0000","last_undegraded":"2023-11-28T11:10:37.514746+0000","last_fullsized":"2023-11-28T11:10:37.514746+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:20.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514469+0000","last_change":"2023-11-28T11:10:36.526839+0000","last_active":"2023-11-28T11:10:37.514469+0000","last_peered":"2023-11-28T11:10:37.514469+0000","last_clean":"2023-11-28T11:10:37.514469+0000","last_became_active":"2023-11-28T11:10:36.526583+0000","last_became_peered":"2023-11-28T11:10:36.526583+0000","last_unstale":"2023-11-28T11:10:37.514469+0000","last_undegraded":"2023-11-28T11:10:37.514469+0000","last_fullsized":"2023-11-28T11:10:37.514469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:31.375598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514646+0000","last_change":"2023-11-28T11:10:36.529010+0000","last_active":"2023-11-28T11:10:37.514646+0000","last_peered":"2023-11-28T11:10:37.514646+0000","last_clean":"2023-11-28T11:10:37.514646+0000","last_became_active":"2023-11-28T11:10:36.528687+0000","last_became_peered":"2023-11-28T11:10:36.528687+0000","last_unstale":"2023-11-28T11:10:37.514646+0000","last_undegraded":"2023-11-28T11:10:37.514646+0000","last_fullsized":"2023-11-28T11:10:37.514646+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:50.593011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515454+0000","last_change":"2023-11-28T11:10:36.532181+0000","last_active":"2023-11-28T11:10:37.515454+0000","last_peered":"2023-11-28T11:10:37.515454+0000","last_clean":"2023-11-28T11:10:37.515454+0000","last_became_active":"2023-11-28T11:10:36.531946+0000","last_became_peered":"2023-11-28T11:10:36.531946+0000","last_unstale":"2023-11-28T11:10:37.515454+0000","last_undegraded":"2023-11-28T11:10:37.515454+0000","last_fullsized":"2023-11-28T11:10:37.515454+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:34.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141761+0000","last_change":"2023-11-28T11:10:36.522452+0000","last_active":"2023-11-28T11:10:38.141761+0000","last_peered":"2023-11-28T11:10:38.141761+0000","last_clean":"2023-11-28T11:10:38.141761+0000","last_became_active":"2023-11-28T11:10:36.522201+0000","last_became_peered":"2023-11-28T11:10:36.522201+0000","last_unstale":"2023-11-28T11:10:38.141761+0000","last_undegraded":"2023-11-28T11:10:38.141761+0000","last_fullsized":"2023-11-28T11:10:38.141761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:59:58.033544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514287+0000","last_change":"2023-11-28T11:10:36.534554+0000","last_active":"2023-11-28T11:10:37.514287+0000","last_peered":"2023-11-28T11:10:37.514287+0000","last_clean":"2023-11-28T11:10:37.514287+0000","last_became_active":"2023-11-28T11:10:36.534313+0000","last_became_peered":"2023-11-28T11:10:36.534313+0000","last_unstale":"2023-11-28T11:10:37.514287+0000","last_undegraded":"2023-11-28T11:10:37.514287+0000","last_fullsized":"2023-11-28T11:10:37.514287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:33.764839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515060+0000","last_change":"2023-11-28T11:10:36.525581+0000","last_active":"2023-11-28T11:10:37.515060+0000","last_peered":"2023-11-28T11:10:37.515060+0000","last_clean":"2023-11-28T11:10:37.515060+0000","last_became_active":"2023-11-28T11:10:36.525315+0000","last_became_peered":"2023-11-28T11:10:36.525315+0000","last_unstale":"2023-11-28T11:10:37.515060+0000","last_undegraded":"2023-11-28T11:10:37.515060+0000","last_fullsized":"2023-11-28T11:10:37.515060+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:12.836764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514618+0000","last_change":"2023-11-28T11:10:36.527490+0000","last_active":"2023-11-28T11:10:37.514618+0000","last_peered":"2023-11-28T11:10:37.514618+0000","last_clean":"2023-11-28T11:10:37.514618+0000","last_became_active":"2023-11-28T11:10:36.527219+0000","last_became_peered":"2023-11-28T11:10:36.527219+0000","last_unstale":"2023-11-28T11:10:37.514618+0000","last_undegraded":"2023-11-28T11:10:37.514618+0000","last_fullsized":"2023-11-28T11:10:37.514618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514163+0000","last_change":"2023-11-28T11:10:36.532971+0000","last_active":"2023-11-28T11:10:37.514163+0000","last_peered":"2023-11-28T11:10:37.514163+0000","last_clean":"2023-11-28T11:10:37.514163+0000","last_became_active":"2023-11-28T11:10:36.532729+0000","last_became_peered":"2023-11-28T11:10:36.532729+0000","last_unstale":"2023-11-28T11:10:37.514163+0000","last_undegraded":"2023-11-28T11:10:37.514163+0000","last_fullsized":"2023-11-28T11:10:37.514163+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:20.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515693+0000","last_change":"2023-11-28T11:10:36.528593+0000","last_active":"2023-11-28T11:10:37.515693+0000","last_peered":"2023-11-28T11:10:37.515693+0000","last_clean":"2023-11-28T11:10:37.515693+0000","last_became_active":"2023-11-28T11:10:36.528202+0000","last_became_peered":"2023-11-28T11:10:36.528202+0000","last_unstale":"2023-11-28T11:10:37.515693+0000","last_undegraded":"2023-11-28T11:10:37.515693+0000","last_fullsized":"2023-11-28T11:10:37.515693+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:23.935065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514945+0000","last_change":"2023-11-28T11:10:36.524381+0000","last_active":"2023-11-28T11:10:37.514945+0000","last_peered":"2023-11-28T11:10:37.514945+0000","last_clean":"2023-11-28T11:10:37.514945+0000","last_became_active":"2023-11-28T11:10:36.524095+0000","last_became_peered":"2023-11-28T11:10:36.524095+0000","last_unstale":"2023-11-28T11:10:37.514945+0000","last_undegraded":"2023-11-28T11:10:37.514945+0000","last_fullsized":"2023-11-28T11:10:37.514945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515238+0000","last_change":"2023-11-28T11:10:36.533836+0000","last_active":"2023-11-28T11:10:37.515238+0000","last_peered":"2023-11-28T11:10:37.515238+0000","last_clean":"2023-11-28T11:10:37.515238+0000","last_became_active":"2023-11-28T11:10:36.533560+0000","last_became_peered":"2023-11-28T11:10:36.533560+0000","last_unstale":"2023-11-28T11:10:37.515238+0000","last_undegraded":"2023-11-28T11:10:37.515238+0000","last_fullsized":"2023-11-28T11:10:37.515238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:25.315412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141535+0000","last_change":"2023-11-28T11:10:36.528419+0000","last_active":"2023-11-28T11:10:38.141535+0000","last_peered":"2023-11-28T11:10:38.141535+0000","last_clean":"2023-11-28T11:10:38.141535+0000","last_became_active":"2023-11-28T11:10:36.527321+0000","last_became_peered":"2023-11-28T11:10:36.527321+0000","last_unstale":"2023-11-28T11:10:38.141535+0000","last_undegraded":"2023-11-28T11:10:38.141535+0000","last_fullsized":"2023-11-28T11:10:38.141535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:06.424953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514471+0000","last_change":"2023-11-28T11:10:36.525552+0000","last_active":"2023-11-28T11:10:37.514471+0000","last_peered":"2023-11-28T11:10:37.514471+0000","last_clean":"2023-11-28T11:10:37.514471+0000","last_became_active":"2023-11-28T11:10:36.525301+0000","last_became_peered":"2023-11-28T11:10:36.525301+0000","last_unstale":"2023-11-28T11:10:37.514471+0000","last_undegraded":"2023-11-28T11:10:37.514471+0000","last_fullsized":"2023-11-28T11:10:37.514471+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:57.807839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515621+0000","last_change":"2023-11-28T11:10:36.538677+0000","last_active":"2023-11-28T11:10:37.515621+0000","last_peered":"2023-11-28T11:10:37.515621+0000","last_clean":"2023-11-28T11:10:37.515621+0000","last_became_active":"2023-11-28T11:10:36.538336+0000","last_became_peered":"2023-11-28T11:10:36.538336+0000","last_unstale":"2023-11-28T11:10:37.515621+0000","last_undegraded":"2023-11-28T11:10:37.515621+0000","last_fullsized":"2023-11-28T11:10:37.515621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:04.544184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515008+0000","last_change":"2023-11-28T11:10:36.535214+0000","last_active":"2023-11-28T11:10:37.515008+0000","last_peered":"2023-11-28T11:10:37.515008+0000","last_clean":"2023-11-28T11:10:37.515008+0000","last_became_active":"2023-11-28T11:10:36.534981+0000","last_became_peered":"2023-11-28T11:10:36.534981+0000","last_unstale":"2023-11-28T11:10:37.515008+0000","last_undegraded":"2023-11-28T11:10:37.515008+0000","last_fullsized":"2023-11-28T11:10:37.515008+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:19.190582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514668+0000","last_change":"2023-11-28T11:10:36.528010+0000","last_active":"2023-11-28T11:10:37.514668+0000","last_peered":"2023-11-28T11:10:37.514668+0000","last_clean":"2023-11-28T11:10:37.514668+0000","last_became_active":"2023-11-28T11:10:36.527719+0000","last_became_peered":"2023-11-28T11:10:36.527719+0000","last_unstale":"2023-11-28T11:10:37.514668+0000","last_undegraded":"2023-11-28T11:10:37.514668+0000","last_fullsized":"2023-11-28T11:10:37.514668+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:58.531465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514890+0000","last_change":"2023-11-28T11:10:36.522035+0000","last_active":"2023-11-28T11:10:37.514890+0000","last_peered":"2023-11-28T11:10:37.514890+0000","last_clean":"2023-11-28T11:10:37.514890+0000","last_became_active":"2023-11-28T11:10:36.521763+0000","last_became_peered":"2023-11-28T11:10:36.521763+0000","last_unstale":"2023-11-28T11:10:37.514890+0000","last_undegraded":"2023-11-28T11:10:37.514890+0000","last_fullsized":"2023-11-28T11:10:37.514890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514820+0000","last_change":"2023-11-28T11:10:36.528832+0000","last_active":"2023-11-28T11:10:37.514820+0000","last_peered":"2023-11-28T11:10:37.514820+0000","last_clean":"2023-11-28T11:10:37.514820+0000","last_became_active":"2023-11-28T11:10:36.528558+0000","last_became_peered":"2023-11-28T11:10:36.528558+0000","last_unstale":"2023-11-28T11:10:37.514820+0000","last_undegraded":"2023-11-28T11:10:37.514820+0000","last_fullsized":"2023-11-28T11:10:37.514820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:28.375662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514434+0000","last_change":"2023-11-28T11:10:36.524969+0000","last_active":"2023-11-28T11:10:37.514434+0000","last_peered":"2023-11-28T11:10:37.514434+0000","last_clean":"2023-11-28T11:10:37.514434+0000","last_became_active":"2023-11-28T11:10:36.524710+0000","last_became_peered":"2023-11-28T11:10:36.524710+0000","last_unstale":"2023-11-28T11:10:37.514434+0000","last_undegraded":"2023-11-28T11:10:37.514434+0000","last_fullsized":"2023-11-28T11:10:37.514434+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:02:40.345280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515505+0000","last_change":"2023-11-28T11:10:36.133446+0000","last_active":"2023-11-28T11:10:37.515505+0000","last_peered":"2023-11-28T11:10:37.515505+0000","last_clean":"2023-11-28T11:10:37.515505+0000","last_became_active":"2023-11-28T11:10:36.133184+0000","last_became_peered":"2023-11-28T11:10:36.133184+0000","last_unstale":"2023-11-28T11:10:37.515505+0000","last_undegraded":"2023-11-28T11:10:37.515505+0000","last_fullsized":"2023-11-28T11:10:37.515505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:13.129227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515095+0000","last_change":"2023-11-28T11:10:36.133435+0000","last_active":"2023-11-28T11:10:37.515095+0000","last_peered":"2023-11-28T11:10:37.515095+0000","last_clean":"2023-11-28T11:10:37.515095+0000","last_became_active":"2023-11-28T11:10:36.133156+0000","last_became_peered":"2023-11-28T11:10:36.133156+0000","last_unstale":"2023-11-28T11:10:37.515095+0000","last_undegraded":"2023-11-28T11:10:37.515095+0000","last_fullsized":"2023-11-28T11:10:37.515095+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:32.589064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514762+0000","last_change":"2023-11-28T11:10:36.119665+0000","last_active":"2023-11-28T11:10:37.514762+0000","last_peered":"2023-11-28T11:10:37.514762+0000","last_clean":"2023-11-28T11:10:37.514762+0000","last_became_active":"2023-11-28T11:10:36.117416+0000","last_became_peered":"2023-11-28T11:10:36.117416+0000","last_unstale":"2023-11-28T11:10:37.514762+0000","last_undegraded":"2023-11-28T11:10:37.514762+0000","last_fullsized":"2023-11-28T11:10:37.514762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:33.877212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515023+0000","last_change":"2023-11-28T11:10:36.523569+0000","last_active":"2023-11-28T11:10:37.515023+0000","last_peered":"2023-11-28T11:10:37.515023+0000","last_clean":"2023-11-28T11:10:37.515023+0000","last_became_active":"2023-11-28T11:10:36.523302+0000","last_became_peered":"2023-11-28T11:10:36.523302+0000","last_unstale":"2023-11-28T11:10:37.515023+0000","last_undegraded":"2023-11-28T11:10:37.515023+0000","last_fullsized":"2023-11-28T11:10:37.515023+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:48.693779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514850+0000","last_change":"2023-11-28T11:10:36.528489+0000","last_active":"2023-11-28T11:10:37.514850+0000","last_peered":"2023-11-28T11:10:37.514850+0000","last_clean":"2023-11-28T11:10:37.514850+0000","last_became_active":"2023-11-28T11:10:36.528196+0000","last_became_peered":"2023-11-28T11:10:36.528196+0000","last_unstale":"2023-11-28T11:10:37.514850+0000","last_undegraded":"2023-11-28T11:10:37.514850+0000","last_fullsized":"2023-11-28T11:10:37.514850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.833897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514973+0000","last_change":"2023-11-28T11:10:36.126539+0000","last_active":"2023-11-28T11:10:37.514973+0000","last_peered":"2023-11-28T11:10:37.514973+0000","last_clean":"2023-11-28T11:10:37.514973+0000","last_became_active":"2023-11-28T11:10:36.126227+0000","last_became_peered":"2023-11-28T11:10:36.126227+0000","last_unstale":"2023-11-28T11:10:37.514973+0000","last_undegraded":"2023-11-28T11:10:37.514973+0000","last_fullsized":"2023-11-28T11:10:37.514973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:28.022412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515008+0000","last_change":"2023-11-28T11:10:36.123501+0000","last_active":"2023-11-28T11:10:37.515008+0000","last_peered":"2023-11-28T11:10:37.515008+0000","last_clean":"2023-11-28T11:10:37.515008+0000","last_became_active":"2023-11-28T11:10:36.122933+0000","last_became_peered":"2023-11-28T11:10:36.122933+0000","last_unstale":"2023-11-28T11:10:37.515008+0000","last_undegraded":"2023-11-28T11:10:37.515008+0000","last_fullsized":"2023-11-28T11:10:37.515008+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:32.757363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514980+0000","last_change":"2023-11-28T11:10:36.524201+0000","last_active":"2023-11-28T11:10:37.514980+0000","last_peered":"2023-11-28T11:10:37.514980+0000","last_clean":"2023-11-28T11:10:37.514980+0000","last_became_active":"2023-11-28T11:10:36.521915+0000","last_became_peered":"2023-11-28T11:10:36.521915+0000","last_unstale":"2023-11-28T11:10:37.514980+0000","last_undegraded":"2023-11-28T11:10:37.514980+0000","last_fullsized":"2023-11-28T11:10:37.514980+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:19:19.207096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514992+0000","last_change":"2023-11-28T11:10:36.136502+0000","last_active":"2023-11-28T11:10:37.514992+0000","last_peered":"2023-11-28T11:10:37.514992+0000","last_clean":"2023-11-28T11:10:37.514992+0000","last_became_active":"2023-11-28T11:10:36.136213+0000","last_became_peered":"2023-11-28T11:10:36.136213+0000","last_unstale":"2023-11-28T11:10:37.514992+0000","last_undegraded":"2023-11-28T11:10:37.514992+0000","last_fullsized":"2023-11-28T11:10:37.514992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:28.022412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514858+0000","last_change":"2023-11-28T11:10:36.118915+0000","last_active":"2023-11-28T11:10:37.514858+0000","last_peered":"2023-11-28T11:10:37.514858+0000","last_clean":"2023-11-28T11:10:37.514858+0000","last_became_active":"2023-11-28T11:10:36.118661+0000","last_became_peered":"2023-11-28T11:10:36.118661+0000","last_unstale":"2023-11-28T11:10:37.514858+0000","last_undegraded":"2023-11-28T11:10:37.514858+0000","last_fullsized":"2023-11-28T11:10:37.514858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:30.368123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515289+0000","last_change":"2023-11-28T11:10:36.528346+0000","last_active":"2023-11-28T11:10:37.515289+0000","last_peered":"2023-11-28T11:10:37.515289+0000","last_clean":"2023-11-28T11:10:37.515289+0000","last_became_active":"2023-11-28T11:10:36.528097+0000","last_became_peered":"2023-11-28T11:10:36.528097+0000","last_unstale":"2023-11-28T11:10:37.515289+0000","last_undegraded":"2023-11-28T11:10:37.515289+0000","last_fullsized":"2023-11-28T11:10:37.515289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:33.646649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515092+0000","last_change":"2023-11-28T11:10:36.123367+0000","last_active":"2023-11-28T11:10:37.515092+0000","last_peered":"2023-11-28T11:10:37.515092+0000","last_clean":"2023-11-28T11:10:37.515092+0000","last_became_active":"2023-11-28T11:10:36.122981+0000","last_became_peered":"2023-11-28T11:10:36.122981+0000","last_unstale":"2023-11-28T11:10:37.515092+0000","last_undegraded":"2023-11-28T11:10:37.515092+0000","last_fullsized":"2023-11-28T11:10:37.515092+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:33:27.881264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515752+0000","last_change":"2023-11-28T11:10:36.528470+0000","last_active":"2023-11-28T11:10:37.515752+0000","last_peered":"2023-11-28T11:10:37.515752+0000","last_clean":"2023-11-28T11:10:37.515752+0000","last_became_active":"2023-11-28T11:10:36.527851+0000","last_became_peered":"2023-11-28T11:10:36.527851+0000","last_unstale":"2023-11-28T11:10:37.515752+0000","last_undegraded":"2023-11-28T11:10:37.515752+0000","last_fullsized":"2023-11-28T11:10:37.515752+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:10.382472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515505+0000","last_change":"2023-11-28T11:10:36.126441+0000","last_active":"2023-11-28T11:10:37.515505+0000","last_peered":"2023-11-28T11:10:37.515505+0000","last_clean":"2023-11-28T11:10:37.515505+0000","last_became_active":"2023-11-28T11:10:36.125967+0000","last_became_peered":"2023-11-28T11:10:36.125967+0000","last_unstale":"2023-11-28T11:10:37.515505+0000","last_undegraded":"2023-11-28T11:10:37.515505+0000","last_fullsized":"2023-11-28T11:10:37.515505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:08.438167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514473+0000","last_change":"2023-11-28T11:10:36.531244+0000","last_active":"2023-11-28T11:10:37.514473+0000","last_peered":"2023-11-28T11:10:37.514473+0000","last_clean":"2023-11-28T11:10:37.514473+0000","last_became_active":"2023-11-28T11:10:36.530978+0000","last_became_peered":"2023-11-28T11:10:36.530978+0000","last_unstale":"2023-11-28T11:10:37.514473+0000","last_undegraded":"2023-11-28T11:10:37.514473+0000","last_fullsized":"2023-11-28T11:10:37.514473+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.833897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141759+0000","last_change":"2023-11-28T11:10:36.123203+0000","last_active":"2023-11-28T11:10:38.141759+0000","last_peered":"2023-11-28T11:10:38.141759+0000","last_clean":"2023-11-28T11:10:38.141759+0000","last_became_active":"2023-11-28T11:10:36.122988+0000","last_became_peered":"2023-11-28T11:10:36.122988+0000","last_unstale":"2023-11-28T11:10:38.141759+0000","last_undegraded":"2023-11-28T11:10:38.141759+0000","last_fullsized":"2023-11-28T11:10:38.141759+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:33.478864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514472+0000","last_change":"2023-11-28T11:10:36.524080+0000","last_active":"2023-11-28T11:10:37.514472+0000","last_peered":"2023-11-28T11:10:37.514472+0000","last_clean":"2023-11-28T11:10:37.514472+0000","last_became_active":"2023-11-28T11:10:36.523831+0000","last_became_peered":"2023-11-28T11:10:36.523831+0000","last_unstale":"2023-11-28T11:10:37.514472+0000","last_undegraded":"2023-11-28T11:10:37.514472+0000","last_fullsized":"2023-11-28T11:10:37.514472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514367+0000","last_change":"2023-11-28T11:10:36.136094+0000","last_active":"2023-11-28T11:10:37.514367+0000","last_peered":"2023-11-28T11:10:37.514367+0000","last_clean":"2023-11-28T11:10:37.514367+0000","last_became_active":"2023-11-28T11:10:36.135780+0000","last_became_peered":"2023-11-28T11:10:36.135780+0000","last_unstale":"2023-11-28T11:10:37.514367+0000","last_undegraded":"2023-11-28T11:10:37.514367+0000","last_fullsized":"2023-11-28T11:10:37.514367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:08.762868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515424+0000","last_change":"2023-11-28T11:10:36.529075+0000","last_active":"2023-11-28T11:10:37.515424+0000","last_peered":"2023-11-28T11:10:37.515424+0000","last_clean":"2023-11-28T11:10:37.515424+0000","last_became_active":"2023-11-28T11:10:36.528708+0000","last_became_peered":"2023-11-28T11:10:36.528708+0000","last_unstale":"2023-11-28T11:10:37.515424+0000","last_undegraded":"2023-11-28T11:10:37.515424+0000","last_fullsized":"2023-11-28T11:10:37.515424+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514729+0000","last_change":"2023-11-28T11:10:36.136681+0000","last_active":"2023-11-28T11:10:37.514729+0000","last_peered":"2023-11-28T11:10:37.514729+0000","last_clean":"2023-11-28T11:10:37.514729+0000","last_became_active":"2023-11-28T11:10:36.136334+0000","last_became_peered":"2023-11-28T11:10:36.136334+0000","last_unstale":"2023-11-28T11:10:37.514729+0000","last_undegraded":"2023-11-28T11:10:37.514729+0000","last_fullsized":"2023-11-28T11:10:37.514729+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:32.757363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514740+0000","last_change":"2023-11-28T11:10:36.527508+0000","last_active":"2023-11-28T11:10:37.514740+0000","last_peered":"2023-11-28T11:10:37.514740+0000","last_clean":"2023-11-28T11:10:37.514740+0000","last_became_active":"2023-11-28T11:10:36.527266+0000","last_became_peered":"2023-11-28T11:10:36.527266+0000","last_unstale":"2023-11-28T11:10:37.514740+0000","last_undegraded":"2023-11-28T11:10:37.514740+0000","last_fullsized":"2023-11-28T11:10:37.514740+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:42.678837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141490+0000","last_change":"2023-11-28T11:10:36.118325+0000","last_active":"2023-11-28T11:10:38.141490+0000","last_peered":"2023-11-28T11:10:38.141490+0000","last_clean":"2023-11-28T11:10:38.141490+0000","last_became_active":"2023-11-28T11:10:36.117983+0000","last_became_peered":"2023-11-28T11:10:36.117983+0000","last_unstale":"2023-11-28T11:10:38.141490+0000","last_undegraded":"2023-11-28T11:10:38.141490+0000","last_fullsized":"2023-11-28T11:10:38.141490+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:25.568140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515333+0000","last_change":"2023-11-28T11:10:36.527082+0000","last_active":"2023-11-28T11:10:37.515333+0000","last_peered":"2023-11-28T11:10:37.515333+0000","last_clean":"2023-11-28T11:10:37.515333+0000","last_became_active":"2023-11-28T11:10:36.526836+0000","last_became_peered":"2023-11-28T11:10:36.526836+0000","last_unstale":"2023-11-28T11:10:37.515333+0000","last_undegraded":"2023-11-28T11:10:37.515333+0000","last_fullsized":"2023-11-28T11:10:37.515333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:51.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515629+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:10:37.515629+0000","last_peered":"2023-11-28T11:10:37.515629+0000","last_clean":"2023-11-28T11:10:37.515629+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:10:37.515629+0000","last_undegraded":"2023-11-28T11:10:37.515629+0000","last_fullsized":"2023-11-28T11:10:37.515629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T11:10:31.512272+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:10:31.512272+0000","last_peered":"2023-11-28T11:10:31.512272+0000","last_clean":"2023-11-28T11:10:31.512272+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:10:31.512272+0000","last_undegraded":"2023-11-28T11:10:31.512272+0000","last_fullsized":"2023-11-28T11:10:31.512272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515180+0000","last_change":"2023-11-28T11:10:36.126778+0000","last_active":"2023-11-28T11:10:37.515180+0000","last_peered":"2023-11-28T11:10:37.515180+0000","last_clean":"2023-11-28T11:10:37.515180+0000","last_became_active":"2023-11-28T11:10:36.126275+0000","last_became_peered":"2023-11-28T11:10:36.126275+0000","last_unstale":"2023-11-28T11:10:37.515180+0000","last_undegraded":"2023-11-28T11:10:37.515180+0000","last_fullsized":"2023-11-28T11:10:37.515180+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:04.198577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141619+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:10:38.141619+0000","last_peered":"2023-11-28T11:10:38.141619+0000","last_clean":"2023-11-28T11:10:38.141619+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:10:38.141619+0000","last_undegraded":"2023-11-28T11:10:38.141619+0000","last_fullsized":"2023-11-28T11:10:38.141619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515501+0000","last_change":"2023-11-28T11:10:36.119977+0000","last_active":"2023-11-28T11:10:37.515501+0000","last_peered":"2023-11-28T11:10:37.515501+0000","last_clean":"2023-11-28T11:10:37.515501+0000","last_became_active":"2023-11-28T11:10:36.117081+0000","last_became_peered":"2023-11-28T11:10:36.117081+0000","last_unstale":"2023-11-28T11:10:37.515501+0000","last_undegraded":"2023-11-28T11:10:37.515501+0000","last_fullsized":"2023-11-28T11:10:37.515501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:08.312145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T11:10:31.512270+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:10:31.512270+0000","last_peered":"2023-11-28T11:10:31.512270+0000","last_clean":"2023-11-28T11:10:31.512270+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:10:31.512270+0000","last_undegraded":"2023-11-28T11:10:31.512270+0000","last_fullsized":"2023-11-28T11:10:31.512270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.513577+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:10:36.513577+0000","last_peered":"2023-11-28T11:10:36.513577+0000","last_clean":"2023-11-28T11:10:36.513577+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:10:36.513577+0000","last_undegraded":"2023-11-28T11:10:36.513577+0000","last_fullsized":"2023-11-28T11:10:36.513577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514556+0000","last_change":"2023-11-28T11:10:36.529294+0000","last_active":"2023-11-28T11:10:37.514556+0000","last_peered":"2023-11-28T11:10:37.514556+0000","last_clean":"2023-11-28T11:10:37.514556+0000","last_became_active":"2023-11-28T11:10:36.529051+0000","last_became_peered":"2023-11-28T11:10:36.529051+0000","last_unstale":"2023-11-28T11:10:37.514556+0000","last_undegraded":"2023-11-28T11:10:37.514556+0000","last_fullsized":"2023-11-28T11:10:37.514556+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:09.319621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515058+0000","last_change":"2023-11-28T11:10:36.124673+0000","last_active":"2023-11-28T11:10:37.515058+0000","last_peered":"2023-11-28T11:10:37.515058+0000","last_clean":"2023-11-28T11:10:37.515058+0000","last_became_active":"2023-11-28T11:10:36.124359+0000","last_became_peered":"2023-11-28T11:10:36.124359+0000","last_unstale":"2023-11-28T11:10:37.515058+0000","last_undegraded":"2023-11-28T11:10:37.515058+0000","last_fullsized":"2023-11-28T11:10:37.515058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:34.374591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.513691+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:10:36.513691+0000","last_peered":"2023-11-28T11:10:36.513691+0000","last_clean":"2023-11-28T11:10:36.513691+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:10:36.513691+0000","last_undegraded":"2023-11-28T11:10:36.513691+0000","last_fullsized":"2023-11-28T11:10:36.513691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515099+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:10:37.515099+0000","last_peered":"2023-11-28T11:10:37.515099+0000","last_clean":"2023-11-28T11:10:37.515099+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:10:37.515099+0000","last_undegraded":"2023-11-28T11:10:37.515099+0000","last_fullsized":"2023-11-28T11:10:37.515099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515046+0000","last_change":"2023-11-28T11:10:36.528366+0000","last_active":"2023-11-28T11:10:37.515046+0000","last_peered":"2023-11-28T11:10:37.515046+0000","last_clean":"2023-11-28T11:10:37.515046+0000","last_became_active":"2023-11-28T11:10:36.528119+0000","last_became_peered":"2023-11-28T11:10:36.528119+0000","last_unstale":"2023-11-28T11:10:37.515046+0000","last_undegraded":"2023-11-28T11:10:37.515046+0000","last_fullsized":"2023-11-28T11:10:37.515046+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:05.763064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.519077+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:10:36.519077+0000","last_peered":"2023-11-28T11:10:36.519077+0000","last_clean":"2023-11-28T11:10:36.519077+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:10:36.519077+0000","last_undegraded":"2023-11-28T11:10:36.519077+0000","last_fullsized":"2023-11-28T11:10:36.519077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:36.103568+0000","last_change":"2023-11-28T11:10:36.103568+0000","last_active":"2023-11-28T11:10:36.103568+0000","last_peered":"2023-11-28T11:10:36.103568+0000","last_clean":"2023-11-28T11:10:36.103568+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:36.103568+0000","last_undegraded":"2023-11-28T11:10:36.103568+0000","last_fullsized":"2023-11-28T11:10:36.103568+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:10:35.096092+0000","last_change":"2023-11-28T11:10:35.096092+0000","last_active":"2023-11-28T11:10:35.096092+0000","last_peered":"2023-11-28T11:10:35.096092+0000","last_clean":"2023-11-28T11:10:35.096092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:10:35.096092+0000","last_undegraded":"2023-11-28T11:10:35.096092+0000","last_fullsized":"2023-11-28T11:10:35.096092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T11:10:31.512848+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:10:31.512848+0000","last_peered":"2023-11-28T11:10:31.512848+0000","last_clean":"2023-11-28T11:10:31.512848+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:10:31.512848+0000","last_undegraded":"2023-11-28T11:10:31.512848+0000","last_fullsized":"2023-11-28T11:10:31.512848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":146,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":32,"acting":32,"num_store_stats":4},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10284,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361556,"statfs":{"total":96636764160,"available":96626233344,"internally_reserved":0,"allocated":1216512,"data_stored":856083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.40000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71799999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.69899999999999995,"15min":0.72199999999999998},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.73899999999999999,"15min":0.76600000000000001},"min":{"1min":0.39700000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82999999999999996,"5min":5.532,"15min":5.532},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.66700000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70499999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67800000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.39500000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.43099999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75800000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.438,"5min":0.437,"15min":0.437},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.501},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.995,"15min":0.995},"last":0.54900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8688,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363152,"statfs":{"total":96636764160,"available":96627867648,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.503,"15min":0.49299999999999999},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.74199999999999999,"15min":0.77600000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65900000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.434},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.74199999999999999,"15min":0.77000000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79500000000000004,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.70699999999999996,"15min":0.73199999999999998},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71699999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.746,"15min":0.77800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72199999999999998,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.48999999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52300000000000002,"15min":0.51800000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.875,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66000000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":1.137,"15min":1.137},"last":0.61099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9000,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362840,"statfs":{"total":96636764160,"available":96627548160,"internally_reserved":0,"allocated":622592,"data_stored":265751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33100000000000002,"15min":0.33500000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.41799999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.496},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.22,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.55500000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33400000000000002,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44700000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.36299999999999999,"15min":0.36599999999999999},"min":{"1min":0.23599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48799999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.54300000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.504,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.63,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82199999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.78500000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78200000000000003,"5min":0.999,"15min":0.999},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.036,"15min":1.036},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84499999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10156,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361684,"statfs":{"total":96636764160,"available":96626364416,"internally_reserved":0,"allocated":1216512,"data_stored":856015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.33900000000000002},"min":{"1min":0.23899999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54200000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32900000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.22600000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.44500000000000001,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.316},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.439,"15min":0.45400000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.58499999999999996,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.309},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.51600000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.35399999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.872,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77500000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":3.298,"15min":3.298},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.72099999999999997,"15min":0.74399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85699999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.56100000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84399999999999997,"5min":0.877,"15min":0.877},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8940,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362900,"statfs":{"total":96636764160,"available":96627609600,"internally_reserved":0,"allocated":626688,"data_stored":267139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.317},"min":{"1min":0.26500000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.47999999999999998,"5min":0.503,"15min":0.503},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36199999999999999,"15min":0.35599999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.503,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.435}]},{"osd":1,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34200000000000003,"15min":0.33600000000000002},"min":{"1min":0.29599999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.504,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.33900000000000002},"min":{"1min":0.26900000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54600000000000004,"5min":1.002,"15min":1.002},"last":0.37}]},{"osd":3,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35499999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.374,"15min":0.36799999999999999},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51600000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73499999999999999,"5min":0.875,"15min":0.875},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.504},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.75600000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52700000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73499999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46000000000000002}]},{"osd":7,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.44800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.80800000000000005,"5min":1.05,"15min":1.05},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.751,"5min":1.222,"15min":1.222},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8944,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362896,"statfs":{"total":96636764160,"available":96627605504,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.36099999999999999,"15min":0.36799999999999999},"min":{"1min":0.22700000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.435,"5min":1.365,"15min":1.365},"last":0.253},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.66300000000000003,"15min":0.72299999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41599999999999998,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.26400000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.73599999999999999,"15min":0.80300000000000005},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45300000000000001,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.39800000000000002,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.44,"5min":1.448,"15min":1.448},"last":0.30399999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.42099999999999999,"15min":0.434},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.52100000000000002,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42499999999999999,"15min":0.42599999999999999},"min":{"1min":0.29099999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.298,"5min":1.474,"15min":1.474},"last":0.39600000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.85499999999999998,"15min":0.90100000000000002},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.94399999999999995,"15min":1.004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.94299999999999995,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.93899999999999995,"15min":0.996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.996,"5min":12.994,"15min":12.994},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.95399999999999996,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.90800000000000003,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97799999999999998,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.97899999999999998,"15min":1.038},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.05,"5min":12.932,"15min":12.932},"last":0.56499999999999995}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.91200000000000003,"15min":0.96199999999999997},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.038,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":8944,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362896,"statfs":{"total":96636764160,"available":96627605504,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.68500000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65500000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52500000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68500000000000005,"5min":0.747,"15min":0.747},"last":0.57799999999999996}]},{"osd":3,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69299999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67000000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.622},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.749}]},{"osd":6,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73099999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72499999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8880,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362960,"statfs":{"total":96636764160,"available":96627671040,"internally_reserved":0,"allocated":565248,"data_stored":239012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.522,"15min":1.522},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76700000000000002,"5min":1.452,"15min":1.452},"last":0.40400000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76700000000000002,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.442},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.69599999999999995,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68799999999999994,"5min":1.032,"15min":1.032},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":2.282,"15min":2.282},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":1.401,"15min":1.401},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":1.478,"15min":1.478},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.498}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68400000000000005,"15min":0.69699999999999995},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83499999999999996,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.51100000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":2.444,"15min":2.444},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.441,"5min":0.44,"15min":0.44},"max":{"1min":0.90300000000000002,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:10:41.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-11-28T11:10:41.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-11-28T11:10:41.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-11-28T11:10:41.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-11-28T11:10:41.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-11-28T11:10:41.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-11-28T11:10:41.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-11-28T11:10:41.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-11-28T11:10:41.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-11-28T11:10:41.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-11-28T11:10:41.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-11-28T11:10:41.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-11-28T11:10:41.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-11-28T11:10:41.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-11-28T11:10:41.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-11-28T11:10:41.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-11-28T11:10:41.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-11-28T11:10:41.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-11-28T11:10:41.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-11-28T11:10:41.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-11-28T11:10:41.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-11-28T11:10:41.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-11-28T11:10:41.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-11-28T11:10:41.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-11-28T11:10:41.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-11-28T11:10:41.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-11-28T11:10:41.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-11-28T11:10:41.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-11-28T11:10:41.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-11-28T11:10:41.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-11-28T11:10:41.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-11-28T11:10:41.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-11-28T11:10:41.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-11-28T11:10:41.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-11-28T11:10:41.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-11-28T11:10:41.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-11-28T11:10:41.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-11-28T11:10:41.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-11-28T11:10:41.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-11-28T11:10:41.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-11-28T11:10:41.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-11-28T11:10:41.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-11-28T11:10:41.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-11-28T11:10:41.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-11-28T11:10:41.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:36.103568+0000', 'last_change': '2023-11-28T11:10:36.103568+0000', 'last_active': '2023-11-28T11:10:36.103568+0000', 'last_peered': '2023-11-28T11:10:36.103568+0000', 'last_clean': '2023-11-28T11:10:36.103568+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:36.103568+0000', 'last_undegraded': '2023-11-28T11:10:36.103568+0000', 'last_fullsized': '2023-11-28T11:10:36.103568+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:36.103568+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-11-28T11:10:41.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:10:35.096092+0000', 'last_change': '2023-11-28T11:10:35.096092+0000', 'last_active': '2023-11-28T11:10:35.096092+0000', 'last_peered': '2023-11-28T11:10:35.096092+0000', 'last_clean': '2023-11-28T11:10:35.096092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:10:35.096092+0000', 'last_undegraded': '2023-11-28T11:10:35.096092+0000', 'last_fullsized': '2023-11-28T11:10:35.096092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'last_clean_scrub_stamp': '2023-11-28T11:10:35.096092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:10:41.344 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T11:10:41.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.481+0000 7fe0640a0700 1 Processor -- start 2023-11-28T11:10:41.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.482+0000 7fe0640a0700 1 -- start start 2023-11-28T11:10:41.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.482+0000 7fe0640a0700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe05c0d0c60 0x7fe05c0b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.482+0000 7fe0640a0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c160e70 0x7fe05c15c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.482+0000 7fe0640a0700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c06e900 con 0x7fe05c06e400 2023-11-28T11:10:41.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.482+0000 7fe0640a0700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c160390 con 0x7fe05c0d0c60 2023-11-28T11:10:41.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.482+0000 7fe0640a0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c160670 con 0x7fe05c160e70 2023-11-28T11:10:41.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe06263d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c160e70 0x7fe05c15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe061e3c700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe05c0d0c60 0x7fe05c0b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe06163b700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe05c06e400 0x7fe05c0d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:47204/0 (socket says 172.21.15.125:47204) 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe061e3c700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe05c0d0c60 0x7fe05c0b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:57008/0 (socket says 172.21.15.125:57008) 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe06163b700 1 -- 172.21.15.125:0/354748356 learned_addr learned my addr 172.21.15.125:0/354748356 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe06263d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c160e70 0x7fe05c15c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:55290/0 (socket says 172.21.15.125:55290) 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe06263d700 1 -- 172.21.15.125:0/354748356 >> v2:172.21.15.167:3300/0 conn(0x7fe05c0d0c60 msgr2=0x7fe05c0b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe06263d700 1 --2- 172.21.15.125:0/354748356 >> v2:172.21.15.167:3300/0 conn(0x7fe05c0d0c60 0x7fe05c0b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe06263d700 1 -- 172.21.15.125:0/354748356 >> v1:172.21.15.167:6789/0 conn(0x7fe05c06e400 legacy=0x7fe05c0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe06263d700 1 -- 172.21.15.125:0/354748356 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c160950 con 0x7fe05c160e70 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe061e3c700 1 --2- 172.21.15.125:0/354748356 >> v2:172.21.15.167:3300/0 conn(0x7fe05c0d0c60 0x7fe05c0b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.483+0000 7fe06263d700 1 --2- 172.21.15.125:0/354748356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c160e70 0x7fe05c15c970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe054009d90 tx=0x7fe05400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1976d99b2def468 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.484+0000 7fe060e3a700 1 -- 172.21.15.125:0/354748356 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05400e070 con 0x7fe05c160e70 2023-11-28T11:10:41.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.484+0000 7fe060e3a700 1 -- 172.21.15.125:0/354748356 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05400bb20 con 0x7fe05c160e70 2023-11-28T11:10:41.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.484+0000 7fe060e3a700 1 -- 172.21.15.125:0/354748356 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054012430 con 0x7fe05c160e70 2023-11-28T11:10:41.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.484+0000 7fe0640a0700 1 -- 172.21.15.125:0/354748356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c160e70 msgr2=0x7fe05c15c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.484+0000 7fe0640a0700 1 --2- 172.21.15.125:0/354748356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c160e70 0x7fe05c15c970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe054009d90 tx=0x7fe05400b330 comp rx=0 tx=0).stop 2023-11-28T11:10:41.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.484+0000 7fe0640a0700 1 -- 172.21.15.125:0/354748356 shutdown_connections 2023-11-28T11:10:41.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.484+0000 7fe0640a0700 1 --2- 172.21.15.125:0/354748356 >> v2:172.21.15.167:3300/0 conn(0x7fe05c0d0c60 0x7fe05c0b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.484+0000 7fe0640a0700 1 --2- 172.21.15.125:0/354748356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c160e70 0x7fe05c15c970 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.484+0000 7fe0640a0700 1 -- 172.21.15.125:0/354748356 >> 172.21.15.125:0/354748356 conn(0x7fe05c06a270 msgr2=0x7fe05c06a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:41.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.484+0000 7fe0640a0700 1 -- 172.21.15.125:0/354748356 shutdown_connections 2023-11-28T11:10:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.484+0000 7fe0640a0700 1 -- 172.21.15.125:0/354748356 wait complete. 2023-11-28T11:10:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.485+0000 7fe0640a0700 1 Processor -- start 2023-11-28T11:10:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.485+0000 7fe0640a0700 1 -- start start 2023-11-28T11:10:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.486+0000 7fe0640a0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05c06e400 0x7fe05c152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.486+0000 7fe0640a0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c0d0c60 0x7fe05c1e8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.486+0000 7fe0640a0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c160e70 0x7fe05c1e6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.486+0000 7fe0640a0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c152b90 con 0x7fe05c06e400 2023-11-28T11:10:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.486+0000 7fe0640a0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0b0d40 con 0x7fe05c160e70 2023-11-28T11:10:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.486+0000 7fe0640a0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0b1020 con 0x7fe05c0d0c60 2023-11-28T11:10:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.486+0000 7fe061e3c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05c06e400 0x7fe05c152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.486+0000 7fe061e3c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05c06e400 0x7fe05c152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60284/0 (socket says 172.21.15.125:60284) 2023-11-28T11:10:41.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.486+0000 7fe061e3c700 1 -- 172.21.15.125:0/3600588434 learned_addr learned my addr 172.21.15.125:0/3600588434 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:41.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.486+0000 7fe06163b700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c0d0c60 0x7fe05c1e8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe06263d700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c160e70 0x7fe05c1e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe061e3c700 1 -- 172.21.15.125:0/3600588434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c0d0c60 msgr2=0x7fe05c1e8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe061e3c700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c0d0c60 0x7fe05c1e8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe061e3c700 1 -- 172.21.15.125:0/3600588434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c160e70 msgr2=0x7fe05c1e6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe061e3c700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c160e70 0x7fe05c1e6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe061e3c700 1 -- 172.21.15.125:0/3600588434 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0094a0 con 0x7fe05c06e400 2023-11-28T11:10:41.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe061e3c700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05c06e400 0x7fe05c152650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00ebe0 tx=0x7fe04c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:41.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe0527fc700 1 -- 172.21.15.125:0/3600588434 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00c910 con 0x7fe05c06e400 2023-11-28T11:10:41.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe0527fc700 1 -- 172.21.15.125:0/3600588434 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c00ca70 con 0x7fe05c06e400 2023-11-28T11:10:41.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe0640a0700 1 -- 172.21.15.125:0/3600588434 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe054009a70 con 0x7fe05c06e400 2023-11-28T11:10:41.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe0527fc700 1 -- 172.21.15.125:0/3600588434 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00cde0 con 0x7fe05c06e400 2023-11-28T11:10:41.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.487+0000 7fe0640a0700 1 -- 172.21.15.125:0/3600588434 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c15ceb0 con 0x7fe05c06e400 2023-11-28T11:10:41.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.488+0000 7fe0640a0700 1 -- 172.21.15.125:0/3600588434 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c0d0740 con 0x7fe05c06e400 2023-11-28T11:10:41.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.488+0000 7fe0527fc700 1 -- 172.21.15.125:0/3600588434 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe04c019030 con 0x7fe05c06e400 2023-11-28T11:10:41.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.489+0000 7fe0527fc700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe0400682f0 0x7fe04006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.489+0000 7fe0527fc700 1 -- 172.21.15.125:0/3600588434 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe04c085dd0 con 0x7fe05c06e400 2023-11-28T11:10:41.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.489+0000 7fe06163b700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe0400682f0 0x7fe04006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.489+0000 7fe06163b700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe0400682f0 0x7fe04006a7a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe05c1563e0 tx=0x7fe058009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:41.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.493+0000 7fe0527fc700 1 -- 172.21.15.125:0/3600588434 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe04c0525a0 con 0x7fe05c06e400 2023-11-28T11:10:41.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.751+0000 7fe0640a0700 1 -- 172.21.15.125:0/3600588434 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe05c15d040 con 0x7fe05c06e400 2023-11-28T11:10:41.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.751+0000 7fe0527fc700 1 -- 172.21.15.125:0/3600588434 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1506 (secure 0 0 0) 0x7fe04c021600 con 0x7fe05c06e400 2023-11-28T11:10:41.752 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:41.752 INFO:teuthology.orchestra.run.smithi125.stdout:{"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":149,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":52,"num_osds":8,"num_up_osds":8,"osd_up_since":1701169703,"num_in_osds":8,"osd_in_since":1701169694,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":60},{"state_name":"unknown","count":45}],"num_pgs":105,"num_pools":4,"num_objects":10,"data_bytes":590514,"bytes_used":75608064,"bytes_avail":773018505216,"bytes_total":773094113280,"unknown_pgs_ratio":0.4285714328289032,"write_bytes_sec":2028,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":23,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-28T11:10:25.644739+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T11:10:41.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 -- 172.21.15.125:0/3600588434 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe0400682f0 msgr2=0x7fe04006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe0400682f0 0x7fe04006a7a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe05c1563e0 tx=0x7fe058009040 comp rx=0 tx=0).stop 2023-11-28T11:10:41.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 -- 172.21.15.125:0/3600588434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05c06e400 msgr2=0x7fe05c152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05c06e400 0x7fe05c152650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00ebe0 tx=0x7fe04c009ec0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 -- 172.21.15.125:0/3600588434 shutdown_connections 2023-11-28T11:10:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c160e70 0x7fe05c1e6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe05c06e400 0x7fe05c152650 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe0400682f0 0x7fe04006a7a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 --2- 172.21.15.125:0/3600588434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c0d0c60 0x7fe05c1e8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 -- 172.21.15.125:0/3600588434 >> 172.21.15.125:0/3600588434 conn(0x7fe05c06a270 msgr2=0x7fe05c15a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 -- 172.21.15.125:0/3600588434 shutdown_connections 2023-11-28T11:10:41.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.753+0000 7fe0640a0700 1 -- 172.21.15.125:0/3600588434 wait complete. 2023-11-28T11:10:41.766 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T11:10:41.766 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:10:41.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.885+0000 7f8b7fdd1700 1 Processor -- start 2023-11-28T11:10:41.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.885+0000 7f8b7fdd1700 1 -- start start 2023-11-28T11:10:41.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.886+0000 7f8b7fdd1700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b78142db0 0x7f8b7813ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.886+0000 7f8b7fdd1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7815e010 con 0x7f8b780b1770 2023-11-28T11:10:41.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.886+0000 7f8b7fdd1700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7813fc90 con 0x7f8b780ce040 2023-11-28T11:10:41.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.886+0000 7f8b7fdd1700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7813f6d0 con 0x7f8b78142db0 2023-11-28T11:10:41.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.886+0000 7f8b7e36e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8b780b1770 0x7f8b780b1b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44420/0 (socket says 172.21.15.125:44420) 2023-11-28T11:10:41.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.886+0000 7f8b7e36e700 1 -- 172.21.15.125:0/2549035191 learned_addr learned my addr 172.21.15.125:0/2549035191 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:41.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.886+0000 7f8b7d36c700 1 --2- 172.21.15.125:0/2549035191 >> v2:172.21.15.167:3300/0 conn(0x7f8b78142db0 0x7f8b7813ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.886+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105805713 0 0) 0x7f8b70001490 con 0x7f8b780b1770 2023-11-28T11:10:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.886+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b640035b0 con 0x7f8b780b1770 2023-11-28T11:10:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 308957532 0 0) 0x7f8b640035b0 con 0x7f8b780b1770 2023-11-28T11:10:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 >> v2:172.21.15.167:3300/0 conn(0x7f8b78142db0 msgr2=0x7f8b7813ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 --2- 172.21.15.125:0/2549035191 >> v2:172.21.15.167:3300/0 conn(0x7f8b78142db0 0x7f8b7813ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 >> v1:172.21.15.167:6789/0 conn(0x7f8b780ce040 legacy=0x7f8b7815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7813f9b0 con 0x7f8b780b1770 2023-11-28T11:10:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f8b70001b80 con 0x7f8b780b1770 2023-11-28T11:10:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 >> v1:172.21.15.125:6789/0 conn(0x7f8b780b1770 legacy=0x7f8b780b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b64003a00 0x7f8b64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b640043a0 0x7f8b64004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b64005050 0x7f8b6400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7813f6d0 con 0x7f8b640043a0 2023-11-28T11:10:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6400bf80 con 0x7f8b64005050 2023-11-28T11:10:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6400c140 con 0x7f8b64003a00 2023-11-28T11:10:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7d36c700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b640043a0 0x7f8b64004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7db6d700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b64003a00 0x7f8b64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7e36e700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b64005050 0x7f8b6400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7d36c700 1 -- 172.21.15.125:0/2549035191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b64003a00 msgr2=0x7f8b64003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7d36c700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b64003a00 0x7f8b64003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7d36c700 1 -- 172.21.15.125:0/2549035191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b64005050 msgr2=0x7f8b6400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7d36c700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b64005050 0x7f8b6400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7d36c700 1 -- 172.21.15.125:0/2549035191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b640035b0 con 0x7f8b640043a0 2023-11-28T11:10:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7e36e700 1 -- 172.21.15.125:0/2549035191 reap_dead start 2023-11-28T11:10:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7db6d700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b64003a00 0x7f8b64003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7d36c700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b640043a0 0x7f8b64004850 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009b60 tx=0x7f8b64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b52502c04da84d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6800e6c0 con 0x7f8b640043a0 2023-11-28T11:10:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6800e820 con 0x7f8b640043a0 2023-11-28T11:10:41.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.887+0000 7f8b7cb6b700 1 -- 172.21.15.125:0/2549035191 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6800eb90 con 0x7f8b640043a0 2023-11-28T11:10:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.888+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/2549035191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b640043a0 msgr2=0x7f8b64004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.888+0000 7f8b7fdd1700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b640043a0 0x7f8b64004850 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009b60 tx=0x7f8b64005880 comp rx=0 tx=0).stop 2023-11-28T11:10:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.888+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/2549035191 shutdown_connections 2023-11-28T11:10:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.888+0000 7f8b7fdd1700 1 --2- 172.21.15.125:0/2549035191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b640043a0 0x7f8b64004850 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.888+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/2549035191 >> 172.21.15.125:0/2549035191 conn(0x7f8b7806c010 msgr2=0x7f8b780cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.888+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/2549035191 shutdown_connections 2023-11-28T11:10:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.888+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/2549035191 wait complete. 2023-11-28T11:10:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.889+0000 7f8b7fdd1700 1 Processor -- start 2023-11-28T11:10:41.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.889+0000 7f8b7fdd1700 1 -- start start 2023-11-28T11:10:41.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7fdd1700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b7815a0c0 0x7f8b7815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7fdd1700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b7815a490 0x7f8b7815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7fdd1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b78157b50 0x7f8b78157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7fdd1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b78140670 con 0x7f8b78157b50 2023-11-28T11:10:41.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7fdd1700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b78158530 con 0x7f8b7815a0c0 2023-11-28T11:10:41.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7fdd1700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7815c9b0 con 0x7f8b7815a490 2023-11-28T11:10:41.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7e36e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b78157b50 0x7f8b78157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7e36e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b78157b50 0x7f8b78157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60306/0 (socket says 172.21.15.125:60306) 2023-11-28T11:10:41.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7e36e700 1 -- 172.21.15.125:0/485288012 learned_addr learned my addr 172.21.15.125:0/485288012 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:41.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7d36c700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b7815a490 0x7f8b7815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7db6d700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b7815a0c0 0x7f8b7815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7e36e700 1 -- 172.21.15.125:0/485288012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b7815a490 msgr2=0x7f8b7815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7e36e700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b7815a490 0x7f8b7815c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7e36e700 1 -- 172.21.15.125:0/485288012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b7815a0c0 msgr2=0x7f8b7815bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:41.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7e36e700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b7815a0c0 0x7f8b7815bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.890+0000 7f8b7e36e700 1 -- 172.21.15.125:0/485288012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7815d3e0 con 0x7f8b78157b50 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.891+0000 7f8b7db6d700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b7815a0c0 0x7f8b7815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.891+0000 7f8b7e36e700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b78157b50 0x7f8b78157ff0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8b780cc740 tx=0x7f8b70008b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.891+0000 7f8b6e7fc700 1 -- 172.21.15.125:0/485288012 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70006980 con 0x7f8b78157b50 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.891+0000 7f8b6e7fc700 1 -- 172.21.15.125:0/485288012 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b70006b20 con 0x7f8b78157b50 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.891+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/485288012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7815d100 con 0x7f8b78157b50 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.891+0000 7f8b6e7fc700 1 -- 172.21.15.125:0/485288012 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70015480 con 0x7f8b78157b50 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.891+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/485288012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b780ce410 con 0x7f8b78157b50 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.892+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/485288012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b781407b0 con 0x7f8b78157b50 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.892+0000 7f8b6e7fc700 1 -- 172.21.15.125:0/485288012 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8b7001c030 con 0x7f8b78157b50 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.893+0000 7f8b6e7fc700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b5c068320 0x7f8b5c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:41.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.893+0000 7f8b7db6d700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b5c068320 0x7f8b5c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:41.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.893+0000 7f8b6e7fc700 1 -- 172.21.15.125:0/485288012 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b70085870 con 0x7f8b78157b50 2023-11-28T11:10:41.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.893+0000 7f8b7db6d700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b5c068320 0x7f8b5c06a7d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8b78063e40 tx=0x7f8b74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:41.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:41.897+0000 7f8b6e7fc700 1 -- 172.21.15.125:0/485288012 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8b781407b0 con 0x7f8b78157b50 2023-11-28T11:10:42.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.076+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/485288012 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b7815c790 con 0x7f8b5c068320 2023-11-28T11:10:42.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.084+0000 7f8b6e7fc700 1 -- 172.21.15.125:0/485288012 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311131 (secure 0 0 0) 0x7f8b740051f0 con 0x7f8b5c068320 2023-11-28T11:10:42.088 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:42.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/485288012 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b5c068320 msgr2=0x7f8b5c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:42.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b5c068320 0x7f8b5c06a7d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8b78063e40 tx=0x7f8b74009040 comp rx=0 tx=0).stop 2023-11-28T11:10:42.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/485288012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b78157b50 msgr2=0x7f8b78157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:42.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b78157b50 0x7f8b78157ff0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8b780cc740 tx=0x7f8b70008b50 comp rx=0 tx=0).stop 2023-11-28T11:10:42.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/485288012 shutdown_connections 2023-11-28T11:10:42.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b78157b50 0x7f8b78157ff0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:42.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b7815a0c0 0x7f8b7815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:42.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b5c068320 0x7f8b5c06a7d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:42.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 --2- 172.21.15.125:0/485288012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b7815a490 0x7f8b7815c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:42.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/485288012 >> 172.21.15.125:0/485288012 conn(0x7f8b7806c010 msgr2=0x7f8b7806e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:42.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/485288012 shutdown_connections 2023-11-28T11:10:42.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:42.087+0000 7f8b7fdd1700 1 -- 172.21.15.125:0/485288012 wait complete. 2023-11-28T11:10:42.091 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:10:42.100 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-11-28T11:10:41.647856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":74584,"kb_used_data":5976,"kb_used_omap":0,"kb_used_meta":68544,"kb_avail":754900136,"statfs":{"total":773094113280,"available":773017739264,"internally_reserved":0,"allocated":6119424,"data_stored":3283512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":70189056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001284"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514648+0000","last_change":"2023-11-28T11:10:36.524056+0000","last_active":"2023-11-28T11:10:37.514648+0000","last_peered":"2023-11-28T11:10:37.514648+0000","last_clean":"2023-11-28T11:10:37.514648+0000","last_became_active":"2023-11-28T11:10:36.523831+0000","last_became_peered":"2023-11-28T11:10:36.523831+0000","last_unstale":"2023-11-28T11:10:37.514648+0000","last_undegraded":"2023-11-28T11:10:37.514648+0000","last_fullsized":"2023-11-28T11:10:37.514648+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514850+0000","last_change":"2023-11-28T11:10:36.524534+0000","last_active":"2023-11-28T11:10:37.514850+0000","last_peered":"2023-11-28T11:10:37.514850+0000","last_clean":"2023-11-28T11:10:37.514850+0000","last_became_active":"2023-11-28T11:10:36.524236+0000","last_became_peered":"2023-11-28T11:10:36.524236+0000","last_unstale":"2023-11-28T11:10:37.514850+0000","last_undegraded":"2023-11-28T11:10:37.514850+0000","last_fullsized":"2023-11-28T11:10:37.514850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:58.155221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515248+0000","last_change":"2023-11-28T11:10:36.526236+0000","last_active":"2023-11-28T11:10:37.515248+0000","last_peered":"2023-11-28T11:10:37.515248+0000","last_clean":"2023-11-28T11:10:37.515248+0000","last_became_active":"2023-11-28T11:10:36.525526+0000","last_became_peered":"2023-11-28T11:10:36.525526+0000","last_unstale":"2023-11-28T11:10:37.515248+0000","last_undegraded":"2023-11-28T11:10:37.515248+0000","last_fullsized":"2023-11-28T11:10:37.515248+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:27.654161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514746+0000","last_change":"2023-11-28T11:10:36.528064+0000","last_active":"2023-11-28T11:10:37.514746+0000","last_peered":"2023-11-28T11:10:37.514746+0000","last_clean":"2023-11-28T11:10:37.514746+0000","last_became_active":"2023-11-28T11:10:36.527767+0000","last_became_peered":"2023-11-28T11:10:36.527767+0000","last_unstale":"2023-11-28T11:10:37.514746+0000","last_undegraded":"2023-11-28T11:10:37.514746+0000","last_fullsized":"2023-11-28T11:10:37.514746+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:20.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583715+0000","last_change":"2023-11-28T11:10:36.532942+0000","last_active":"2023-11-28T11:10:39.583715+0000","last_peered":"2023-11-28T11:10:39.583715+0000","last_clean":"2023-11-28T11:10:39.583715+0000","last_became_active":"2023-11-28T11:10:36.532390+0000","last_became_peered":"2023-11-28T11:10:36.532390+0000","last_unstale":"2023-11-28T11:10:39.583715+0000","last_undegraded":"2023-11-28T11:10:39.583715+0000","last_fullsized":"2023-11-28T11:10:39.583715+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514469+0000","last_change":"2023-11-28T11:10:36.526839+0000","last_active":"2023-11-28T11:10:37.514469+0000","last_peered":"2023-11-28T11:10:37.514469+0000","last_clean":"2023-11-28T11:10:37.514469+0000","last_became_active":"2023-11-28T11:10:36.526583+0000","last_became_peered":"2023-11-28T11:10:36.526583+0000","last_unstale":"2023-11-28T11:10:37.514469+0000","last_undegraded":"2023-11-28T11:10:37.514469+0000","last_fullsized":"2023-11-28T11:10:37.514469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:31.375598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514646+0000","last_change":"2023-11-28T11:10:36.529010+0000","last_active":"2023-11-28T11:10:37.514646+0000","last_peered":"2023-11-28T11:10:37.514646+0000","last_clean":"2023-11-28T11:10:37.514646+0000","last_became_active":"2023-11-28T11:10:36.528687+0000","last_became_peered":"2023-11-28T11:10:36.528687+0000","last_unstale":"2023-11-28T11:10:37.514646+0000","last_undegraded":"2023-11-28T11:10:37.514646+0000","last_fullsized":"2023-11-28T11:10:37.514646+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:50.593011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.539757+0000","last_change":"2023-11-28T11:10:36.534714+0000","last_active":"2023-11-28T11:10:36.539757+0000","last_peered":"2023-11-28T11:10:36.539757+0000","last_clean":"2023-11-28T11:10:36.539757+0000","last_became_active":"2023-11-28T11:10:36.534392+0000","last_became_peered":"2023-11-28T11:10:36.534392+0000","last_unstale":"2023-11-28T11:10:36.539757+0000","last_undegraded":"2023-11-28T11:10:36.539757+0000","last_fullsized":"2023-11-28T11:10:36.539757+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:50.593011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538593+0000","last_change":"2023-11-28T11:10:36.537355+0000","last_active":"2023-11-28T11:10:36.538593+0000","last_peered":"2023-11-28T11:10:36.538593+0000","last_clean":"2023-11-28T11:10:36.538593+0000","last_became_active":"2023-11-28T11:10:36.535077+0000","last_became_peered":"2023-11-28T11:10:36.535077+0000","last_unstale":"2023-11-28T11:10:36.538593+0000","last_undegraded":"2023-11-28T11:10:36.538593+0000","last_fullsized":"2023-11-28T11:10:36.538593+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:05.763064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515454+0000","last_change":"2023-11-28T11:10:36.532181+0000","last_active":"2023-11-28T11:10:37.515454+0000","last_peered":"2023-11-28T11:10:37.515454+0000","last_clean":"2023-11-28T11:10:37.515454+0000","last_became_active":"2023-11-28T11:10:36.531946+0000","last_became_peered":"2023-11-28T11:10:36.531946+0000","last_unstale":"2023-11-28T11:10:37.515454+0000","last_undegraded":"2023-11-28T11:10:37.515454+0000","last_fullsized":"2023-11-28T11:10:37.515454+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:34.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141761+0000","last_change":"2023-11-28T11:10:36.522452+0000","last_active":"2023-11-28T11:10:38.141761+0000","last_peered":"2023-11-28T11:10:38.141761+0000","last_clean":"2023-11-28T11:10:38.141761+0000","last_became_active":"2023-11-28T11:10:36.522201+0000","last_became_peered":"2023-11-28T11:10:36.522201+0000","last_unstale":"2023-11-28T11:10:38.141761+0000","last_undegraded":"2023-11-28T11:10:38.141761+0000","last_fullsized":"2023-11-28T11:10:38.141761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:59:58.033544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538189+0000","last_change":"2023-11-28T11:10:36.531793+0000","last_active":"2023-11-28T11:10:36.538189+0000","last_peered":"2023-11-28T11:10:36.538189+0000","last_clean":"2023-11-28T11:10:36.538189+0000","last_became_active":"2023-11-28T11:10:36.530049+0000","last_became_peered":"2023-11-28T11:10:36.530049+0000","last_unstale":"2023-11-28T11:10:36.538189+0000","last_undegraded":"2023-11-28T11:10:36.538189+0000","last_fullsized":"2023-11-28T11:10:36.538189+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:27.654161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514287+0000","last_change":"2023-11-28T11:10:36.534554+0000","last_active":"2023-11-28T11:10:37.514287+0000","last_peered":"2023-11-28T11:10:37.514287+0000","last_clean":"2023-11-28T11:10:37.514287+0000","last_became_active":"2023-11-28T11:10:36.534313+0000","last_became_peered":"2023-11-28T11:10:36.534313+0000","last_unstale":"2023-11-28T11:10:37.514287+0000","last_undegraded":"2023-11-28T11:10:37.514287+0000","last_fullsized":"2023-11-28T11:10:37.514287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:33.764839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515060+0000","last_change":"2023-11-28T11:10:36.525581+0000","last_active":"2023-11-28T11:10:37.515060+0000","last_peered":"2023-11-28T11:10:37.515060+0000","last_clean":"2023-11-28T11:10:37.515060+0000","last_became_active":"2023-11-28T11:10:36.525315+0000","last_became_peered":"2023-11-28T11:10:36.525315+0000","last_unstale":"2023-11-28T11:10:37.515060+0000","last_undegraded":"2023-11-28T11:10:37.515060+0000","last_fullsized":"2023-11-28T11:10:37.515060+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:12.836764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514618+0000","last_change":"2023-11-28T11:10:36.527490+0000","last_active":"2023-11-28T11:10:37.514618+0000","last_peered":"2023-11-28T11:10:37.514618+0000","last_clean":"2023-11-28T11:10:37.514618+0000","last_became_active":"2023-11-28T11:10:36.527219+0000","last_became_peered":"2023-11-28T11:10:36.527219+0000","last_unstale":"2023-11-28T11:10:37.514618+0000","last_undegraded":"2023-11-28T11:10:37.514618+0000","last_fullsized":"2023-11-28T11:10:37.514618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514163+0000","last_change":"2023-11-28T11:10:36.532971+0000","last_active":"2023-11-28T11:10:37.514163+0000","last_peered":"2023-11-28T11:10:37.514163+0000","last_clean":"2023-11-28T11:10:37.514163+0000","last_became_active":"2023-11-28T11:10:36.532729+0000","last_became_peered":"2023-11-28T11:10:36.532729+0000","last_unstale":"2023-11-28T11:10:37.514163+0000","last_undegraded":"2023-11-28T11:10:37.514163+0000","last_fullsized":"2023-11-28T11:10:37.514163+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:20.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515693+0000","last_change":"2023-11-28T11:10:36.528593+0000","last_active":"2023-11-28T11:10:37.515693+0000","last_peered":"2023-11-28T11:10:37.515693+0000","last_clean":"2023-11-28T11:10:37.515693+0000","last_became_active":"2023-11-28T11:10:36.528202+0000","last_became_peered":"2023-11-28T11:10:36.528202+0000","last_unstale":"2023-11-28T11:10:37.515693+0000","last_undegraded":"2023-11-28T11:10:37.515693+0000","last_fullsized":"2023-11-28T11:10:37.515693+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:23.935065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514945+0000","last_change":"2023-11-28T11:10:36.524381+0000","last_active":"2023-11-28T11:10:37.514945+0000","last_peered":"2023-11-28T11:10:37.514945+0000","last_clean":"2023-11-28T11:10:37.514945+0000","last_became_active":"2023-11-28T11:10:36.524095+0000","last_became_peered":"2023-11-28T11:10:36.524095+0000","last_unstale":"2023-11-28T11:10:37.514945+0000","last_undegraded":"2023-11-28T11:10:37.514945+0000","last_fullsized":"2023-11-28T11:10:37.514945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515238+0000","last_change":"2023-11-28T11:10:36.533836+0000","last_active":"2023-11-28T11:10:37.515238+0000","last_peered":"2023-11-28T11:10:37.515238+0000","last_clean":"2023-11-28T11:10:37.515238+0000","last_became_active":"2023-11-28T11:10:36.533560+0000","last_became_peered":"2023-11-28T11:10:36.533560+0000","last_unstale":"2023-11-28T11:10:37.515238+0000","last_undegraded":"2023-11-28T11:10:37.515238+0000","last_fullsized":"2023-11-28T11:10:37.515238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:25.315412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.535983+0000","last_change":"2023-11-28T11:10:36.532702+0000","last_active":"2023-11-28T11:10:36.535983+0000","last_peered":"2023-11-28T11:10:36.535983+0000","last_clean":"2023-11-28T11:10:36.535983+0000","last_became_active":"2023-11-28T11:10:36.532398+0000","last_became_peered":"2023-11-28T11:10:36.532398+0000","last_unstale":"2023-11-28T11:10:36.535983+0000","last_undegraded":"2023-11-28T11:10:36.535983+0000","last_fullsized":"2023-11-28T11:10:36.535983+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:21.311791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.530521+0000","last_change":"2023-11-28T11:10:36.526799+0000","last_active":"2023-11-28T11:10:36.530521+0000","last_peered":"2023-11-28T11:10:36.530521+0000","last_clean":"2023-11-28T11:10:36.530521+0000","last_became_active":"2023-11-28T11:10:36.526541+0000","last_became_peered":"2023-11-28T11:10:36.526541+0000","last_unstale":"2023-11-28T11:10:36.530521+0000","last_undegraded":"2023-11-28T11:10:36.530521+0000","last_fullsized":"2023-11-28T11:10:36.530521+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:09.770343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538087+0000","last_change":"2023-11-28T11:10:36.533609+0000","last_active":"2023-11-28T11:10:36.538087+0000","last_peered":"2023-11-28T11:10:36.538087+0000","last_clean":"2023-11-28T11:10:36.538087+0000","last_became_active":"2023-11-28T11:10:36.531968+0000","last_became_peered":"2023-11-28T11:10:36.531968+0000","last_unstale":"2023-11-28T11:10:36.538087+0000","last_undegraded":"2023-11-28T11:10:36.538087+0000","last_fullsized":"2023-11-28T11:10:36.538087+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:25.315412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141535+0000","last_change":"2023-11-28T11:10:36.528419+0000","last_active":"2023-11-28T11:10:38.141535+0000","last_peered":"2023-11-28T11:10:38.141535+0000","last_clean":"2023-11-28T11:10:38.141535+0000","last_became_active":"2023-11-28T11:10:36.527321+0000","last_became_peered":"2023-11-28T11:10:36.527321+0000","last_unstale":"2023-11-28T11:10:38.141535+0000","last_undegraded":"2023-11-28T11:10:38.141535+0000","last_fullsized":"2023-11-28T11:10:38.141535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:06.424953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514471+0000","last_change":"2023-11-28T11:10:36.525552+0000","last_active":"2023-11-28T11:10:37.514471+0000","last_peered":"2023-11-28T11:10:37.514471+0000","last_clean":"2023-11-28T11:10:37.514471+0000","last_became_active":"2023-11-28T11:10:36.525301+0000","last_became_peered":"2023-11-28T11:10:36.525301+0000","last_unstale":"2023-11-28T11:10:37.514471+0000","last_undegraded":"2023-11-28T11:10:37.514471+0000","last_fullsized":"2023-11-28T11:10:37.514471+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:57.807839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515621+0000","last_change":"2023-11-28T11:10:36.538677+0000","last_active":"2023-11-28T11:10:37.515621+0000","last_peered":"2023-11-28T11:10:37.515621+0000","last_clean":"2023-11-28T11:10:37.515621+0000","last_became_active":"2023-11-28T11:10:36.538336+0000","last_became_peered":"2023-11-28T11:10:36.538336+0000","last_unstale":"2023-11-28T11:10:37.515621+0000","last_undegraded":"2023-11-28T11:10:37.515621+0000","last_fullsized":"2023-11-28T11:10:37.515621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:04.544184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538014+0000","last_change":"2023-11-28T11:10:36.526666+0000","last_active":"2023-11-28T11:10:36.538014+0000","last_peered":"2023-11-28T11:10:36.538014+0000","last_clean":"2023-11-28T11:10:36.538014+0000","last_became_active":"2023-11-28T11:10:36.526406+0000","last_became_peered":"2023-11-28T11:10:36.526406+0000","last_unstale":"2023-11-28T11:10:36.538014+0000","last_undegraded":"2023-11-28T11:10:36.538014+0000","last_fullsized":"2023-11-28T11:10:36.538014+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:02.769111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515008+0000","last_change":"2023-11-28T11:10:36.535214+0000","last_active":"2023-11-28T11:10:37.515008+0000","last_peered":"2023-11-28T11:10:37.515008+0000","last_clean":"2023-11-28T11:10:37.515008+0000","last_became_active":"2023-11-28T11:10:36.534981+0000","last_became_peered":"2023-11-28T11:10:36.534981+0000","last_unstale":"2023-11-28T11:10:37.515008+0000","last_undegraded":"2023-11-28T11:10:37.515008+0000","last_fullsized":"2023-11-28T11:10:37.515008+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:19.190582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.531382+0000","last_change":"2023-11-28T11:10:36.528115+0000","last_active":"2023-11-28T11:10:36.531382+0000","last_peered":"2023-11-28T11:10:36.531382+0000","last_clean":"2023-11-28T11:10:36.531382+0000","last_became_active":"2023-11-28T11:10:36.527806+0000","last_became_peered":"2023-11-28T11:10:36.527806+0000","last_unstale":"2023-11-28T11:10:36.531382+0000","last_undegraded":"2023-11-28T11:10:36.531382+0000","last_fullsized":"2023-11-28T11:10:36.531382+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:44.837465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514668+0000","last_change":"2023-11-28T11:10:36.528010+0000","last_active":"2023-11-28T11:10:37.514668+0000","last_peered":"2023-11-28T11:10:37.514668+0000","last_clean":"2023-11-28T11:10:37.514668+0000","last_became_active":"2023-11-28T11:10:36.527719+0000","last_became_peered":"2023-11-28T11:10:36.527719+0000","last_unstale":"2023-11-28T11:10:37.514668+0000","last_undegraded":"2023-11-28T11:10:37.514668+0000","last_fullsized":"2023-11-28T11:10:37.514668+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:58.531465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514890+0000","last_change":"2023-11-28T11:10:36.522035+0000","last_active":"2023-11-28T11:10:37.514890+0000","last_peered":"2023-11-28T11:10:37.514890+0000","last_clean":"2023-11-28T11:10:37.514890+0000","last_became_active":"2023-11-28T11:10:36.521763+0000","last_became_peered":"2023-11-28T11:10:36.521763+0000","last_unstale":"2023-11-28T11:10:37.514890+0000","last_undegraded":"2023-11-28T11:10:37.514890+0000","last_fullsized":"2023-11-28T11:10:37.514890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514820+0000","last_change":"2023-11-28T11:10:36.528832+0000","last_active":"2023-11-28T11:10:37.514820+0000","last_peered":"2023-11-28T11:10:37.514820+0000","last_clean":"2023-11-28T11:10:37.514820+0000","last_became_active":"2023-11-28T11:10:36.528558+0000","last_became_peered":"2023-11-28T11:10:36.528558+0000","last_unstale":"2023-11-28T11:10:37.514820+0000","last_undegraded":"2023-11-28T11:10:37.514820+0000","last_fullsized":"2023-11-28T11:10:37.514820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:28.375662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.541397+0000","last_change":"2023-11-28T11:10:36.540895+0000","last_active":"2023-11-28T11:10:36.541397+0000","last_peered":"2023-11-28T11:10:36.541397+0000","last_clean":"2023-11-28T11:10:36.541397+0000","last_became_active":"2023-11-28T11:10:36.540593+0000","last_became_peered":"2023-11-28T11:10:36.540593+0000","last_unstale":"2023-11-28T11:10:36.541397+0000","last_undegraded":"2023-11-28T11:10:36.541397+0000","last_fullsized":"2023-11-28T11:10:36.541397+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:51.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514434+0000","last_change":"2023-11-28T11:10:36.524969+0000","last_active":"2023-11-28T11:10:37.514434+0000","last_peered":"2023-11-28T11:10:37.514434+0000","last_clean":"2023-11-28T11:10:37.514434+0000","last_became_active":"2023-11-28T11:10:36.524710+0000","last_became_peered":"2023-11-28T11:10:36.524710+0000","last_unstale":"2023-11-28T11:10:37.514434+0000","last_undegraded":"2023-11-28T11:10:37.514434+0000","last_fullsized":"2023-11-28T11:10:37.514434+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:02:40.345280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.536059+0000","last_change":"2023-11-28T11:10:36.124253+0000","last_active":"2023-11-28T11:10:36.536059+0000","last_peered":"2023-11-28T11:10:36.536059+0000","last_clean":"2023-11-28T11:10:36.536059+0000","last_became_active":"2023-11-28T11:10:36.123935+0000","last_became_peered":"2023-11-28T11:10:36.123935+0000","last_unstale":"2023-11-28T11:10:36.536059+0000","last_undegraded":"2023-11-28T11:10:36.536059+0000","last_fullsized":"2023-11-28T11:10:36.536059+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:36.890541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.527288+0000","last_change":"2023-11-28T11:10:36.525460+0000","last_active":"2023-11-28T11:10:36.527288+0000","last_peered":"2023-11-28T11:10:36.527288+0000","last_clean":"2023-11-28T11:10:36.527288+0000","last_became_active":"2023-11-28T11:10:36.525018+0000","last_became_peered":"2023-11-28T11:10:36.525018+0000","last_unstale":"2023-11-28T11:10:36.527288+0000","last_undegraded":"2023-11-28T11:10:36.527288+0000","last_fullsized":"2023-11-28T11:10:36.527288+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515505+0000","last_change":"2023-11-28T11:10:36.133446+0000","last_active":"2023-11-28T11:10:37.515505+0000","last_peered":"2023-11-28T11:10:37.515505+0000","last_clean":"2023-11-28T11:10:37.515505+0000","last_became_active":"2023-11-28T11:10:36.133184+0000","last_became_peered":"2023-11-28T11:10:36.133184+0000","last_unstale":"2023-11-28T11:10:37.515505+0000","last_undegraded":"2023-11-28T11:10:37.515505+0000","last_fullsized":"2023-11-28T11:10:37.515505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:13.129227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.530527+0000","last_change":"2023-11-28T11:10:36.527498+0000","last_active":"2023-11-28T11:10:36.530527+0000","last_peered":"2023-11-28T11:10:36.530527+0000","last_clean":"2023-11-28T11:10:36.530527+0000","last_became_active":"2023-11-28T11:10:36.526279+0000","last_became_peered":"2023-11-28T11:10:36.526279+0000","last_unstale":"2023-11-28T11:10:36.530527+0000","last_undegraded":"2023-11-28T11:10:36.530527+0000","last_fullsized":"2023-11-28T11:10:36.530527+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:14.136702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515095+0000","last_change":"2023-11-28T11:10:36.133435+0000","last_active":"2023-11-28T11:10:37.515095+0000","last_peered":"2023-11-28T11:10:37.515095+0000","last_clean":"2023-11-28T11:10:37.515095+0000","last_became_active":"2023-11-28T11:10:36.133156+0000","last_became_peered":"2023-11-28T11:10:36.133156+0000","last_unstale":"2023-11-28T11:10:37.515095+0000","last_undegraded":"2023-11-28T11:10:37.515095+0000","last_fullsized":"2023-11-28T11:10:37.515095+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:32.589064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538280+0000","last_change":"2023-11-28T11:10:36.530352+0000","last_active":"2023-11-28T11:10:36.538280+0000","last_peered":"2023-11-28T11:10:36.538280+0000","last_clean":"2023-11-28T11:10:36.538280+0000","last_became_active":"2023-11-28T11:10:36.530058+0000","last_became_peered":"2023-11-28T11:10:36.530058+0000","last_unstale":"2023-11-28T11:10:36.538280+0000","last_undegraded":"2023-11-28T11:10:36.538280+0000","last_fullsized":"2023-11-28T11:10:36.538280+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:57.807839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.541702+0000","last_change":"2023-11-28T11:10:36.125331+0000","last_active":"2023-11-28T11:10:36.541702+0000","last_peered":"2023-11-28T11:10:36.541702+0000","last_clean":"2023-11-28T11:10:36.541702+0000","last_became_active":"2023-11-28T11:10:36.125034+0000","last_became_peered":"2023-11-28T11:10:36.125034+0000","last_unstale":"2023-11-28T11:10:36.541702+0000","last_undegraded":"2023-11-28T11:10:36.541702+0000","last_fullsized":"2023-11-28T11:10:36.541702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:08.312145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583801+0000","last_change":"2023-11-28T11:10:36.531333+0000","last_active":"2023-11-28T11:10:39.583801+0000","last_peered":"2023-11-28T11:10:39.583801+0000","last_clean":"2023-11-28T11:10:39.583801+0000","last_became_active":"2023-11-28T11:10:36.530981+0000","last_became_peered":"2023-11-28T11:10:36.530981+0000","last_unstale":"2023-11-28T11:10:39.583801+0000","last_undegraded":"2023-11-28T11:10:39.583801+0000","last_fullsized":"2023-11-28T11:10:39.583801+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:02.769111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514762+0000","last_change":"2023-11-28T11:10:36.119665+0000","last_active":"2023-11-28T11:10:37.514762+0000","last_peered":"2023-11-28T11:10:37.514762+0000","last_clean":"2023-11-28T11:10:37.514762+0000","last_became_active":"2023-11-28T11:10:36.117416+0000","last_became_peered":"2023-11-28T11:10:36.117416+0000","last_unstale":"2023-11-28T11:10:37.514762+0000","last_undegraded":"2023-11-28T11:10:37.514762+0000","last_fullsized":"2023-11-28T11:10:37.514762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:33.877212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515023+0000","last_change":"2023-11-28T11:10:36.523569+0000","last_active":"2023-11-28T11:10:37.515023+0000","last_peered":"2023-11-28T11:10:37.515023+0000","last_clean":"2023-11-28T11:10:37.515023+0000","last_became_active":"2023-11-28T11:10:36.523302+0000","last_became_peered":"2023-11-28T11:10:36.523302+0000","last_unstale":"2023-11-28T11:10:37.515023+0000","last_undegraded":"2023-11-28T11:10:37.515023+0000","last_fullsized":"2023-11-28T11:10:37.515023+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:48.693779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583531+0000","last_change":"2023-11-28T11:10:36.124249+0000","last_active":"2023-11-28T11:10:39.583531+0000","last_peered":"2023-11-28T11:10:39.583531+0000","last_clean":"2023-11-28T11:10:39.583531+0000","last_became_active":"2023-11-28T11:10:36.123975+0000","last_became_peered":"2023-11-28T11:10:36.123975+0000","last_unstale":"2023-11-28T11:10:39.583531+0000","last_undegraded":"2023-11-28T11:10:39.583531+0000","last_fullsized":"2023-11-28T11:10:39.583531+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:04.198577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538028+0000","last_change":"2023-11-28T11:10:36.526769+0000","last_active":"2023-11-28T11:10:36.538028+0000","last_peered":"2023-11-28T11:10:36.538028+0000","last_clean":"2023-11-28T11:10:36.538028+0000","last_became_active":"2023-11-28T11:10:36.526533+0000","last_became_peered":"2023-11-28T11:10:36.526533+0000","last_unstale":"2023-11-28T11:10:36.538028+0000","last_undegraded":"2023-11-28T11:10:36.538028+0000","last_fullsized":"2023-11-28T11:10:36.538028+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:10.382472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.519687+0000","last_change":"2023-11-28T11:10:36.124477+0000","last_active":"2023-11-28T11:10:36.519687+0000","last_peered":"2023-11-28T11:10:36.519687+0000","last_clean":"2023-11-28T11:10:36.519687+0000","last_became_active":"2023-11-28T11:10:36.123849+0000","last_became_peered":"2023-11-28T11:10:36.123849+0000","last_unstale":"2023-11-28T11:10:36.519687+0000","last_undegraded":"2023-11-28T11:10:36.519687+0000","last_fullsized":"2023-11-28T11:10:36.519687+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:49:28.668040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514850+0000","last_change":"2023-11-28T11:10:36.528489+0000","last_active":"2023-11-28T11:10:37.514850+0000","last_peered":"2023-11-28T11:10:37.514850+0000","last_clean":"2023-11-28T11:10:37.514850+0000","last_became_active":"2023-11-28T11:10:36.528196+0000","last_became_peered":"2023-11-28T11:10:36.528196+0000","last_unstale":"2023-11-28T11:10:37.514850+0000","last_undegraded":"2023-11-28T11:10:37.514850+0000","last_fullsized":"2023-11-28T11:10:37.514850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.833897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514973+0000","last_change":"2023-11-28T11:10:36.126539+0000","last_active":"2023-11-28T11:10:37.514973+0000","last_peered":"2023-11-28T11:10:37.514973+0000","last_clean":"2023-11-28T11:10:37.514973+0000","last_became_active":"2023-11-28T11:10:36.126227+0000","last_became_peered":"2023-11-28T11:10:36.126227+0000","last_unstale":"2023-11-28T11:10:37.514973+0000","last_undegraded":"2023-11-28T11:10:37.514973+0000","last_fullsized":"2023-11-28T11:10:37.514973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:28.022412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583560+0000","last_change":"2023-11-28T11:10:36.535403+0000","last_active":"2023-11-28T11:10:39.583560+0000","last_peered":"2023-11-28T11:10:39.583560+0000","last_clean":"2023-11-28T11:10:39.583560+0000","last_became_active":"2023-11-28T11:10:36.535115+0000","last_became_peered":"2023-11-28T11:10:36.535115+0000","last_unstale":"2023-11-28T11:10:39.583560+0000","last_undegraded":"2023-11-28T11:10:39.583560+0000","last_fullsized":"2023-11-28T11:10:39.583560+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:48.693779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515008+0000","last_change":"2023-11-28T11:10:36.123501+0000","last_active":"2023-11-28T11:10:37.515008+0000","last_peered":"2023-11-28T11:10:37.515008+0000","last_clean":"2023-11-28T11:10:37.515008+0000","last_became_active":"2023-11-28T11:10:36.122933+0000","last_became_peered":"2023-11-28T11:10:36.122933+0000","last_unstale":"2023-11-28T11:10:37.515008+0000","last_undegraded":"2023-11-28T11:10:37.515008+0000","last_fullsized":"2023-11-28T11:10:37.515008+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:32.757363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.535505+0000","last_change":"2023-11-28T11:10:36.533327+0000","last_active":"2023-11-28T11:10:36.535505+0000","last_peered":"2023-11-28T11:10:36.535505+0000","last_clean":"2023-11-28T11:10:36.535505+0000","last_became_active":"2023-11-28T11:10:36.533057+0000","last_became_peered":"2023-11-28T11:10:36.533057+0000","last_unstale":"2023-11-28T11:10:36.535505+0000","last_undegraded":"2023-11-28T11:10:36.535505+0000","last_fullsized":"2023-11-28T11:10:36.535505+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:02:40.345280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583846+0000","last_change":"2023-11-28T11:10:36.128801+0000","last_active":"2023-11-28T11:10:39.583846+0000","last_peered":"2023-11-28T11:10:39.583846+0000","last_clean":"2023-11-28T11:10:39.583846+0000","last_became_active":"2023-11-28T11:10:36.128548+0000","last_became_peered":"2023-11-28T11:10:36.128548+0000","last_unstale":"2023-11-28T11:10:39.583846+0000","last_undegraded":"2023-11-28T11:10:39.583846+0000","last_fullsized":"2023-11-28T11:10:39.583846+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:55:32.368703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514980+0000","last_change":"2023-11-28T11:10:36.524201+0000","last_active":"2023-11-28T11:10:37.514980+0000","last_peered":"2023-11-28T11:10:37.514980+0000","last_clean":"2023-11-28T11:10:37.514980+0000","last_became_active":"2023-11-28T11:10:36.521915+0000","last_became_peered":"2023-11-28T11:10:36.521915+0000","last_unstale":"2023-11-28T11:10:37.514980+0000","last_undegraded":"2023-11-28T11:10:37.514980+0000","last_fullsized":"2023-11-28T11:10:37.514980+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:19:19.207096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514992+0000","last_change":"2023-11-28T11:10:36.136502+0000","last_active":"2023-11-28T11:10:37.514992+0000","last_peered":"2023-11-28T11:10:37.514992+0000","last_clean":"2023-11-28T11:10:37.514992+0000","last_became_active":"2023-11-28T11:10:36.136213+0000","last_became_peered":"2023-11-28T11:10:36.136213+0000","last_unstale":"2023-11-28T11:10:37.514992+0000","last_undegraded":"2023-11-28T11:10:37.514992+0000","last_fullsized":"2023-11-28T11:10:37.514992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:28.022412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583747+0000","last_change":"2023-11-28T11:10:36.532774+0000","last_active":"2023-11-28T11:10:39.583747+0000","last_peered":"2023-11-28T11:10:39.583747+0000","last_clean":"2023-11-28T11:10:39.583747+0000","last_became_active":"2023-11-28T11:10:36.532064+0000","last_became_peered":"2023-11-28T11:10:36.532064+0000","last_unstale":"2023-11-28T11:10:39.583747+0000","last_undegraded":"2023-11-28T11:10:39.583747+0000","last_fullsized":"2023-11-28T11:10:39.583747+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:58.155221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.547087+0000","last_change":"2023-11-28T11:10:36.128272+0000","last_active":"2023-11-28T11:10:36.547087+0000","last_peered":"2023-11-28T11:10:36.547087+0000","last_clean":"2023-11-28T11:10:36.547087+0000","last_became_active":"2023-11-28T11:10:36.127792+0000","last_became_peered":"2023-11-28T11:10:36.127792+0000","last_unstale":"2023-11-28T11:10:36.547087+0000","last_undegraded":"2023-11-28T11:10:36.547087+0000","last_fullsized":"2023-11-28T11:10:36.547087+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:55:32.368703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.530301+0000","last_change":"2023-11-28T11:10:36.527358+0000","last_active":"2023-11-28T11:10:36.530301+0000","last_peered":"2023-11-28T11:10:36.530301+0000","last_clean":"2023-11-28T11:10:36.530301+0000","last_became_active":"2023-11-28T11:10:36.526775+0000","last_became_peered":"2023-11-28T11:10:36.526775+0000","last_unstale":"2023-11-28T11:10:36.530301+0000","last_undegraded":"2023-11-28T11:10:36.530301+0000","last_fullsized":"2023-11-28T11:10:36.530301+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:58.155221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514858+0000","last_change":"2023-11-28T11:10:36.118915+0000","last_active":"2023-11-28T11:10:37.514858+0000","last_peered":"2023-11-28T11:10:37.514858+0000","last_clean":"2023-11-28T11:10:37.514858+0000","last_became_active":"2023-11-28T11:10:36.118661+0000","last_became_peered":"2023-11-28T11:10:36.118661+0000","last_unstale":"2023-11-28T11:10:37.514858+0000","last_undegraded":"2023-11-28T11:10:37.514858+0000","last_fullsized":"2023-11-28T11:10:37.514858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:30.368123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515289+0000","last_change":"2023-11-28T11:10:36.528346+0000","last_active":"2023-11-28T11:10:37.515289+0000","last_peered":"2023-11-28T11:10:37.515289+0000","last_clean":"2023-11-28T11:10:37.515289+0000","last_became_active":"2023-11-28T11:10:36.528097+0000","last_became_peered":"2023-11-28T11:10:36.528097+0000","last_unstale":"2023-11-28T11:10:37.515289+0000","last_undegraded":"2023-11-28T11:10:37.515289+0000","last_fullsized":"2023-11-28T11:10:37.515289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:33.646649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.520225+0000","last_change":"2023-11-28T11:10:36.126459+0000","last_active":"2023-11-28T11:10:36.520225+0000","last_peered":"2023-11-28T11:10:36.520225+0000","last_clean":"2023-11-28T11:10:36.520225+0000","last_became_active":"2023-11-28T11:10:36.126182+0000","last_became_peered":"2023-11-28T11:10:36.126182+0000","last_unstale":"2023-11-28T11:10:36.520225+0000","last_undegraded":"2023-11-28T11:10:36.520225+0000","last_fullsized":"2023-11-28T11:10:36.520225+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:12.568877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538038+0000","last_change":"2023-11-28T11:10:36.531273+0000","last_active":"2023-11-28T11:10:36.538038+0000","last_peered":"2023-11-28T11:10:36.538038+0000","last_clean":"2023-11-28T11:10:36.538038+0000","last_became_active":"2023-11-28T11:10:36.530999+0000","last_became_peered":"2023-11-28T11:10:36.530999+0000","last_unstale":"2023-11-28T11:10:36.538038+0000","last_undegraded":"2023-11-28T11:10:36.538038+0000","last_fullsized":"2023-11-28T11:10:36.538038+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:57.427676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515092+0000","last_change":"2023-11-28T11:10:36.123367+0000","last_active":"2023-11-28T11:10:37.515092+0000","last_peered":"2023-11-28T11:10:37.515092+0000","last_clean":"2023-11-28T11:10:37.515092+0000","last_became_active":"2023-11-28T11:10:36.122981+0000","last_became_peered":"2023-11-28T11:10:36.122981+0000","last_unstale":"2023-11-28T11:10:37.515092+0000","last_undegraded":"2023-11-28T11:10:37.515092+0000","last_fullsized":"2023-11-28T11:10:37.515092+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:33:27.881264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515752+0000","last_change":"2023-11-28T11:10:36.528470+0000","last_active":"2023-11-28T11:10:37.515752+0000","last_peered":"2023-11-28T11:10:37.515752+0000","last_clean":"2023-11-28T11:10:37.515752+0000","last_became_active":"2023-11-28T11:10:36.527851+0000","last_became_peered":"2023-11-28T11:10:36.527851+0000","last_unstale":"2023-11-28T11:10:37.515752+0000","last_undegraded":"2023-11-28T11:10:37.515752+0000","last_fullsized":"2023-11-28T11:10:37.515752+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:10.382472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.544545+0000","last_change":"2023-11-28T11:10:36.121933+0000","last_active":"2023-11-28T11:10:36.544545+0000","last_peered":"2023-11-28T11:10:36.544545+0000","last_clean":"2023-11-28T11:10:36.544545+0000","last_became_active":"2023-11-28T11:10:36.121666+0000","last_became_peered":"2023-11-28T11:10:36.121666+0000","last_unstale":"2023-11-28T11:10:36.544545+0000","last_undegraded":"2023-11-28T11:10:36.544545+0000","last_fullsized":"2023-11-28T11:10:36.544545+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:41.671362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.539768+0000","last_change":"2023-11-28T11:10:36.534842+0000","last_active":"2023-11-28T11:10:36.539768+0000","last_peered":"2023-11-28T11:10:36.539768+0000","last_clean":"2023-11-28T11:10:36.539768+0000","last_became_active":"2023-11-28T11:10:36.534497+0000","last_became_peered":"2023-11-28T11:10:36.534497+0000","last_unstale":"2023-11-28T11:10:36.539768+0000","last_undegraded":"2023-11-28T11:10:36.539768+0000","last_fullsized":"2023-11-28T11:10:36.539768+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:12.836764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515505+0000","last_change":"2023-11-28T11:10:36.126441+0000","last_active":"2023-11-28T11:10:37.515505+0000","last_peered":"2023-11-28T11:10:37.515505+0000","last_clean":"2023-11-28T11:10:37.515505+0000","last_became_active":"2023-11-28T11:10:36.125967+0000","last_became_peered":"2023-11-28T11:10:36.125967+0000","last_unstale":"2023-11-28T11:10:37.515505+0000","last_undegraded":"2023-11-28T11:10:37.515505+0000","last_fullsized":"2023-11-28T11:10:37.515505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:08.438167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514473+0000","last_change":"2023-11-28T11:10:36.531244+0000","last_active":"2023-11-28T11:10:37.514473+0000","last_peered":"2023-11-28T11:10:37.514473+0000","last_clean":"2023-11-28T11:10:37.514473+0000","last_became_active":"2023-11-28T11:10:36.530978+0000","last_became_peered":"2023-11-28T11:10:36.530978+0000","last_unstale":"2023-11-28T11:10:37.514473+0000","last_undegraded":"2023-11-28T11:10:37.514473+0000","last_fullsized":"2023-11-28T11:10:37.514473+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.833897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141759+0000","last_change":"2023-11-28T11:10:36.123203+0000","last_active":"2023-11-28T11:10:38.141759+0000","last_peered":"2023-11-28T11:10:38.141759+0000","last_clean":"2023-11-28T11:10:38.141759+0000","last_became_active":"2023-11-28T11:10:36.122988+0000","last_became_peered":"2023-11-28T11:10:36.122988+0000","last_unstale":"2023-11-28T11:10:38.141759+0000","last_undegraded":"2023-11-28T11:10:38.141759+0000","last_fullsized":"2023-11-28T11:10:38.141759+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:33.478864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583562+0000","last_change":"2023-11-28T11:10:36.534096+0000","last_active":"2023-11-28T11:10:39.583562+0000","last_peered":"2023-11-28T11:10:39.583562+0000","last_clean":"2023-11-28T11:10:39.583562+0000","last_became_active":"2023-11-28T11:10:36.533808+0000","last_became_peered":"2023-11-28T11:10:36.533808+0000","last_unstale":"2023-11-28T11:10:39.583562+0000","last_undegraded":"2023-11-28T11:10:39.583562+0000","last_fullsized":"2023-11-28T11:10:39.583562+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:51.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.535986+0000","last_change":"2023-11-28T11:10:36.136515+0000","last_active":"2023-11-28T11:10:36.535986+0000","last_peered":"2023-11-28T11:10:36.535986+0000","last_clean":"2023-11-28T11:10:36.535986+0000","last_became_active":"2023-11-28T11:10:36.136242+0000","last_became_peered":"2023-11-28T11:10:36.136242+0000","last_unstale":"2023-11-28T11:10:36.535986+0000","last_undegraded":"2023-11-28T11:10:36.535986+0000","last_fullsized":"2023-11-28T11:10:36.535986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:48.913184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514472+0000","last_change":"2023-11-28T11:10:36.524080+0000","last_active":"2023-11-28T11:10:37.514472+0000","last_peered":"2023-11-28T11:10:37.514472+0000","last_clean":"2023-11-28T11:10:37.514472+0000","last_became_active":"2023-11-28T11:10:36.523831+0000","last_became_peered":"2023-11-28T11:10:36.523831+0000","last_unstale":"2023-11-28T11:10:37.514472+0000","last_undegraded":"2023-11-28T11:10:37.514472+0000","last_fullsized":"2023-11-28T11:10:37.514472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.519780+0000","last_change":"2023-11-28T11:10:36.124870+0000","last_active":"2023-11-28T11:10:36.519780+0000","last_peered":"2023-11-28T11:10:36.519780+0000","last_clean":"2023-11-28T11:10:36.519780+0000","last_became_active":"2023-11-28T11:10:36.124623+0000","last_became_peered":"2023-11-28T11:10:36.124623+0000","last_unstale":"2023-11-28T11:10:36.519780+0000","last_undegraded":"2023-11-28T11:10:36.519780+0000","last_fullsized":"2023-11-28T11:10:36.519780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:25:36.553811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.535490+0000","last_change":"2023-11-28T11:10:36.532774+0000","last_active":"2023-11-28T11:10:36.535490+0000","last_peered":"2023-11-28T11:10:36.535490+0000","last_clean":"2023-11-28T11:10:36.535490+0000","last_became_active":"2023-11-28T11:10:36.532486+0000","last_became_peered":"2023-11-28T11:10:36.532486+0000","last_unstale":"2023-11-28T11:10:36.535490+0000","last_undegraded":"2023-11-28T11:10:36.535490+0000","last_fullsized":"2023-11-28T11:10:36.535490+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514367+0000","last_change":"2023-11-28T11:10:36.136094+0000","last_active":"2023-11-28T11:10:37.514367+0000","last_peered":"2023-11-28T11:10:37.514367+0000","last_clean":"2023-11-28T11:10:37.514367+0000","last_became_active":"2023-11-28T11:10:36.135780+0000","last_became_peered":"2023-11-28T11:10:36.135780+0000","last_unstale":"2023-11-28T11:10:37.514367+0000","last_undegraded":"2023-11-28T11:10:37.514367+0000","last_fullsized":"2023-11-28T11:10:37.514367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:08.762868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.533382+0000","last_change":"2023-11-28T11:10:36.531381+0000","last_active":"2023-11-28T11:10:36.533382+0000","last_peered":"2023-11-28T11:10:36.533382+0000","last_clean":"2023-11-28T11:10:36.533382+0000","last_became_active":"2023-11-28T11:10:36.531088+0000","last_became_peered":"2023-11-28T11:10:36.531088+0000","last_unstale":"2023-11-28T11:10:36.533382+0000","last_undegraded":"2023-11-28T11:10:36.533382+0000","last_fullsized":"2023-11-28T11:10:36.533382+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:33.596539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.519949+0000","last_change":"2023-11-28T11:10:36.128467+0000","last_active":"2023-11-28T11:10:36.519949+0000","last_peered":"2023-11-28T11:10:36.519949+0000","last_clean":"2023-11-28T11:10:36.519949+0000","last_became_active":"2023-11-28T11:10:36.128068+0000","last_became_peered":"2023-11-28T11:10:36.128068+0000","last_unstale":"2023-11-28T11:10:36.519949+0000","last_undegraded":"2023-11-28T11:10:36.519949+0000","last_fullsized":"2023-11-28T11:10:36.519949+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:04.198577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515424+0000","last_change":"2023-11-28T11:10:36.529075+0000","last_active":"2023-11-28T11:10:37.515424+0000","last_peered":"2023-11-28T11:10:37.515424+0000","last_clean":"2023-11-28T11:10:37.515424+0000","last_became_active":"2023-11-28T11:10:36.528708+0000","last_became_peered":"2023-11-28T11:10:36.528708+0000","last_unstale":"2023-11-28T11:10:37.515424+0000","last_undegraded":"2023-11-28T11:10:37.515424+0000","last_fullsized":"2023-11-28T11:10:37.515424+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514729+0000","last_change":"2023-11-28T11:10:36.136681+0000","last_active":"2023-11-28T11:10:37.514729+0000","last_peered":"2023-11-28T11:10:37.514729+0000","last_clean":"2023-11-28T11:10:37.514729+0000","last_became_active":"2023-11-28T11:10:36.136334+0000","last_became_peered":"2023-11-28T11:10:36.136334+0000","last_unstale":"2023-11-28T11:10:37.514729+0000","last_undegraded":"2023-11-28T11:10:37.514729+0000","last_fullsized":"2023-11-28T11:10:37.514729+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:32.757363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514740+0000","last_change":"2023-11-28T11:10:36.527508+0000","last_active":"2023-11-28T11:10:37.514740+0000","last_peered":"2023-11-28T11:10:37.514740+0000","last_clean":"2023-11-28T11:10:37.514740+0000","last_became_active":"2023-11-28T11:10:36.527266+0000","last_became_peered":"2023-11-28T11:10:36.527266+0000","last_unstale":"2023-11-28T11:10:37.514740+0000","last_undegraded":"2023-11-28T11:10:37.514740+0000","last_fullsized":"2023-11-28T11:10:37.514740+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:42.678837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141490+0000","last_change":"2023-11-28T11:10:36.118325+0000","last_active":"2023-11-28T11:10:38.141490+0000","last_peered":"2023-11-28T11:10:38.141490+0000","last_clean":"2023-11-28T11:10:38.141490+0000","last_became_active":"2023-11-28T11:10:36.117983+0000","last_became_peered":"2023-11-28T11:10:36.117983+0000","last_unstale":"2023-11-28T11:10:38.141490+0000","last_undegraded":"2023-11-28T11:10:38.141490+0000","last_fullsized":"2023-11-28T11:10:38.141490+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:25.568140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515333+0000","last_change":"2023-11-28T11:10:36.527082+0000","last_active":"2023-11-28T11:10:37.515333+0000","last_peered":"2023-11-28T11:10:37.515333+0000","last_clean":"2023-11-28T11:10:37.515333+0000","last_became_active":"2023-11-28T11:10:36.526836+0000","last_became_peered":"2023-11-28T11:10:36.526836+0000","last_unstale":"2023-11-28T11:10:37.515333+0000","last_undegraded":"2023-11-28T11:10:37.515333+0000","last_fullsized":"2023-11-28T11:10:37.515333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:51.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583556+0000","last_change":"2023-11-28T11:10:36.123639+0000","last_active":"2023-11-28T11:10:39.583556+0000","last_peered":"2023-11-28T11:10:39.583556+0000","last_clean":"2023-11-28T11:10:39.583556+0000","last_became_active":"2023-11-28T11:10:36.123346+0000","last_became_peered":"2023-11-28T11:10:36.123346+0000","last_unstale":"2023-11-28T11:10:39.583556+0000","last_undegraded":"2023-11-28T11:10:39.583556+0000","last_fullsized":"2023-11-28T11:10:39.583556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:04.366016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515629+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:10:37.515629+0000","last_peered":"2023-11-28T11:10:37.515629+0000","last_clean":"2023-11-28T11:10:37.515629+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:10:37.515629+0000","last_undegraded":"2023-11-28T11:10:37.515629+0000","last_fullsized":"2023-11-28T11:10:37.515629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.541384+0000","last_change":"2023-11-28T11:10:36.540771+0000","last_active":"2023-11-28T11:10:36.541384+0000","last_peered":"2023-11-28T11:10:36.541384+0000","last_clean":"2023-11-28T11:10:36.541384+0000","last_became_active":"2023-11-28T11:10:36.540507+0000","last_became_peered":"2023-11-28T11:10:36.540507+0000","last_unstale":"2023-11-28T11:10:36.541384+0000","last_undegraded":"2023-11-28T11:10:36.541384+0000","last_fullsized":"2023-11-28T11:10:36.541384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:48.693779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538022+0000","last_change":"2023-11-28T11:10:36.126657+0000","last_active":"2023-11-28T11:10:36.538022+0000","last_peered":"2023-11-28T11:10:36.538022+0000","last_clean":"2023-11-28T11:10:36.538022+0000","last_became_active":"2023-11-28T11:10:36.126383+0000","last_became_peered":"2023-11-28T11:10:36.126383+0000","last_unstale":"2023-11-28T11:10:36.538022+0000","last_undegraded":"2023-11-28T11:10:36.538022+0000","last_fullsized":"2023-11-28T11:10:36.538022+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:50:37.096652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.517950+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:10:36.517950+0000","last_peered":"2023-11-28T11:10:36.517950+0000","last_clean":"2023-11-28T11:10:36.517950+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:10:36.517950+0000","last_undegraded":"2023-11-28T11:10:36.517950+0000","last_fullsized":"2023-11-28T11:10:36.517950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538297+0000","last_change":"2023-11-28T11:10:36.534490+0000","last_active":"2023-11-28T11:10:36.538297+0000","last_peered":"2023-11-28T11:10:36.538297+0000","last_clean":"2023-11-28T11:10:36.538297+0000","last_became_active":"2023-11-28T11:10:36.534230+0000","last_became_peered":"2023-11-28T11:10:36.534230+0000","last_unstale":"2023-11-28T11:10:36.538297+0000","last_undegraded":"2023-11-28T11:10:36.538297+0000","last_fullsized":"2023-11-28T11:10:36.538297+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:40.802246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515180+0000","last_change":"2023-11-28T11:10:36.126778+0000","last_active":"2023-11-28T11:10:37.515180+0000","last_peered":"2023-11-28T11:10:37.515180+0000","last_clean":"2023-11-28T11:10:37.515180+0000","last_became_active":"2023-11-28T11:10:36.126275+0000","last_became_peered":"2023-11-28T11:10:36.126275+0000","last_unstale":"2023-11-28T11:10:37.515180+0000","last_undegraded":"2023-11-28T11:10:37.515180+0000","last_fullsized":"2023-11-28T11:10:37.515180+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:04.198577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141619+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:10:38.141619+0000","last_peered":"2023-11-28T11:10:38.141619+0000","last_clean":"2023-11-28T11:10:38.141619+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:10:38.141619+0000","last_undegraded":"2023-11-28T11:10:38.141619+0000","last_fullsized":"2023-11-28T11:10:38.141619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.524865+0000","last_change":"2023-11-28T11:10:36.524114+0000","last_active":"2023-11-28T11:10:36.524865+0000","last_peered":"2023-11-28T11:10:36.524865+0000","last_clean":"2023-11-28T11:10:36.524865+0000","last_became_active":"2023-11-28T11:10:36.523827+0000","last_became_peered":"2023-11-28T11:10:36.523827+0000","last_unstale":"2023-11-28T11:10:36.524865+0000","last_undegraded":"2023-11-28T11:10:36.524865+0000","last_fullsized":"2023-11-28T11:10:36.524865+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:23.676984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515501+0000","last_change":"2023-11-28T11:10:36.119977+0000","last_active":"2023-11-28T11:10:37.515501+0000","last_peered":"2023-11-28T11:10:37.515501+0000","last_clean":"2023-11-28T11:10:37.515501+0000","last_became_active":"2023-11-28T11:10:36.117081+0000","last_became_peered":"2023-11-28T11:10:36.117081+0000","last_unstale":"2023-11-28T11:10:37.515501+0000","last_undegraded":"2023-11-28T11:10:37.515501+0000","last_fullsized":"2023-11-28T11:10:37.515501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:08.312145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.517493+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:10:36.517493+0000","last_peered":"2023-11-28T11:10:36.517493+0000","last_clean":"2023-11-28T11:10:36.517493+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:10:36.517493+0000","last_undegraded":"2023-11-28T11:10:36.517493+0000","last_fullsized":"2023-11-28T11:10:36.517493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.513577+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:10:36.513577+0000","last_peered":"2023-11-28T11:10:36.513577+0000","last_clean":"2023-11-28T11:10:36.513577+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:10:36.513577+0000","last_undegraded":"2023-11-28T11:10:36.513577+0000","last_fullsized":"2023-11-28T11:10:36.513577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514556+0000","last_change":"2023-11-28T11:10:36.529294+0000","last_active":"2023-11-28T11:10:37.514556+0000","last_peered":"2023-11-28T11:10:37.514556+0000","last_clean":"2023-11-28T11:10:37.514556+0000","last_became_active":"2023-11-28T11:10:36.529051+0000","last_became_peered":"2023-11-28T11:10:36.529051+0000","last_unstale":"2023-11-28T11:10:37.514556+0000","last_undegraded":"2023-11-28T11:10:37.514556+0000","last_fullsized":"2023-11-28T11:10:37.514556+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:09.319621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515058+0000","last_change":"2023-11-28T11:10:36.124673+0000","last_active":"2023-11-28T11:10:37.515058+0000","last_peered":"2023-11-28T11:10:37.515058+0000","last_clean":"2023-11-28T11:10:37.515058+0000","last_became_active":"2023-11-28T11:10:36.124359+0000","last_became_peered":"2023-11-28T11:10:36.124359+0000","last_unstale":"2023-11-28T11:10:37.515058+0000","last_undegraded":"2023-11-28T11:10:37.515058+0000","last_fullsized":"2023-11-28T11:10:37.515058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:34.374591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.513691+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:10:36.513691+0000","last_peered":"2023-11-28T11:10:36.513691+0000","last_clean":"2023-11-28T11:10:36.513691+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:10:36.513691+0000","last_undegraded":"2023-11-28T11:10:36.513691+0000","last_fullsized":"2023-11-28T11:10:36.513691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.537940+0000","last_change":"2023-11-28T11:10:36.526598+0000","last_active":"2023-11-28T11:10:36.537940+0000","last_peered":"2023-11-28T11:10:36.537940+0000","last_clean":"2023-11-28T11:10:36.537940+0000","last_became_active":"2023-11-28T11:10:36.526319+0000","last_became_peered":"2023-11-28T11:10:36.526319+0000","last_unstale":"2023-11-28T11:10:36.537940+0000","last_undegraded":"2023-11-28T11:10:36.537940+0000","last_fullsized":"2023-11-28T11:10:36.537940+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:28.375662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.518951+0000","last_change":"2023-11-28T11:10:36.133707+0000","last_active":"2023-11-28T11:10:36.518951+0000","last_peered":"2023-11-28T11:10:36.518951+0000","last_clean":"2023-11-28T11:10:36.518951+0000","last_became_active":"2023-11-28T11:10:36.133380+0000","last_became_peered":"2023-11-28T11:10:36.133380+0000","last_unstale":"2023-11-28T11:10:36.518951+0000","last_undegraded":"2023-11-28T11:10:36.518951+0000","last_fullsized":"2023-11-28T11:10:36.518951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:33.877212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515099+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:10:37.515099+0000","last_peered":"2023-11-28T11:10:37.515099+0000","last_clean":"2023-11-28T11:10:37.515099+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:10:37.515099+0000","last_undegraded":"2023-11-28T11:10:37.515099+0000","last_fullsized":"2023-11-28T11:10:37.515099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515046+0000","last_change":"2023-11-28T11:10:36.528366+0000","last_active":"2023-11-28T11:10:37.515046+0000","last_peered":"2023-11-28T11:10:37.515046+0000","last_clean":"2023-11-28T11:10:37.515046+0000","last_became_active":"2023-11-28T11:10:36.528119+0000","last_became_peered":"2023-11-28T11:10:36.528119+0000","last_unstale":"2023-11-28T11:10:37.515046+0000","last_undegraded":"2023-11-28T11:10:37.515046+0000","last_fullsized":"2023-11-28T11:10:37.515046+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:05.763064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.522685+0000","last_change":"2023-11-28T11:10:36.124716+0000","last_active":"2023-11-28T11:10:36.522685+0000","last_peered":"2023-11-28T11:10:36.522685+0000","last_clean":"2023-11-28T11:10:36.522685+0000","last_became_active":"2023-11-28T11:10:36.124462+0000","last_became_peered":"2023-11-28T11:10:36.124462+0000","last_unstale":"2023-11-28T11:10:36.522685+0000","last_undegraded":"2023-11-28T11:10:36.522685+0000","last_fullsized":"2023-11-28T11:10:36.522685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:04.366016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.519077+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:10:36.519077+0000","last_peered":"2023-11-28T11:10:36.519077+0000","last_clean":"2023-11-28T11:10:36.519077+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:10:36.519077+0000","last_undegraded":"2023-11-28T11:10:36.519077+0000","last_fullsized":"2023-11-28T11:10:36.519077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.527232+0000","last_change":"2023-11-28T11:10:36.524993+0000","last_active":"2023-11-28T11:10:36.527232+0000","last_peered":"2023-11-28T11:10:36.527232+0000","last_clean":"2023-11-28T11:10:36.527232+0000","last_became_active":"2023-11-28T11:10:36.524685+0000","last_became_peered":"2023-11-28T11:10:36.524685+0000","last_unstale":"2023-11-28T11:10:36.527232+0000","last_undegraded":"2023-11-28T11:10:36.527232+0000","last_fullsized":"2023-11-28T11:10:36.527232+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.520040+0000","last_change":"2023-11-28T11:10:36.136431+0000","last_active":"2023-11-28T11:10:36.520040+0000","last_peered":"2023-11-28T11:10:36.520040+0000","last_clean":"2023-11-28T11:10:36.520040+0000","last_became_active":"2023-11-28T11:10:36.136139+0000","last_became_peered":"2023-11-28T11:10:36.136139+0000","last_unstale":"2023-11-28T11:10:36.520040+0000","last_undegraded":"2023-11-28T11:10:36.520040+0000","last_fullsized":"2023-11-28T11:10:36.520040+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:30.368123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.121343+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:10:36.121343+0000","last_peered":"2023-11-28T11:10:36.121343+0000","last_clean":"2023-11-28T11:10:36.121343+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:10:36.121343+0000","last_undegraded":"2023-11-28T11:10:36.121343+0000","last_fullsized":"2023-11-28T11:10:36.121343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10284,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361556,"statfs":{"total":96636764160,"available":96626233344,"internally_reserved":0,"allocated":1216512,"data_stored":856083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.40000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71799999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.69899999999999995,"15min":0.72199999999999998},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.73899999999999999,"15min":0.76600000000000001},"min":{"1min":0.39700000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82999999999999996,"5min":5.532,"15min":5.532},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.66700000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70499999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67800000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.39500000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.43099999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75800000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.438,"5min":0.437,"15min":0.437},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.501},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.995,"15min":0.995},"last":0.54900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8860,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362980,"statfs":{"total":96636764160,"available":96627691520,"internally_reserved":0,"allocated":610304,"data_stored":259574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.503,"15min":0.49299999999999999},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.624},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.74199999999999999,"15min":0.77600000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65900000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.55000000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.74199999999999999,"15min":0.77000000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79500000000000004,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.70699999999999996,"15min":0.73199999999999998},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71699999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.746,"15min":0.77800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72199999999999998,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.52900000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52300000000000002,"15min":0.51800000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.44},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.46400000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.875,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.36699999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":1.137,"15min":1.137},"last":0.65000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9000,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362840,"statfs":{"total":96636764160,"available":96627548160,"internally_reserved":0,"allocated":622592,"data_stored":265751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33100000000000002,"15min":0.33500000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.41799999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.496},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.22,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.55500000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33400000000000002,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44700000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.36299999999999999,"15min":0.36599999999999999},"min":{"1min":0.23599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48799999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.54300000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.504,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.63,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82199999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.78500000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78200000000000003,"5min":0.999,"15min":0.999},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.036,"15min":1.036},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84499999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10156,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361684,"statfs":{"total":96636764160,"available":96626364416,"internally_reserved":0,"allocated":1216512,"data_stored":856015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.33900000000000002},"min":{"1min":0.23899999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54200000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32900000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.22600000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.44500000000000001,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.316},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.439,"15min":0.45400000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.58499999999999996,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.309},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.51600000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.35399999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.872,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77500000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":3.298,"15min":3.298},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.72099999999999997,"15min":0.74399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85699999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.56100000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84399999999999997,"5min":0.877,"15min":0.877},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8940,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362900,"statfs":{"total":96636764160,"available":96627609600,"internally_reserved":0,"allocated":626688,"data_stored":267139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.317},"min":{"1min":0.26500000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.47999999999999998,"5min":0.503,"15min":0.503},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36199999999999999,"15min":0.35599999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.503,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.435}]},{"osd":1,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34200000000000003,"15min":0.33600000000000002},"min":{"1min":0.29599999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.504,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.33900000000000002},"min":{"1min":0.26900000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54600000000000004,"5min":1.002,"15min":1.002},"last":0.37}]},{"osd":3,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35499999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.374,"15min":0.36799999999999999},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51600000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73499999999999999,"5min":0.875,"15min":0.875},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.504},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.75600000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52700000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73499999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46000000000000002}]},{"osd":7,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.44800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.80800000000000005,"5min":1.05,"15min":1.05},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.751,"5min":1.222,"15min":1.222},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":618496,"data_stored":260508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.36099999999999999,"15min":0.36799999999999999},"min":{"1min":0.22700000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.435,"5min":1.365,"15min":1.365},"last":0.253},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.66300000000000003,"15min":0.72299999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41599999999999998,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.376}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.73599999999999999,"15min":0.80300000000000005},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45300000000000001,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.317},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.39800000000000002,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.44,"5min":1.448,"15min":1.448},"last":0.29999999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.42099999999999999,"15min":0.434},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.52100000000000002,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42499999999999999,"15min":0.42599999999999999},"min":{"1min":0.29099999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.298,"5min":1.474,"15min":1.474},"last":0.38900000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.85499999999999998,"15min":0.90100000000000002},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.94399999999999995,"15min":1.004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.94299999999999995,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.51400000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.93899999999999995,"15min":0.996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.996,"5min":12.994,"15min":12.994},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.95399999999999996,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.90800000000000003,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97799999999999998,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.97899999999999998,"15min":1.038},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.05,"5min":12.932,"15min":12.932},"last":0.53900000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.91200000000000003,"15min":0.96199999999999997},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.038,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.60099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9112,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362728,"statfs":{"total":96636764160,"available":96627433472,"internally_reserved":0,"allocated":606208,"data_stored":259504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.501},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.68500000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60899999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65500000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.68700000000000006}]},{"osd":2,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68500000000000005,"5min":0.747,"15min":0.747},"last":0.754}]},{"osd":3,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69299999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67000000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.77100000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73099999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.85799999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72499999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.78100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9044,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362796,"statfs":{"total":96636764160,"available":96627503104,"internally_reserved":0,"allocated":602112,"data_stored":258938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.522,"15min":1.522},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76700000000000002,"5min":1.452,"15min":1.452},"last":0.58299999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76700000000000002,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.69599999999999995,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68799999999999994,"5min":1.032,"15min":1.032},"last":0.622},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":2.282,"15min":2.282},"last":0.46600000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":1.401,"15min":1.401},"last":0.496},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":1.478,"15min":1.478},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.53100000000000003}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68400000000000005,"15min":0.69699999999999995},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83499999999999996,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.55900000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":2.444,"15min":2.444},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.441,"5min":0.44,"15min":0.44},"max":{"1min":0.90300000000000002,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.54800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:10:45.105 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:10:45.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.243+0000 7f0d2ac97700 1 Processor -- start 2023-11-28T11:10:45.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.244+0000 7f0d2ac97700 1 -- start start 2023-11-28T11:10:45.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.244+0000 7f0d2ac97700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d2415e010 0x7f0d240ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.244+0000 7f0d2ac97700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2415af30 con 0x7f0d240d15f0 2023-11-28T11:10:45.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.244+0000 7f0d2ac97700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2415ef40 con 0x7f0d2406e400 2023-11-28T11:10:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.244+0000 7f0d2ac97700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2415a9d0 con 0x7f0d2415e010 2023-11-28T11:10:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.245+0000 7f0d29234700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d2415e010 0x7f0d240ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.245+0000 7f0d23fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0d240d15f0 0x7f0d2415b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44436/0 (socket says 172.21.15.125:44436) 2023-11-28T11:10:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.245+0000 7f0d23fff700 1 -- 172.21.15.125:0/1203893974 learned_addr learned my addr 172.21.15.125:0/1203893974 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.245+0000 7f0d29234700 1 -- 172.21.15.125:0/1203893974 >> v1:172.21.15.167:6789/0 conn(0x7f0d2406e400 legacy=0x7f0d2406e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.245+0000 7f0d29234700 1 -- 172.21.15.125:0/1203893974 >> v1:172.21.15.125:6789/0 conn(0x7f0d240d15f0 legacy=0x7f0d2415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.245+0000 7f0d237fe700 1 -- 172.21.15.125:0/1203893974 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912341884 0 0) 0x7f0d2415af30 con 0x7f0d240d15f0 2023-11-28T11:10:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.245+0000 7f0d29234700 1 -- 172.21.15.125:0/1203893974 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2415e980 con 0x7f0d2415e010 2023-11-28T11:10:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.245+0000 7f0d29234700 1 --2- 172.21.15.125:0/1203893974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d2415e010 0x7f0d240ce970 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009d90 tx=0x7f0d1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed789ef6de3a1e1f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.245+0000 7f0d237fe700 1 -- 172.21.15.125:0/1203893974 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00e070 con 0x7f0d2415e010 2023-11-28T11:10:45.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.245+0000 7f0d237fe700 1 -- 172.21.15.125:0/1203893974 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c00bbd0 con 0x7f0d2415e010 2023-11-28T11:10:45.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.245+0000 7f0d237fe700 1 -- 172.21.15.125:0/1203893974 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c012430 con 0x7f0d2415e010 2023-11-28T11:10:45.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.246+0000 7f0d2ac97700 1 -- 172.21.15.125:0/1203893974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d2415e010 msgr2=0x7f0d240ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.246+0000 7f0d2ac97700 1 --2- 172.21.15.125:0/1203893974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d2415e010 0x7f0d240ce970 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009d90 tx=0x7f0d1c00b330 comp rx=0 tx=0).stop 2023-11-28T11:10:45.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.246+0000 7f0d2ac97700 1 -- 172.21.15.125:0/1203893974 shutdown_connections 2023-11-28T11:10:45.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.246+0000 7f0d2ac97700 1 --2- 172.21.15.125:0/1203893974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d2415e010 0x7f0d240ce970 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.246+0000 7f0d2ac97700 1 -- 172.21.15.125:0/1203893974 >> 172.21.15.125:0/1203893974 conn(0x7f0d2406a270 msgr2=0x7f0d2406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:45.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.246+0000 7f0d2ac97700 1 -- 172.21.15.125:0/1203893974 shutdown_connections 2023-11-28T11:10:45.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.246+0000 7f0d2ac97700 1 -- 172.21.15.125:0/1203893974 wait complete. 2023-11-28T11:10:45.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.247+0000 7f0d2ac97700 1 Processor -- start 2023-11-28T11:10:45.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.247+0000 7f0d2ac97700 1 -- start start 2023-11-28T11:10:45.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.248+0000 7f0d2ac97700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d2406e400 0x7f0d240cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.248+0000 7f0d2ac97700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d240d15f0 0x7f0d240b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.248+0000 7f0d2ac97700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2415e010 0x7f0d24149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.248+0000 7f0d2ac97700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240b5c90 con 0x7f0d240d15f0 2023-11-28T11:10:45.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.248+0000 7f0d2ac97700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240b4bf0 con 0x7f0d2415e010 2023-11-28T11:10:45.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.248+0000 7f0d2ac97700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240b4ed0 con 0x7f0d2406e400 2023-11-28T11:10:45.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.248+0000 7f0d23fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d240d15f0 0x7f0d240b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d23fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d240d15f0 0x7f0d240b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60320/0 (socket says 172.21.15.125:60320) 2023-11-28T11:10:45.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d23fff700 1 -- 172.21.15.125:0/4027977756 learned_addr learned my addr 172.21.15.125:0/4027977756 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d29234700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2415e010 0x7f0d24149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d23fff700 1 -- 172.21.15.125:0/4027977756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d2406e400 msgr2=0x7f0d240cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d23fff700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d2406e400 0x7f0d240cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d23fff700 1 -- 172.21.15.125:0/4027977756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2415e010 msgr2=0x7f0d24149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d23fff700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2415e010 0x7f0d24149350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d23fff700 1 -- 172.21.15.125:0/4027977756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c009a70 con 0x7f0d240d15f0 2023-11-28T11:10:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d23fff700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d240d15f0 0x7f0d240b4250 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0d10001eb0 tx=0x7f0d1000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d217fa700 1 -- 172.21.15.125:0/4027977756 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10004c80 con 0x7f0d240d15f0 2023-11-28T11:10:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d217fa700 1 -- 172.21.15.125:0/4027977756 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d10004de0 con 0x7f0d240d15f0 2023-11-28T11:10:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d2ac97700 1 -- 172.21.15.125:0/4027977756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2415abc0 con 0x7f0d240d15f0 2023-11-28T11:10:45.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d217fa700 1 -- 172.21.15.125:0/4027977756 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10007310 con 0x7f0d240d15f0 2023-11-28T11:10:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.249+0000 7f0d2ac97700 1 -- 172.21.15.125:0/4027977756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2415ec60 con 0x7f0d240d15f0 2023-11-28T11:10:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.250+0000 7f0d2ac97700 1 -- 172.21.15.125:0/4027977756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2415e490 con 0x7f0d240d15f0 2023-11-28T11:10:45.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.251+0000 7f0d217fa700 1 -- 172.21.15.125:0/4027977756 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0d1001a020 con 0x7f0d240d15f0 2023-11-28T11:10:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.251+0000 7f0d217fa700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d08068320 0x7f0d0806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.251+0000 7f0d217fa700 1 -- 172.21.15.125:0/4027977756 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d10085820 con 0x7f0d240d15f0 2023-11-28T11:10:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.251+0000 7f0d28a33700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d08068320 0x7f0d0806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.251+0000 7f0d28a33700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d08068320 0x7f0d0806a7d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0d18000f60 tx=0x7f0d18007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:45.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.255+0000 7f0d217fa700 1 -- 172.21.15.125:0/4027977756 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0d10052080 con 0x7f0d240d15f0 2023-11-28T11:10:45.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.432+0000 7f0d2ac97700 1 -- 172.21.15.125:0/4027977756 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d240743f0 con 0x7f0d08068320 2023-11-28T11:10:45.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.440+0000 7f0d217fa700 1 -- 172.21.15.125:0/4027977756 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311131 (secure 0 0 0) 0x7f0d240743f0 con 0x7f0d08068320 2023-11-28T11:10:45.444 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:45.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 -- 172.21.15.125:0/4027977756 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d08068320 msgr2=0x7f0d0806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d08068320 0x7f0d0806a7d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0d18000f60 tx=0x7f0d18007a40 comp rx=0 tx=0).stop 2023-11-28T11:10:45.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 -- 172.21.15.125:0/4027977756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d240d15f0 msgr2=0x7f0d240b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d240d15f0 0x7f0d240b4250 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0d10001eb0 tx=0x7f0d1000c8b0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 -- 172.21.15.125:0/4027977756 shutdown_connections 2023-11-28T11:10:45.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2415e010 0x7f0d24149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d08068320 0x7f0d0806a7d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d2406e400 0x7f0d240cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 --2- 172.21.15.125:0/4027977756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d240d15f0 0x7f0d240b4250 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 -- 172.21.15.125:0/4027977756 >> 172.21.15.125:0/4027977756 conn(0x7f0d2406a270 msgr2=0x7f0d2406e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:45.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 -- 172.21.15.125:0/4027977756 shutdown_connections 2023-11-28T11:10:45.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.444+0000 7f0d2ac97700 1 -- 172.21.15.125:0/4027977756 wait complete. 2023-11-28T11:10:45.448 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:10:45.456 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-11-28T11:10:43.648444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":74584,"kb_used_data":5976,"kb_used_omap":0,"kb_used_meta":68544,"kb_avail":754900136,"statfs":{"total":773094113280,"available":773017739264,"internally_reserved":0,"allocated":6119424,"data_stored":3283512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":70189056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.539190"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514648+0000","last_change":"2023-11-28T11:10:36.524056+0000","last_active":"2023-11-28T11:10:37.514648+0000","last_peered":"2023-11-28T11:10:37.514648+0000","last_clean":"2023-11-28T11:10:37.514648+0000","last_became_active":"2023-11-28T11:10:36.523831+0000","last_became_peered":"2023-11-28T11:10:36.523831+0000","last_unstale":"2023-11-28T11:10:37.514648+0000","last_undegraded":"2023-11-28T11:10:37.514648+0000","last_fullsized":"2023-11-28T11:10:37.514648+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514850+0000","last_change":"2023-11-28T11:10:36.524534+0000","last_active":"2023-11-28T11:10:37.514850+0000","last_peered":"2023-11-28T11:10:37.514850+0000","last_clean":"2023-11-28T11:10:37.514850+0000","last_became_active":"2023-11-28T11:10:36.524236+0000","last_became_peered":"2023-11-28T11:10:36.524236+0000","last_unstale":"2023-11-28T11:10:37.514850+0000","last_undegraded":"2023-11-28T11:10:37.514850+0000","last_fullsized":"2023-11-28T11:10:37.514850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:58.155221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515248+0000","last_change":"2023-11-28T11:10:36.526236+0000","last_active":"2023-11-28T11:10:37.515248+0000","last_peered":"2023-11-28T11:10:37.515248+0000","last_clean":"2023-11-28T11:10:37.515248+0000","last_became_active":"2023-11-28T11:10:36.525526+0000","last_became_peered":"2023-11-28T11:10:36.525526+0000","last_unstale":"2023-11-28T11:10:37.515248+0000","last_undegraded":"2023-11-28T11:10:37.515248+0000","last_fullsized":"2023-11-28T11:10:37.515248+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:27.654161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514746+0000","last_change":"2023-11-28T11:10:36.528064+0000","last_active":"2023-11-28T11:10:37.514746+0000","last_peered":"2023-11-28T11:10:37.514746+0000","last_clean":"2023-11-28T11:10:37.514746+0000","last_became_active":"2023-11-28T11:10:36.527767+0000","last_became_peered":"2023-11-28T11:10:36.527767+0000","last_unstale":"2023-11-28T11:10:37.514746+0000","last_undegraded":"2023-11-28T11:10:37.514746+0000","last_fullsized":"2023-11-28T11:10:37.514746+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:20.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583715+0000","last_change":"2023-11-28T11:10:36.532942+0000","last_active":"2023-11-28T11:10:39.583715+0000","last_peered":"2023-11-28T11:10:39.583715+0000","last_clean":"2023-11-28T11:10:39.583715+0000","last_became_active":"2023-11-28T11:10:36.532390+0000","last_became_peered":"2023-11-28T11:10:36.532390+0000","last_unstale":"2023-11-28T11:10:39.583715+0000","last_undegraded":"2023-11-28T11:10:39.583715+0000","last_fullsized":"2023-11-28T11:10:39.583715+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514469+0000","last_change":"2023-11-28T11:10:36.526839+0000","last_active":"2023-11-28T11:10:37.514469+0000","last_peered":"2023-11-28T11:10:37.514469+0000","last_clean":"2023-11-28T11:10:37.514469+0000","last_became_active":"2023-11-28T11:10:36.526583+0000","last_became_peered":"2023-11-28T11:10:36.526583+0000","last_unstale":"2023-11-28T11:10:37.514469+0000","last_undegraded":"2023-11-28T11:10:37.514469+0000","last_fullsized":"2023-11-28T11:10:37.514469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:31.375598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514646+0000","last_change":"2023-11-28T11:10:36.529010+0000","last_active":"2023-11-28T11:10:37.514646+0000","last_peered":"2023-11-28T11:10:37.514646+0000","last_clean":"2023-11-28T11:10:37.514646+0000","last_became_active":"2023-11-28T11:10:36.528687+0000","last_became_peered":"2023-11-28T11:10:36.528687+0000","last_unstale":"2023-11-28T11:10:37.514646+0000","last_undegraded":"2023-11-28T11:10:37.514646+0000","last_fullsized":"2023-11-28T11:10:37.514646+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:50.593011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.539757+0000","last_change":"2023-11-28T11:10:36.534714+0000","last_active":"2023-11-28T11:10:36.539757+0000","last_peered":"2023-11-28T11:10:36.539757+0000","last_clean":"2023-11-28T11:10:36.539757+0000","last_became_active":"2023-11-28T11:10:36.534392+0000","last_became_peered":"2023-11-28T11:10:36.534392+0000","last_unstale":"2023-11-28T11:10:36.539757+0000","last_undegraded":"2023-11-28T11:10:36.539757+0000","last_fullsized":"2023-11-28T11:10:36.539757+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:50.593011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538593+0000","last_change":"2023-11-28T11:10:36.537355+0000","last_active":"2023-11-28T11:10:36.538593+0000","last_peered":"2023-11-28T11:10:36.538593+0000","last_clean":"2023-11-28T11:10:36.538593+0000","last_became_active":"2023-11-28T11:10:36.535077+0000","last_became_peered":"2023-11-28T11:10:36.535077+0000","last_unstale":"2023-11-28T11:10:36.538593+0000","last_undegraded":"2023-11-28T11:10:36.538593+0000","last_fullsized":"2023-11-28T11:10:36.538593+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:05.763064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515454+0000","last_change":"2023-11-28T11:10:36.532181+0000","last_active":"2023-11-28T11:10:37.515454+0000","last_peered":"2023-11-28T11:10:37.515454+0000","last_clean":"2023-11-28T11:10:37.515454+0000","last_became_active":"2023-11-28T11:10:36.531946+0000","last_became_peered":"2023-11-28T11:10:36.531946+0000","last_unstale":"2023-11-28T11:10:37.515454+0000","last_undegraded":"2023-11-28T11:10:37.515454+0000","last_fullsized":"2023-11-28T11:10:37.515454+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:34.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141761+0000","last_change":"2023-11-28T11:10:36.522452+0000","last_active":"2023-11-28T11:10:38.141761+0000","last_peered":"2023-11-28T11:10:38.141761+0000","last_clean":"2023-11-28T11:10:38.141761+0000","last_became_active":"2023-11-28T11:10:36.522201+0000","last_became_peered":"2023-11-28T11:10:36.522201+0000","last_unstale":"2023-11-28T11:10:38.141761+0000","last_undegraded":"2023-11-28T11:10:38.141761+0000","last_fullsized":"2023-11-28T11:10:38.141761+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:59:58.033544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538189+0000","last_change":"2023-11-28T11:10:36.531793+0000","last_active":"2023-11-28T11:10:36.538189+0000","last_peered":"2023-11-28T11:10:36.538189+0000","last_clean":"2023-11-28T11:10:36.538189+0000","last_became_active":"2023-11-28T11:10:36.530049+0000","last_became_peered":"2023-11-28T11:10:36.530049+0000","last_unstale":"2023-11-28T11:10:36.538189+0000","last_undegraded":"2023-11-28T11:10:36.538189+0000","last_fullsized":"2023-11-28T11:10:36.538189+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:27.654161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514287+0000","last_change":"2023-11-28T11:10:36.534554+0000","last_active":"2023-11-28T11:10:37.514287+0000","last_peered":"2023-11-28T11:10:37.514287+0000","last_clean":"2023-11-28T11:10:37.514287+0000","last_became_active":"2023-11-28T11:10:36.534313+0000","last_became_peered":"2023-11-28T11:10:36.534313+0000","last_unstale":"2023-11-28T11:10:37.514287+0000","last_undegraded":"2023-11-28T11:10:37.514287+0000","last_fullsized":"2023-11-28T11:10:37.514287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:33.764839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515060+0000","last_change":"2023-11-28T11:10:36.525581+0000","last_active":"2023-11-28T11:10:37.515060+0000","last_peered":"2023-11-28T11:10:37.515060+0000","last_clean":"2023-11-28T11:10:37.515060+0000","last_became_active":"2023-11-28T11:10:36.525315+0000","last_became_peered":"2023-11-28T11:10:36.525315+0000","last_unstale":"2023-11-28T11:10:37.515060+0000","last_undegraded":"2023-11-28T11:10:37.515060+0000","last_fullsized":"2023-11-28T11:10:37.515060+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:12.836764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514618+0000","last_change":"2023-11-28T11:10:36.527490+0000","last_active":"2023-11-28T11:10:37.514618+0000","last_peered":"2023-11-28T11:10:37.514618+0000","last_clean":"2023-11-28T11:10:37.514618+0000","last_became_active":"2023-11-28T11:10:36.527219+0000","last_became_peered":"2023-11-28T11:10:36.527219+0000","last_unstale":"2023-11-28T11:10:37.514618+0000","last_undegraded":"2023-11-28T11:10:37.514618+0000","last_fullsized":"2023-11-28T11:10:37.514618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514163+0000","last_change":"2023-11-28T11:10:36.532971+0000","last_active":"2023-11-28T11:10:37.514163+0000","last_peered":"2023-11-28T11:10:37.514163+0000","last_clean":"2023-11-28T11:10:37.514163+0000","last_became_active":"2023-11-28T11:10:36.532729+0000","last_became_peered":"2023-11-28T11:10:36.532729+0000","last_unstale":"2023-11-28T11:10:37.514163+0000","last_undegraded":"2023-11-28T11:10:37.514163+0000","last_fullsized":"2023-11-28T11:10:37.514163+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:20.985031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515693+0000","last_change":"2023-11-28T11:10:36.528593+0000","last_active":"2023-11-28T11:10:37.515693+0000","last_peered":"2023-11-28T11:10:37.515693+0000","last_clean":"2023-11-28T11:10:37.515693+0000","last_became_active":"2023-11-28T11:10:36.528202+0000","last_became_peered":"2023-11-28T11:10:36.528202+0000","last_unstale":"2023-11-28T11:10:37.515693+0000","last_undegraded":"2023-11-28T11:10:37.515693+0000","last_fullsized":"2023-11-28T11:10:37.515693+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:23.935065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514945+0000","last_change":"2023-11-28T11:10:36.524381+0000","last_active":"2023-11-28T11:10:37.514945+0000","last_peered":"2023-11-28T11:10:37.514945+0000","last_clean":"2023-11-28T11:10:37.514945+0000","last_became_active":"2023-11-28T11:10:36.524095+0000","last_became_peered":"2023-11-28T11:10:36.524095+0000","last_unstale":"2023-11-28T11:10:37.514945+0000","last_undegraded":"2023-11-28T11:10:37.514945+0000","last_fullsized":"2023-11-28T11:10:37.514945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515238+0000","last_change":"2023-11-28T11:10:36.533836+0000","last_active":"2023-11-28T11:10:37.515238+0000","last_peered":"2023-11-28T11:10:37.515238+0000","last_clean":"2023-11-28T11:10:37.515238+0000","last_became_active":"2023-11-28T11:10:36.533560+0000","last_became_peered":"2023-11-28T11:10:36.533560+0000","last_unstale":"2023-11-28T11:10:37.515238+0000","last_undegraded":"2023-11-28T11:10:37.515238+0000","last_fullsized":"2023-11-28T11:10:37.515238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:25.315412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.535983+0000","last_change":"2023-11-28T11:10:36.532702+0000","last_active":"2023-11-28T11:10:36.535983+0000","last_peered":"2023-11-28T11:10:36.535983+0000","last_clean":"2023-11-28T11:10:36.535983+0000","last_became_active":"2023-11-28T11:10:36.532398+0000","last_became_peered":"2023-11-28T11:10:36.532398+0000","last_unstale":"2023-11-28T11:10:36.535983+0000","last_undegraded":"2023-11-28T11:10:36.535983+0000","last_fullsized":"2023-11-28T11:10:36.535983+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:21.311791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.530521+0000","last_change":"2023-11-28T11:10:36.526799+0000","last_active":"2023-11-28T11:10:36.530521+0000","last_peered":"2023-11-28T11:10:36.530521+0000","last_clean":"2023-11-28T11:10:36.530521+0000","last_became_active":"2023-11-28T11:10:36.526541+0000","last_became_peered":"2023-11-28T11:10:36.526541+0000","last_unstale":"2023-11-28T11:10:36.530521+0000","last_undegraded":"2023-11-28T11:10:36.530521+0000","last_fullsized":"2023-11-28T11:10:36.530521+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:09.770343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538087+0000","last_change":"2023-11-28T11:10:36.533609+0000","last_active":"2023-11-28T11:10:36.538087+0000","last_peered":"2023-11-28T11:10:36.538087+0000","last_clean":"2023-11-28T11:10:36.538087+0000","last_became_active":"2023-11-28T11:10:36.531968+0000","last_became_peered":"2023-11-28T11:10:36.531968+0000","last_unstale":"2023-11-28T11:10:36.538087+0000","last_undegraded":"2023-11-28T11:10:36.538087+0000","last_fullsized":"2023-11-28T11:10:36.538087+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:25.315412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141535+0000","last_change":"2023-11-28T11:10:36.528419+0000","last_active":"2023-11-28T11:10:38.141535+0000","last_peered":"2023-11-28T11:10:38.141535+0000","last_clean":"2023-11-28T11:10:38.141535+0000","last_became_active":"2023-11-28T11:10:36.527321+0000","last_became_peered":"2023-11-28T11:10:36.527321+0000","last_unstale":"2023-11-28T11:10:38.141535+0000","last_undegraded":"2023-11-28T11:10:38.141535+0000","last_fullsized":"2023-11-28T11:10:38.141535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:06.424953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514471+0000","last_change":"2023-11-28T11:10:36.525552+0000","last_active":"2023-11-28T11:10:37.514471+0000","last_peered":"2023-11-28T11:10:37.514471+0000","last_clean":"2023-11-28T11:10:37.514471+0000","last_became_active":"2023-11-28T11:10:36.525301+0000","last_became_peered":"2023-11-28T11:10:36.525301+0000","last_unstale":"2023-11-28T11:10:37.514471+0000","last_undegraded":"2023-11-28T11:10:37.514471+0000","last_fullsized":"2023-11-28T11:10:37.514471+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:57.807839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515621+0000","last_change":"2023-11-28T11:10:36.538677+0000","last_active":"2023-11-28T11:10:37.515621+0000","last_peered":"2023-11-28T11:10:37.515621+0000","last_clean":"2023-11-28T11:10:37.515621+0000","last_became_active":"2023-11-28T11:10:36.538336+0000","last_became_peered":"2023-11-28T11:10:36.538336+0000","last_unstale":"2023-11-28T11:10:37.515621+0000","last_undegraded":"2023-11-28T11:10:37.515621+0000","last_fullsized":"2023-11-28T11:10:37.515621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:04.544184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538014+0000","last_change":"2023-11-28T11:10:36.526666+0000","last_active":"2023-11-28T11:10:36.538014+0000","last_peered":"2023-11-28T11:10:36.538014+0000","last_clean":"2023-11-28T11:10:36.538014+0000","last_became_active":"2023-11-28T11:10:36.526406+0000","last_became_peered":"2023-11-28T11:10:36.526406+0000","last_unstale":"2023-11-28T11:10:36.538014+0000","last_undegraded":"2023-11-28T11:10:36.538014+0000","last_fullsized":"2023-11-28T11:10:36.538014+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:02.769111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515008+0000","last_change":"2023-11-28T11:10:36.535214+0000","last_active":"2023-11-28T11:10:37.515008+0000","last_peered":"2023-11-28T11:10:37.515008+0000","last_clean":"2023-11-28T11:10:37.515008+0000","last_became_active":"2023-11-28T11:10:36.534981+0000","last_became_peered":"2023-11-28T11:10:36.534981+0000","last_unstale":"2023-11-28T11:10:37.515008+0000","last_undegraded":"2023-11-28T11:10:37.515008+0000","last_fullsized":"2023-11-28T11:10:37.515008+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:19.190582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.531382+0000","last_change":"2023-11-28T11:10:36.528115+0000","last_active":"2023-11-28T11:10:36.531382+0000","last_peered":"2023-11-28T11:10:36.531382+0000","last_clean":"2023-11-28T11:10:36.531382+0000","last_became_active":"2023-11-28T11:10:36.527806+0000","last_became_peered":"2023-11-28T11:10:36.527806+0000","last_unstale":"2023-11-28T11:10:36.531382+0000","last_undegraded":"2023-11-28T11:10:36.531382+0000","last_fullsized":"2023-11-28T11:10:36.531382+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:44.837465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514668+0000","last_change":"2023-11-28T11:10:36.528010+0000","last_active":"2023-11-28T11:10:37.514668+0000","last_peered":"2023-11-28T11:10:37.514668+0000","last_clean":"2023-11-28T11:10:37.514668+0000","last_became_active":"2023-11-28T11:10:36.527719+0000","last_became_peered":"2023-11-28T11:10:36.527719+0000","last_unstale":"2023-11-28T11:10:37.514668+0000","last_undegraded":"2023-11-28T11:10:37.514668+0000","last_fullsized":"2023-11-28T11:10:37.514668+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:58.531465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514890+0000","last_change":"2023-11-28T11:10:36.522035+0000","last_active":"2023-11-28T11:10:37.514890+0000","last_peered":"2023-11-28T11:10:37.514890+0000","last_clean":"2023-11-28T11:10:37.514890+0000","last_became_active":"2023-11-28T11:10:36.521763+0000","last_became_peered":"2023-11-28T11:10:36.521763+0000","last_unstale":"2023-11-28T11:10:37.514890+0000","last_undegraded":"2023-11-28T11:10:37.514890+0000","last_fullsized":"2023-11-28T11:10:37.514890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514820+0000","last_change":"2023-11-28T11:10:36.528832+0000","last_active":"2023-11-28T11:10:37.514820+0000","last_peered":"2023-11-28T11:10:37.514820+0000","last_clean":"2023-11-28T11:10:37.514820+0000","last_became_active":"2023-11-28T11:10:36.528558+0000","last_became_peered":"2023-11-28T11:10:36.528558+0000","last_unstale":"2023-11-28T11:10:37.514820+0000","last_undegraded":"2023-11-28T11:10:37.514820+0000","last_fullsized":"2023-11-28T11:10:37.514820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:28.375662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.541397+0000","last_change":"2023-11-28T11:10:36.540895+0000","last_active":"2023-11-28T11:10:36.541397+0000","last_peered":"2023-11-28T11:10:36.541397+0000","last_clean":"2023-11-28T11:10:36.541397+0000","last_became_active":"2023-11-28T11:10:36.540593+0000","last_became_peered":"2023-11-28T11:10:36.540593+0000","last_unstale":"2023-11-28T11:10:36.541397+0000","last_undegraded":"2023-11-28T11:10:36.541397+0000","last_fullsized":"2023-11-28T11:10:36.541397+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:51.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514434+0000","last_change":"2023-11-28T11:10:36.524969+0000","last_active":"2023-11-28T11:10:37.514434+0000","last_peered":"2023-11-28T11:10:37.514434+0000","last_clean":"2023-11-28T11:10:37.514434+0000","last_became_active":"2023-11-28T11:10:36.524710+0000","last_became_peered":"2023-11-28T11:10:36.524710+0000","last_unstale":"2023-11-28T11:10:37.514434+0000","last_undegraded":"2023-11-28T11:10:37.514434+0000","last_fullsized":"2023-11-28T11:10:37.514434+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:02:40.345280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.536059+0000","last_change":"2023-11-28T11:10:36.124253+0000","last_active":"2023-11-28T11:10:36.536059+0000","last_peered":"2023-11-28T11:10:36.536059+0000","last_clean":"2023-11-28T11:10:36.536059+0000","last_became_active":"2023-11-28T11:10:36.123935+0000","last_became_peered":"2023-11-28T11:10:36.123935+0000","last_unstale":"2023-11-28T11:10:36.536059+0000","last_undegraded":"2023-11-28T11:10:36.536059+0000","last_fullsized":"2023-11-28T11:10:36.536059+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:36.890541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.527288+0000","last_change":"2023-11-28T11:10:36.525460+0000","last_active":"2023-11-28T11:10:36.527288+0000","last_peered":"2023-11-28T11:10:36.527288+0000","last_clean":"2023-11-28T11:10:36.527288+0000","last_became_active":"2023-11-28T11:10:36.525018+0000","last_became_peered":"2023-11-28T11:10:36.525018+0000","last_unstale":"2023-11-28T11:10:36.527288+0000","last_undegraded":"2023-11-28T11:10:36.527288+0000","last_fullsized":"2023-11-28T11:10:36.527288+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515505+0000","last_change":"2023-11-28T11:10:36.133446+0000","last_active":"2023-11-28T11:10:37.515505+0000","last_peered":"2023-11-28T11:10:37.515505+0000","last_clean":"2023-11-28T11:10:37.515505+0000","last_became_active":"2023-11-28T11:10:36.133184+0000","last_became_peered":"2023-11-28T11:10:36.133184+0000","last_unstale":"2023-11-28T11:10:37.515505+0000","last_undegraded":"2023-11-28T11:10:37.515505+0000","last_fullsized":"2023-11-28T11:10:37.515505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:13.129227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.530527+0000","last_change":"2023-11-28T11:10:36.527498+0000","last_active":"2023-11-28T11:10:36.530527+0000","last_peered":"2023-11-28T11:10:36.530527+0000","last_clean":"2023-11-28T11:10:36.530527+0000","last_became_active":"2023-11-28T11:10:36.526279+0000","last_became_peered":"2023-11-28T11:10:36.526279+0000","last_unstale":"2023-11-28T11:10:36.530527+0000","last_undegraded":"2023-11-28T11:10:36.530527+0000","last_fullsized":"2023-11-28T11:10:36.530527+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:14.136702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515095+0000","last_change":"2023-11-28T11:10:36.133435+0000","last_active":"2023-11-28T11:10:37.515095+0000","last_peered":"2023-11-28T11:10:37.515095+0000","last_clean":"2023-11-28T11:10:37.515095+0000","last_became_active":"2023-11-28T11:10:36.133156+0000","last_became_peered":"2023-11-28T11:10:36.133156+0000","last_unstale":"2023-11-28T11:10:37.515095+0000","last_undegraded":"2023-11-28T11:10:37.515095+0000","last_fullsized":"2023-11-28T11:10:37.515095+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:32.589064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538280+0000","last_change":"2023-11-28T11:10:36.530352+0000","last_active":"2023-11-28T11:10:36.538280+0000","last_peered":"2023-11-28T11:10:36.538280+0000","last_clean":"2023-11-28T11:10:36.538280+0000","last_became_active":"2023-11-28T11:10:36.530058+0000","last_became_peered":"2023-11-28T11:10:36.530058+0000","last_unstale":"2023-11-28T11:10:36.538280+0000","last_undegraded":"2023-11-28T11:10:36.538280+0000","last_fullsized":"2023-11-28T11:10:36.538280+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:57.807839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.541702+0000","last_change":"2023-11-28T11:10:36.125331+0000","last_active":"2023-11-28T11:10:36.541702+0000","last_peered":"2023-11-28T11:10:36.541702+0000","last_clean":"2023-11-28T11:10:36.541702+0000","last_became_active":"2023-11-28T11:10:36.125034+0000","last_became_peered":"2023-11-28T11:10:36.125034+0000","last_unstale":"2023-11-28T11:10:36.541702+0000","last_undegraded":"2023-11-28T11:10:36.541702+0000","last_fullsized":"2023-11-28T11:10:36.541702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:08.312145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583801+0000","last_change":"2023-11-28T11:10:36.531333+0000","last_active":"2023-11-28T11:10:39.583801+0000","last_peered":"2023-11-28T11:10:39.583801+0000","last_clean":"2023-11-28T11:10:39.583801+0000","last_became_active":"2023-11-28T11:10:36.530981+0000","last_became_peered":"2023-11-28T11:10:36.530981+0000","last_unstale":"2023-11-28T11:10:39.583801+0000","last_undegraded":"2023-11-28T11:10:39.583801+0000","last_fullsized":"2023-11-28T11:10:39.583801+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:02.769111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514762+0000","last_change":"2023-11-28T11:10:36.119665+0000","last_active":"2023-11-28T11:10:37.514762+0000","last_peered":"2023-11-28T11:10:37.514762+0000","last_clean":"2023-11-28T11:10:37.514762+0000","last_became_active":"2023-11-28T11:10:36.117416+0000","last_became_peered":"2023-11-28T11:10:36.117416+0000","last_unstale":"2023-11-28T11:10:37.514762+0000","last_undegraded":"2023-11-28T11:10:37.514762+0000","last_fullsized":"2023-11-28T11:10:37.514762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:33.877212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515023+0000","last_change":"2023-11-28T11:10:36.523569+0000","last_active":"2023-11-28T11:10:37.515023+0000","last_peered":"2023-11-28T11:10:37.515023+0000","last_clean":"2023-11-28T11:10:37.515023+0000","last_became_active":"2023-11-28T11:10:36.523302+0000","last_became_peered":"2023-11-28T11:10:36.523302+0000","last_unstale":"2023-11-28T11:10:37.515023+0000","last_undegraded":"2023-11-28T11:10:37.515023+0000","last_fullsized":"2023-11-28T11:10:37.515023+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:48.693779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583531+0000","last_change":"2023-11-28T11:10:36.124249+0000","last_active":"2023-11-28T11:10:39.583531+0000","last_peered":"2023-11-28T11:10:39.583531+0000","last_clean":"2023-11-28T11:10:39.583531+0000","last_became_active":"2023-11-28T11:10:36.123975+0000","last_became_peered":"2023-11-28T11:10:36.123975+0000","last_unstale":"2023-11-28T11:10:39.583531+0000","last_undegraded":"2023-11-28T11:10:39.583531+0000","last_fullsized":"2023-11-28T11:10:39.583531+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:04.198577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538028+0000","last_change":"2023-11-28T11:10:36.526769+0000","last_active":"2023-11-28T11:10:36.538028+0000","last_peered":"2023-11-28T11:10:36.538028+0000","last_clean":"2023-11-28T11:10:36.538028+0000","last_became_active":"2023-11-28T11:10:36.526533+0000","last_became_peered":"2023-11-28T11:10:36.526533+0000","last_unstale":"2023-11-28T11:10:36.538028+0000","last_undegraded":"2023-11-28T11:10:36.538028+0000","last_fullsized":"2023-11-28T11:10:36.538028+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:10.382472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.519687+0000","last_change":"2023-11-28T11:10:36.124477+0000","last_active":"2023-11-28T11:10:36.519687+0000","last_peered":"2023-11-28T11:10:36.519687+0000","last_clean":"2023-11-28T11:10:36.519687+0000","last_became_active":"2023-11-28T11:10:36.123849+0000","last_became_peered":"2023-11-28T11:10:36.123849+0000","last_unstale":"2023-11-28T11:10:36.519687+0000","last_undegraded":"2023-11-28T11:10:36.519687+0000","last_fullsized":"2023-11-28T11:10:36.519687+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:49:28.668040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514850+0000","last_change":"2023-11-28T11:10:36.528489+0000","last_active":"2023-11-28T11:10:37.514850+0000","last_peered":"2023-11-28T11:10:37.514850+0000","last_clean":"2023-11-28T11:10:37.514850+0000","last_became_active":"2023-11-28T11:10:36.528196+0000","last_became_peered":"2023-11-28T11:10:36.528196+0000","last_unstale":"2023-11-28T11:10:37.514850+0000","last_undegraded":"2023-11-28T11:10:37.514850+0000","last_fullsized":"2023-11-28T11:10:37.514850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.833897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514973+0000","last_change":"2023-11-28T11:10:36.126539+0000","last_active":"2023-11-28T11:10:37.514973+0000","last_peered":"2023-11-28T11:10:37.514973+0000","last_clean":"2023-11-28T11:10:37.514973+0000","last_became_active":"2023-11-28T11:10:36.126227+0000","last_became_peered":"2023-11-28T11:10:36.126227+0000","last_unstale":"2023-11-28T11:10:37.514973+0000","last_undegraded":"2023-11-28T11:10:37.514973+0000","last_fullsized":"2023-11-28T11:10:37.514973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:28.022412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583560+0000","last_change":"2023-11-28T11:10:36.535403+0000","last_active":"2023-11-28T11:10:39.583560+0000","last_peered":"2023-11-28T11:10:39.583560+0000","last_clean":"2023-11-28T11:10:39.583560+0000","last_became_active":"2023-11-28T11:10:36.535115+0000","last_became_peered":"2023-11-28T11:10:36.535115+0000","last_unstale":"2023-11-28T11:10:39.583560+0000","last_undegraded":"2023-11-28T11:10:39.583560+0000","last_fullsized":"2023-11-28T11:10:39.583560+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:48.693779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515008+0000","last_change":"2023-11-28T11:10:36.123501+0000","last_active":"2023-11-28T11:10:37.515008+0000","last_peered":"2023-11-28T11:10:37.515008+0000","last_clean":"2023-11-28T11:10:37.515008+0000","last_became_active":"2023-11-28T11:10:36.122933+0000","last_became_peered":"2023-11-28T11:10:36.122933+0000","last_unstale":"2023-11-28T11:10:37.515008+0000","last_undegraded":"2023-11-28T11:10:37.515008+0000","last_fullsized":"2023-11-28T11:10:37.515008+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:32.757363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.535505+0000","last_change":"2023-11-28T11:10:36.533327+0000","last_active":"2023-11-28T11:10:36.535505+0000","last_peered":"2023-11-28T11:10:36.535505+0000","last_clean":"2023-11-28T11:10:36.535505+0000","last_became_active":"2023-11-28T11:10:36.533057+0000","last_became_peered":"2023-11-28T11:10:36.533057+0000","last_unstale":"2023-11-28T11:10:36.535505+0000","last_undegraded":"2023-11-28T11:10:36.535505+0000","last_fullsized":"2023-11-28T11:10:36.535505+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:02:40.345280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583846+0000","last_change":"2023-11-28T11:10:36.128801+0000","last_active":"2023-11-28T11:10:39.583846+0000","last_peered":"2023-11-28T11:10:39.583846+0000","last_clean":"2023-11-28T11:10:39.583846+0000","last_became_active":"2023-11-28T11:10:36.128548+0000","last_became_peered":"2023-11-28T11:10:36.128548+0000","last_unstale":"2023-11-28T11:10:39.583846+0000","last_undegraded":"2023-11-28T11:10:39.583846+0000","last_fullsized":"2023-11-28T11:10:39.583846+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:55:32.368703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514980+0000","last_change":"2023-11-28T11:10:36.524201+0000","last_active":"2023-11-28T11:10:37.514980+0000","last_peered":"2023-11-28T11:10:37.514980+0000","last_clean":"2023-11-28T11:10:37.514980+0000","last_became_active":"2023-11-28T11:10:36.521915+0000","last_became_peered":"2023-11-28T11:10:36.521915+0000","last_unstale":"2023-11-28T11:10:37.514980+0000","last_undegraded":"2023-11-28T11:10:37.514980+0000","last_fullsized":"2023-11-28T11:10:37.514980+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:19:19.207096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514992+0000","last_change":"2023-11-28T11:10:36.136502+0000","last_active":"2023-11-28T11:10:37.514992+0000","last_peered":"2023-11-28T11:10:37.514992+0000","last_clean":"2023-11-28T11:10:37.514992+0000","last_became_active":"2023-11-28T11:10:36.136213+0000","last_became_peered":"2023-11-28T11:10:36.136213+0000","last_unstale":"2023-11-28T11:10:37.514992+0000","last_undegraded":"2023-11-28T11:10:37.514992+0000","last_fullsized":"2023-11-28T11:10:37.514992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:28.022412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583747+0000","last_change":"2023-11-28T11:10:36.532774+0000","last_active":"2023-11-28T11:10:39.583747+0000","last_peered":"2023-11-28T11:10:39.583747+0000","last_clean":"2023-11-28T11:10:39.583747+0000","last_became_active":"2023-11-28T11:10:36.532064+0000","last_became_peered":"2023-11-28T11:10:36.532064+0000","last_unstale":"2023-11-28T11:10:39.583747+0000","last_undegraded":"2023-11-28T11:10:39.583747+0000","last_fullsized":"2023-11-28T11:10:39.583747+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:58.155221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.547087+0000","last_change":"2023-11-28T11:10:36.128272+0000","last_active":"2023-11-28T11:10:36.547087+0000","last_peered":"2023-11-28T11:10:36.547087+0000","last_clean":"2023-11-28T11:10:36.547087+0000","last_became_active":"2023-11-28T11:10:36.127792+0000","last_became_peered":"2023-11-28T11:10:36.127792+0000","last_unstale":"2023-11-28T11:10:36.547087+0000","last_undegraded":"2023-11-28T11:10:36.547087+0000","last_fullsized":"2023-11-28T11:10:36.547087+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:55:32.368703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.530301+0000","last_change":"2023-11-28T11:10:36.527358+0000","last_active":"2023-11-28T11:10:36.530301+0000","last_peered":"2023-11-28T11:10:36.530301+0000","last_clean":"2023-11-28T11:10:36.530301+0000","last_became_active":"2023-11-28T11:10:36.526775+0000","last_became_peered":"2023-11-28T11:10:36.526775+0000","last_unstale":"2023-11-28T11:10:36.530301+0000","last_undegraded":"2023-11-28T11:10:36.530301+0000","last_fullsized":"2023-11-28T11:10:36.530301+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:58.155221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514858+0000","last_change":"2023-11-28T11:10:36.118915+0000","last_active":"2023-11-28T11:10:37.514858+0000","last_peered":"2023-11-28T11:10:37.514858+0000","last_clean":"2023-11-28T11:10:37.514858+0000","last_became_active":"2023-11-28T11:10:36.118661+0000","last_became_peered":"2023-11-28T11:10:36.118661+0000","last_unstale":"2023-11-28T11:10:37.514858+0000","last_undegraded":"2023-11-28T11:10:37.514858+0000","last_fullsized":"2023-11-28T11:10:37.514858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:30.368123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515289+0000","last_change":"2023-11-28T11:10:36.528346+0000","last_active":"2023-11-28T11:10:37.515289+0000","last_peered":"2023-11-28T11:10:37.515289+0000","last_clean":"2023-11-28T11:10:37.515289+0000","last_became_active":"2023-11-28T11:10:36.528097+0000","last_became_peered":"2023-11-28T11:10:36.528097+0000","last_unstale":"2023-11-28T11:10:37.515289+0000","last_undegraded":"2023-11-28T11:10:37.515289+0000","last_fullsized":"2023-11-28T11:10:37.515289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:33.646649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.520225+0000","last_change":"2023-11-28T11:10:36.126459+0000","last_active":"2023-11-28T11:10:36.520225+0000","last_peered":"2023-11-28T11:10:36.520225+0000","last_clean":"2023-11-28T11:10:36.520225+0000","last_became_active":"2023-11-28T11:10:36.126182+0000","last_became_peered":"2023-11-28T11:10:36.126182+0000","last_unstale":"2023-11-28T11:10:36.520225+0000","last_undegraded":"2023-11-28T11:10:36.520225+0000","last_fullsized":"2023-11-28T11:10:36.520225+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:12.568877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538038+0000","last_change":"2023-11-28T11:10:36.531273+0000","last_active":"2023-11-28T11:10:36.538038+0000","last_peered":"2023-11-28T11:10:36.538038+0000","last_clean":"2023-11-28T11:10:36.538038+0000","last_became_active":"2023-11-28T11:10:36.530999+0000","last_became_peered":"2023-11-28T11:10:36.530999+0000","last_unstale":"2023-11-28T11:10:36.538038+0000","last_undegraded":"2023-11-28T11:10:36.538038+0000","last_fullsized":"2023-11-28T11:10:36.538038+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:57.427676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515092+0000","last_change":"2023-11-28T11:10:36.123367+0000","last_active":"2023-11-28T11:10:37.515092+0000","last_peered":"2023-11-28T11:10:37.515092+0000","last_clean":"2023-11-28T11:10:37.515092+0000","last_became_active":"2023-11-28T11:10:36.122981+0000","last_became_peered":"2023-11-28T11:10:36.122981+0000","last_unstale":"2023-11-28T11:10:37.515092+0000","last_undegraded":"2023-11-28T11:10:37.515092+0000","last_fullsized":"2023-11-28T11:10:37.515092+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:33:27.881264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515752+0000","last_change":"2023-11-28T11:10:36.528470+0000","last_active":"2023-11-28T11:10:37.515752+0000","last_peered":"2023-11-28T11:10:37.515752+0000","last_clean":"2023-11-28T11:10:37.515752+0000","last_became_active":"2023-11-28T11:10:36.527851+0000","last_became_peered":"2023-11-28T11:10:36.527851+0000","last_unstale":"2023-11-28T11:10:37.515752+0000","last_undegraded":"2023-11-28T11:10:37.515752+0000","last_fullsized":"2023-11-28T11:10:37.515752+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:10.382472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.544545+0000","last_change":"2023-11-28T11:10:36.121933+0000","last_active":"2023-11-28T11:10:36.544545+0000","last_peered":"2023-11-28T11:10:36.544545+0000","last_clean":"2023-11-28T11:10:36.544545+0000","last_became_active":"2023-11-28T11:10:36.121666+0000","last_became_peered":"2023-11-28T11:10:36.121666+0000","last_unstale":"2023-11-28T11:10:36.544545+0000","last_undegraded":"2023-11-28T11:10:36.544545+0000","last_fullsized":"2023-11-28T11:10:36.544545+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:41.671362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.539768+0000","last_change":"2023-11-28T11:10:36.534842+0000","last_active":"2023-11-28T11:10:36.539768+0000","last_peered":"2023-11-28T11:10:36.539768+0000","last_clean":"2023-11-28T11:10:36.539768+0000","last_became_active":"2023-11-28T11:10:36.534497+0000","last_became_peered":"2023-11-28T11:10:36.534497+0000","last_unstale":"2023-11-28T11:10:36.539768+0000","last_undegraded":"2023-11-28T11:10:36.539768+0000","last_fullsized":"2023-11-28T11:10:36.539768+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:12.836764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515505+0000","last_change":"2023-11-28T11:10:36.126441+0000","last_active":"2023-11-28T11:10:37.515505+0000","last_peered":"2023-11-28T11:10:37.515505+0000","last_clean":"2023-11-28T11:10:37.515505+0000","last_became_active":"2023-11-28T11:10:36.125967+0000","last_became_peered":"2023-11-28T11:10:36.125967+0000","last_unstale":"2023-11-28T11:10:37.515505+0000","last_undegraded":"2023-11-28T11:10:37.515505+0000","last_fullsized":"2023-11-28T11:10:37.515505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:08.438167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514473+0000","last_change":"2023-11-28T11:10:36.531244+0000","last_active":"2023-11-28T11:10:37.514473+0000","last_peered":"2023-11-28T11:10:37.514473+0000","last_clean":"2023-11-28T11:10:37.514473+0000","last_became_active":"2023-11-28T11:10:36.530978+0000","last_became_peered":"2023-11-28T11:10:36.530978+0000","last_unstale":"2023-11-28T11:10:37.514473+0000","last_undegraded":"2023-11-28T11:10:37.514473+0000","last_fullsized":"2023-11-28T11:10:37.514473+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.833897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141759+0000","last_change":"2023-11-28T11:10:36.123203+0000","last_active":"2023-11-28T11:10:38.141759+0000","last_peered":"2023-11-28T11:10:38.141759+0000","last_clean":"2023-11-28T11:10:38.141759+0000","last_became_active":"2023-11-28T11:10:36.122988+0000","last_became_peered":"2023-11-28T11:10:36.122988+0000","last_unstale":"2023-11-28T11:10:38.141759+0000","last_undegraded":"2023-11-28T11:10:38.141759+0000","last_fullsized":"2023-11-28T11:10:38.141759+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:33.478864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583562+0000","last_change":"2023-11-28T11:10:36.534096+0000","last_active":"2023-11-28T11:10:39.583562+0000","last_peered":"2023-11-28T11:10:39.583562+0000","last_clean":"2023-11-28T11:10:39.583562+0000","last_became_active":"2023-11-28T11:10:36.533808+0000","last_became_peered":"2023-11-28T11:10:36.533808+0000","last_unstale":"2023-11-28T11:10:39.583562+0000","last_undegraded":"2023-11-28T11:10:39.583562+0000","last_fullsized":"2023-11-28T11:10:39.583562+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:51.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.535986+0000","last_change":"2023-11-28T11:10:36.136515+0000","last_active":"2023-11-28T11:10:36.535986+0000","last_peered":"2023-11-28T11:10:36.535986+0000","last_clean":"2023-11-28T11:10:36.535986+0000","last_became_active":"2023-11-28T11:10:36.136242+0000","last_became_peered":"2023-11-28T11:10:36.136242+0000","last_unstale":"2023-11-28T11:10:36.535986+0000","last_undegraded":"2023-11-28T11:10:36.535986+0000","last_fullsized":"2023-11-28T11:10:36.535986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:48.913184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514472+0000","last_change":"2023-11-28T11:10:36.524080+0000","last_active":"2023-11-28T11:10:37.514472+0000","last_peered":"2023-11-28T11:10:37.514472+0000","last_clean":"2023-11-28T11:10:37.514472+0000","last_became_active":"2023-11-28T11:10:36.523831+0000","last_became_peered":"2023-11-28T11:10:36.523831+0000","last_unstale":"2023-11-28T11:10:37.514472+0000","last_undegraded":"2023-11-28T11:10:37.514472+0000","last_fullsized":"2023-11-28T11:10:37.514472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:42:37.897017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.519780+0000","last_change":"2023-11-28T11:10:36.124870+0000","last_active":"2023-11-28T11:10:36.519780+0000","last_peered":"2023-11-28T11:10:36.519780+0000","last_clean":"2023-11-28T11:10:36.519780+0000","last_became_active":"2023-11-28T11:10:36.124623+0000","last_became_peered":"2023-11-28T11:10:36.124623+0000","last_unstale":"2023-11-28T11:10:36.519780+0000","last_undegraded":"2023-11-28T11:10:36.519780+0000","last_fullsized":"2023-11-28T11:10:36.519780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:25:36.553811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.535490+0000","last_change":"2023-11-28T11:10:36.532774+0000","last_active":"2023-11-28T11:10:36.535490+0000","last_peered":"2023-11-28T11:10:36.535490+0000","last_clean":"2023-11-28T11:10:36.535490+0000","last_became_active":"2023-11-28T11:10:36.532486+0000","last_became_peered":"2023-11-28T11:10:36.532486+0000","last_unstale":"2023-11-28T11:10:36.535490+0000","last_undegraded":"2023-11-28T11:10:36.535490+0000","last_fullsized":"2023-11-28T11:10:36.535490+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:36.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514367+0000","last_change":"2023-11-28T11:10:36.136094+0000","last_active":"2023-11-28T11:10:37.514367+0000","last_peered":"2023-11-28T11:10:37.514367+0000","last_clean":"2023-11-28T11:10:37.514367+0000","last_became_active":"2023-11-28T11:10:36.135780+0000","last_became_peered":"2023-11-28T11:10:36.135780+0000","last_unstale":"2023-11-28T11:10:37.514367+0000","last_undegraded":"2023-11-28T11:10:37.514367+0000","last_fullsized":"2023-11-28T11:10:37.514367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:08.762868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.533382+0000","last_change":"2023-11-28T11:10:36.531381+0000","last_active":"2023-11-28T11:10:36.533382+0000","last_peered":"2023-11-28T11:10:36.533382+0000","last_clean":"2023-11-28T11:10:36.533382+0000","last_became_active":"2023-11-28T11:10:36.531088+0000","last_became_peered":"2023-11-28T11:10:36.531088+0000","last_unstale":"2023-11-28T11:10:36.533382+0000","last_undegraded":"2023-11-28T11:10:36.533382+0000","last_fullsized":"2023-11-28T11:10:36.533382+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:33.596539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.519949+0000","last_change":"2023-11-28T11:10:36.128467+0000","last_active":"2023-11-28T11:10:36.519949+0000","last_peered":"2023-11-28T11:10:36.519949+0000","last_clean":"2023-11-28T11:10:36.519949+0000","last_became_active":"2023-11-28T11:10:36.128068+0000","last_became_peered":"2023-11-28T11:10:36.128068+0000","last_unstale":"2023-11-28T11:10:36.519949+0000","last_undegraded":"2023-11-28T11:10:36.519949+0000","last_fullsized":"2023-11-28T11:10:36.519949+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:04.198577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515424+0000","last_change":"2023-11-28T11:10:36.529075+0000","last_active":"2023-11-28T11:10:37.515424+0000","last_peered":"2023-11-28T11:10:37.515424+0000","last_clean":"2023-11-28T11:10:37.515424+0000","last_became_active":"2023-11-28T11:10:36.528708+0000","last_became_peered":"2023-11-28T11:10:36.528708+0000","last_unstale":"2023-11-28T11:10:37.515424+0000","last_undegraded":"2023-11-28T11:10:37.515424+0000","last_fullsized":"2023-11-28T11:10:37.515424+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514729+0000","last_change":"2023-11-28T11:10:36.136681+0000","last_active":"2023-11-28T11:10:37.514729+0000","last_peered":"2023-11-28T11:10:37.514729+0000","last_clean":"2023-11-28T11:10:37.514729+0000","last_became_active":"2023-11-28T11:10:36.136334+0000","last_became_peered":"2023-11-28T11:10:36.136334+0000","last_unstale":"2023-11-28T11:10:37.514729+0000","last_undegraded":"2023-11-28T11:10:37.514729+0000","last_fullsized":"2023-11-28T11:10:37.514729+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:32.757363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514740+0000","last_change":"2023-11-28T11:10:36.527508+0000","last_active":"2023-11-28T11:10:37.514740+0000","last_peered":"2023-11-28T11:10:37.514740+0000","last_clean":"2023-11-28T11:10:37.514740+0000","last_became_active":"2023-11-28T11:10:36.527266+0000","last_became_peered":"2023-11-28T11:10:36.527266+0000","last_unstale":"2023-11-28T11:10:37.514740+0000","last_undegraded":"2023-11-28T11:10:37.514740+0000","last_fullsized":"2023-11-28T11:10:37.514740+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:42.678837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141490+0000","last_change":"2023-11-28T11:10:36.118325+0000","last_active":"2023-11-28T11:10:38.141490+0000","last_peered":"2023-11-28T11:10:38.141490+0000","last_clean":"2023-11-28T11:10:38.141490+0000","last_became_active":"2023-11-28T11:10:36.117983+0000","last_became_peered":"2023-11-28T11:10:36.117983+0000","last_unstale":"2023-11-28T11:10:38.141490+0000","last_undegraded":"2023-11-28T11:10:38.141490+0000","last_fullsized":"2023-11-28T11:10:38.141490+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:25.568140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515333+0000","last_change":"2023-11-28T11:10:36.527082+0000","last_active":"2023-11-28T11:10:37.515333+0000","last_peered":"2023-11-28T11:10:37.515333+0000","last_clean":"2023-11-28T11:10:37.515333+0000","last_became_active":"2023-11-28T11:10:36.526836+0000","last_became_peered":"2023-11-28T11:10:36.526836+0000","last_unstale":"2023-11-28T11:10:37.515333+0000","last_undegraded":"2023-11-28T11:10:37.515333+0000","last_fullsized":"2023-11-28T11:10:37.515333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:51.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:39.583556+0000","last_change":"2023-11-28T11:10:36.123639+0000","last_active":"2023-11-28T11:10:39.583556+0000","last_peered":"2023-11-28T11:10:39.583556+0000","last_clean":"2023-11-28T11:10:39.583556+0000","last_became_active":"2023-11-28T11:10:36.123346+0000","last_became_peered":"2023-11-28T11:10:36.123346+0000","last_unstale":"2023-11-28T11:10:39.583556+0000","last_undegraded":"2023-11-28T11:10:39.583556+0000","last_fullsized":"2023-11-28T11:10:39.583556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:04.366016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515629+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:10:37.515629+0000","last_peered":"2023-11-28T11:10:37.515629+0000","last_clean":"2023-11-28T11:10:37.515629+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:10:37.515629+0000","last_undegraded":"2023-11-28T11:10:37.515629+0000","last_fullsized":"2023-11-28T11:10:37.515629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.541384+0000","last_change":"2023-11-28T11:10:36.540771+0000","last_active":"2023-11-28T11:10:36.541384+0000","last_peered":"2023-11-28T11:10:36.541384+0000","last_clean":"2023-11-28T11:10:36.541384+0000","last_became_active":"2023-11-28T11:10:36.540507+0000","last_became_peered":"2023-11-28T11:10:36.540507+0000","last_unstale":"2023-11-28T11:10:36.541384+0000","last_undegraded":"2023-11-28T11:10:36.541384+0000","last_fullsized":"2023-11-28T11:10:36.541384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:48.693779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538022+0000","last_change":"2023-11-28T11:10:36.126657+0000","last_active":"2023-11-28T11:10:36.538022+0000","last_peered":"2023-11-28T11:10:36.538022+0000","last_clean":"2023-11-28T11:10:36.538022+0000","last_became_active":"2023-11-28T11:10:36.126383+0000","last_became_peered":"2023-11-28T11:10:36.126383+0000","last_unstale":"2023-11-28T11:10:36.538022+0000","last_undegraded":"2023-11-28T11:10:36.538022+0000","last_fullsized":"2023-11-28T11:10:36.538022+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:50:37.096652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.517950+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:10:36.517950+0000","last_peered":"2023-11-28T11:10:36.517950+0000","last_clean":"2023-11-28T11:10:36.517950+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:10:36.517950+0000","last_undegraded":"2023-11-28T11:10:36.517950+0000","last_fullsized":"2023-11-28T11:10:36.517950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.538297+0000","last_change":"2023-11-28T11:10:36.534490+0000","last_active":"2023-11-28T11:10:36.538297+0000","last_peered":"2023-11-28T11:10:36.538297+0000","last_clean":"2023-11-28T11:10:36.538297+0000","last_became_active":"2023-11-28T11:10:36.534230+0000","last_became_peered":"2023-11-28T11:10:36.534230+0000","last_unstale":"2023-11-28T11:10:36.538297+0000","last_undegraded":"2023-11-28T11:10:36.538297+0000","last_fullsized":"2023-11-28T11:10:36.538297+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:40.802246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515180+0000","last_change":"2023-11-28T11:10:36.126778+0000","last_active":"2023-11-28T11:10:37.515180+0000","last_peered":"2023-11-28T11:10:37.515180+0000","last_clean":"2023-11-28T11:10:37.515180+0000","last_became_active":"2023-11-28T11:10:36.126275+0000","last_became_peered":"2023-11-28T11:10:36.126275+0000","last_unstale":"2023-11-28T11:10:37.515180+0000","last_undegraded":"2023-11-28T11:10:37.515180+0000","last_fullsized":"2023-11-28T11:10:37.515180+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:04.198577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:38.141619+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:10:38.141619+0000","last_peered":"2023-11-28T11:10:38.141619+0000","last_clean":"2023-11-28T11:10:38.141619+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:10:38.141619+0000","last_undegraded":"2023-11-28T11:10:38.141619+0000","last_fullsized":"2023-11-28T11:10:38.141619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.524865+0000","last_change":"2023-11-28T11:10:36.524114+0000","last_active":"2023-11-28T11:10:36.524865+0000","last_peered":"2023-11-28T11:10:36.524865+0000","last_clean":"2023-11-28T11:10:36.524865+0000","last_became_active":"2023-11-28T11:10:36.523827+0000","last_became_peered":"2023-11-28T11:10:36.523827+0000","last_unstale":"2023-11-28T11:10:36.524865+0000","last_undegraded":"2023-11-28T11:10:36.524865+0000","last_fullsized":"2023-11-28T11:10:36.524865+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:23.676984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515501+0000","last_change":"2023-11-28T11:10:36.119977+0000","last_active":"2023-11-28T11:10:37.515501+0000","last_peered":"2023-11-28T11:10:37.515501+0000","last_clean":"2023-11-28T11:10:37.515501+0000","last_became_active":"2023-11-28T11:10:36.117081+0000","last_became_peered":"2023-11-28T11:10:36.117081+0000","last_unstale":"2023-11-28T11:10:37.515501+0000","last_undegraded":"2023-11-28T11:10:37.515501+0000","last_fullsized":"2023-11-28T11:10:37.515501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:08.312145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.517493+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:10:36.517493+0000","last_peered":"2023-11-28T11:10:36.517493+0000","last_clean":"2023-11-28T11:10:36.517493+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:10:36.517493+0000","last_undegraded":"2023-11-28T11:10:36.517493+0000","last_fullsized":"2023-11-28T11:10:36.517493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.513577+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:10:36.513577+0000","last_peered":"2023-11-28T11:10:36.513577+0000","last_clean":"2023-11-28T11:10:36.513577+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:10:36.513577+0000","last_undegraded":"2023-11-28T11:10:36.513577+0000","last_fullsized":"2023-11-28T11:10:36.513577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.514556+0000","last_change":"2023-11-28T11:10:36.529294+0000","last_active":"2023-11-28T11:10:37.514556+0000","last_peered":"2023-11-28T11:10:37.514556+0000","last_clean":"2023-11-28T11:10:37.514556+0000","last_became_active":"2023-11-28T11:10:36.529051+0000","last_became_peered":"2023-11-28T11:10:36.529051+0000","last_unstale":"2023-11-28T11:10:37.514556+0000","last_undegraded":"2023-11-28T11:10:37.514556+0000","last_fullsized":"2023-11-28T11:10:37.514556+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:09.319621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515058+0000","last_change":"2023-11-28T11:10:36.124673+0000","last_active":"2023-11-28T11:10:37.515058+0000","last_peered":"2023-11-28T11:10:37.515058+0000","last_clean":"2023-11-28T11:10:37.515058+0000","last_became_active":"2023-11-28T11:10:36.124359+0000","last_became_peered":"2023-11-28T11:10:36.124359+0000","last_unstale":"2023-11-28T11:10:37.515058+0000","last_undegraded":"2023-11-28T11:10:37.515058+0000","last_fullsized":"2023-11-28T11:10:37.515058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:34.374591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.513691+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:10:36.513691+0000","last_peered":"2023-11-28T11:10:36.513691+0000","last_clean":"2023-11-28T11:10:36.513691+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:10:36.513691+0000","last_undegraded":"2023-11-28T11:10:36.513691+0000","last_fullsized":"2023-11-28T11:10:36.513691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.537940+0000","last_change":"2023-11-28T11:10:36.526598+0000","last_active":"2023-11-28T11:10:36.537940+0000","last_peered":"2023-11-28T11:10:36.537940+0000","last_clean":"2023-11-28T11:10:36.537940+0000","last_became_active":"2023-11-28T11:10:36.526319+0000","last_became_peered":"2023-11-28T11:10:36.526319+0000","last_unstale":"2023-11-28T11:10:36.537940+0000","last_undegraded":"2023-11-28T11:10:36.537940+0000","last_fullsized":"2023-11-28T11:10:36.537940+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:28.375662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.518951+0000","last_change":"2023-11-28T11:10:36.133707+0000","last_active":"2023-11-28T11:10:36.518951+0000","last_peered":"2023-11-28T11:10:36.518951+0000","last_clean":"2023-11-28T11:10:36.518951+0000","last_became_active":"2023-11-28T11:10:36.133380+0000","last_became_peered":"2023-11-28T11:10:36.133380+0000","last_unstale":"2023-11-28T11:10:36.518951+0000","last_undegraded":"2023-11-28T11:10:36.518951+0000","last_fullsized":"2023-11-28T11:10:36.518951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:33.877212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515099+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:10:37.515099+0000","last_peered":"2023-11-28T11:10:37.515099+0000","last_clean":"2023-11-28T11:10:37.515099+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:10:37.515099+0000","last_undegraded":"2023-11-28T11:10:37.515099+0000","last_fullsized":"2023-11-28T11:10:37.515099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:10:37.515046+0000","last_change":"2023-11-28T11:10:36.528366+0000","last_active":"2023-11-28T11:10:37.515046+0000","last_peered":"2023-11-28T11:10:37.515046+0000","last_clean":"2023-11-28T11:10:37.515046+0000","last_became_active":"2023-11-28T11:10:36.528119+0000","last_became_peered":"2023-11-28T11:10:36.528119+0000","last_unstale":"2023-11-28T11:10:37.515046+0000","last_undegraded":"2023-11-28T11:10:37.515046+0000","last_fullsized":"2023-11-28T11:10:37.515046+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:05.763064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.522685+0000","last_change":"2023-11-28T11:10:36.124716+0000","last_active":"2023-11-28T11:10:36.522685+0000","last_peered":"2023-11-28T11:10:36.522685+0000","last_clean":"2023-11-28T11:10:36.522685+0000","last_became_active":"2023-11-28T11:10:36.124462+0000","last_became_peered":"2023-11-28T11:10:36.124462+0000","last_unstale":"2023-11-28T11:10:36.522685+0000","last_undegraded":"2023-11-28T11:10:36.522685+0000","last_fullsized":"2023-11-28T11:10:36.522685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:04.366016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.519077+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:10:36.519077+0000","last_peered":"2023-11-28T11:10:36.519077+0000","last_clean":"2023-11-28T11:10:36.519077+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:10:36.519077+0000","last_undegraded":"2023-11-28T11:10:36.519077+0000","last_fullsized":"2023-11-28T11:10:36.519077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.527232+0000","last_change":"2023-11-28T11:10:36.524993+0000","last_active":"2023-11-28T11:10:36.527232+0000","last_peered":"2023-11-28T11:10:36.527232+0000","last_clean":"2023-11-28T11:10:36.527232+0000","last_became_active":"2023-11-28T11:10:36.524685+0000","last_became_peered":"2023-11-28T11:10:36.524685+0000","last_unstale":"2023-11-28T11:10:36.527232+0000","last_undegraded":"2023-11-28T11:10:36.527232+0000","last_fullsized":"2023-11-28T11:10:36.527232+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:36.103568+0000","last_clean_scrub_stamp":"2023-11-28T11:10:36.103568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:38.685821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.520040+0000","last_change":"2023-11-28T11:10:36.136431+0000","last_active":"2023-11-28T11:10:36.520040+0000","last_peered":"2023-11-28T11:10:36.520040+0000","last_clean":"2023-11-28T11:10:36.520040+0000","last_became_active":"2023-11-28T11:10:36.136139+0000","last_became_peered":"2023-11-28T11:10:36.136139+0000","last_unstale":"2023-11-28T11:10:36.520040+0000","last_undegraded":"2023-11-28T11:10:36.520040+0000","last_fullsized":"2023-11-28T11:10:36.520040+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:10:35.096092+0000","last_clean_scrub_stamp":"2023-11-28T11:10:35.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:30.368123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T11:10:36.121343+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:10:36.121343+0000","last_peered":"2023-11-28T11:10:36.121343+0000","last_clean":"2023-11-28T11:10:36.121343+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:10:36.121343+0000","last_undegraded":"2023-11-28T11:10:36.121343+0000","last_fullsized":"2023-11-28T11:10:36.121343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10284,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361556,"statfs":{"total":96636764160,"available":96626233344,"internally_reserved":0,"allocated":1216512,"data_stored":856083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.40000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71799999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.69899999999999995,"15min":0.72199999999999998},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.73899999999999999,"15min":0.76600000000000001},"min":{"1min":0.39700000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82999999999999996,"5min":5.532,"15min":5.532},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.66700000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70499999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67800000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.39500000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.43099999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75800000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.438,"5min":0.437,"15min":0.437},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.501},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.995,"15min":0.995},"last":0.54900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8860,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362980,"statfs":{"total":96636764160,"available":96627691520,"internally_reserved":0,"allocated":610304,"data_stored":259574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.503,"15min":0.49299999999999999},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.624},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.74199999999999999,"15min":0.77600000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65900000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.55000000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.74199999999999999,"15min":0.77000000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79500000000000004,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.70699999999999996,"15min":0.73199999999999998},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71699999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.746,"15min":0.77800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72199999999999998,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.52900000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52300000000000002,"15min":0.51800000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.44},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.46400000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.875,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.36699999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":1.137,"15min":1.137},"last":0.65000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9000,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362840,"statfs":{"total":96636764160,"available":96627548160,"internally_reserved":0,"allocated":622592,"data_stored":265751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33100000000000002,"15min":0.33500000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.41799999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.496},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.22,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.55500000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33400000000000002,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44700000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.36299999999999999,"15min":0.36599999999999999},"min":{"1min":0.23599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48799999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.54300000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.504,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.63,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82199999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.78500000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78200000000000003,"5min":0.999,"15min":0.999},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.036,"15min":1.036},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84499999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10156,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361684,"statfs":{"total":96636764160,"available":96626364416,"internally_reserved":0,"allocated":1216512,"data_stored":856015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.33900000000000002},"min":{"1min":0.23899999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54200000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32900000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.22600000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.44500000000000001,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.316},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.439,"15min":0.45400000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.58499999999999996,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.309},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.51600000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.35399999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.872,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77500000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":3.298,"15min":3.298},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.72099999999999997,"15min":0.74399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85699999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.56100000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84399999999999997,"5min":0.877,"15min":0.877},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8940,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362900,"statfs":{"total":96636764160,"available":96627609600,"internally_reserved":0,"allocated":626688,"data_stored":267139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.317},"min":{"1min":0.26500000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.47999999999999998,"5min":0.503,"15min":0.503},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36199999999999999,"15min":0.35599999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.503,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.435}]},{"osd":1,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34200000000000003,"15min":0.33600000000000002},"min":{"1min":0.29599999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.504,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.33900000000000002},"min":{"1min":0.26900000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54600000000000004,"5min":1.002,"15min":1.002},"last":0.37}]},{"osd":3,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35499999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.374,"15min":0.36799999999999999},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51600000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73499999999999999,"5min":0.875,"15min":0.875},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.504},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.75600000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52700000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73499999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46000000000000002}]},{"osd":7,"last update":"Tue Nov 28 11:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.44800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.80800000000000005,"5min":1.05,"15min":1.05},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.751,"5min":1.222,"15min":1.222},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":618496,"data_stored":260508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.36099999999999999,"15min":0.36799999999999999},"min":{"1min":0.22700000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.435,"5min":1.365,"15min":1.365},"last":0.253},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.66300000000000003,"15min":0.72299999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41599999999999998,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.376}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.73599999999999999,"15min":0.80300000000000005},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45300000000000001,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.317},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.39800000000000002,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.44,"5min":1.448,"15min":1.448},"last":0.29999999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.42099999999999999,"15min":0.434},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.52100000000000002,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42499999999999999,"15min":0.42599999999999999},"min":{"1min":0.29099999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.298,"5min":1.474,"15min":1.474},"last":0.38900000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.85499999999999998,"15min":0.90100000000000002},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.94399999999999995,"15min":1.004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.94299999999999995,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.51400000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.93899999999999995,"15min":0.996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.996,"5min":12.994,"15min":12.994},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.95399999999999996,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.90800000000000003,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97799999999999998,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.97899999999999998,"15min":1.038},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.05,"5min":12.932,"15min":12.932},"last":0.53900000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.91200000000000003,"15min":0.96199999999999997},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.038,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.60099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9112,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362728,"statfs":{"total":96636764160,"available":96627433472,"internally_reserved":0,"allocated":606208,"data_stored":259504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.501},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.68500000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60899999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65500000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.68700000000000006}]},{"osd":2,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68500000000000005,"5min":0.747,"15min":0.747},"last":0.754}]},{"osd":3,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69299999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67000000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.77100000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73099999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.85799999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72499999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.78100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9044,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362796,"statfs":{"total":96636764160,"available":96627503104,"internally_reserved":0,"allocated":602112,"data_stored":258938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.522,"15min":1.522},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76700000000000002,"5min":1.452,"15min":1.452},"last":0.58299999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76700000000000002,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.69599999999999995,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68799999999999994,"5min":1.032,"15min":1.032},"last":0.622},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":2.282,"15min":2.282},"last":0.46600000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":1.401,"15min":1.401},"last":0.496},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":1.478,"15min":1.478},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.53100000000000003}]},{"osd":6,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68400000000000005,"15min":0.69699999999999995},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83499999999999996,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.55900000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":2.444,"15min":2.444},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.441,"5min":0.44,"15min":0.44},"max":{"1min":0.90300000000000002,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.54800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:10:45.461 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:10:45.461 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T11:10:45.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.622+0000 7fda81abf700 1 Processor -- start 2023-11-28T11:10:45.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.622+0000 7fda81abf700 1 -- start start 2023-11-28T11:10:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.623+0000 7fda81abf700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c0718e0 0x7fda7c06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.623+0000 7fda81abf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c160a50 con 0x7fda7c06cdc0 2023-11-28T11:10:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.623+0000 7fda81abf700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c160d30 con 0x7fda7c15c810 2023-11-28T11:10:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.623+0000 7fda81abf700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c15cbe0 con 0x7fda7c0718e0 2023-11-28T11:10:45.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.623+0000 7fda7bfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fda7c06cdc0 0x7fda7c06a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44454/0 (socket says 172.21.15.125:44454) 2023-11-28T11:10:45.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.623+0000 7fda7bfff700 1 -- 172.21.15.125:0/4022162278 learned_addr learned my addr 172.21.15.125:0/4022162278 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:45.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7affd700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c0718e0 0x7fda7c06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102807778 0 0) 0x7fda7c160a50 con 0x7fda7c06cdc0 2023-11-28T11:10:45.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda640035b0 con 0x7fda7c06cdc0 2023-11-28T11:10:45.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3990620965 0 0) 0x7fda640035b0 con 0x7fda7c06cdc0 2023-11-28T11:10:45.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c0718e0 msgr2=0x7fda7c06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:45.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c0718e0 0x7fda7c06c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 >> v1:172.21.15.167:6789/0 conn(0x7fda7c15c810 legacy=0x7fda7c160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c161010 con 0x7fda7c06cdc0 2023-11-28T11:10:45.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fda740019f0 con 0x7fda7c06cdc0 2023-11-28T11:10:45.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 >> v1:172.21.15.125:6789/0 conn(0x7fda7c06cdc0 legacy=0x7fda7c06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda64003a30 0x7fda64003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c0718e0 0x7fda64004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda64004d90 0x7fda64005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c15cbe0 con 0x7fda64004d90 2023-11-28T11:10:45.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6400bac0 con 0x7fda64003a30 2023-11-28T11:10:45.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6400bc80 con 0x7fda7c0718e0 2023-11-28T11:10:45.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7bfff700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda64004d90 0x7fda64005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7b7fe700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda64003a30 0x7fda64003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7affd700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c0718e0 0x7fda64004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7bfff700 1 -- 172.21.15.125:0/4022162278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c0718e0 msgr2=0x7fda64004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:45.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7bfff700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c0718e0 0x7fda64004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7bfff700 1 -- 172.21.15.125:0/4022162278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda64003a30 msgr2=0x7fda64003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:45.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7bfff700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda64003a30 0x7fda64003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.624+0000 7fda7bfff700 1 -- 172.21.15.125:0/4022162278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda640035b0 con 0x7fda64004d90 2023-11-28T11:10:45.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.625+0000 7fda7bfff700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda64004d90 0x7fda64005200 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fda7400a800 tx=0x7fda64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec2e0e09d68853f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:45.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.625+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7400a2f0 con 0x7fda64004d90 2023-11-28T11:10:45.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.625+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda74012600 con 0x7fda64004d90 2023-11-28T11:10:45.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.625+0000 7fda7a7fc700 1 -- 172.21.15.125:0/4022162278 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740129b0 con 0x7fda64004d90 2023-11-28T11:10:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.625+0000 7fda81abf700 1 -- 172.21.15.125:0/4022162278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda64004d90 msgr2=0x7fda64005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.625+0000 7fda81abf700 1 --2- 172.21.15.125:0/4022162278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda64004d90 0x7fda64005200 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fda7400a800 tx=0x7fda64005880 comp rx=0 tx=0).stop 2023-11-28T11:10:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.625+0000 7fda7bfff700 1 -- 172.21.15.125:0/4022162278 reap_dead start 2023-11-28T11:10:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.625+0000 7fda81abf700 1 -- 172.21.15.125:0/4022162278 shutdown_connections 2023-11-28T11:10:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.625+0000 7fda81abf700 1 -- 172.21.15.125:0/4022162278 >> 172.21.15.125:0/4022162278 conn(0x7fda7c06c010 msgr2=0x7fda7c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.625+0000 7fda81abf700 1 -- 172.21.15.125:0/4022162278 shutdown_connections 2023-11-28T11:10:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.625+0000 7fda81abf700 1 -- 172.21.15.125:0/4022162278 wait complete. 2023-11-28T11:10:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.626+0000 7fda81abf700 1 Processor -- start 2023-11-28T11:10:45.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.627+0000 7fda81abf700 1 -- start start 2023-11-28T11:10:45.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.627+0000 7fda81abf700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c15a6f0 0x7fda7c1e8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.627+0000 7fda81abf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7c0b40c0 0x7fda7c1e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.627+0000 7fda81abf700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda7c15b450 0x7fda7c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.627+0000 7fda81abf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0b51b0 con 0x7fda7c0b40c0 2023-11-28T11:10:45.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.627+0000 7fda81abf700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0b45a0 con 0x7fda7c15b450 2023-11-28T11:10:45.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.627+0000 7fda81abf700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0b4880 con 0x7fda7c15a6f0 2023-11-28T11:10:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.627+0000 7fda7affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7c0b40c0 0x7fda7c1e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda7affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7c0b40c0 0x7fda7c1e85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60340/0 (socket says 172.21.15.125:60340) 2023-11-28T11:10:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda7affd700 1 -- 172.21.15.125:0/1454362393 learned_addr learned my addr 172.21.15.125:0/1454362393 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda7b7fe700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c15a6f0 0x7fda7c1e8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda7bfff700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda7c15b450 0x7fda7c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda7affd700 1 -- 172.21.15.125:0/1454362393 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c15a6f0 msgr2=0x7fda7c1e8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda7affd700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c15a6f0 0x7fda7c1e8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda7affd700 1 -- 172.21.15.125:0/1454362393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda7c15b450 msgr2=0x7fda7c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda7affd700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda7c15b450 0x7fda7c0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda7affd700 1 -- 172.21.15.125:0/1454362393 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c0ce740 con 0x7fda7c0b40c0 2023-11-28T11:10:45.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda7affd700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7c0b40c0 0x7fda7c1e85b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fda6c011aa0 tx=0x7fda6c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda63fff700 1 -- 172.21.15.125:0/1454362393 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c011ee0 con 0x7fda7c0b40c0 2023-11-28T11:10:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda63fff700 1 -- 172.21.15.125:0/1454362393 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c00f940 con 0x7fda7c0b40c0 2023-11-28T11:10:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda81abf700 1 -- 172.21.15.125:0/1454362393 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c0ceb20 con 0x7fda7c0b40c0 2023-11-28T11:10:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda63fff700 1 -- 172.21.15.125:0/1454362393 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c00fcf0 con 0x7fda7c0b40c0 2023-11-28T11:10:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.628+0000 7fda81abf700 1 -- 172.21.15.125:0/1454362393 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c0ce8d0 con 0x7fda7c0b40c0 2023-11-28T11:10:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.629+0000 7fda81abf700 1 -- 172.21.15.125:0/1454362393 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c0b5320 con 0x7fda7c0b40c0 2023-11-28T11:10:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.629+0000 7fda63fff700 1 -- 172.21.15.125:0/1454362393 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fda6c014440 con 0x7fda7c0b40c0 2023-11-28T11:10:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.630+0000 7fda63fff700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda68068320 0x7fda6806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.630+0000 7fda63fff700 1 -- 172.21.15.125:0/1454362393 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda6c086530 con 0x7fda7c0b40c0 2023-11-28T11:10:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.630+0000 7fda7b7fe700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda68068320 0x7fda6806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:45.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.630+0000 7fda7b7fe700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda68068320 0x7fda6806a7d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fda70007fd0 tx=0x7fda70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:45.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.634+0000 7fda63fff700 1 -- 172.21.15.125:0/1454362393 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fda6c052e10 con 0x7fda7c0b40c0 2023-11-28T11:10:45.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.897+0000 7fda81abf700 1 -- 172.21.15.125:0/1454362393 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fda7c0743f0 con 0x7fda7c0b40c0 2023-11-28T11:10:45.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.903+0000 7fda63fff700 1 -- 172.21.15.125:0/1454362393 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7fda6c056430 con 0x7fda7c0b40c0 2023-11-28T11:10:45.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 -- 172.21.15.125:0/1454362393 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda68068320 msgr2=0x7fda6806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda68068320 0x7fda6806a7d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fda70007fd0 tx=0x7fda70009040 comp rx=0 tx=0).stop 2023-11-28T11:10:45.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 -- 172.21.15.125:0/1454362393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7c0b40c0 msgr2=0x7fda7c1e85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:45.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7c0b40c0 0x7fda7c1e85b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fda6c011aa0 tx=0x7fda6c011db0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 -- 172.21.15.125:0/1454362393 shutdown_connections 2023-11-28T11:10:45.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda7c15b450 0x7fda7c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fda68068320 0x7fda6806a7d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda7c15a6f0 0x7fda7c1e8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 --2- 172.21.15.125:0/1454362393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7c0b40c0 0x7fda7c1e85b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:45.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 -- 172.21.15.125:0/1454362393 >> 172.21.15.125:0/1454362393 conn(0x7fda7c06c010 msgr2=0x7fda7c0adcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:45.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 -- 172.21.15.125:0/1454362393 shutdown_connections 2023-11-28T11:10:45.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:45.905+0000 7fda81abf700 1 -- 172.21.15.125:0/1454362393 wait complete. 2023-11-28T11:10:45.907 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-11-28T11:10:45.918 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:10:46.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.037+0000 7f8b41ff6700 1 Processor -- start 2023-11-28T11:10:46.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.037+0000 7f8b41ff6700 1 -- start start 2023-11-28T11:10:46.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b41ff6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b3c15cc80 0x7f8b3c06de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b41ff6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8b3c06e3a0 0x7f8b3c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b41ff6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3c0b1810 con 0x7f8b3c06a270 2023-11-28T11:10:46.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b41ff6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3c0b2490 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b41ff6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0b1af0 con 0x7f8b3c15cc80 2023-11-28T11:10:46.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b3bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8b3c06e3a0 0x7f8b3c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b3b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8b3c06a270 0x7f8b3c06a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44470/0 (socket says 172.21.15.125:44470) 2023-11-28T11:10:46.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b3b7fe700 1 -- 172.21.15.125:0/2224522395 learned_addr learned my addr 172.21.15.125:0/2224522395 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:46.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b3bfff700 1 -- 172.21.15.125:0/2224522395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b3c15cc80 msgr2=0x7f8b3c06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b3bfff700 1 --2- 172.21.15.125:0/2224522395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b3c15cc80 0x7f8b3c06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b3bfff700 1 -- 172.21.15.125:0/2224522395 >> v1:172.21.15.125:6789/0 conn(0x7f8b3c06a270 legacy=0x7f8b3c06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b3bfff700 1 -- 172.21.15.125:0/2224522395 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c0b1dd0 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b3a7fc700 1 -- 172.21.15.125:0/2224522395 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21092142 0 0) 0x7f8b3c0b1810 con 0x7f8b3c06a270 2023-11-28T11:10:46.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.038+0000 7f8b3bfff700 1 --2- 172.21.15.125:0/2224522395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c06e3a0 0x7f8b3c070d20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009d90 tx=0x7f8b3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c86f7dd2fe6ddd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:46.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.039+0000 7f8b3a7fc700 1 -- 172.21.15.125:0/2224522395 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3400e070 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.039+0000 7f8b3a7fc700 1 -- 172.21.15.125:0/2224522395 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3400bbd0 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.039+0000 7f8b3a7fc700 1 -- 172.21.15.125:0/2224522395 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34012430 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.039+0000 7f8b41ff6700 1 -- 172.21.15.125:0/2224522395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c06e3a0 msgr2=0x7f8b3c070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.039+0000 7f8b41ff6700 1 --2- 172.21.15.125:0/2224522395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c06e3a0 0x7f8b3c070d20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009d90 tx=0x7f8b3400b330 comp rx=0 tx=0).stop 2023-11-28T11:10:46.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.039+0000 7f8b41ff6700 1 -- 172.21.15.125:0/2224522395 shutdown_connections 2023-11-28T11:10:46.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.039+0000 7f8b41ff6700 1 --2- 172.21.15.125:0/2224522395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c06e3a0 0x7f8b3c070d20 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.039+0000 7f8b41ff6700 1 --2- 172.21.15.125:0/2224522395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b3c15cc80 0x7f8b3c06de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.039+0000 7f8b41ff6700 1 -- 172.21.15.125:0/2224522395 >> 172.21.15.125:0/2224522395 conn(0x7f8b3c06c010 msgr2=0x7f8b3c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:46.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.039+0000 7f8b41ff6700 1 -- 172.21.15.125:0/2224522395 shutdown_connections 2023-11-28T11:10:46.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.039+0000 7f8b41ff6700 1 -- 172.21.15.125:0/2224522395 wait complete. 2023-11-28T11:10:46.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.040+0000 7f8b41ff6700 1 Processor -- start 2023-11-28T11:10:46.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.040+0000 7f8b41ff6700 1 -- start start 2023-11-28T11:10:46.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.041+0000 7f8b41ff6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b3c06a270 0x7f8b3c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.041+0000 7f8b41ff6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c06e3a0 0x7f8b3c0ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.041+0000 7f8b41ff6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b3c15cc80 0x7f8b3c0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.041+0000 7f8b41ff6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c150ad0 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.041+0000 7f8b41ff6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0cbb70 con 0x7f8b3c15cc80 2023-11-28T11:10:46.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.041+0000 7f8b41ff6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0c6f40 con 0x7f8b3c06a270 2023-11-28T11:10:46.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.041+0000 7f8b3affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c06e3a0 0x7f8b3c0ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.041+0000 7f8b3affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c06e3a0 0x7f8b3c0ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60354/0 (socket says 172.21.15.125:60354) 2023-11-28T11:10:46.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.041+0000 7f8b3affd700 1 -- 172.21.15.125:0/3061382814 learned_addr learned my addr 172.21.15.125:0/3061382814 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:46.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b3b7fe700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b3c06a270 0x7f8b3c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b3bfff700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b3c15cc80 0x7f8b3c0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b3affd700 1 -- 172.21.15.125:0/3061382814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b3c06a270 msgr2=0x7f8b3c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b3affd700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b3c06a270 0x7f8b3c0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b3affd700 1 -- 172.21.15.125:0/3061382814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b3c15cc80 msgr2=0x7f8b3c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b3affd700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b3c15cc80 0x7f8b3c0ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b3affd700 1 -- 172.21.15.125:0/3061382814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b34009a70 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b3bfff700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b3c15cc80 0x7f8b3c0ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:46.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b3affd700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c06e3a0 0x7f8b3c0ad270 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00b4a0 tx=0x7f8b2c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:46.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b23fff700 1 -- 172.21.15.125:0/3061382814 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c011830 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b23fff700 1 -- 172.21.15.125:0/3061382814 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c011990 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b41ff6700 1 -- 172.21.15.125:0/3061382814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c06e7e0 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b23fff700 1 -- 172.21.15.125:0/3061382814 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c011d40 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.042+0000 7f8b41ff6700 1 -- 172.21.15.125:0/3061382814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c0b20b0 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.043+0000 7f8b41ff6700 1 -- 172.21.15.125:0/3061382814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c15daa0 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.043+0000 7f8b23fff700 1 -- 172.21.15.125:0/3061382814 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8b2c021070 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.044+0000 7f8b23fff700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b280682f0 0x7f8b2806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.044+0000 7f8b23fff700 1 -- 172.21.15.125:0/3061382814 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b2c085bc0 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.044+0000 7f8b3b7fe700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b280682f0 0x7f8b2806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.044+0000 7f8b3b7fe700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b280682f0 0x7f8b2806a7a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8b30000f60 tx=0x7f8b30007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:46.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.048+0000 7f8b23fff700 1 -- 172.21.15.125:0/3061382814 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8b2c0523a0 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.274+0000 7f8b41ff6700 1 -- 172.21.15.125:0/3061382814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b3c0743f0 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.274+0000 7f8b23fff700 1 -- 172.21.15.125:0/3061382814 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f8b2c015090 con 0x7f8b3c06e3a0 2023-11-28T11:10:46.275 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:46.275 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/991177251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":991177251},{"type":"v1","addr":"172.21.15.167:6834","nonce":991177251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/289069328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":289069328},{"type":"v1","addr":"172.21.15.167:6835","nonce":289069328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3275492587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3275492587},{"type":"v1","addr":"172.21.15.125:6836","nonce":3275492587}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:10:36.508959+0000","modified":"2023-11-28T11:10:39.516894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5775":{"gid":5775,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3179120009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":3179120009},{"type":"v1","addr":"172.21.15.125:6837","nonce":3179120009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:10:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 -- 172.21.15.125:0/3061382814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b280682f0 msgr2=0x7f8b2806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b280682f0 0x7f8b2806a7a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8b30000f60 tx=0x7f8b30007c90 comp rx=0 tx=0).stop 2023-11-28T11:10:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 -- 172.21.15.125:0/3061382814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c06e3a0 msgr2=0x7f8b3c0ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c06e3a0 0x7f8b3c0ad270 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00b4a0 tx=0x7f8b2c00b860 comp rx=0 tx=0).stop 2023-11-28T11:10:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 -- 172.21.15.125:0/3061382814 shutdown_connections 2023-11-28T11:10:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b3c15cc80 0x7f8b3c0ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8b280682f0 0x7f8b2806a7a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b3c06a270 0x7f8b3c0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 --2- 172.21.15.125:0/3061382814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b3c06e3a0 0x7f8b3c0ad270 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 -- 172.21.15.125:0/3061382814 >> 172.21.15.125:0/3061382814 conn(0x7f8b3c06c010 msgr2=0x7f8b3c06a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:46.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 -- 172.21.15.125:0/3061382814 shutdown_connections 2023-11-28T11:10:46.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.277+0000 7f8b41ff6700 1 -- 172.21.15.125:0/3061382814 wait complete. 2023-11-28T11:10:46.279 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 23 2023-11-28T11:10:46.693 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:10:36.508959+0000', 'modified': '2023-11-28T11:10:39.516894+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5775}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5775': {'gid': 5775, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6837/3179120009', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6835', 'nonce': 3179120009}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 3179120009}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:10:46.693 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:10:46.693 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T11:10:46.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.815+0000 7fe1c8309700 1 Processor -- start 2023-11-28T11:10:46.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.815+0000 7fe1c8309700 1 -- start start 2023-11-28T11:10:46.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.816+0000 7fe1c8309700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1c015fe50 0x7fe1c006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.816+0000 7fe1c8309700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 0x7fe1c0160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.816+0000 7fe1c8309700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c0161370 con 0x7fe1c00b27d0 2023-11-28T11:10:46.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.816+0000 7fe1c8309700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c0160220 con 0x7fe1c015fe50 2023-11-28T11:10:46.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.816+0000 7fe1c8309700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00cf700 con 0x7fe1c00b3b80 2023-11-28T11:10:46.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.816+0000 7fe1c60a5700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1c015fe50 0x7fe1c006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.816+0000 7fe1c58a4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 0x7fe1c0160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.816+0000 7fe1c58a4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 0x7fe1c0160ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:55368/0 (socket says 172.21.15.125:55368) 2023-11-28T11:10:46.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.816+0000 7fe1c58a4700 1 -- 172.21.15.125:0/352449738 learned_addr learned my addr 172.21.15.125:0/352449738 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:46.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.816+0000 7fe1c60a5700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1c015fe50 0x7fe1c006d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:57090/0 (socket says 172.21.15.125:57090) 2023-11-28T11:10:46.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.816+0000 7fe1c68a6700 1 --1- 172.21.15.125:0/352449738 >> v1:172.21.15.167:6789/0 conn(0x7fe1c00b27d0 0x7fe1c00cfb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:47288/0 (socket says 172.21.15.125:47288) 2023-11-28T11:10:46.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.817+0000 7fe1c58a4700 1 -- 172.21.15.125:0/352449738 >> v2:172.21.15.167:3300/0 conn(0x7fe1c015fe50 msgr2=0x7fe1c006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.817+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/352449738 >> v2:172.21.15.167:3300/0 conn(0x7fe1c015fe50 0x7fe1c006d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.817+0000 7fe1c58a4700 1 -- 172.21.15.125:0/352449738 >> v1:172.21.15.167:6789/0 conn(0x7fe1c00b27d0 legacy=0x7fe1c00cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.817+0000 7fe1c58a4700 1 -- 172.21.15.125:0/352449738 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c00b3fd0 con 0x7fe1c00b3b80 2023-11-28T11:10:46.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.817+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/352449738 >> v2:172.21.15.167:3300/0 conn(0x7fe1c015fe50 0x7fe1c006d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:10:46.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.817+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/352449738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 0x7fe1c0160ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0098f0 tx=0x7fe1bc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee9d93c21c2cc2f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:46.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.817+0000 7fe1c50a3700 1 -- 172.21.15.125:0/352449738 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc011830 con 0x7fe1c00b3b80 2023-11-28T11:10:46.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.817+0000 7fe1c50a3700 1 -- 172.21.15.125:0/352449738 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc011990 con 0x7fe1c00b3b80 2023-11-28T11:10:46.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.817+0000 7fe1c50a3700 1 -- 172.21.15.125:0/352449738 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc011d20 con 0x7fe1c00b3b80 2023-11-28T11:10:46.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.818+0000 7fe1c8309700 1 -- 172.21.15.125:0/352449738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 msgr2=0x7fe1c0160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.818+0000 7fe1c8309700 1 --2- 172.21.15.125:0/352449738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 0x7fe1c0160ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0098f0 tx=0x7fe1bc009c00 comp rx=0 tx=0).stop 2023-11-28T11:10:46.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.818+0000 7fe1c8309700 1 -- 172.21.15.125:0/352449738 shutdown_connections 2023-11-28T11:10:46.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.818+0000 7fe1c8309700 1 --2- 172.21.15.125:0/352449738 >> v2:172.21.15.167:3300/0 conn(0x7fe1c015fe50 0x7fe1c006d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.818+0000 7fe1c8309700 1 --2- 172.21.15.125:0/352449738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 0x7fe1c0160ad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.818+0000 7fe1c8309700 1 -- 172.21.15.125:0/352449738 >> 172.21.15.125:0/352449738 conn(0x7fe1c006ea80 msgr2=0x7fe1c006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:46.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.818+0000 7fe1c8309700 1 -- 172.21.15.125:0/352449738 shutdown_connections 2023-11-28T11:10:46.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.818+0000 7fe1c8309700 1 -- 172.21.15.125:0/352449738 wait complete. 2023-11-28T11:10:46.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.819+0000 7fe1c8309700 1 Processor -- start 2023-11-28T11:10:46.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.819+0000 7fe1c8309700 1 -- start start 2023-11-28T11:10:46.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c8309700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1c00b27d0 0x7fe1c00b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c8309700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 0x7fe1c00b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c8309700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1c015fe50 0x7fe1c0154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c8309700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0155760 con 0x7fe1c015fe50 2023-11-28T11:10:46.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c8309700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b6ab0 con 0x7fe1c00b27d0 2023-11-28T11:10:46.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c8309700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b64f0 con 0x7fe1c00b3b80 2023-11-28T11:10:46.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c68a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1c015fe50 0x7fe1c0154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c68a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1c015fe50 0x7fe1c0154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60368/0 (socket says 172.21.15.125:60368) 2023-11-28T11:10:46.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c68a6700 1 -- 172.21.15.125:0/1679679070 learned_addr learned my addr 172.21.15.125:0/1679679070 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:46.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 0x7fe1c00b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1c00b27d0 0x7fe1c00b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c68a6700 1 -- 172.21.15.125:0/1679679070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 msgr2=0x7fe1c00b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c68a6700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 0x7fe1c00b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c68a6700 1 -- 172.21.15.125:0/1679679070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1c00b27d0 msgr2=0x7fe1c00b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c68a6700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1c00b27d0 0x7fe1c00b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c68a6700 1 -- 172.21.15.125:0/1679679070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00094a0 con 0x7fe1c015fe50 2023-11-28T11:10:46.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c68a6700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1c015fe50 0x7fe1c0154600 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800cbc0 tx=0x7fe1b800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:46.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1b6ffd700 1 -- 172.21.15.125:0/1679679070 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b800a9e0 con 0x7fe1c015fe50 2023-11-28T11:10:46.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1b6ffd700 1 -- 172.21.15.125:0/1679679070 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b800ab40 con 0x7fe1c015fe50 2023-11-28T11:10:46.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1b6ffd700 1 -- 172.21.15.125:0/1679679070 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8007070 con 0x7fe1c015fe50 2023-11-28T11:10:46.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.820+0000 7fe1c8309700 1 -- 172.21.15.125:0/1679679070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1bc009550 con 0x7fe1c015fe50 2023-11-28T11:10:46.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.821+0000 7fe1c8309700 1 -- 172.21.15.125:0/1679679070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c00cf0b0 con 0x7fe1c015fe50 2023-11-28T11:10:46.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.822+0000 7fe1b6ffd700 1 -- 172.21.15.125:0/1679679070 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe1b8019030 con 0x7fe1c015fe50 2023-11-28T11:10:46.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.822+0000 7fe1b6ffd700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1a40682f0 0x7fe1a406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.822+0000 7fe1b6ffd700 1 -- 172.21.15.125:0/1679679070 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1b80856d0 con 0x7fe1c015fe50 2023-11-28T11:10:46.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.822+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1a40682f0 0x7fe1a406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.823+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1a40682f0 0x7fe1a406a7a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe1c015fbb0 tx=0x7fe1b0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:46.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.824+0000 7fe1d4492b80 1 Processor -- start 2023-11-28T11:10:46.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.824+0000 7fe1d4492b80 1 -- start start 2023-11-28T11:10:46.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.825+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.825+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af3130 0x561328af5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.825+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af6120 0x561328b11770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.825+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613289b5bc0 con 0x561328af5810 2023-11-28T11:10:46.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.825+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561328a24350 con 0x561328af6120 2023-11-28T11:10:46.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.825+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561328a1d880 con 0x561328af3130 2023-11-28T11:10:46.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.825+0000 7fe1c60a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1c60a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60372/0 (socket says 172.21.15.125:60372) 2023-11-28T11:10:46.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1c60a5700 1 -- 172.21.15.125:0/2878128156 learned_addr learned my addr 172.21.15.125:0/2878128156 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:46.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1c68a6700 1 --2- 172.21.15.125:0/2878128156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af6120 0x561328b11770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/2878128156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af3130 0x561328af5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1c60a5700 1 -- 172.21.15.125:0/2878128156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af3130 msgr2=0x561328af5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/2878128156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af3130 0x561328af5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1c60a5700 1 -- 172.21.15.125:0/2878128156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af6120 msgr2=0x561328b11770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/2878128156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af6120 0x561328b11770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1c60a5700 1 -- 172.21.15.125:0/2878128156 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56132889f5e0 con 0x561328af5810 2023-11-28T11:10:46.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/2878128156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acba20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0011de0 tx=0x7fe1b0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fd375804865b65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:46.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1a3fff700 1 -- 172.21.15.125:0/2878128156 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0014c60 con 0x561328af5810 2023-11-28T11:10:46.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1a3fff700 1 -- 172.21.15.125:0/2878128156 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b0014dc0 con 0x561328af5810 2023-11-28T11:10:46.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.826+0000 7fe1a3fff700 1 -- 172.21.15.125:0/2878128156 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00215f0 con 0x561328af5810 2023-11-28T11:10:46.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.827+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2878128156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 msgr2=0x561328acba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.827+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/2878128156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acba20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0011de0 tx=0x7fe1b0014000 comp rx=0 tx=0).stop 2023-11-28T11:10:46.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.827+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2878128156 shutdown_connections 2023-11-28T11:10:46.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.827+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/2878128156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af6120 0x561328b11770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.827+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/2878128156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acba20 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.827+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/2878128156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af3130 0x561328af5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.827+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2878128156 >> 172.21.15.125:0/2878128156 conn(0x561328ac8d60 msgr2=0x561328ac96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:46.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.827+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2878128156 shutdown_connections 2023-11-28T11:10:46.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.827+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2878128156 wait complete. 2023-11-28T11:10:46.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.827+0000 7fe1d4492b80 1 -- start start 2023-11-28T11:10:46.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.828+0000 7fe1d4492b80 1 Processor -- start 2023-11-28T11:10:46.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.828+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af3130 0x561328ae7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.828+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328ae9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.828+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af6120 0x561328af3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.828+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613288a18d0 con 0x561328af5810 2023-11-28T11:10:46.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.828+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561328aea410 con 0x561328af6120 2023-11-28T11:10:46.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.828+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561328b14fb0 con 0x561328af3130 2023-11-28T11:10:46.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.828+0000 7fe1d4492b80 10 client.0 _ll_register_callbacks cb 0x5613288c3240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:10:46.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1c58a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328ae9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1c58a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328ae9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60380/0 (socket says 172.21.15.125:60380) 2023-11-28T11:10:46.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1c58a4700 1 -- 172.21.15.125:0/786324521 learned_addr learned my addr 172.21.15.125:0/786324521 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:46.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1c68a6700 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af6120 0x561328af3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af3130 0x561328ae7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1c58a4700 1 -- 172.21.15.125:0/786324521 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af3130 msgr2=0x561328ae7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af3130 0x561328ae7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1c58a4700 1 -- 172.21.15.125:0/786324521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af6120 msgr2=0x561328af3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af6120 0x561328af3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1c58a4700 1 -- 172.21.15.125:0/786324521 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b0011b40 con 0x561328af5810 2023-11-28T11:10:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328ae9ed0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc013000 tx=0x7fe1bc00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b75a4916338c6d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:10:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1a17fa700 1 -- 172.21.15.125:0/786324521 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc01f040 con 0x561328af5810 2023-11-28T11:10:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1a17fa700 1 -- 172.21.15.125:0/786324521 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1bc004250 con 0x561328af5810 2023-11-28T11:10:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1d4492b80 1 -- 172.21.15.125:0/786324521 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613289eb140 con 0x561328af5810 2023-11-28T11:10:46.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1a17fa700 1 -- 172.21.15.125:0/786324521 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1bc004410 con 0x561328af5810 2023-11-28T11:10:46.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1d4492b80 10 client.5949 fetch_fsmap learned FSMap version 23 2023-11-28T11:10:46.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1d4492b80 1 -- 172.21.15.125:0/786324521 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56132884bd90 con 0x561328af5810 2023-11-28T11:10:46.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.829+0000 7fe1a17fa700 1 -- 172.21.15.125:0/786324521 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613289eb140 con 0x561328af5810 2023-11-28T11:10:46.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.830+0000 7fe1a17fa700 1 -- 172.21.15.125:0/786324521 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fe1bc0036a0 con 0x561328af5810 2023-11-28T11:10:46.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.830+0000 7fe1d4492b80 10 client.5949 fetch_fsmap finished waiting for FSMap version 23 2023-11-28T11:10:46.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.830+0000 7fe1d4492b80 10 client.5949 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:10:46.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.830+0000 7fe1d4492b80 20 client.5949 populate_metadata read hostname 'smithi125' 2023-11-28T11:10:46.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.830+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x561328af7140 0x561328af8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.830+0000 7fe1d4492b80 4 client.5949 mds_command: new command op to 5775 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:10:46.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.830+0000 7fe1d4492b80 1 -- 172.21.15.125:0/786324521 --> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5613288a1f10 con 0x561328af7140 2023-11-28T11:10:46.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.830+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x561328af7140 0x561328af8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.830+0000 7fe1a17fa700 10 client.5949 ms_handle_connect on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:46.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.830+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x561328af7140 0x561328af8a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f650bcda83fe3574 server_cookie=97435c7f31d0620f in_seq=0 out_seq=0 2023-11-28T11:10:46.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1a17fa700 1 -- 172.21.15.125:0/786324521 <== mds.0 v2:172.21.15.125:6835/3179120009 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x5613288a1f10 con 0x561328af7140 2023-11-28T11:10:46.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1a17fa700 10 client.5949 handle_command_reply: tid=0 2023-11-28T11:10:46.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 1 client.5949 shutdown 2023-11-28T11:10:46.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 1 -- 172.21.15.125:0/786324521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 msgr2=0x561328ae9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328ae9ed0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc013000 tx=0x7fe1bc00e000 comp rx=0 tx=0).stop 2023-11-28T11:10:46.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 1 -- 172.21.15.125:0/786324521 shutdown_connections 2023-11-28T11:10:46.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af6120 0x561328af3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af3130 0x561328ae7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x561328af7140 0x561328af8a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/786324521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328ae9ed0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 1 -- 172.21.15.125:0/786324521 >> 172.21.15.125:0/786324521 conn(0x561328ac8d60 msgr2=0x561328acb990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:46.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1a17fa700 0 client.5949 ms_handle_reset on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:46.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 1 -- 172.21.15.125:0/786324521 shutdown_connections 2023-11-28T11:10:46.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 1 -- 172.21.15.125:0/786324521 wait complete. 2023-11-28T11:10:46.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.831+0000 7fe1d4492b80 20 client.5949 trim_cache size 0 max 16384 2023-11-28T11:10:46.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.848+0000 7fe1d4492b80 1 Processor -- start 2023-11-28T11:10:46.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.848+0000 7fe1d4492b80 1 -- start start 2023-11-28T11:10:46.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af3130 0x561328ae7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af6120 0x561328acbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x561328ae9ef0 con 0x561328af5810 2023-11-28T11:10:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561328aed0f0 con 0x561328af3130 2023-11-28T11:10:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561328ac9d00 con 0x561328af6120 2023-11-28T11:10:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1c58a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1c58a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60388/0 (socket says 172.21.15.125:60388) 2023-11-28T11:10:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1c58a4700 1 -- 172.21.15.125:0/1496973848 learned_addr learned my addr 172.21.15.125:0/1496973848 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/1496973848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af3130 0x561328ae7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1c68a6700 1 --2- 172.21.15.125:0/1496973848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af6120 0x561328acbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1c58a4700 1 -- 172.21.15.125:0/1496973848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af6120 msgr2=0x561328acbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/1496973848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af6120 0x561328acbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1c58a4700 1 -- 172.21.15.125:0/1496973848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af3130 msgr2=0x561328ae7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/1496973848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af3130 0x561328ae7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1c58a4700 1 -- 172.21.15.125:0/1496973848 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613289e4140 con 0x561328af5810 2023-11-28T11:10:46.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.849+0000 7fe1c68a6700 1 --2- 172.21.15.125:0/1496973848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af6120 0x561328acbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:46.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/1496973848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acb6c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009c40 tx=0x7fe1bc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50813e966864742e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:46.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1b4dad700 1 -- 172.21.15.125:0/1496973848 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc037070 con 0x561328af5810 2023-11-28T11:10:46.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1b4dad700 1 -- 172.21.15.125:0/1496973848 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc003b60 con 0x561328af5810 2023-11-28T11:10:46.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1b4dad700 1 -- 172.21.15.125:0/1496973848 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc01f040 con 0x561328af5810 2023-11-28T11:10:46.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1d4492b80 1 -- 172.21.15.125:0/1496973848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 msgr2=0x561328acb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/1496973848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acb6c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009c40 tx=0x7fe1bc011000 comp rx=0 tx=0).stop 2023-11-28T11:10:46.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1d4492b80 1 -- 172.21.15.125:0/1496973848 shutdown_connections 2023-11-28T11:10:46.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/1496973848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af6120 0x561328acbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/1496973848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af3130 0x561328ae7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/1496973848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af5810 0x561328acb6c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1d4492b80 1 -- 172.21.15.125:0/1496973848 >> 172.21.15.125:0/1496973848 conn(0x561328ac8d60 msgr2=0x561328ae7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:46.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1d4492b80 1 -- 172.21.15.125:0/1496973848 shutdown_connections 2023-11-28T11:10:46.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.850+0000 7fe1d4492b80 1 -- 172.21.15.125:0/1496973848 wait complete. 2023-11-28T11:10:46.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.851+0000 7fe1d4492b80 1 -- start start 2023-11-28T11:10:46.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.851+0000 7fe1d4492b80 1 Processor -- start 2023-11-28T11:10:46.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.852+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af3130 0x561328b78a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.852+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af5810 0x561328af8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.852+0000 7fe1d4492b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af6120 0x561328aea600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.852+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x561328aebea0 con 0x561328af3130 2023-11-28T11:10:46.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.852+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561328ae9ac0 con 0x561328af5810 2023-11-28T11:10:46.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.852+0000 7fe1d4492b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561328aeccc0 con 0x561328af6120 2023-11-28T11:10:46.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1d4492b80 10 client.0 _ll_register_callbacks cb 0x5613288c3240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:10:46.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1c60a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af3130 0x561328b78a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1c60a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af3130 0x561328b78a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60390/0 (socket says 172.21.15.125:60390) 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1c60a5700 1 -- 172.21.15.125:0/2056327455 learned_addr learned my addr 172.21.15.125:0/2056327455 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1c68a6700 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af6120 0x561328aea600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af5810 0x561328af8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1c60a5700 1 -- 172.21.15.125:0/2056327455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af6120 msgr2=0x561328aea600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af6120 0x561328aea600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1c60a5700 1 -- 172.21.15.125:0/2056327455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af5810 msgr2=0x561328af8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af5810 0x561328af8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1c60a5700 1 -- 172.21.15.125:0/2056327455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56132884bd90 con 0x561328af3130 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1c60a5700 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af3130 0x561328b78a10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x561328ac70d0 tx=0x7fe1b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565644d19a287837 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:10:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1a17fa700 1 -- 172.21.15.125:0/2056327455 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0030040 con 0x561328af3130 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1a17fa700 1 -- 172.21.15.125:0/2056327455 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1b001c040 con 0x561328af3130 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2056327455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613289db160 con 0x561328af3130 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1a17fa700 1 -- 172.21.15.125:0/2056327455 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1b00345f0 con 0x561328af3130 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1d4492b80 10 client.5955 fetch_fsmap learned FSMap version 23 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2056327455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x561328872200 con 0x561328af3130 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1a17fa700 1 -- 172.21.15.125:0/2056327455 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613289db160 con 0x561328af3130 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.853+0000 7fe1a17fa700 1 -- 172.21.15.125:0/2056327455 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fe1b0034750 con 0x561328af3130 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 10 client.5955 fetch_fsmap finished waiting for FSMap version 23 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 10 client.5955 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 20 client.5955 populate_metadata read hostname 'smithi125' 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x561328b17550 0x561328b17920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 4 client.5955 mds_command: new command op to 5775 tid=0[{"prefix": "status"}] 2023-11-28T11:10:46.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2056327455 --> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5613289c5170 con 0x561328b17550 2023-11-28T11:10:46.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x561328b17550 0x561328b17920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1a17fa700 10 client.5955 ms_handle_connect on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:46.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1c58a4700 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x561328b17550 0x561328b17920 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed89757780dbe0d5 server_cookie=2e3202fdf1fd8a1b in_seq=0 out_seq=0 2023-11-28T11:10:46.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1a17fa700 1 -- 172.21.15.125:0/2056327455 <== mds.0 v2:172.21.15.125:6835/3179120009 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5613289c5170 con 0x561328b17550 2023-11-28T11:10:46.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1a17fa700 10 client.5955 handle_command_reply: tid=0 2023-11-28T11:10:46.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 client.5955 shutdown 2023-11-28T11:10:46.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2056327455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af3130 msgr2=0x561328b78a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af3130 0x561328b78a10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x561328ac70d0 tx=0x7fe1b0019000 comp rx=0 tx=0).stop 2023-11-28T11:10:46.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2056327455 shutdown_connections 2023-11-28T11:10:46.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561328af6120 0x561328aea600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x561328b17550 0x561328b17920 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x561328af3130 0x561328b78a10 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 --2- 172.21.15.125:0/2056327455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561328af5810 0x561328af8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1a17fa700 0 client.5955 ms_handle_reset on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2056327455 >> 172.21.15.125:0/2056327455 conn(0x561328ac8d60 msgr2=0x561328ac5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2056327455 shutdown_connections 2023-11-28T11:10:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.854+0000 7fe1d4492b80 1 -- 172.21.15.125:0/2056327455 wait complete. 2023-11-28T11:10:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1d4492b80 20 client.5955 trim_cache size 0 max 16384 2023-11-28T11:10:46.863 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea", 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5775, 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 10.343926617999999, 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 23, 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 52, 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 52, 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 15.705472725 2023-11-28T11:10:46.864 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:10:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 -- 172.21.15.125:0/1679679070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1a40682f0 msgr2=0x7fe1a406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1a40682f0 0x7fe1a406a7a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe1c015fbb0 tx=0x7fe1b0009210 comp rx=0 tx=0).stop 2023-11-28T11:10:46.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 -- 172.21.15.125:0/1679679070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1c015fe50 msgr2=0x7fe1c0154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1c015fe50 0x7fe1c0154600 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800cbc0 tx=0x7fe1b800ced0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 -- 172.21.15.125:0/1679679070 shutdown_connections 2023-11-28T11:10:46.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1c015fe50 0x7fe1c0154600 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1c00b27d0 0x7fe1c00b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe1a40682f0 0x7fe1a406a7a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 --2- 172.21.15.125:0/1679679070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1c00b3b80 0x7fe1c00b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 -- 172.21.15.125:0/1679679070 >> 172.21.15.125:0/1679679070 conn(0x7fe1c006ea80 msgr2=0x7fe1c015e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:46.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 -- 172.21.15.125:0/1679679070 shutdown_connections 2023-11-28T11:10:46.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.855+0000 7fe1c8309700 1 -- 172.21.15.125:0/1679679070 wait complete. 2023-11-28T11:10:46.867 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:10:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.987+0000 7f0469436700 1 Processor -- start 2023-11-28T11:10:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.988+0000 7f0469436700 1 -- start start 2023-11-28T11:10:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.988+0000 7f0469436700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f046406ab10 0x7f046406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.988+0000 7f0469436700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04640d1ee0 con 0x7f04640d0450 2023-11-28T11:10:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.988+0000 7f0469436700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0464161120 con 0x7f04640cd5a0 2023-11-28T11:10:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.988+0000 7f0469436700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046406b420 con 0x7f046406ab10 2023-11-28T11:10:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.988+0000 7f04637fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f04640d0450 0x7f0464160a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44526/0 (socket says 172.21.15.125:44526) 2023-11-28T11:10:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.988+0000 7f04637fe700 1 -- 172.21.15.125:0/894124366 learned_addr learned my addr 172.21.15.125:0/894124366 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614607509 0 0) 0x7f04640d1ee0 con 0x7f04640d0450 2023-11-28T11:10:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f044c0035b0 con 0x7f04640d0450 2023-11-28T11:10:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0462ffd700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f046406ab10 0x7f046406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2996290110 0 0) 0x7f044c0035b0 con 0x7f04640d0450 2023-11-28T11:10:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f046406ab10 msgr2=0x7f046406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f046406ab10 0x7f046406aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 >> v1:172.21.15.167:6789/0 conn(0x7f04640cd5a0 legacy=0x7f0464160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04640cdb10 con 0x7f04640d0450 2023-11-28T11:10:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f045c0019f0 con 0x7f04640d0450 2023-11-28T11:10:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 >> v1:172.21.15.125:6789/0 conn(0x7f04640d0450 legacy=0x7f0464160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f044c003a30 0x7f044c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f044c004850 0x7f044c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f046406ab10 0x7f044c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046406b420 con 0x7f044c003a30 2023-11-28T11:10:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c00bac0 con 0x7f044c004850 2023-11-28T11:10:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c00bc50 con 0x7f046406ab10 2023-11-28T11:10:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0462ffd700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f044c003a30 0x7f044c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f04627fc700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f044c004850 0x7f044c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f04637fe700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f046406ab10 0x7f044c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0462ffd700 1 -- 172.21.15.125:0/894124366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f046406ab10 msgr2=0x7f044c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0462ffd700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f046406ab10 0x7f044c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0462ffd700 1 -- 172.21.15.125:0/894124366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f044c004850 msgr2=0x7f044c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0462ffd700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f044c004850 0x7f044c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.989+0000 7f0462ffd700 1 -- 172.21.15.125:0/894124366 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c0035b0 con 0x7f044c003a30 2023-11-28T11:10:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.990+0000 7f0462ffd700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f044c003a30 0x7f044c003e40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0458009b60 tx=0x7f044c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94b5ab0ff338502 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.990+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800e6c0 con 0x7f044c003a30 2023-11-28T11:10:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.990+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045800e820 con 0x7f044c003a30 2023-11-28T11:10:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.990+0000 7f0461ffb700 1 -- 172.21.15.125:0/894124366 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800eb90 con 0x7f044c003a30 2023-11-28T11:10:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.990+0000 7f0469436700 1 -- 172.21.15.125:0/894124366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f044c003a30 msgr2=0x7f044c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.990+0000 7f0469436700 1 --2- 172.21.15.125:0/894124366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f044c003a30 0x7f044c003e40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0458009b60 tx=0x7f044c005880 comp rx=0 tx=0).stop 2023-11-28T11:10:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.990+0000 7f04637fe700 1 -- 172.21.15.125:0/894124366 reap_dead start 2023-11-28T11:10:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.990+0000 7f0469436700 1 -- 172.21.15.125:0/894124366 shutdown_connections 2023-11-28T11:10:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.990+0000 7f0469436700 1 -- 172.21.15.125:0/894124366 >> 172.21.15.125:0/894124366 conn(0x7f046406c520 msgr2=0x7f046406c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.990+0000 7f0469436700 1 -- 172.21.15.125:0/894124366 shutdown_connections 2023-11-28T11:10:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.990+0000 7f0469436700 1 -- 172.21.15.125:0/894124366 wait complete. 2023-11-28T11:10:46.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.992+0000 7f0469436700 1 Processor -- start 2023-11-28T11:10:46.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.992+0000 7f0469436700 1 -- start start 2023-11-28T11:10:46.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.992+0000 7f0469436700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f044c003a30 0x7f0464155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.992+0000 7f0469436700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04640cb740 0x7f04640b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.992+0000 7f0469436700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04640b7d10 0x7f04640ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.992+0000 7f0469436700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04640b8160 con 0x7f04640b7d10 2023-11-28T11:10:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.992+0000 7f0469436700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0464156030 con 0x7f04640cb740 2023-11-28T11:10:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.992+0000 7f0469436700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046415fc30 con 0x7f044c003a30 2023-11-28T11:10:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f04637fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04640b7d10 0x7f04640ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f04637fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04640b7d10 0x7f04640ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60414/0 (socket says 172.21.15.125:60414) 2023-11-28T11:10:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f04637fe700 1 -- 172.21.15.125:0/2453820410 learned_addr learned my addr 172.21.15.125:0/2453820410 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f04627fc700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04640cb740 0x7f04640b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f0462ffd700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f044c003a30 0x7f0464155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f04637fe700 1 -- 172.21.15.125:0/2453820410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f044c003a30 msgr2=0x7f0464155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f04637fe700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f044c003a30 0x7f0464155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f04637fe700 1 -- 172.21.15.125:0/2453820410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04640cb740 msgr2=0x7f04640b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f04637fe700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04640cb740 0x7f04640b77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f04637fe700 1 -- 172.21.15.125:0/2453820410 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04640d1b70 con 0x7f04640b7d10 2023-11-28T11:10:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f04637fe700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04640b7d10 0x7f04640ca020 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f046406bf60 tx=0x7f045c00a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f044b7fe700 1 -- 172.21.15.125:0/2453820410 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c00ac70 con 0x7f04640b7d10 2023-11-28T11:10:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f044b7fe700 1 -- 172.21.15.125:0/2453820410 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c00add0 con 0x7f04640b7d10 2023-11-28T11:10:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f044b7fe700 1 -- 172.21.15.125:0/2453820410 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c013630 con 0x7f04640b7d10 2023-11-28T11:10:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f0469436700 1 -- 172.21.15.125:0/2453820410 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04640d1890 con 0x7f04640b7d10 2023-11-28T11:10:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.993+0000 7f0469436700 1 -- 172.21.15.125:0/2453820410 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046415cad0 con 0x7f04640b7d10 2023-11-28T11:10:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.994+0000 7f0469436700 1 -- 172.21.15.125:0/2453820410 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04640743f0 con 0x7f04640b7d10 2023-11-28T11:10:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.994+0000 7f044b7fe700 1 -- 172.21.15.125:0/2453820410 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f045c023070 con 0x7f04640b7d10 2023-11-28T11:10:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.995+0000 7f044b7fe700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0450068320 0x7f045006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.995+0000 7f044b7fe700 1 -- 172.21.15.125:0/2453820410 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f045c086640 con 0x7f04640b7d10 2023-11-28T11:10:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.995+0000 7f0462ffd700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0450068320 0x7f045006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.995+0000 7f0462ffd700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0450068320 0x7f045006a7d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f04580090b0 tx=0x7f045801f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:46.999+0000 7f044b7fe700 1 -- 172.21.15.125:0/2453820410 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f045c052ea0 con 0x7f04640b7d10 2023-11-28T11:10:47.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.228+0000 7f0469436700 1 -- 172.21.15.125:0/2453820410 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f04640d2c80 con 0x7f04640b7d10 2023-11-28T11:10:47.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.228+0000 7f044b7fe700 1 -- 172.21.15.125:0/2453820410 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f045c017070 con 0x7f04640b7d10 2023-11-28T11:10:47.229 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:10:47.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 -- 172.21.15.125:0/2453820410 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0450068320 msgr2=0x7f045006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:47.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0450068320 0x7f045006a7d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f04580090b0 tx=0x7f045801f040 comp rx=0 tx=0).stop 2023-11-28T11:10:47.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 -- 172.21.15.125:0/2453820410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04640b7d10 msgr2=0x7f04640ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:47.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04640b7d10 0x7f04640ca020 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f046406bf60 tx=0x7f045c00a5f0 comp rx=0 tx=0).stop 2023-11-28T11:10:47.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 -- 172.21.15.125:0/2453820410 shutdown_connections 2023-11-28T11:10:47.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04640b7d10 0x7f04640ca020 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:47.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0450068320 0x7f045006a7d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:47.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f044c003a30 0x7f0464155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:47.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 --2- 172.21.15.125:0/2453820410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04640cb740 0x7f04640b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:47.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 -- 172.21.15.125:0/2453820410 >> 172.21.15.125:0/2453820410 conn(0x7f046406c520 msgr2=0x7f0464157760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:47.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 -- 172.21.15.125:0/2453820410 shutdown_connections 2023-11-28T11:10:47.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:47.230+0000 7f0469436700 1 -- 172.21.15.125:0/2453820410 wait complete. 2023-11-28T11:10:47.242 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:10:47.243 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:10:47.243 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-11-28T11:10:47.243 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:10:47.243 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:10:47.243 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:10:47.243 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T11:10:47.243 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:10:47.243 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:10:47.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:47.244 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-11-28T11:10:47.262 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:10:47.263 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:10:47.263 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:10:47.263 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:10:47.263 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-11-28T11:10:47.263 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:10:47.263 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:10:47.263 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:10:47.263 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:10:47.263 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:10:47.263 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:10:47.264 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:10:47.264 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:10:47.264 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:10:47.264 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-28T11:10:47.264 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42223sec preferred_lft 42223sec 2023-11-28T11:10:47.264 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::af9c:3934:f827:ab8e/64 scope link noprefixroute 2023-11-28T11:10:47.264 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:10:47.264 INFO:teuthology.orchestra.run.smithi125.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:10:47.264 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 1e:0c:6e:81:a9:77 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:10:47.264 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:10:47.264 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:10:47.265 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::2847:a7ff:fe7f:fad9/64 scope link 2023-11-28T11:10:47.265 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:10:47.265 INFO:teuthology.orchestra.run.smithi125.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:10:47.265 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 8a:65:01:86:2c:a8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:10:47.265 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::8865:1ff:fe86:2ca8/64 scope link 2023-11-28T11:10:47.265 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:10:47.265 INFO:teuthology.orchestra.run.smithi125.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:10:47.265 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 1e:0c:6e:81:a9:77 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:10:47.265 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::1c0c:6eff:fe81:a977/64 scope link 2023-11-28T11:10:47.265 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:10:47.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:47.266 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:10:47.331 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-11-28T11:10:47.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:47.331 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-11-28T11:10:47.391 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-11-28T11:10:47.391 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:10:47.391 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T11:10:47.391 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T11:10:47.392 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:10:47.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:47.392 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:10:47.392 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:10:47.393 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T11:10:47.393 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T11:10:47.393 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T11:10:47.393 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:10:47.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:47.495 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-11-28T11:10:47.512 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T11:10:47.512 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:10:47.512 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:10:47.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:47.512 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-11-28T11:10:47.579 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T11:10:47.579 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:10:47.579 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:10:47.636 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:10:47.636 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:10:47.636 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:10:47.692 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-11-28T11:10:47.759 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:10:47.759 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:10:47.825 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:10:47.826 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:10:47.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:47.827 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-28T11:10:47.884 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:10:47.884 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T11:10:47.926 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-11-28T11:10:47.952 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:10:47.952 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:10:48.012 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2023-11-28T11:10:48.011+0000 7f5e7ed155c0 -1 init, newargv = 0x55681b442070 newargc=15 2023-11-28T11:10:48.012 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[123725]: starting ceph client 2023-11-28T11:10:48.016 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[123725]: starting fuse 2023-11-28T11:10:48.020 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:10:48.021 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:10:48.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:48.021 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-28T11:10:48.078 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-11-28T11:10:48.078 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-11-28T11:10:48.078 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-11-28T11:10:48.079 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:10:48.080 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:10:48.081 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.0")) 2023-11-28T11:10:48.081 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:10:48.201 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.123725.asok 2023-11-28T11:10:48.384 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.123725.asok 2023-11-28T11:10:48.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:48.384 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.123725.asok status 2023-11-28T11:10:48.540 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:10:48.540 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-11-28T11:10:48.541 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:10:48.541 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:10:48.541 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2023-11-28T11:10:48.541 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-11-28T11:10:48.541 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T11:10:48.541 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "123725", 2023-11-28T11:10:48.541 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-11-28T11:10:48.541 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:48.541 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-11-28T11:10:48.541 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-11-28T11:10:48.542 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5970, 2023-11-28T11:10:48.542 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-11-28T11:10:48.542 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-11-28T11:10:48.542 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-11-28T11:10:48.542 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5970 2023-11-28T11:10:48.542 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:48.542 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-28T11:10:48.542 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-28T11:10:48.542 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:10:48.542 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1563275351 2023-11-28T11:10:48.542 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1563275351 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5970 192.168.0.1:0/1563275351", 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/1563275351", 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 23, 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 52, 2023-11-28T11:10:48.543 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:10:48.544 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-11-28T11:10:48.544 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-11-28T11:10:48.544 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:10:48.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:48.551 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-11-28T11:10:48.551 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T11:10:48.567 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-11-28T11:10:48.568 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T11:10:48.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:48.568 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:10:48.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:48.636 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2023-11-28T11:10:48.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:10:48.698 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2023-11-28T11:10:48.757 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:10:48.758 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:10:48.758 DEBUG:teuthology.orchestra.run.smithi125:> import stat 2023-11-28T11:10:48.758 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:10:48.758 DEBUG:teuthology.orchestra.run.smithi125:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2023-11-28T11:10:48.758 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:10:48.863 INFO:teuthology.orchestra.run.smithi125.stdout:1099511627777 2023-11-28T11:10:49.052 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:10:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.212+0000 7f23d0342700 1 Processor -- start 2023-11-28T11:10:49.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.212+0000 7f23d0342700 1 -- start start 2023-11-28T11:10:49.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23d0342700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f23c80d0c60 0x7f23c80b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23d0342700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c806e900 con 0x7f23c806e400 2023-11-28T11:10:49.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23d0342700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c8160390 con 0x7f23c8160e70 2023-11-28T11:10:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23d0342700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c8160670 con 0x7f23c80d0c60 2023-11-28T11:10:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23ce0de700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f23c80d0c60 0x7f23c80b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23ce0de700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f23c80d0c60 0x7f23c80b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60432/0 (socket says 172.21.15.125:60432) 2023-11-28T11:10:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23cd8dd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f23c806e400 0x7f23c80d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44556/0 (socket says 172.21.15.125:44556) 2023-11-28T11:10:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23ce0de700 1 -- 172.21.15.125:0/725147106 learned_addr learned my addr 172.21.15.125:0/725147106 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23ce0de700 1 -- 172.21.15.125:0/725147106 >> v1:172.21.15.167:6789/0 conn(0x7f23c8160e70 legacy=0x7f23c815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23ce0de700 1 -- 172.21.15.125:0/725147106 >> v1:172.21.15.125:6789/0 conn(0x7f23c806e400 legacy=0x7f23c80d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23ce0de700 1 -- 172.21.15.125:0/725147106 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8160950 con 0x7f23c80d0c60 2023-11-28T11:10:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.213+0000 7f23cd0dc700 1 -- 172.21.15.125:0/725147106 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109370201 0 0) 0x7f23c806e900 con 0x7f23c806e400 2023-11-28T11:10:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.214+0000 7f23ce0de700 1 --2- 172.21.15.125:0/725147106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23c80d0c60 0x7f23c80b5be0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f23b80098f0 tx=0x7f23b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211f0f54f7d35132 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.214+0000 7f23cd0dc700 1 -- 172.21.15.125:0/725147106 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8004230 con 0x7f23c80d0c60 2023-11-28T11:10:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.214+0000 7f23cd0dc700 1 -- 172.21.15.125:0/725147106 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b8004390 con 0x7f23c80d0c60 2023-11-28T11:10:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.214+0000 7f23cd0dc700 1 -- 172.21.15.125:0/725147106 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b80036a0 con 0x7f23c80d0c60 2023-11-28T11:10:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.214+0000 7f23d0342700 1 -- 172.21.15.125:0/725147106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23c80d0c60 msgr2=0x7f23c80b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.214+0000 7f23d0342700 1 --2- 172.21.15.125:0/725147106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23c80d0c60 0x7f23c80b5be0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f23b80098f0 tx=0x7f23b8009c00 comp rx=0 tx=0).stop 2023-11-28T11:10:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.214+0000 7f23d0342700 1 -- 172.21.15.125:0/725147106 shutdown_connections 2023-11-28T11:10:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.214+0000 7f23d0342700 1 --2- 172.21.15.125:0/725147106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23c80d0c60 0x7f23c80b5be0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.214+0000 7f23d0342700 1 -- 172.21.15.125:0/725147106 >> 172.21.15.125:0/725147106 conn(0x7f23c806a270 msgr2=0x7f23c806a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.214+0000 7f23d0342700 1 -- 172.21.15.125:0/725147106 shutdown_connections 2023-11-28T11:10:49.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.214+0000 7f23d0342700 1 -- 172.21.15.125:0/725147106 wait complete. 2023-11-28T11:10:49.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.215+0000 7f23d0342700 1 Processor -- start 2023-11-28T11:10:49.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.216+0000 7f23d0342700 1 -- start start 2023-11-28T11:10:49.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.216+0000 7f23d0342700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23c806e400 0x7f23c81417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.216+0000 7f23d0342700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23c80d0c60 0x7f23c814edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.216+0000 7f23d0342700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23c8160e70 0x7f23c814df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.216+0000 7f23d0342700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8141d20 con 0x7f23c806e400 2023-11-28T11:10:49.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.216+0000 7f23d0342700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80ca4e0 con 0x7f23c80d0c60 2023-11-28T11:10:49.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.216+0000 7f23d0342700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c814d1a0 con 0x7f23c8160e70 2023-11-28T11:10:49.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.216+0000 7f23ce0de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23c806e400 0x7f23c81417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.216+0000 7f23ce0de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23c806e400 0x7f23c81417e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60438/0 (socket says 172.21.15.125:60438) 2023-11-28T11:10:49.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.216+0000 7f23ce0de700 1 -- 172.21.15.125:0/1814745498 learned_addr learned my addr 172.21.15.125:0/1814745498 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:49.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23ce0de700 1 -- 172.21.15.125:0/1814745498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23c8160e70 msgr2=0x7f23c814df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23ce0de700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23c8160e70 0x7f23c814df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23cd8dd700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23c80d0c60 0x7f23c814edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23ce0de700 1 -- 172.21.15.125:0/1814745498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23c80d0c60 msgr2=0x7f23c814edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23ce0de700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23c80d0c60 0x7f23c814edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23ce0de700 1 -- 172.21.15.125:0/1814745498 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b8009550 con 0x7f23c806e400 2023-11-28T11:10:49.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23ce0de700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23c806e400 0x7f23c81417e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f23c80b6eb0 tx=0x7f23b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23beffd700 1 -- 172.21.15.125:0/1814745498 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8003dc0 con 0x7f23c806e400 2023-11-28T11:10:49.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23beffd700 1 -- 172.21.15.125:0/1814745498 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b801f070 con 0x7f23c806e400 2023-11-28T11:10:49.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23d0342700 1 -- 172.21.15.125:0/1814745498 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c815d080 con 0x7f23c806e400 2023-11-28T11:10:49.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23beffd700 1 -- 172.21.15.125:0/1814745498 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b800b8a0 con 0x7f23c806e400 2023-11-28T11:10:49.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.217+0000 7f23d0342700 1 -- 172.21.15.125:0/1814745498 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c80d0740 con 0x7f23c806e400 2023-11-28T11:10:49.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.218+0000 7f23d0342700 1 -- 172.21.15.125:0/1814745498 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c815d210 con 0x7f23c806e400 2023-11-28T11:10:49.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.218+0000 7f23beffd700 1 -- 172.21.15.125:0/1814745498 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f23b802a020 con 0x7f23c806e400 2023-11-28T11:10:49.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.219+0000 7f23beffd700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f23ac0682f0 0x7f23ac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.219+0000 7f23cd8dd700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f23ac0682f0 0x7f23ac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.219+0000 7f23beffd700 1 -- 172.21.15.125:0/1814745498 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f23b8087630 con 0x7f23c806e400 2023-11-28T11:10:49.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.219+0000 7f23cd8dd700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f23ac0682f0 0x7f23ac06a7a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f23c814c650 tx=0x7f23c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.223+0000 7f23beffd700 1 -- 172.21.15.125:0/1814745498 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f23b8053db0 con 0x7f23c806e400 2023-11-28T11:10:49.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.449+0000 7f23d0342700 1 -- 172.21.15.125:0/1814745498 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23c815d210 con 0x7f23c806e400 2023-11-28T11:10:49.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.449+0000 7f23beffd700 1 -- 172.21.15.125:0/1814745498 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f23b8058e60 con 0x7f23c806e400 2023-11-28T11:10:49.450 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:49.450 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/991177251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":991177251},{"type":"v1","addr":"172.21.15.167:6834","nonce":991177251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/289069328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":289069328},{"type":"v1","addr":"172.21.15.167:6835","nonce":289069328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3275492587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3275492587},{"type":"v1","addr":"172.21.15.125:6836","nonce":3275492587}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:10:36.508959+0000","modified":"2023-11-28T11:10:39.516894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5775":{"gid":5775,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3179120009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":3179120009},{"type":"v1","addr":"172.21.15.125:6837","nonce":3179120009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:10:49.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 -- 172.21.15.125:0/1814745498 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f23ac0682f0 msgr2=0x7f23ac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f23ac0682f0 0x7f23ac06a7a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f23c814c650 tx=0x7f23c4009040 comp rx=0 tx=0).stop 2023-11-28T11:10:49.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 -- 172.21.15.125:0/1814745498 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23c806e400 msgr2=0x7f23c81417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23c806e400 0x7f23c81417e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f23c80b6eb0 tx=0x7f23b8004750 comp rx=0 tx=0).stop 2023-11-28T11:10:49.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 -- 172.21.15.125:0/1814745498 shutdown_connections 2023-11-28T11:10:49.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f23ac0682f0 0x7f23ac06a7a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23c8160e70 0x7f23c814df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23c806e400 0x7f23c81417e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 --2- 172.21.15.125:0/1814745498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23c80d0c60 0x7f23c814edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 -- 172.21.15.125:0/1814745498 >> 172.21.15.125:0/1814745498 conn(0x7f23c806a270 msgr2=0x7f23c815b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:49.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 -- 172.21.15.125:0/1814745498 shutdown_connections 2023-11-28T11:10:49.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.452+0000 7f23d0342700 1 -- 172.21.15.125:0/1814745498 wait complete. 2023-11-28T11:10:49.454 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 23 2023-11-28T11:10:49.465 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-28T11:10:49.609 INFO:teuthology.orchestra.run.smithi125.stdout:{"message":"","return_code":0} 2023-11-28T11:10:49.609 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:10:49.609 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T11:10:49.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.652+0000 7f0c0c04c080 1 Processor -- start 2023-11-28T11:10:49.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c0c04c080 1 -- start start 2023-11-28T11:10:49.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c0c04c080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdede17a0 0x55afdee0ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c0c04c080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55afdee287b0 0x55afdee09b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c0c04c080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55afdeeb7430 0x55afdeeb5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c0c04c080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afded19fe0 con 0x55afdede17a0 2023-11-28T11:10:49.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c0c04c080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afdeeabdc0 con 0x55afdee287b0 2023-11-28T11:10:49.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c0c04c080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afdeeb6d20 con 0x55afdeeb7430 2023-11-28T11:10:49.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c0214f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdede17a0 0x55afdee0ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c0214f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdede17a0 0x55afdee0ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60452/0 (socket says 172.21.15.125:60452) 2023-11-28T11:10:49.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c0214f700 1 -- 172.21.15.125:0/2327570265 learned_addr learned my addr 172.21.15.125:0/2327570265 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:49.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c0194e700 1 --2- 172.21.15.125:0/2327570265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55afdee287b0 0x55afdee09b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.653+0000 7f0c02950700 1 --2- 172.21.15.125:0/2327570265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55afdeeb7430 0x55afdeeb5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0214f700 1 -- 172.21.15.125:0/2327570265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55afdeeb7430 msgr2=0x55afdeeb5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:49.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0214f700 1 --2- 172.21.15.125:0/2327570265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55afdeeb7430 0x55afdeeb5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0214f700 1 -- 172.21.15.125:0/2327570265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55afdee287b0 msgr2=0x55afdee09b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:49.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0214f700 1 --2- 172.21.15.125:0/2327570265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55afdee287b0 0x55afdee09b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0214f700 1 -- 172.21.15.125:0/2327570265 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf4005d20 con 0x55afdede17a0 2023-11-28T11:10:49.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c02950700 1 --2- 172.21.15.125:0/2327570265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55afdeeb7430 0x55afdeeb5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:49.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0214f700 1 --2- 172.21.15.125:0/2327570265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdede17a0 0x55afdee0ae10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40099a0 tx=0x7f0bf4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede948b725a87012 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0094c700 1 -- 172.21.15.125:0/2327570265 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf400f040 con 0x55afdede17a0 2023-11-28T11:10:49.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0094c700 1 -- 172.21.15.125:0/2327570265 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf4008ab0 con 0x55afdede17a0 2023-11-28T11:10:49.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0094c700 1 -- 172.21.15.125:0/2327570265 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4008e20 con 0x55afdede17a0 2023-11-28T11:10:49.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0c04c080 1 -- 172.21.15.125:0/2327570265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdede17a0 msgr2=0x55afdee0ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0c04c080 1 --2- 172.21.15.125:0/2327570265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdede17a0 0x55afdee0ae10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40099a0 tx=0x7f0bf4005a00 comp rx=0 tx=0).stop 2023-11-28T11:10:49.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0c04c080 1 -- 172.21.15.125:0/2327570265 shutdown_connections 2023-11-28T11:10:49.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0c04c080 1 --2- 172.21.15.125:0/2327570265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55afdeeb7430 0x55afdeeb5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0c04c080 1 --2- 172.21.15.125:0/2327570265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdede17a0 0x55afdee0ae10 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0c04c080 1 --2- 172.21.15.125:0/2327570265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55afdee287b0 0x55afdee09b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0c04c080 1 -- 172.21.15.125:0/2327570265 >> 172.21.15.125:0/2327570265 conn(0x55afdee0baf0 msgr2=0x55afdeddd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:49.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0c04c080 1 -- 172.21.15.125:0/2327570265 shutdown_connections 2023-11-28T11:10:49.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.654+0000 7f0c0c04c080 1 -- 172.21.15.125:0/2327570265 wait complete. 2023-11-28T11:10:49.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.655+0000 7f0c0c04c080 1 Processor -- start 2023-11-28T11:10:49.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.655+0000 7f0c0c04c080 1 -- start start 2023-11-28T11:10:49.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0c04c080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55afdede17a0 0x55afdeea6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0c04c080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdee287b0 0x55afdeeac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0c04c080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55afdeeb7430 0x55afdeea5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0c04c080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afdee0da30 con 0x55afdee287b0 2023-11-28T11:10:49.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0c04c080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afdeea60d0 con 0x55afdede17a0 2023-11-28T11:10:49.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0c04c080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afdef43dd0 con 0x55afdeeb7430 2023-11-28T11:10:49.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0194e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdee287b0 0x55afdeeac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0194e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdee287b0 0x55afdeeac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60460/0 (socket says 172.21.15.125:60460) 2023-11-28T11:10:49.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0194e700 1 -- 172.21.15.125:0/1085967943 learned_addr learned my addr 172.21.15.125:0/1085967943 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:49.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c02950700 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55afdeeb7430 0x55afdeea5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0214f700 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55afdede17a0 0x55afdeea6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0194e700 1 -- 172.21.15.125:0/1085967943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55afdeeb7430 msgr2=0x55afdeea5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0194e700 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55afdeeb7430 0x55afdeea5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0194e700 1 -- 172.21.15.125:0/1085967943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55afdede17a0 msgr2=0x55afdeea6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0194e700 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55afdede17a0 0x55afdeea6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0194e700 1 -- 172.21.15.125:0/1085967943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf4009600 con 0x55afdee287b0 2023-11-28T11:10:49.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0c0194e700 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdee287b0 0x55afdeeac8a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800ee10 tx=0x7f0bf800c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0bf37fe700 1 -- 172.21.15.125:0/1085967943 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8001ae0 con 0x55afdee287b0 2023-11-28T11:10:49.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0bf37fe700 1 -- 172.21.15.125:0/1085967943 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf8013070 con 0x55afdee287b0 2023-11-28T11:10:49.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.656+0000 7f0bf37fe700 1 -- 172.21.15.125:0/1085967943 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800f450 con 0x55afdee287b0 2023-11-28T11:10:49.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.657+0000 7f0c0c04c080 1 -- 172.21.15.125:0/1085967943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55afded25830 con 0x55afdee287b0 2023-11-28T11:10:49.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.657+0000 7f0c0c04c080 1 -- 172.21.15.125:0/1085967943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc00a100 con 0x55afdee287b0 2023-11-28T11:10:49.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.658+0000 7f0bf37fe700 1 -- 172.21.15.125:0/1085967943 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0bf8020070 con 0x55afdee287b0 2023-11-28T11:10:49.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.658+0000 7f0bf37fe700 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0be4066c10 0x7f0be40690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.658+0000 7f0bf37fe700 1 -- 172.21.15.125:0/1085967943 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bf8084cc0 con 0x55afdee287b0 2023-11-28T11:10:49.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.658+0000 7f0c0214f700 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0be4066c10 0x7f0be40690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.658+0000 7f0c0c04c080 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x55afdef43960 0x55afdee0dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.658+0000 7f0c0c04c080 1 -- 172.21.15.125:0/1085967943 --> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52) v8 -- 0x55afdeea6950 con 0x55afdef43960 2023-11-28T11:10:49.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.658+0000 7f0c02950700 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x55afdef43960 0x55afdee0dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c0214f700 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0be4066c10 0x7f0be40690c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400afd0 tx=0x7f0bf4012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c02950700 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x55afdef43960 0x55afdee0dec0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c02950700 1 -- 172.21.15.125:0/1085967943 <== osd.1 v2:172.21.15.125:6824/103588 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f0bfc00fa60 con 0x55afdef43960 2023-11-28T11:10:49.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c0c04c080 1 -- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x55afdef43960 msgr2=0x55afdee0dec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c0c04c080 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x55afdef43960 0x55afdee0dec0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c0c04c080 1 -- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0be4066c10 msgr2=0x7f0be40690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c0c04c080 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0be4066c10 0x7f0be40690c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400afd0 tx=0x7f0bf4012000 comp rx=0 tx=0).stop 2023-11-28T11:10:49.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c0c04c080 1 -- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdee287b0 msgr2=0x55afdeeac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c0c04c080 1 --2- 172.21.15.125:0/1085967943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55afdee287b0 0x55afdeeac8a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800ee10 tx=0x7f0bf800c640 comp rx=0 tx=0).stop 2023-11-28T11:10:49.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c02950700 1 -- 172.21.15.125:0/1085967943 reap_dead start 2023-11-28T11:10:49.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c0c04c080 1 -- 172.21.15.125:0/1085967943 shutdown_connections 2023-11-28T11:10:49.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c0c04c080 1 -- 172.21.15.125:0/1085967943 >> 172.21.15.125:0/1085967943 conn(0x55afdee0baf0 msgr2=0x55afdeddd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:49.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c0c04c080 1 -- 172.21.15.125:0/1085967943 shutdown_connections 2023-11-28T11:10:49.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.659+0000 7f0c0c04c080 1 -- 172.21.15.125:0/1085967943 wait complete. 2023-11-28T11:10:49.676 INFO:teuthology.orchestra.run.smithi125.stdout:Yalphaparent_a 2023-11-28T11:10:49.676 DEBUG:teuthology.orchestra.run.smithi125:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T11:10:49.779 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:10:49.780 INFO:teuthology.orchestra.run.smithi125.stdout: "ino": 1099511627777, 2023-11-28T11:10:49.780 INFO:teuthology.orchestra.run.smithi125.stdout: "ancestors": [ 2023-11-28T11:10:49.780 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:49.780 INFO:teuthology.orchestra.run.smithi125.stdout: "dirino": 1099511627776, 2023-11-28T11:10:49.780 INFO:teuthology.orchestra.run.smithi125.stdout: "dname": "alpha", 2023-11-28T11:10:49.780 INFO:teuthology.orchestra.run.smithi125.stdout: "version": 2 2023-11-28T11:10:49.780 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:10:49.781 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:10:49.781 INFO:teuthology.orchestra.run.smithi125.stdout: "dirino": 1, 2023-11-28T11:10:49.781 INFO:teuthology.orchestra.run.smithi125.stdout: "dname": "parent_a", 2023-11-28T11:10:49.781 INFO:teuthology.orchestra.run.smithi125.stdout: "version": 4 2023-11-28T11:10:49.781 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:49.781 INFO:teuthology.orchestra.run.smithi125.stdout: ], 2023-11-28T11:10:49.781 INFO:teuthology.orchestra.run.smithi125.stdout: "pool": 8, 2023-11-28T11:10:49.781 INFO:teuthology.orchestra.run.smithi125.stdout: "old_pools": [] 2023-11-28T11:10:49.781 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:10:49.781 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:49.783 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2023-11-28T11:10:49.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.827+0000 7f82f4689080 1 Processor -- start 2023-11-28T11:10:49.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.827+0000 7f82f4689080 1 -- start start 2023-11-28T11:10:49.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82f4689080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3baa190 0x5603d3bc3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82f4689080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d3c4f600 0x5603d3ba8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82f4689080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5603d3ba87b0 0x5603d3bbdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82f4689080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3b25000 con 0x5603d3baa190 2023-11-28T11:10:49.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82f4689080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3ab7fe0 con 0x5603d3c4f600 2023-11-28T11:10:49.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82f4689080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603d3b7f220 con 0x5603d3ba87b0 2023-11-28T11:10:49.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82ea78c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3baa190 0x5603d3bc3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82ea78c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3baa190 0x5603d3bc3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60480/0 (socket says 172.21.15.125:60480) 2023-11-28T11:10:49.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82ea78c700 1 -- 172.21.15.125:0/1505013547 learned_addr learned my addr 172.21.15.125:0/1505013547 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:49.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82e9f8b700 1 --2- 172.21.15.125:0/1505013547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d3c4f600 0x5603d3ba8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82eaf8d700 1 --2- 172.21.15.125:0/1505013547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5603d3ba87b0 0x5603d3bbdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82ea78c700 1 -- 172.21.15.125:0/1505013547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5603d3ba87b0 msgr2=0x5603d3bbdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:49.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82ea78c700 1 --2- 172.21.15.125:0/1505013547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5603d3ba87b0 0x5603d3bbdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82ea78c700 1 -- 172.21.15.125:0/1505013547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d3c4f600 msgr2=0x5603d3ba8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:49.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82ea78c700 1 --2- 172.21.15.125:0/1505013547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d3c4f600 0x5603d3ba8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82ea78c700 1 -- 172.21.15.125:0/1505013547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603d3ad0360 con 0x5603d3baa190 2023-11-28T11:10:49.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82e9f8b700 1 --2- 172.21.15.125:0/1505013547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d3c4f600 0x5603d3ba8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:49.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82ea78c700 1 --2- 172.21.15.125:0/1505013547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3baa190 0x5603d3bc3ca0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f82e0001680 tx=0x7f82e00097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d94a1f31bd8d812 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82e8f89700 1 -- 172.21.15.125:0/1505013547 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000f450 con 0x5603d3baa190 2023-11-28T11:10:49.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82e8f89700 1 -- 172.21.15.125:0/1505013547 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000f5d0 con 0x5603d3baa190 2023-11-28T11:10:49.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.828+0000 7f82e8f89700 1 -- 172.21.15.125:0/1505013547 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000f980 con 0x5603d3baa190 2023-11-28T11:10:49.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.829+0000 7f82f4689080 1 -- 172.21.15.125:0/1505013547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3baa190 msgr2=0x5603d3bc3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.829+0000 7f82f4689080 1 --2- 172.21.15.125:0/1505013547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3baa190 0x5603d3bc3ca0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f82e0001680 tx=0x7f82e00097b0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.829+0000 7f82f4689080 1 -- 172.21.15.125:0/1505013547 shutdown_connections 2023-11-28T11:10:49.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.829+0000 7f82f4689080 1 --2- 172.21.15.125:0/1505013547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5603d3ba87b0 0x5603d3bbdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.829+0000 7f82f4689080 1 --2- 172.21.15.125:0/1505013547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3baa190 0x5603d3bc3ca0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.829+0000 7f82f4689080 1 --2- 172.21.15.125:0/1505013547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d3c4f600 0x5603d3ba8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.829+0000 7f82f4689080 1 -- 172.21.15.125:0/1505013547 >> 172.21.15.125:0/1505013547 conn(0x5603d3ba9b00 msgr2=0x5603d3b67ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:49.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.829+0000 7f82f4689080 1 -- 172.21.15.125:0/1505013547 shutdown_connections 2023-11-28T11:10:49.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.829+0000 7f82f4689080 1 -- 172.21.15.125:0/1505013547 wait complete. 2023-11-28T11:10:49.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.829+0000 7f82f4689080 1 Processor -- start 2023-11-28T11:10:49.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.829+0000 7f82f4689080 1 -- start start 2023-11-28T11:10:49.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82f4689080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3ba87b0 0x5603d3c44cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82f4689080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d3baa190 0x5603d3c55810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82f4689080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5603d3c4f600 0x5603d3b7f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82f4689080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3bc3630 con 0x5603d3ba87b0 2023-11-28T11:10:49.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82f4689080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3bc30b0 con 0x5603d3baa190 2023-11-28T11:10:49.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82f4689080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603d3bc3350 con 0x5603d3c4f600 2023-11-28T11:10:49.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82ea78c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3ba87b0 0x5603d3c44cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82ea78c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3ba87b0 0x5603d3c44cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60486/0 (socket says 172.21.15.125:60486) 2023-11-28T11:10:49.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82ea78c700 1 -- 172.21.15.125:0/2372493102 learned_addr learned my addr 172.21.15.125:0/2372493102 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:49.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82e9f8b700 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d3baa190 0x5603d3c55810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82eaf8d700 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5603d3c4f600 0x5603d3b7f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82ea78c700 1 -- 172.21.15.125:0/2372493102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5603d3c4f600 msgr2=0x5603d3b7f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82ea78c700 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5603d3c4f600 0x5603d3b7f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82ea78c700 1 -- 172.21.15.125:0/2372493102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d3baa190 msgr2=0x5603d3c55810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.830+0000 7f82ea78c700 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d3baa190 0x5603d3c55810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.831+0000 7f82ea78c700 1 -- 172.21.15.125:0/2372493102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603d3ad0120 con 0x5603d3ba87b0 2023-11-28T11:10:49.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.831+0000 7f82eaf8d700 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5603d3c4f600 0x5603d3b7f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:49.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.831+0000 7f82ea78c700 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3ba87b0 0x5603d3c44cd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009bb0 tx=0x7f82e0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.831+0000 7f82db7fe700 1 -- 172.21.15.125:0/2372493102 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0018620 con 0x5603d3ba87b0 2023-11-28T11:10:49.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.831+0000 7f82db7fe700 1 -- 172.21.15.125:0/2372493102 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e0018780 con 0x5603d3ba87b0 2023-11-28T11:10:49.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.831+0000 7f82f4689080 1 -- 172.21.15.125:0/2372493102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5603d3bc64a0 con 0x5603d3ba87b0 2023-11-28T11:10:49.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.831+0000 7f82db7fe700 1 -- 172.21.15.125:0/2372493102 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0018b30 con 0x5603d3ba87b0 2023-11-28T11:10:49.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.831+0000 7f82f4689080 1 -- 172.21.15.125:0/2372493102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603d3ac3830 con 0x5603d3ba87b0 2023-11-28T11:10:49.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.832+0000 7f82db7fe700 1 -- 172.21.15.125:0/2372493102 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f82e002a030 con 0x5603d3ba87b0 2023-11-28T11:10:49.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.832+0000 7f82db7fe700 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f82cc066c10 0x7f82cc0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.833+0000 7f82db7fe700 1 -- 172.21.15.125:0/2372493102 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82e0004040 con 0x5603d3ba87b0 2023-11-28T11:10:49.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.833+0000 7f82e9f8b700 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f82cc066c10 0x7f82cc0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.833+0000 7f82f4689080 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x5603d3bab8c0 0x5603d3c47880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.833+0000 7f82f4689080 1 -- 172.21.15.125:0/2372493102 --> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52) v8 -- 0x5603d3c47dc0 con 0x5603d3bab8c0 2023-11-28T11:10:49.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.833+0000 7f82eaf8d700 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x5603d3bab8c0 0x5603d3c47880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.833+0000 7f82e9f8b700 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f82cc066c10 0x7f82cc0690c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5603d3c57be0 tx=0x7f82dc00c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.833+0000 7f82eaf8d700 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x5603d3bab8c0 0x5603d3c47880 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.834+0000 7f82eaf8d700 1 -- 172.21.15.125:0/2372493102 <== osd.1 v2:172.21.15.125:6824/103588 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v52'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f82e4006040 con 0x5603d3bab8c0 2023-11-28T11:10:49.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.834+0000 7f82f4689080 1 -- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x5603d3bab8c0 msgr2=0x5603d3c47880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.834+0000 7f82f4689080 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x5603d3bab8c0 0x5603d3c47880 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.834+0000 7f82f4689080 1 -- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f82cc066c10 msgr2=0x7f82cc0690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.834+0000 7f82f4689080 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f82cc066c10 0x7f82cc0690c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5603d3c57be0 tx=0x7f82dc00c040 comp rx=0 tx=0).stop 2023-11-28T11:10:49.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.834+0000 7f82f4689080 1 -- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3ba87b0 msgr2=0x5603d3c44cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.834+0000 7f82f4689080 1 --2- 172.21.15.125:0/2372493102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5603d3ba87b0 0x5603d3c44cd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009bb0 tx=0x7f82e0001930 comp rx=0 tx=0).stop 2023-11-28T11:10:49.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.834+0000 7f82eaf8d700 1 -- 172.21.15.125:0/2372493102 reap_dead start 2023-11-28T11:10:49.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.834+0000 7f82f4689080 1 -- 172.21.15.125:0/2372493102 shutdown_connections 2023-11-28T11:10:49.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.834+0000 7f82f4689080 1 -- 172.21.15.125:0/2372493102 >> 172.21.15.125:0/2372493102 conn(0x5603d3ba9b00 msgr2=0x5603d3b67ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:49.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.835+0000 7f82f4689080 1 -- 172.21.15.125:0/2372493102 shutdown_connections 2023-11-28T11:10:49.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.835+0000 7f82f4689080 1 -- 172.21.15.125:0/2372493102 wait complete. 2023-11-28T11:10:49.852 DEBUG:teuthology.orchestra.run.smithi125:> sudo daemon-helper kill ceph --cluster ceph -w 2023-11-28T11:10:49.856 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2023-11-28T11:10:49.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.983+0000 7fd2ae72b700 1 Processor -- start 2023-11-28T11:10:49.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.983+0000 7fd2ae72b700 1 -- start start 2023-11-28T11:10:49.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2ae72b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd2a80b22e0 0x7fd2a80d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2ae72b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2a80d1270 0x7fd2a80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:49.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2ae72b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a80d16d0 con 0x7fd2a815cce0 2023-11-28T11:10:49.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2ae72b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a80b32b0 con 0x7fd2a80b22e0 2023-11-28T11:10:49.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2ae72b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a80b26e0 con 0x7fd2a80d1270 2023-11-28T11:10:49.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2a77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd2a80b22e0 0x7fd2a80d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2a7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd2a815cce0 0x7fd2a80b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44620/0 (socket says 172.21.15.125:44620) 2023-11-28T11:10:49.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2a77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd2a80b22e0 0x7fd2a80d0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60498/0 (socket says 172.21.15.125:60498) 2023-11-28T11:10:49.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2a7fff700 1 -- 172.21.15.125:0/2368180618 learned_addr learned my addr 172.21.15.125:0/2368180618 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:49.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2accc8700 1 --2- 172.21.15.125:0/2368180618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2a80d1270 0x7fd2a80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:49.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2a77fe700 1 -- 172.21.15.125:0/2368180618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2a80d1270 msgr2=0x7fd2a80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:49.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/2368180618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2a80d1270 0x7fd2a80b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2a77fe700 1 -- 172.21.15.125:0/2368180618 >> v1:172.21.15.125:6789/0 conn(0x7fd2a815cce0 legacy=0x7fd2a80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2a77fe700 1 -- 172.21.15.125:0/2368180618 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a80b1e60 con 0x7fd2a80b22e0 2023-11-28T11:10:49.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2a6ffd700 1 -- 172.21.15.125:0/2368180618 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780813129 0 0) 0x7fd2a80d16d0 con 0x7fd2a815cce0 2023-11-28T11:10:49.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.984+0000 7fd2accc8700 1 --2- 172.21.15.125:0/2368180618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2a80d1270 0x7fd2a80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:49.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/2368180618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2a80b22e0 0x7fd2a80d0d30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009840 tx=0x7fd29c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4733540758d72ea7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:49.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2a6ffd700 1 -- 172.21.15.125:0/2368180618 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c011830 con 0x7fd2a80b22e0 2023-11-28T11:10:49.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2a6ffd700 1 -- 172.21.15.125:0/2368180618 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c011990 con 0x7fd2a80b22e0 2023-11-28T11:10:49.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2a6ffd700 1 -- 172.21.15.125:0/2368180618 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c011d20 con 0x7fd2a80b22e0 2023-11-28T11:10:49.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2ae72b700 1 -- 172.21.15.125:0/2368180618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2a80b22e0 msgr2=0x7fd2a80d0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:49.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2ae72b700 1 --2- 172.21.15.125:0/2368180618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2a80b22e0 0x7fd2a80d0d30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009840 tx=0x7fd29c009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:49.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2ae72b700 1 -- 172.21.15.125:0/2368180618 shutdown_connections 2023-11-28T11:10:49.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2ae72b700 1 --2- 172.21.15.125:0/2368180618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2a80d1270 0x7fd2a80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2ae72b700 1 --2- 172.21.15.125:0/2368180618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2a80b22e0 0x7fd2a80d0d30 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:49.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2ae72b700 1 -- 172.21.15.125:0/2368180618 >> 172.21.15.125:0/2368180618 conn(0x7fd2a809c4d0 msgr2=0x7fd2a80d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:49.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2ae72b700 1 -- 172.21.15.125:0/2368180618 shutdown_connections 2023-11-28T11:10:49.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.985+0000 7fd2ae72b700 1 -- 172.21.15.125:0/2368180618 wait complete. 2023-11-28T11:10:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.987+0000 7fd2ae72b700 1 Processor -- start 2023-11-28T11:10:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.987+0000 7fd2ae72b700 1 -- start start 2023-11-28T11:10:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.987+0000 7fd2ae72b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2a80d1270 0x7fd2a80c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.987+0000 7fd2ae72b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2a815cce0 0x7fd2a815fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2ae72b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2a81601c0 0x7fd2a814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2ae72b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a80c9750 con 0x7fd2a815cce0 2023-11-28T11:10:50.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2ae72b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a815ebe0 con 0x7fd2a81601c0 2023-11-28T11:10:50.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2ae72b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a815eec0 con 0x7fd2a80d1270 2023-11-28T11:10:50.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2a815cce0 0x7fd2a815fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2a815cce0 0x7fd2a815fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60504/0 (socket says 172.21.15.125:60504) 2023-11-28T11:10:50.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a77fe700 1 -- 172.21.15.125:0/791803558 learned_addr learned my addr 172.21.15.125:0/791803558 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:50.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2accc8700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2a81601c0 0x7fd2a814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2a80d1270 0x7fd2a80c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a77fe700 1 -- 172.21.15.125:0/791803558 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2a80d1270 msgr2=0x7fd2a80c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2a80d1270 0x7fd2a80c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a77fe700 1 -- 172.21.15.125:0/791803558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2a81601c0 msgr2=0x7fd2a814a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2a81601c0 0x7fd2a814a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a77fe700 1 -- 172.21.15.125:0/791803558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c0094a0 con 0x7fd2a815cce0 2023-11-28T11:10:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2accc8700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2a81601c0 0x7fd2a814a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2a815cce0 0x7fd2a815fc80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd29c014040 tx=0x7fd29c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a4ff9700 1 -- 172.21.15.125:0/791803558 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0038a0 con 0x7fd2a815cce0 2023-11-28T11:10:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a4ff9700 1 -- 172.21.15.125:0/791803558 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c01e070 con 0x7fd2a815cce0 2023-11-28T11:10:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2ae72b700 1 -- 172.21.15.125:0/791803558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a80b2c60 con 0x7fd2a815cce0 2023-11-28T11:10:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2a4ff9700 1 -- 172.21.15.125:0/791803558 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c003c20 con 0x7fd2a815cce0 2023-11-28T11:10:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.988+0000 7fd2ae72b700 1 -- 172.21.15.125:0/791803558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a80b2980 con 0x7fd2a815cce0 2023-11-28T11:10:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.990+0000 7fd2a4ff9700 1 -- 172.21.15.125:0/791803558 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd29c00f050 con 0x7fd2a815cce0 2023-11-28T11:10:50.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.990+0000 7fd2a4ff9700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2940682f0 0x7fd29406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.991+0000 7fd2a4ff9700 1 -- 172.21.15.125:0/791803558 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd29c086d50 con 0x7fd2a815cce0 2023-11-28T11:10:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.991+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2940682f0 0x7fd29406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.991+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2940682f0 0x7fd29406a7a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd298000f60 tx=0x7fd298007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.992+0000 7fd2ba8b4b80 1 Processor -- start 2023-11-28T11:10:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.992+0000 7fd2ba8b4b80 1 -- start start 2023-11-28T11:10:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be868e0 0x55715be5caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be86cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715bea2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715bd46c90 con 0x55715be871f0 2023-11-28T11:10:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715bdb5420 con 0x55715be84200 2023-11-28T11:10:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55715bdae950 con 0x55715be868e0 2023-11-28T11:10:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2accc8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715bea2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2accc8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715bea2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60514/0 (socket says 172.21.15.125:60514) 2023-11-28T11:10:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2accc8700 1 -- 172.21.15.125:0/4001185235 learned_addr learned my addr 172.21.15.125:0/4001185235 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2a77fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be86cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/4001185235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be868e0 0x55715be5caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2accc8700 1 -- 172.21.15.125:0/4001185235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be868e0 msgr2=0x55715be5caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2accc8700 1 --2- 172.21.15.125:0/4001185235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be868e0 0x55715be5caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2accc8700 1 -- 172.21.15.125:0/4001185235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 msgr2=0x55715be86cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2accc8700 1 --2- 172.21.15.125:0/4001185235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be86cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.993+0000 7fd2accc8700 1 -- 172.21.15.125:0/4001185235 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55715bc306b0 con 0x55715be871f0 2023-11-28T11:10:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd2accc8700 1 --2- 172.21.15.125:0/4001185235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715bea2840 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009bb0 tx=0x7fd2a0009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b05bdfdbfe34963 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd28dffb700 1 -- 172.21.15.125:0/4001185235 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0014410 con 0x55715be871f0 2023-11-28T11:10:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd28dffb700 1 -- 172.21.15.125:0/4001185235 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a000f050 con 0x55715be871f0 2023-11-28T11:10:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd28dffb700 1 -- 172.21.15.125:0/4001185235 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0014770 con 0x55715be871f0 2023-11-28T11:10:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/4001185235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 msgr2=0x55715bea2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/4001185235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715bea2840 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009bb0 tx=0x7fd2a0009ec0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/4001185235 shutdown_connections 2023-11-28T11:10:50.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/4001185235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715bea2840 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/4001185235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be868e0 0x55715be5caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/4001185235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be86cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/4001185235 >> 172.21.15.125:0/4001185235 conn(0x55715be59e30 msgr2=0x55715be5a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.994+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/4001185235 shutdown_connections 2023-11-28T11:10:50.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.995+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/4001185235 wait complete. 2023-11-28T11:10:50.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.995+0000 7fd2ba8b4b80 1 -- start start 2023-11-28T11:10:50.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.995+0000 7fd2ba8b4b80 1 Processor -- start 2023-11-28T11:10:50.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be9b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be868e0 0x55715be85ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be871f0 0x55715be87aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715bc329a0 con 0x55715be868e0 2023-11-28T11:10:50.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715be887c0 con 0x55715be84200 2023-11-28T11:10:50.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55715be79a40 con 0x55715be871f0 2023-11-28T11:10:50.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2ba8b4b80 10 client.0 _ll_register_callbacks cb 0x55715bc54310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:10:50.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2a77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be868e0 0x55715be85ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2a77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be868e0 0x55715be85ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60518/0 (socket says 172.21.15.125:60518) 2023-11-28T11:10:50.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2a77fe700 1 -- 172.21.15.125:0/735569411 learned_addr learned my addr 172.21.15.125:0/735569411 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:50.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2a77fe700 1 -- 172.21.15.125:0/735569411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be871f0 msgr2=0x55715be87aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be871f0 0x55715be87aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be9b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2a77fe700 1 -- 172.21.15.125:0/735569411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 msgr2=0x55715be9b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.996+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be9b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2a77fe700 1 -- 172.21.15.125:0/735569411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a00097e0 con 0x55715be868e0 2023-11-28T11:10:50.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be868e0 0x55715be85ba0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd29c056f70 tx=0x7fd29c02c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5236426d87ae9714 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd286ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:10:50.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd286ffd700 1 -- 172.21.15.125:0/735569411 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c083070 con 0x55715be868e0 2023-11-28T11:10:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd286ffd700 1 -- 172.21.15.125:0/735569411 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd29c056970 con 0x55715be868e0 2023-11-28T11:10:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/735569411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55715bd7c210 con 0x55715be868e0 2023-11-28T11:10:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd286ffd700 1 -- 172.21.15.125:0/735569411 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd29c05ee70 con 0x55715be868e0 2023-11-28T11:10:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2ba8b4b80 10 client.6009 fetch_fsmap learned FSMap version 23 2023-11-28T11:10:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/735569411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55715bbdce60 con 0x55715be868e0 2023-11-28T11:10:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd286ffd700 1 -- 172.21.15.125:0/735569411 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55715bd7c210 con 0x55715be868e0 2023-11-28T11:10:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd286ffd700 1 -- 172.21.15.125:0/735569411 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd29c053060 con 0x55715be868e0 2023-11-28T11:10:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2ba8b4b80 10 client.6009 fetch_fsmap finished waiting for FSMap version 23 2023-11-28T11:10:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2ba8b4b80 10 client.6009 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-11-28T11:10:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2ba8b4b80 20 client.6009 populate_metadata read hostname 'smithi125' 2023-11-28T11:10:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55715be76f90 0x55715be78d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2ba8b4b80 4 client.6009 mds_command: new command op to 5775 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:10:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/735569411 --> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55715bc32fe0 con 0x55715be76f90 2023-11-28T11:10:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.997+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55715be76f90 0x55715be78d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd286ffd700 10 client.6009 ms_handle_connect on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55715be76f90 0x55715be78d70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36ad80c4970c81af server_cookie=84dd789f3cc08eca in_seq=0 out_seq=0 2023-11-28T11:10:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd286ffd700 1 -- 172.21.15.125:0/735569411 <== mds.0 v2:172.21.15.125:6835/3179120009 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55715bc32fe0 con 0x55715be76f90 2023-11-28T11:10:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd286ffd700 10 client.6009 handle_command_reply: tid=0 2023-11-28T11:10:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd2ba8b4b80 1 client.6009 shutdown 2023-11-28T11:10:50.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/735569411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be868e0 msgr2=0x55715be85ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be868e0 0x55715be85ba0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd29c056f70 tx=0x7fd29c02c4d0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/735569411 shutdown_connections 2023-11-28T11:10:50.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be871f0 0x55715be87aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be9b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55715be76f90 0x55715be78d70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/735569411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be868e0 0x55715be85ba0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd286ffd700 0 client.6009 ms_handle_reset on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:50.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.998+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/735569411 >> 172.21.15.125:0/735569411 conn(0x55715be59e30 msgr2=0x55715be5b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.999+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/735569411 shutdown_connections 2023-11-28T11:10:50.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.999+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/735569411 wait complete. 2023-11-28T11:10:50.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:49.999+0000 7fd2ba8b4b80 20 client.6009 trim_cache size 0 max 16384 2023-11-28T11:10:50.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.005+0000 7fb84d54a700 1 Processor -- start 2023-11-28T11:10:50.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.005+0000 7fb84d54a700 1 -- start start 2023-11-28T11:10:50.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.006+0000 7fb84d54a700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb8480b21e0 0x7fb8480b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.006+0000 7fb84d54a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480cf1c0 0x7fb8480d1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.006+0000 7fb84d54a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8480d2b20 con 0x7fb8480cf890 2023-11-28T11:10:50.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.006+0000 7fb84d54a700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480b25b0 con 0x7fb8480b21e0 2023-11-28T11:10:50.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.006+0000 7fb84d54a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480cd600 con 0x7fb8480cf1c0 2023-11-28T11:10:50.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.006+0000 7fb8477fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb8480cf890 0x7fb8480d2fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44652/0 (socket says 172.21.15.125:44652) 2023-11-28T11:10:50.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.006+0000 7fb8477fe700 1 -- 172.21.15.125:0/153041775 learned_addr learned my addr 172.21.15.125:0/153041775 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:50.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.006+0000 7fb846ffd700 1 --2- 172.21.15.125:0/153041775 >> v2:172.21.15.167:3300/0 conn(0x7fb8480b21e0 0x7fb8480b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.006+0000 7fb8467fc700 1 --2- 172.21.15.125:0/153041775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480cf1c0 0x7fb8480d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.007+0000 7fb845ffb700 1 -- 172.21.15.125:0/153041775 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761572395 0 0) 0x7fb8480d2b20 con 0x7fb8480cf890 2023-11-28T11:10:50.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.007+0000 7fb845ffb700 1 -- 172.21.15.125:0/153041775 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8300035b0 con 0x7fb8480cf890 2023-11-28T11:10:50.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.007+0000 7fb846ffd700 1 -- 172.21.15.125:0/153041775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480cf1c0 msgr2=0x7fb8480d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.007+0000 7fb846ffd700 1 --2- 172.21.15.125:0/153041775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480cf1c0 0x7fb8480d1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.007+0000 7fb846ffd700 1 -- 172.21.15.125:0/153041775 >> v1:172.21.15.125:6789/0 conn(0x7fb8480cf890 legacy=0x7fb8480d2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.007+0000 7fb846ffd700 1 -- 172.21.15.125:0/153041775 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8480cd8e0 con 0x7fb8480b21e0 2023-11-28T11:10:50.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.007+0000 7fb8467fc700 1 --2- 172.21.15.125:0/153041775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480cf1c0 0x7fb8480d1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:10:50.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.007+0000 7fb846ffd700 1 --2- 172.21.15.125:0/153041775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480b21e0 0x7fb8480b5cd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb838009840 tx=0x7fb838009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f244b689314e8f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.007+0000 7fb845ffb700 1 -- 172.21.15.125:0/153041775 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838011830 con 0x7fb8480b21e0 2023-11-28T11:10:50.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.007+0000 7fb845ffb700 1 -- 172.21.15.125:0/153041775 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838011990 con 0x7fb8480b21e0 2023-11-28T11:10:50.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.007+0000 7fb845ffb700 1 -- 172.21.15.125:0/153041775 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838011d00 con 0x7fb8480b21e0 2023-11-28T11:10:50.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.008+0000 7fb84d54a700 1 -- 172.21.15.125:0/153041775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480b21e0 msgr2=0x7fb8480b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.008+0000 7fb84d54a700 1 --2- 172.21.15.125:0/153041775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480b21e0 0x7fb8480b5cd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb838009840 tx=0x7fb838009b50 comp rx=0 tx=0).stop 2023-11-28T11:10:50.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.008+0000 7fb84d54a700 1 -- 172.21.15.125:0/153041775 shutdown_connections 2023-11-28T11:10:50.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.008+0000 7fb84d54a700 1 --2- 172.21.15.125:0/153041775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480b21e0 0x7fb8480b5cd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.008+0000 7fb84d54a700 1 --2- 172.21.15.125:0/153041775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480cf1c0 0x7fb8480d1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.008+0000 7fb84d54a700 1 -- 172.21.15.125:0/153041775 >> 172.21.15.125:0/153041775 conn(0x7fb84806aa80 msgr2=0x7fb84806ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.008+0000 7fb84d54a700 1 -- 172.21.15.125:0/153041775 shutdown_connections 2023-11-28T11:10:50.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.008+0000 7fb84d54a700 1 -- 172.21.15.125:0/153041775 wait complete. 2023-11-28T11:10:50.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.009+0000 7fb84d54a700 1 Processor -- start 2023-11-28T11:10:50.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.009+0000 7fb84d54a700 1 -- start start 2023-11-28T11:10:50.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb84d54a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8480b21e0 0x7fb8480cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb84d54a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480cf1c0 0x7fb848146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb84d54a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480cf890 0x7fb848155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb84d54a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb848157c50 con 0x7fb8480b21e0 2023-11-28T11:10:50.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb84d54a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb848147dd0 con 0x7fb8480cf1c0 2023-11-28T11:10:50.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb84d54a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb848147530 con 0x7fb8480cf890 2023-11-28T11:10:50.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb846ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8480b21e0 0x7fb8480cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb846ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8480b21e0 0x7fb8480cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60530/0 (socket says 172.21.15.125:60530) 2023-11-28T11:10:50.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb846ffd700 1 -- 172.21.15.125:0/2360541045 learned_addr learned my addr 172.21.15.125:0/2360541045 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:50.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb8467fc700 1 --2- 172.21.15.125:0/2360541045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480cf1c0 0x7fb848146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb8477fe700 1 --2- 172.21.15.125:0/2360541045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480cf890 0x7fb848155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb846ffd700 1 -- 172.21.15.125:0/2360541045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480cf890 msgr2=0x7fb848155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb846ffd700 1 --2- 172.21.15.125:0/2360541045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480cf890 0x7fb848155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb846ffd700 1 -- 172.21.15.125:0/2360541045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480cf1c0 msgr2=0x7fb848146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb846ffd700 1 --2- 172.21.15.125:0/2360541045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480cf1c0 0x7fb848146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.010+0000 7fb846ffd700 1 -- 172.21.15.125:0/2360541045 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c0094a0 con 0x7fb8480b21e0 2023-11-28T11:10:50.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.011+0000 7fb846ffd700 1 --2- 172.21.15.125:0/2360541045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8480b21e0 0x7fb8480cafa0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb838000c00 tx=0x7fb838004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.011+0000 7fb82f7fe700 1 -- 172.21.15.125:0/2360541045 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838004550 con 0x7fb8480b21e0 2023-11-28T11:10:50.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.011+0000 7fb82f7fe700 1 -- 172.21.15.125:0/2360541045 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83801f070 con 0x7fb8480b21e0 2023-11-28T11:10:50.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.011+0000 7fb84d54a700 1 -- 172.21.15.125:0/2360541045 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8380094a0 con 0x7fb8480b21e0 2023-11-28T11:10:50.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.011+0000 7fb82f7fe700 1 -- 172.21.15.125:0/2360541045 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380038c0 con 0x7fb8480b21e0 2023-11-28T11:10:50.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.011+0000 7fb84d54a700 1 -- 172.21.15.125:0/2360541045 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8480d19a0 con 0x7fb8480b21e0 2023-11-28T11:10:50.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.011+0000 7fb84d54a700 1 -- 172.21.15.125:0/2360541045 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fb8480d27b0 con 0x7fb8480b21e0 2023-11-28T11:10:50.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.013+0000 7fb82f7fe700 1 -- 172.21.15.125:0/2360541045 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb83800f050 con 0x7fb8480b21e0 2023-11-28T11:10:50.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.013+0000 7fb82f7fe700 1 --2- 172.21.15.125:0/2360541045 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb8340682f0 0x7fb83406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.013+0000 7fb82f7fe700 1 -- 172.21.15.125:0/2360541045 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb838021070 con 0x7fb8480b21e0 2023-11-28T11:10:50.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.013+0000 7fb8467fc700 1 --2- 172.21.15.125:0/2360541045 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb8340682f0 0x7fb83406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.013+0000 7fb82f7fe700 1 -- 172.21.15.125:0/2360541045 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+502 (secure 0 0 0) 0x7fb83808e070 con 0x7fb8480b21e0 2023-11-28T11:10:50.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.013+0000 7fb84d54a700 1 -- 172.21.15.125:0/2360541045 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fb8480cfd10 con 0x7fb8480b21e0 2023-11-28T11:10:50.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.013+0000 7fb8467fc700 1 --2- 172.21.15.125:0/2360541045 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb8340682f0 0x7fb83406a7a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb8480cf610 tx=0x7fb83c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.017+0000 7fd2ba8b4b80 1 Processor -- start 2023-11-28T11:10:50.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.017+0000 7fd2ba8b4b80 1 -- start start 2023-11-28T11:10:50.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.017+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be85b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be868e0 0x55715be860c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715be78b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715be78610 con 0x55715be871f0 2023-11-28T11:10:50.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715be5a200 con 0x55715be84200 2023-11-28T11:10:50.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55715be87b40 con 0x55715be868e0 2023-11-28T11:10:50.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2accc8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715be78b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2accc8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715be78b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60542/0 (socket says 172.21.15.125:60542) 2023-11-28T11:10:50.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2accc8700 1 -- 172.21.15.125:0/2136784710 learned_addr learned my addr 172.21.15.125:0/2136784710 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:50.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2accc8700 1 -- 172.21.15.125:0/2136784710 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be868e0 msgr2=0x55715be860c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/2136784710 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be868e0 0x55715be860c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/2136784710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be85b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2accc8700 1 --2- 172.21.15.125:0/2136784710 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be868e0 0x55715be860c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2accc8700 1 -- 172.21.15.125:0/2136784710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 msgr2=0x55715be85b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2accc8700 1 --2- 172.21.15.125:0/2136784710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be85b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2accc8700 1 -- 172.21.15.125:0/2136784710 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55715bd75210 con 0x55715be871f0 2023-11-28T11:10:50.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/2136784710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be85b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:50.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd2accc8700 1 --2- 172.21.15.125:0/2136784710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715be78b80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0016040 tx=0x7fd2a000d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88369164cc2ecbd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd28e7fc700 1 -- 172.21.15.125:0/2136784710 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0004800 con 0x55715be871f0 2023-11-28T11:10:50.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd28e7fc700 1 -- 172.21.15.125:0/2136784710 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a0023070 con 0x55715be871f0 2023-11-28T11:10:50.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.018+0000 7fd28e7fc700 1 -- 172.21.15.125:0/2136784710 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0028670 con 0x55715be871f0 2023-11-28T11:10:50.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.019+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/2136784710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 msgr2=0x55715be78b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.019+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/2136784710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715be78b80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0016040 tx=0x7fd2a000d000 comp rx=0 tx=0).stop 2023-11-28T11:10:50.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.019+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/2136784710 shutdown_connections 2023-11-28T11:10:50.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.019+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/2136784710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be871f0 0x55715be78b80 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.019+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/2136784710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be84200 0x55715be85b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.019+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/2136784710 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be868e0 0x55715be860c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.019+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/2136784710 >> 172.21.15.125:0/2136784710 conn(0x55715be59e30 msgr2=0x55715be7e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.019+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/2136784710 shutdown_connections 2023-11-28T11:10:50.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.019+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/2136784710 wait complete. 2023-11-28T11:10:50.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.020+0000 7fd2ba8b4b80 1 -- start start 2023-11-28T11:10:50.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.020+0000 7fd2ba8b4b80 1 Processor -- start 2023-11-28T11:10:50.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be84200 0x55715be97a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be868e0 0x55715bea4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2ba8b4b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be871f0 0x55715be857f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715bea3d40 con 0x55715be84200 2023-11-28T11:10:50.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715bf08100 con 0x55715be868e0 2023-11-28T11:10:50.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2ba8b4b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55715be7f270 con 0x55715be871f0 2023-11-28T11:10:50.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2ba8b4b80 10 client.0 _ll_register_callbacks cb 0x55715bc54310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:10:50.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2a7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be84200 0x55715be97a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2a7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be84200 0x55715be97a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60544/0 (socket says 172.21.15.125:60544) 2023-11-28T11:10:50.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2a7fff700 1 -- 172.21.15.125:0/3920722503 learned_addr learned my addr 172.21.15.125:0/3920722503 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:50.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2accc8700 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be871f0 0x55715be857f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be868e0 0x55715bea4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2a7fff700 1 -- 172.21.15.125:0/3920722503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be871f0 msgr2=0x55715be857f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be871f0 0x55715be857f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2a7fff700 1 -- 172.21.15.125:0/3920722503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be868e0 msgr2=0x55715bea4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be868e0 0x55715bea4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2a7fff700 1 -- 172.21.15.125:0/3920722503 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55715bc306b0 con 0x55715be84200 2023-11-28T11:10:50.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2accc8700 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be871f0 0x55715be857f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:10:50.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2a7fff700 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be84200 0x55715be97a60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd298007fd0 tx=0x7fd298000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ceab0d0745bebc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd286ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:10:50.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd286ffd700 1 -- 172.21.15.125:0/3920722503 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29802a070 con 0x55715be84200 2023-11-28T11:10:50.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd286ffd700 1 -- 172.21.15.125:0/3920722503 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd298015550 con 0x55715be84200 2023-11-28T11:10:50.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/3920722503 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55715bd6c230 con 0x55715be84200 2023-11-28T11:10:50.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd286ffd700 1 -- 172.21.15.125:0/3920722503 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd298015710 con 0x55715be84200 2023-11-28T11:10:50.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2ba8b4b80 10 client.6021 fetch_fsmap learned FSMap version 23 2023-11-28T11:10:50.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.021+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/3920722503 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55715bc032d0 con 0x55715be84200 2023-11-28T11:10:50.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.022+0000 7fd286ffd700 1 -- 172.21.15.125:0/3920722503 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55715bd6c230 con 0x55715be84200 2023-11-28T11:10:50.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.022+0000 7fd286ffd700 1 -- 172.21.15.125:0/3920722503 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd298015870 con 0x55715be84200 2023-11-28T11:10:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.022+0000 7fd2ba8b4b80 10 client.6021 fetch_fsmap finished waiting for FSMap version 23 2023-11-28T11:10:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.022+0000 7fd2ba8b4b80 10 client.6021 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-11-28T11:10:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.022+0000 7fd2ba8b4b80 20 client.6021 populate_metadata read hostname 'smithi125' 2023-11-28T11:10:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.022+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55715be85d30 0x55715bf07390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.022+0000 7fd2ba8b4b80 4 client.6021 mds_command: new command op to 5775 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-11-28T11:10:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.022+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/3920722503 --> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x55715bd56240 con 0x55715be85d30 2023-11-28T11:10:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.022+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55715be85d30 0x55715bf07390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.022+0000 7fd286ffd700 10 client.6021 ms_handle_connect on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.022+0000 7fd2a77fe700 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55715be85d30 0x55715bf07390 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94b8e63d9b466a5f server_cookie=7d56b2429849992e in_seq=0 out_seq=0 2023-11-28T11:10:50.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd286ffd700 1 -- 172.21.15.125:0/3920722503 <== mds.0 v2:172.21.15.125:6835/3179120009 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55715bd56240 con 0x55715be85d30 2023-11-28T11:10:50.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd286ffd700 10 client.6021 handle_command_reply: tid=0 2023-11-28T11:10:50.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 1 client.6021 shutdown 2023-11-28T11:10:50.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/3920722503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be84200 msgr2=0x55715be97a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be84200 0x55715be97a60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd298007fd0 tx=0x7fd298000ed0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/3920722503 shutdown_connections 2023-11-28T11:10:50.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715be871f0 0x55715be857f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55715be85d30 0x55715bf07390 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55715be84200 0x55715be97a60 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd286ffd700 0 client.6021 ms_handle_reset on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:50.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 1 --2- 172.21.15.125:0/3920722503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715be868e0 0x55715bea4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/3920722503 >> 172.21.15.125:0/3920722503 conn(0x55715be59e30 msgr2=0x55715be9add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.041 INFO:tasks.ceph.mds.a.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd6af2c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5970=0-4194304@1} caps={5970=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5970 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x563ba9e9b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T11:10:50.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/3920722503 shutdown_connections 2023-11-28T11:10:50.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 1 -- 172.21.15.125:0/3920722503 wait complete. 2023-11-28T11:10:50.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.023+0000 7fd2ba8b4b80 20 client.6021 trim_cache size 0 max 16384 2023-11-28T11:10:50.043 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:10:50.043 INFO:teuthology.orchestra.run.smithi125.stdout: "return_code": 0, 2023-11-28T11:10:50.043 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_tag": "cbb20dfe-0531-4a05-9a3e-66e70d36b68b", 2023-11-28T11:10:50.043 INFO:teuthology.orchestra.run.smithi125.stdout: "mode": "asynchronous" 2023-11-28T11:10:50.044 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:10:50.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 -- 172.21.15.125:0/791803558 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2940682f0 msgr2=0x7fd29406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2940682f0 0x7fd29406a7a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd298000f60 tx=0x7fd298007be0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 -- 172.21.15.125:0/791803558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2a815cce0 msgr2=0x7fd2a815fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2a815cce0 0x7fd2a815fc80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd29c014040 tx=0x7fd29c004750 comp rx=0 tx=0).stop 2023-11-28T11:10:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 -- 172.21.15.125:0/791803558 shutdown_connections 2023-11-28T11:10:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2a81601c0 0x7fd2a814a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2940682f0 0x7fd29406a7a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2a80d1270 0x7fd2a80c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 --2- 172.21.15.125:0/791803558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2a815cce0 0x7fd2a815fc80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 -- 172.21.15.125:0/791803558 >> 172.21.15.125:0/791803558 conn(0x7fd2a809c4d0 msgr2=0x7fd2a815b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 -- 172.21.15.125:0/791803558 shutdown_connections 2023-11-28T11:10:50.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.024+0000 7fd2ae72b700 1 -- 172.21.15.125:0/791803558 wait complete. 2023-11-28T11:10:50.048 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-11-28T11:10:50.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.170+0000 7ff398d24700 1 Processor -- start 2023-11-28T11:10:50.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.170+0000 7ff398d24700 1 -- start start 2023-11-28T11:10:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff398d24700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff394071890 0x7ff3940ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff398d24700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39415cc10 con 0x7ff3940cf710 2023-11-28T11:10:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff398d24700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39406c9b0 con 0x7ff39406a980 2023-11-28T11:10:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff398d24700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39406cc90 con 0x7ff394071890 2023-11-28T11:10:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff39259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff3940cf710 0x7ff39406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44676/0 (socket says 172.21.15.125:44676) 2023-11-28T11:10:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff39259c700 1 -- 172.21.15.125:0/2593224195 learned_addr learned my addr 172.21.15.125:0/2593224195 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:10:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff392d9d700 1 --2- 172.21.15.125:0/2593224195 >> v2:172.21.15.125:3300/0 conn(0x7ff394071890 0x7ff3940ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff392d9d700 1 -- 172.21.15.125:0/2593224195 >> v1:172.21.15.167:6789/0 conn(0x7ff39406a980 legacy=0x7ff394160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff392d9d700 1 -- 172.21.15.125:0/2593224195 >> v1:172.21.15.125:6789/0 conn(0x7ff3940cf710 legacy=0x7ff39406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff392d9d700 1 -- 172.21.15.125:0/2593224195 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39406cf70 con 0x7ff394071890 2023-11-28T11:10:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff39159a700 1 -- 172.21.15.125:0/2593224195 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300961976 0 0) 0x7ff39415cc10 con 0x7ff3940cf710 2023-11-28T11:10:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff392d9d700 1 --2- 172.21.15.125:0/2593224195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff394071890 0x7ff3940ce740 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d90 tx=0x7ff38c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5445b9300c2df6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.171+0000 7ff39159a700 1 -- 172.21.15.125:0/2593224195 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00e070 con 0x7ff394071890 2023-11-28T11:10:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.172+0000 7ff39159a700 1 -- 172.21.15.125:0/2593224195 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c00bbd0 con 0x7ff394071890 2023-11-28T11:10:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.172+0000 7ff39159a700 1 -- 172.21.15.125:0/2593224195 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c012430 con 0x7ff394071890 2023-11-28T11:10:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.172+0000 7ff398d24700 1 -- 172.21.15.125:0/2593224195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff394071890 msgr2=0x7ff3940ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.172+0000 7ff398d24700 1 --2- 172.21.15.125:0/2593224195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff394071890 0x7ff3940ce740 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d90 tx=0x7ff38c00b330 comp rx=0 tx=0).stop 2023-11-28T11:10:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.172+0000 7ff398d24700 1 -- 172.21.15.125:0/2593224195 shutdown_connections 2023-11-28T11:10:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.172+0000 7ff398d24700 1 --2- 172.21.15.125:0/2593224195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff394071890 0x7ff3940ce740 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.172+0000 7ff398d24700 1 -- 172.21.15.125:0/2593224195 >> 172.21.15.125:0/2593224195 conn(0x7ff39406c010 msgr2=0x7ff3940cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.172+0000 7ff398d24700 1 -- 172.21.15.125:0/2593224195 shutdown_connections 2023-11-28T11:10:50.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.172+0000 7ff398d24700 1 -- 172.21.15.125:0/2593224195 wait complete. 2023-11-28T11:10:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.173+0000 7ff398d24700 1 Processor -- start 2023-11-28T11:10:50.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.173+0000 7ff398d24700 1 -- start start 2023-11-28T11:10:50.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.174+0000 7ff398d24700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39406a980 0x7ff39414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.174+0000 7ff398d24700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff394071890 0x7ff39414d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.174+0000 7ff398d24700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3940cf710 0x7ff3941f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.174+0000 7ff398d24700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39414c0e0 con 0x7ff39406a980 2023-11-28T11:10:50.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.174+0000 7ff398d24700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39414c3c0 con 0x7ff394071890 2023-11-28T11:10:50.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.174+0000 7ff398d24700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39414c6a0 con 0x7ff3940cf710 2023-11-28T11:10:50.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.174+0000 7ff39259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39406a980 0x7ff39414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.174+0000 7ff39259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39406a980 0x7ff39414bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60558/0 (socket says 172.21.15.125:60558) 2023-11-28T11:10:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.174+0000 7ff39259c700 1 -- 172.21.15.125:0/3883630048 learned_addr learned my addr 172.21.15.125:0/3883630048 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.174+0000 7ff392d9d700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3940cf710 0x7ff3941f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.174+0000 7ff391d9b700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff394071890 0x7ff39414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff39259c700 1 -- 172.21.15.125:0/3883630048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3940cf710 msgr2=0x7ff3941f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff39259c700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3940cf710 0x7ff3941f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff39259c700 1 -- 172.21.15.125:0/3883630048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff394071890 msgr2=0x7ff39414d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff39259c700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff394071890 0x7ff39414d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff39259c700 1 -- 172.21.15.125:0/3883630048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c009a70 con 0x7ff39406a980 2023-11-28T11:10:50.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff391d9b700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff394071890 0x7ff39414d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:10:50.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff39259c700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39406a980 0x7ff39414bb00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c520 tx=0x7ff38400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff382ffd700 1 -- 172.21.15.125:0/3883630048 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff384004c80 con 0x7ff39406a980 2023-11-28T11:10:50.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff382ffd700 1 -- 172.21.15.125:0/3883630048 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff384004e20 con 0x7ff39406a980 2023-11-28T11:10:50.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff398d24700 1 -- 172.21.15.125:0/3883630048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39406d530 con 0x7ff39406a980 2023-11-28T11:10:50.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff382ffd700 1 -- 172.21.15.125:0/3883630048 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff384007310 con 0x7ff39406a980 2023-11-28T11:10:50.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.175+0000 7ff398d24700 1 -- 172.21.15.125:0/3883630048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39406d250 con 0x7ff39406a980 2023-11-28T11:10:50.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.176+0000 7ff382ffd700 1 -- 172.21.15.125:0/3883630048 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff38401a020 con 0x7ff39406a980 2023-11-28T11:10:50.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.177+0000 7ff382ffd700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3740682f0 0x7ff37406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.177+0000 7ff382ffd700 1 -- 172.21.15.125:0/3883630048 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff384085970 con 0x7ff39406a980 2023-11-28T11:10:50.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.177+0000 7ff391d9b700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3740682f0 0x7ff37406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.177+0000 7ff391d9b700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3740682f0 0x7ff37406a7a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff3940adf00 tx=0x7ff388009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.178+0000 7ff3a4eadb80 1 Processor -- start 2023-11-28T11:10:50.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.179+0000 7ff3a4eadb80 1 -- start start 2023-11-28T11:10:50.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.179+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd5860 0x55d1bbbaba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.179+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd3180 0x55d1bbbd5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.179+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd6170 0x55d1bbbf17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.179+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1bba95c10 con 0x55d1bbbd3180 2023-11-28T11:10:50.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.179+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1bbb043a0 con 0x55d1bbbd5860 2023-11-28T11:10:50.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.179+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1bbafd8d0 con 0x55d1bbbd6170 2023-11-28T11:10:50.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff391d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd3180 0x55d1bbbd5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff391d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd3180 0x55d1bbbd5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60568/0 (socket says 172.21.15.125:60568) 2023-11-28T11:10:50.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff391d9b700 1 -- 172.21.15.125:0/3877972690 learned_addr learned my addr 172.21.15.125:0/3877972690 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:50.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff391d9b700 1 -- 172.21.15.125:0/3877972690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd6170 msgr2=0x55d1bbbf17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff391d9b700 1 --2- 172.21.15.125:0/3877972690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd6170 0x55d1bbbf17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff391d9b700 1 -- 172.21.15.125:0/3877972690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd5860 msgr2=0x55d1bbbaba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff391d9b700 1 --2- 172.21.15.125:0/3877972690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd5860 0x55d1bbbaba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff391d9b700 1 -- 172.21.15.125:0/3877972690 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1bb97f630 con 0x55d1bbbd3180 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff391d9b700 1 --2- 172.21.15.125:0/3877972690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd3180 0x55d1bbbd5c30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff3880146f0 tx=0x7ff388010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41068643a298a34f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff373fff700 1 -- 172.21.15.125:0/3877972690 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3880127e0 con 0x55d1bbbd3180 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff373fff700 1 -- 172.21.15.125:0/3877972690 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff388012940 con 0x55d1bbbd3180 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.180+0000 7ff373fff700 1 -- 172.21.15.125:0/3877972690 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388012cd0 con 0x55d1bbbd3180 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.181+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/3877972690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd3180 msgr2=0x55d1bbbd5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.181+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/3877972690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd3180 0x55d1bbbd5c30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff3880146f0 tx=0x7ff388010000 comp rx=0 tx=0).stop 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.181+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/3877972690 shutdown_connections 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.181+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/3877972690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd6170 0x55d1bbbf17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.181+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/3877972690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd5860 0x55d1bbbaba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.181+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/3877972690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd3180 0x55d1bbbd5c30 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.181+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/3877972690 >> 172.21.15.125:0/3877972690 conn(0x55d1bbba8db0 msgr2=0x55d1bbba9740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.181+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/3877972690 shutdown_connections 2023-11-28T11:10:50.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.181+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/3877972690 wait complete. 2023-11-28T11:10:50.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.181+0000 7ff3a4eadb80 1 -- start start 2023-11-28T11:10:50.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.182+0000 7ff3a4eadb80 1 Processor -- start 2023-11-28T11:10:50.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 0x55d1bbbea130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd5860 0x55d1bbbe8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbe8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1bb981920 con 0x55d1bbbd6170 2023-11-28T11:10:50.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1bbbf8b80 con 0x55d1bbbd3180 2023-11-28T11:10:50.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1bbbf5440 con 0x55d1bbbd5860 2023-11-28T11:10:50.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff3a4eadb80 10 client.0 _ll_register_callbacks cb 0x55d1bb9a3290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:10:50.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff392d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbe8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff392d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbe8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60576/0 (socket says 172.21.15.125:60576) 2023-11-28T11:10:50.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff392d9d700 1 -- 172.21.15.125:0/897501425 learned_addr learned my addr 172.21.15.125:0/897501425 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:50.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff39259c700 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 0x55d1bbbea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff391d9b700 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd5860 0x55d1bbbe8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff392d9d700 1 -- 172.21.15.125:0/897501425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd5860 msgr2=0x55d1bbbe8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff392d9d700 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd5860 0x55d1bbbe8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff392d9d700 1 -- 172.21.15.125:0/897501425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 msgr2=0x55d1bbbea130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff392d9d700 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 0x55d1bbbea130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.183+0000 7ff392d9d700 1 -- 172.21.15.125:0/897501425 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39406c9b0 con 0x55d1bbbd6170 2023-11-28T11:10:50.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff392d9d700 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbe8bb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff394067450 tx=0x7ff38c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55dc1536707a63ec server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3717fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:10:50.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3717fa700 1 -- 172.21.15.125:0/897501425 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c012d20 con 0x55d1bbbd6170 2023-11-28T11:10:50.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3717fa700 1 -- 172.21.15.125:0/897501425 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff38c003e20 con 0x55d1bbbd6170 2023-11-28T11:10:50.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/897501425 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1bbacb190 con 0x55d1bbbd6170 2023-11-28T11:10:50.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3717fa700 1 -- 172.21.15.125:0/897501425 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff38c0098f0 con 0x55d1bbbd6170 2023-11-28T11:10:50.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3a4eadb80 10 client.6036 fetch_fsmap learned FSMap version 23 2023-11-28T11:10:50.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/897501425 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55d1bb92bde0 con 0x55d1bbbd6170 2023-11-28T11:10:50.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3717fa700 1 -- 172.21.15.125:0/897501425 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1bbacb190 con 0x55d1bbbd6170 2023-11-28T11:10:50.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3717fa700 1 -- 172.21.15.125:0/897501425 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 3106+0+0 (secure 0 0 0) 0x7ff38c004040 con 0x55d1bbbd6170 2023-11-28T11:10:50.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3a4eadb80 10 client.6036 fetch_fsmap finished waiting for FSMap version 23 2023-11-28T11:10:50.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3a4eadb80 10 client.6036 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-11-28T11:10:50.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3a4eadb80 20 client.6036 populate_metadata read hostname 'smithi125' 2023-11-28T11:10:50.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55d1bbbf4d20 0x55d1bbbccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3a4eadb80 4 client.6036 mds_command: new command op to 5775 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:10:50.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/897501425 --> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1bb981f60 con 0x55d1bbbf4d20 2023-11-28T11:10:50.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.184+0000 7ff39259c700 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55d1bbbf4d20 0x55d1bbbccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3717fa700 10 client.6036 ms_handle_connect on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:50.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff39259c700 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55d1bbbf4d20 0x55d1bbbccab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da0a4a06cade6b2b server_cookie=5ca72fcf55cc661e in_seq=0 out_seq=0 2023-11-28T11:10:50.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3717fa700 1 -- 172.21.15.125:0/897501425 <== mds.0 v2:172.21.15.125:6835/3179120009 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55d1bb981f60 con 0x55d1bbbf4d20 2023-11-28T11:10:50.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3717fa700 10 client.6036 handle_command_reply: tid=0 2023-11-28T11:10:50.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3a4eadb80 1 client.6036 shutdown 2023-11-28T11:10:50.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/897501425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 msgr2=0x55d1bbbe8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbe8bb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff394067450 tx=0x7ff38c004ad0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/897501425 shutdown_connections 2023-11-28T11:10:50.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55d1bbbf4d20 0x55d1bbbccab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbe8bb0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 0x55d1bbbea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3717fa700 0 client.6036 ms_handle_reset on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:50.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/897501425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd5860 0x55d1bbbe8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/897501425 >> 172.21.15.125:0/897501425 conn(0x55d1bbba8db0 msgr2=0x55d1bbbaba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/897501425 shutdown_connections 2023-11-28T11:10:50.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.185+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/897501425 wait complete. 2023-11-28T11:10:50.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.186+0000 7ff3a4eadb80 20 client.6036 trim_cache size 0 max 16384 2023-11-28T11:10:50.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.202+0000 7ff3a4eadb80 1 Processor -- start 2023-11-28T11:10:50.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.202+0000 7ff3a4eadb80 1 -- start start 2023-11-28T11:10:50.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.202+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 0x55d1bbbea130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.202+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd5860 0x55d1bbba7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.202+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.202+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1bbbacd40 con 0x55d1bbbd6170 2023-11-28T11:10:50.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.202+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1bbbd8fc0 con 0x55d1bbbd3180 2023-11-28T11:10:50.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.202+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1bbbf4960 con 0x55d1bbbd5860 2023-11-28T11:10:50.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.202+0000 7ff392d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.202+0000 7ff392d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60584/0 (socket says 172.21.15.125:60584) 2023-11-28T11:10:50.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.202+0000 7ff392d9d700 1 -- 172.21.15.125:0/2305423814 learned_addr learned my addr 172.21.15.125:0/2305423814 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:50.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff392d9d700 1 -- 172.21.15.125:0/2305423814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd5860 msgr2=0x55d1bbba7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff392d9d700 1 --2- 172.21.15.125:0/2305423814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd5860 0x55d1bbba7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff392d9d700 1 -- 172.21.15.125:0/2305423814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 msgr2=0x55d1bbbea130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff392d9d700 1 --2- 172.21.15.125:0/2305423814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 0x55d1bbbea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff392d9d700 1 -- 172.21.15.125:0/2305423814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1bbac4190 con 0x55d1bbbd6170 2023-11-28T11:10:50.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff392d9d700 1 --2- 172.21.15.125:0/2305423814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbccab0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00d010 tx=0x7ff38c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe226ed294add8cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff380ff9700 1 -- 172.21.15.125:0/2305423814 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00b730 con 0x55d1bbbd6170 2023-11-28T11:10:50.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff380ff9700 1 -- 172.21.15.125:0/2305423814 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c004800 con 0x55d1bbbd6170 2023-11-28T11:10:50.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff380ff9700 1 -- 172.21.15.125:0/2305423814 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c012d60 con 0x55d1bbbd6170 2023-11-28T11:10:50.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/2305423814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 msgr2=0x55d1bbbccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/2305423814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbccab0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00d010 tx=0x7ff38c01f000 comp rx=0 tx=0).stop 2023-11-28T11:10:50.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/2305423814 shutdown_connections 2023-11-28T11:10:50.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/2305423814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd6170 0x55d1bbbccab0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/2305423814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 0x55d1bbbea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.203+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/2305423814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd5860 0x55d1bbba7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.204+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/2305423814 >> 172.21.15.125:0/2305423814 conn(0x55d1bbba8db0 msgr2=0x55d1bbba7150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.204+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/2305423814 shutdown_connections 2023-11-28T11:10:50.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.204+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/2305423814 wait complete. 2023-11-28T11:10:50.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.204+0000 7ff3a4eadb80 1 -- start start 2023-11-28T11:10:50.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.204+0000 7ff3a4eadb80 1 Processor -- start 2023-11-28T11:10:50.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 0x55d1bbc58e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd5860 0x55d1bbbaab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff3a4eadb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd6170 0x55d1bbbab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1bbc10280 con 0x55d1bbbd5860 2023-11-28T11:10:50.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1bbba9590 con 0x55d1bbbd3180 2023-11-28T11:10:50.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff3a4eadb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1bbbe7e00 con 0x55d1bbbd6170 2023-11-28T11:10:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff3a4eadb80 10 client.0 _ll_register_callbacks cb 0x55d1bb9a3290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:10:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff391d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd5860 0x55d1bbbaab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff391d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd5860 0x55d1bbbaab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60588/0 (socket says 172.21.15.125:60588) 2023-11-28T11:10:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff391d9b700 1 -- 172.21.15.125:0/991952355 learned_addr learned my addr 172.21.15.125:0/991952355 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:10:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff392d9d700 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd6170 0x55d1bbbab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff39259c700 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 0x55d1bbc58e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff391d9b700 1 -- 172.21.15.125:0/991952355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd6170 msgr2=0x55d1bbbab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff391d9b700 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd6170 0x55d1bbbab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff391d9b700 1 -- 172.21.15.125:0/991952355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 msgr2=0x55d1bbc58e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:10:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff391d9b700 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 0x55d1bbc58e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.205+0000 7ff391d9b700 1 -- 172.21.15.125:0/991952355 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1bb92bde0 con 0x55d1bbbd5860 2023-11-28T11:10:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff391d9b700 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd5860 0x55d1bbbaab60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff388009010 tx=0x7ff388001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399bd7bb66720d17 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:10:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3717fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:10:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3717fa700 1 -- 172.21.15.125:0/991952355 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388007450 con 0x55d1bbbd5860 2023-11-28T11:10:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3717fa700 1 -- 172.21.15.125:0/991952355 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff3880075b0 con 0x55d1bbbd5860 2023-11-28T11:10:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/991952355 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1bbabb1b0 con 0x55d1bbbd5860 2023-11-28T11:10:50.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3717fa700 1 -- 172.21.15.125:0/991952355 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff388007770 con 0x55d1bbbd5860 2023-11-28T11:10:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3a4eadb80 10 client.6042 fetch_fsmap learned FSMap version 23 2023-11-28T11:10:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/991952355 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55d1bb952250 con 0x55d1bbbd5860 2023-11-28T11:10:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3717fa700 1 -- 172.21.15.125:0/991952355 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1bbabb1b0 con 0x55d1bbbd5860 2023-11-28T11:10:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3717fa700 1 -- 172.21.15.125:0/991952355 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 3106+0+0 (secure 0 0 0) 0x7ff388030060 con 0x55d1bbbd5860 2023-11-28T11:10:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3a4eadb80 10 client.6042 fetch_fsmap finished waiting for FSMap version 23 2023-11-28T11:10:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3a4eadb80 10 client.6042 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-11-28T11:10:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3a4eadb80 20 client.6042 populate_metadata read hostname 'smithi125' 2023-11-28T11:10:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55d1bbbcbd80 0x55d1bbc0f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:10:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3a4eadb80 4 client.6042 mds_command: new command op to 5775 tid=0[{"prefix": "scrub status"}] 2023-11-28T11:10:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/991952355 --> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d1bbaa51c0 con 0x55d1bbbcbd80 2023-11-28T11:10:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff39259c700 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55d1bbbcbd80 0x55d1bbc0f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:10:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.206+0000 7ff3717fa700 10 client.6042 ms_handle_connect on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff39259c700 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55d1bbbcbd80 0x55d1bbc0f050 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fcd6cd73015da32 server_cookie=8609e9eb519333f6 in_seq=0 out_seq=0 2023-11-28T11:10:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3717fa700 1 -- 172.21.15.125:0/991952355 <== mds.0 v2:172.21.15.125:6835/3179120009 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x55d1bbaa51c0 con 0x55d1bbbcbd80 2023-11-28T11:10:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3717fa700 10 client.6042 handle_command_reply: tid=0 2023-11-28T11:10:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 1 client.6042 shutdown 2023-11-28T11:10:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/991952355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd5860 msgr2=0x55d1bbbaab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd5860 0x55d1bbbaab60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff388009010 tx=0x7ff388001120 comp rx=0 tx=0).stop 2023-11-28T11:10:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/991952355 shutdown_connections 2023-11-28T11:10:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d1bbbd6170 0x55d1bbbab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1bbbd3180 0x55d1bbc58e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x55d1bbbcbd80 0x55d1bbc0f050 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 1 --2- 172.21.15.125:0/991952355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d1bbbd5860 0x55d1bbbaab60 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3717fa700 0 client.6042 ms_handle_reset on v2:172.21.15.125:6835/3179120009 2023-11-28T11:10:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/991952355 >> 172.21.15.125:0/991952355 conn(0x55d1bbba8db0 msgr2=0x55d1bbbccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/991952355 shutdown_connections 2023-11-28T11:10:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 1 -- 172.21.15.125:0/991952355 wait complete. 2023-11-28T11:10:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.207+0000 7ff3a4eadb80 20 client.6042 trim_cache size 0 max 16384 2023-11-28T11:10:50.228 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:10:50.228 INFO:teuthology.orchestra.run.smithi125.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-28T11:10:50.228 INFO:teuthology.orchestra.run.smithi125.stdout: "scrubs": { 2023-11-28T11:10:50.229 INFO:teuthology.orchestra.run.smithi125.stdout: "cbb20dfe-0531-4a05-9a3e-66e70d36b68b": { 2023-11-28T11:10:50.229 INFO:teuthology.orchestra.run.smithi125.stdout: "path": "/", 2023-11-28T11:10:50.229 INFO:teuthology.orchestra.run.smithi125.stdout: "tag": "cbb20dfe-0531-4a05-9a3e-66e70d36b68b", 2023-11-28T11:10:50.229 INFO:teuthology.orchestra.run.smithi125.stdout: "options": "recursive,repair" 2023-11-28T11:10:50.229 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:50.229 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:10:50.230 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:10:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 -- 172.21.15.125:0/3883630048 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3740682f0 msgr2=0x7ff37406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3740682f0 0x7ff37406a7a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff3940adf00 tx=0x7ff388009040 comp rx=0 tx=0).stop 2023-11-28T11:10:50.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 -- 172.21.15.125:0/3883630048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39406a980 msgr2=0x7ff39414bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:10:50.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39406a980 0x7ff39414bb00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c520 tx=0x7ff38400c8e0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 -- 172.21.15.125:0/3883630048 shutdown_connections 2023-11-28T11:10:50.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff3740682f0 0x7ff37406a7a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3940cf710 0x7ff3941f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff39406a980 0x7ff39414bb00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 --2- 172.21.15.125:0/3883630048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff394071890 0x7ff39414d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:10:50.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 -- 172.21.15.125:0/3883630048 >> 172.21.15.125:0/3883630048 conn(0x7ff39406c010 msgr2=0x7ff3940ac8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:10:50.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 -- 172.21.15.125:0/3883630048 shutdown_connections 2023-11-28T11:10:50.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.208+0000 7ff398d24700 1 -- 172.21.15.125:0/3883630048 wait complete. 2023-11-28T11:10:50.235 INFO:tasks.cephfs.filesystem:scrub status for tag:cbb20dfe-0531-4a05-9a3e-66e70d36b68b - {'path': '/', 'tag': 'cbb20dfe-0531-4a05-9a3e-66e70d36b68b', 'options': 'recursive,repair'} 2023-11-28T11:10:50.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:50.933+0000 7fb82f7fe700 1 -- 172.21.15.125:0/2360541045 <== mon.0 v2:172.21.15.125:3300/0 7 ==== log(6 entries from seq 1 at 2023-11-28T11:10:50.023294+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7fb838024380 con 0x7fb8480b21e0 2023-11-28T11:10:51.006 INFO:teuthology.orchestra.run.smithi125.stdout: cluster: 2023-11-28T11:10:51.006 INFO:teuthology.orchestra.run.smithi125.stdout: id: 1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea 2023-11-28T11:10:51.006 INFO:teuthology.orchestra.run.smithi125.stdout: health: HEALTH_OK 2023-11-28T11:10:51.006 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:51.006 INFO:teuthology.orchestra.run.smithi125.stdout: services: 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: mgr: y(active, since 2m), standbys: x 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: mds: 1/1 daemons up, 3 standby 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: data: 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: volumes: 1/1 healthy 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: pools: 4 pools, 105 pgs 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: objects: 26 objects, 586 KiB 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: usage: 73 MiB used, 720 GiB / 720 GiB avail 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: pgs: 105 active+clean 2023-11-28T11:10:51.007 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:51.008 INFO:teuthology.orchestra.run.smithi125.stdout: io: 2023-11-28T11:10:51.008 INFO:teuthology.orchestra.run.smithi125.stdout: client: 2.5 KiB/s wr, 0 op/s rd, 5 op/s wr 2023-11-28T11:10:51.008 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:51.008 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:10:51.008 INFO:teuthology.orchestra.run.smithi125.stdout:2023-11-28T11:10:50.023294+0000 mds.a [INF] scrub queued for path: / 2023-11-28T11:10:51.008 INFO:teuthology.orchestra.run.smithi125.stdout:2023-11-28T11:10:50.023298+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2023-11-28T11:10:51.008 INFO:teuthology.orchestra.run.smithi125.stdout:2023-11-28T11:10:50.023303+0000 mds.a [INF] scrub summary: active paths [/] 2023-11-28T11:10:51.008 INFO:teuthology.orchestra.run.smithi125.stdout:2023-11-28T11:10:50.024083+0000 mds.a [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2023-11-28T11:10:51.008 INFO:teuthology.orchestra.run.smithi125.stdout:2023-11-28T11:10:50.024094+0000 mds.a [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2023-11-28T11:10:51.008 INFO:teuthology.orchestra.run.smithi125.stdout:2023-11-28T11:10:50.024500+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2023-11-28T11:10:51.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:10:51.937+0000 7fb82f7fe700 1 -- 172.21.15.125:0/2360541045 <== mon.0 v2:172.21.15.125:3300/0 8 ==== log(1 entries from seq 7 at 2023-11-28T11:10:51.151570+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7fb83805f9b0 con 0x7fb8480b21e0 2023-11-28T11:10:51.937 INFO:teuthology.orchestra.run.smithi125.stdout:2023-11-28T11:10:51.151570+0000 mds.a [INF] scrub summary: idle 2023-11-28T11:11:02.891 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:11:02.894 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:11:18.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:18.978+0000 7fb82f7fe700 1 -- 172.21.15.125:0/2360541045 <== mon.0 v2:172.21.15.125:3300/0 9 ==== log(2 entries from seq 566 at 2023-11-28T11:11:18.974406+0000) v1 ==== 597+0+0 (secure 0 0 0) 0x7fb838055a60 con 0x7fb8480b21e0 2023-11-28T11:11:19.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:19.987+0000 7fb82f7fe700 1 -- 172.21.15.125:0/2360541045 <== mon.0 v2:172.21.15.125:3300/0 10 ==== log(2 entries from seq 568 at 2023-11-28T11:11:18.984799+0000) v1 ==== 601+0+0 (secure 0 0 0) 0x7fb838055cc0 con 0x7fb8480b21e0 2023-11-28T11:11:20.236 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-11-28T11:11:20.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.377+0000 7f6474881700 1 Processor -- start 2023-11-28T11:11:20.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.377+0000 7f6474881700 1 -- start start 2023-11-28T11:11:20.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.378+0000 7f6474881700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f647015c810 0x7f6470160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.378+0000 7f6474881700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f647006a270 0x7f647006a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.378+0000 7f6474881700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647006ac10 con 0x7f64700718e0 2023-11-28T11:11:20.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.378+0000 7f6474881700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647015cbe0 con 0x7f647006a270 2023-11-28T11:11:20.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.378+0000 7f6474881700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64701607a0 con 0x7f647015c810 2023-11-28T11:11:20.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f647006a270 0x7f647006a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f647006a270 0x7f647006a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60594/0 (socket says 172.21.15.125:60594) 2023-11-28T11:11:20.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646ed9d700 1 -- 172.21.15.125:0/1734119862 learned_addr learned my addr 172.21.15.125:0/1734119862 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:20.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646e59c700 1 --2- 172.21.15.125:0/1734119862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f647015c810 0x7f6470160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646ed9d700 1 -- 172.21.15.125:0/1734119862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f647015c810 msgr2=0x7f6470160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:20.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646ed9d700 1 --2- 172.21.15.125:0/1734119862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f647015c810 0x7f6470160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646ed9d700 1 -- 172.21.15.125:0/1734119862 >> v1:172.21.15.167:6789/0 conn(0x7f64700718e0 legacy=0x7f647006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:20.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646ed9d700 1 -- 172.21.15.125:0/1734119862 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6470160a50 con 0x7f647006a270 2023-11-28T11:11:20.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646e59c700 1 --2- 172.21.15.125:0/1734119862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f647015c810 0x7f6470160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:20.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646ed9d700 1 --2- 172.21.15.125:0/1734119862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f647006a270 0x7f647006a6d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6468009e50 tx=0x7f646800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f9018c05c7de51 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:20.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646d59a700 1 -- 172.21.15.125:0/1734119862 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800e070 con 0x7f647006a270 2023-11-28T11:11:20.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646d59a700 1 -- 172.21.15.125:0/1734119862 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6468003a20 con 0x7f647006a270 2023-11-28T11:11:20.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.379+0000 7f646d59a700 1 -- 172.21.15.125:0/1734119862 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468003dd0 con 0x7f647006a270 2023-11-28T11:11:20.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.380+0000 7f6474881700 1 -- 172.21.15.125:0/1734119862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f647006a270 msgr2=0x7f647006a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.380+0000 7f6474881700 1 --2- 172.21.15.125:0/1734119862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f647006a270 0x7f647006a6d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6468009e50 tx=0x7f646800b330 comp rx=0 tx=0).stop 2023-11-28T11:11:20.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.380+0000 7f6474881700 1 -- 172.21.15.125:0/1734119862 shutdown_connections 2023-11-28T11:11:20.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.380+0000 7f6474881700 1 --2- 172.21.15.125:0/1734119862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f647006a270 0x7f647006a6d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.380+0000 7f6474881700 1 --2- 172.21.15.125:0/1734119862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f647015c810 0x7f6470160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.380+0000 7f6474881700 1 -- 172.21.15.125:0/1734119862 >> 172.21.15.125:0/1734119862 conn(0x7f647006c010 msgr2=0x7f64700cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:20.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.380+0000 7f6474881700 1 -- 172.21.15.125:0/1734119862 shutdown_connections 2023-11-28T11:11:20.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.380+0000 7f6474881700 1 -- 172.21.15.125:0/1734119862 wait complete. 2023-11-28T11:11:20.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.381+0000 7f6474881700 1 Processor -- start 2023-11-28T11:11:20.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.381+0000 7f6474881700 1 -- start start 2023-11-28T11:11:20.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.382+0000 7f6474881700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f647006a270 0x7f647014e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.382+0000 7f6474881700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64700718e0 0x7f64700af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.382+0000 7f6474881700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647015c810 0x7f6470156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.382+0000 7f6474881700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64700af170 con 0x7f64700718e0 2023-11-28T11:11:20.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.382+0000 7f6474881700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6470157890 con 0x7f647015c810 2023-11-28T11:11:20.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.382+0000 7f6474881700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64701572d0 con 0x7f647006a270 2023-11-28T11:11:20.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.382+0000 7f646dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64700718e0 0x7f64700af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.382+0000 7f646dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64700718e0 0x7f64700af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60600/0 (socket says 172.21.15.125:60600) 2023-11-28T11:11:20.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.382+0000 7f646dd9b700 1 -- 172.21.15.125:0/4062265440 learned_addr learned my addr 172.21.15.125:0/4062265440 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:20.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.382+0000 7f646e59c700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f647006a270 0x7f647014e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.382+0000 7f646ed9d700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647015c810 0x7f6470156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.383+0000 7f646dd9b700 1 -- 172.21.15.125:0/4062265440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f647006a270 msgr2=0x7f647014e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.383+0000 7f646dd9b700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f647006a270 0x7f647014e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.383+0000 7f646dd9b700 1 -- 172.21.15.125:0/4062265440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647015c810 msgr2=0x7f6470156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.383+0000 7f646dd9b700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647015c810 0x7f6470156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.383+0000 7f646dd9b700 1 -- 172.21.15.125:0/4062265440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6468009b30 con 0x7f64700718e0 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.383+0000 7f646dd9b700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64700718e0 0x7f64700af600 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f646400c4d0 tx=0x7f646400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.383+0000 7f645effd700 1 -- 172.21.15.125:0/4062265440 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464011790 con 0x7f64700718e0 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.383+0000 7f645effd700 1 -- 172.21.15.125:0/4062265440 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64640118f0 con 0x7f64700718e0 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.383+0000 7f6474881700 1 -- 172.21.15.125:0/4062265440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6470161010 con 0x7f64700718e0 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.383+0000 7f645effd700 1 -- 172.21.15.125:0/4062265440 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464011ca0 con 0x7f64700718e0 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.383+0000 7f6474881700 1 -- 172.21.15.125:0/4062265440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6470160d30 con 0x7f64700718e0 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.385+0000 7f645effd700 1 -- 172.21.15.125:0/4062265440 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6464010050 con 0x7f64700718e0 2023-11-28T11:11:20.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.385+0000 7f645effd700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64500682f0 0x7f645006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.385+0000 7f645effd700 1 -- 172.21.15.125:0/4062265440 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f64640858e0 con 0x7f64700718e0 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.385+0000 7f646e59c700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64500682f0 0x7f645006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.386+0000 7f646e59c700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64500682f0 0x7f645006a7a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6460006fd0 tx=0x7f6460008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.387+0000 7f6480a0ab80 1 Processor -- start 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.387+0000 7f6480a0ab80 1 -- start start 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 0x558ea9a38a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a62c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 0x558ea9a7e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea9922c10 con 0x558ea9a60180 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea99913a0 con 0x558ea9a63170 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ea998a8d0 con 0x558ea9a62860 2023-11-28T11:11:20.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f646dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a62c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f646dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a62c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60608/0 (socket says 172.21.15.125:60608) 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f646dd9b700 1 -- 172.21.15.125:0/1457331863 learned_addr learned my addr 172.21.15.125:0/1457331863 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f646dd9b700 1 -- 172.21.15.125:0/1457331863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 msgr2=0x558ea9a38a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f646dd9b700 1 --2- 172.21.15.125:0/1457331863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 0x558ea9a38a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f646dd9b700 1 -- 172.21.15.125:0/1457331863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 msgr2=0x558ea9a7e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f646ed9d700 1 --2- 172.21.15.125:0/1457331863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 0x558ea9a7e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f646dd9b700 1 --2- 172.21.15.125:0/1457331863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 0x558ea9a7e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.388+0000 7f646dd9b700 1 -- 172.21.15.125:0/1457331863 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ea980c630 con 0x558ea9a60180 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.389+0000 7f646dd9b700 1 --2- 172.21.15.125:0/1457331863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a62c30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f64640557a0 tx=0x7f64640521b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c926dce78849b03d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.389+0000 7f644ffff700 1 -- 172.21.15.125:0/1457331863 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646405d940 con 0x558ea9a60180 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.389+0000 7f644ffff700 1 -- 172.21.15.125:0/1457331863 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646405daa0 con 0x558ea9a60180 2023-11-28T11:11:20.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.389+0000 7f644ffff700 1 -- 172.21.15.125:0/1457331863 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646405dc10 con 0x558ea9a60180 2023-11-28T11:11:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.389+0000 7f6480a0ab80 1 -- 172.21.15.125:0/1457331863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 msgr2=0x558ea9a62c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.389+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/1457331863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a62c30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f64640557a0 tx=0x7f64640521b0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.389+0000 7f6480a0ab80 1 -- 172.21.15.125:0/1457331863 shutdown_connections 2023-11-28T11:11:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.389+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/1457331863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 0x558ea9a7e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.389+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/1457331863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 0x558ea9a38a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.389+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/1457331863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a62c30 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.389+0000 7f6480a0ab80 1 -- 172.21.15.125:0/1457331863 >> 172.21.15.125:0/1457331863 conn(0x558ea9a35db0 msgr2=0x558ea9a36740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.390+0000 7f6480a0ab80 1 -- 172.21.15.125:0/1457331863 shutdown_connections 2023-11-28T11:11:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.390+0000 7f6480a0ab80 1 -- 172.21.15.125:0/1457331863 wait complete. 2023-11-28T11:11:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.390+0000 7f6480a0ab80 1 -- start start 2023-11-28T11:11:20.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.390+0000 7f6480a0ab80 1 Processor -- start 2023-11-28T11:11:20.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.391+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a60180 0x558ea9a593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.391+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a62860 0x558ea9a80b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.391+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a63170 0x558ea9a810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.391+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea980e920 con 0x558ea9a63170 2023-11-28T11:11:20.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.391+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea9a81d40 con 0x558ea9a62860 2023-11-28T11:11:20.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.391+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ea9a82160 con 0x558ea9a60180 2023-11-28T11:11:20.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.391+0000 7f6480a0ab80 10 client.0 _ll_register_callbacks cb 0x558ea9830290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:11:20.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.391+0000 7f646ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a63170 0x558ea9a810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.391+0000 7f646ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a63170 0x558ea9a810c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60616/0 (socket says 172.21.15.125:60616) 2023-11-28T11:11:20.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.391+0000 7f646ed9d700 1 -- 172.21.15.125:0/3479754707 learned_addr learned my addr 172.21.15.125:0/3479754707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:20.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f646dd9b700 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a62860 0x558ea9a80b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f646e59c700 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a60180 0x558ea9a593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f646ed9d700 1 -- 172.21.15.125:0/3479754707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a60180 msgr2=0x558ea9a593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:20.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f646ed9d700 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a60180 0x558ea9a593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f646ed9d700 1 -- 172.21.15.125:0/3479754707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a62860 msgr2=0x558ea9a80b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:20.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f646ed9d700 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a62860 0x558ea9a80b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f646ed9d700 1 -- 172.21.15.125:0/3479754707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6470160d30 con 0x558ea9a63170 2023-11-28T11:11:20.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f646e59c700 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a60180 0x558ea9a593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:20.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f644d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:11:20.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f646ed9d700 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a63170 0x558ea9a810c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6470067450 tx=0x7f6468004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec1dfa4397d4b42 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:20.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f644d7fa700 1 -- 172.21.15.125:0/3479754707 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468004230 con 0x558ea9a63170 2023-11-28T11:11:20.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f644d7fa700 1 -- 172.21.15.125:0/3479754707 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6468004390 con 0x558ea9a63170 2023-11-28T11:11:20.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3479754707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ea9958190 con 0x558ea9a63170 2023-11-28T11:11:20.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f644d7fa700 1 -- 172.21.15.125:0/3479754707 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6468004550 con 0x558ea9a63170 2023-11-28T11:11:20.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f6480a0ab80 10 client.6054 fetch_fsmap learned FSMap version 23 2023-11-28T11:11:20.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3479754707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x558ea97b8de0 con 0x558ea9a63170 2023-11-28T11:11:20.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f644d7fa700 1 -- 172.21.15.125:0/3479754707 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ea9958190 con 0x558ea9a63170 2023-11-28T11:11:20.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f644d7fa700 1 -- 172.21.15.125:0/3479754707 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f6468012430 con 0x558ea9a63170 2023-11-28T11:11:20.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f6480a0ab80 10 client.6054 fetch_fsmap finished waiting for FSMap version 23 2023-11-28T11:11:20.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f6480a0ab80 10 client.6054 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-11-28T11:11:20.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f6480a0ab80 20 client.6054 populate_metadata read hostname 'smithi125' 2023-11-28T11:11:20.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.392+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x558ea9a76980 0x558ea9a76d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.393+0000 7f6480a0ab80 4 client.6054 mds_command: new command op to 5775 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.393+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3479754707 --> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ea980ef60 con 0x558ea9a76980 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.393+0000 7f646e59c700 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x558ea9a76980 0x558ea9a76d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.393+0000 7f644d7fa700 10 client.6054 ms_handle_connect on v2:172.21.15.125:6835/3179120009 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.393+0000 7f646e59c700 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x558ea9a76980 0x558ea9a76d50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=910df91f1487404b server_cookie=8f521cd5727ff4c5 in_seq=0 out_seq=0 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.393+0000 7f644d7fa700 1 -- 172.21.15.125:0/3479754707 <== mds.0 v2:172.21.15.125:6835/3179120009 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x558ea980ef60 con 0x558ea9a76980 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.393+0000 7f644d7fa700 10 client.6054 handle_command_reply: tid=0 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.393+0000 7f6480a0ab80 1 client.6054 shutdown 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3479754707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a63170 msgr2=0x558ea9a810c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a63170 0x558ea9a810c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6470067450 tx=0x7f6468004b40 comp rx=0 tx=0).stop 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3479754707 shutdown_connections 2023-11-28T11:11:20.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x558ea9a76980 0x558ea9a76d50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a63170 0x558ea9a810c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f644d7fa700 0 client.6054 ms_handle_reset on v2:172.21.15.125:6835/3179120009 2023-11-28T11:11:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a60180 0x558ea9a593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3479754707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a62860 0x558ea9a80b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3479754707 >> 172.21.15.125:0/3479754707 conn(0x558ea9a35db0 msgr2=0x558ea9a389e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3479754707 shutdown_connections 2023-11-28T11:11:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3479754707 wait complete. 2023-11-28T11:11:20.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.394+0000 7f6480a0ab80 20 client.6054 trim_cache size 0 max 16384 2023-11-28T11:11:20.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.410+0000 7f6480a0ab80 1 Processor -- start 2023-11-28T11:11:20.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.411+0000 7f6480a0ab80 1 -- start start 2023-11-28T11:11:20.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.411+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a80bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.411+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 0x558ea9a591b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.411+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 0x558ea9a596f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.411+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea9a624d0 con 0x558ea9a60180 2023-11-28T11:11:20.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.411+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea9a5a3d0 con 0x558ea9a63170 2023-11-28T11:11:20.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.411+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ea9a5b360 con 0x558ea9a62860 2023-11-28T11:11:20.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.411+0000 7f646e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a80bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.411+0000 7f646e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a80bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60620/0 (socket says 172.21.15.125:60620) 2023-11-28T11:11:20.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.411+0000 7f646e59c700 1 -- 172.21.15.125:0/2739335475 learned_addr learned my addr 172.21.15.125:0/2739335475 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:20.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f646e59c700 1 -- 172.21.15.125:0/2739335475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 msgr2=0x558ea9a591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:20.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f646e59c700 1 --2- 172.21.15.125:0/2739335475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 0x558ea9a591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f646e59c700 1 -- 172.21.15.125:0/2739335475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 msgr2=0x558ea9a596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:20.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f646e59c700 1 --2- 172.21.15.125:0/2739335475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 0x558ea9a596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f646e59c700 1 -- 172.21.15.125:0/2739335475 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ea9951190 con 0x558ea9a60180 2023-11-28T11:11:20.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f646e59c700 1 --2- 172.21.15.125:0/2739335475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a80bb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x558ea9a5fc50 tx=0x7f64600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef4d86dfd88a444 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:20.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f645cff9700 1 -- 172.21.15.125:0/2739335475 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460025410 con 0x558ea9a60180 2023-11-28T11:11:20.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f645cff9700 1 -- 172.21.15.125:0/2739335475 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646000c040 con 0x558ea9a60180 2023-11-28T11:11:20.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f645cff9700 1 -- 172.21.15.125:0/2739335475 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460025c50 con 0x558ea9a60180 2023-11-28T11:11:20.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f6480a0ab80 1 -- 172.21.15.125:0/2739335475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 msgr2=0x558ea9a80bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/2739335475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a80bb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x558ea9a5fc50 tx=0x7f64600047c0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.412+0000 7f6480a0ab80 1 -- 172.21.15.125:0/2739335475 shutdown_connections 2023-11-28T11:11:20.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.413+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/2739335475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 0x558ea9a596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.413+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/2739335475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9a80bb0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.413+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/2739335475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 0x558ea9a591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.413+0000 7f6480a0ab80 1 -- 172.21.15.125:0/2739335475 >> 172.21.15.125:0/2739335475 conn(0x558ea9a35db0 msgr2=0x558ea9a76d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:20.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.413+0000 7f6480a0ab80 1 -- 172.21.15.125:0/2739335475 shutdown_connections 2023-11-28T11:11:20.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.413+0000 7f6480a0ab80 1 -- 172.21.15.125:0/2739335475 wait complete. 2023-11-28T11:11:20.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.413+0000 7f6480a0ab80 1 -- start start 2023-11-28T11:11:20.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.413+0000 7f6480a0ab80 1 Processor -- start 2023-11-28T11:11:20.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9ae2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 0x558ea9a96df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f6480a0ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 0x558ea9a591b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea9a743a0 con 0x558ea9a60180 2023-11-28T11:11:20.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea9a31e20 con 0x558ea9a63170 2023-11-28T11:11:20.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f6480a0ab80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ea9ae37b0 con 0x558ea9a62860 2023-11-28T11:11:20.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f6480a0ab80 10 client.0 _ll_register_callbacks cb 0x558ea9830290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:11:20.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f646e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9ae2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f646e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9ae2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60626/0 (socket says 172.21.15.125:60626) 2023-11-28T11:11:20.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f646e59c700 1 -- 172.21.15.125:0/3455698223 learned_addr learned my addr 172.21.15.125:0/3455698223 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:20.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f646ed9d700 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 0x558ea9a591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f646dd9b700 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 0x558ea9a96df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f646e59c700 1 -- 172.21.15.125:0/3455698223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 msgr2=0x558ea9a96df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:20.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f646e59c700 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 0x558ea9a96df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f646e59c700 1 -- 172.21.15.125:0/3455698223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 msgr2=0x558ea9a591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:20.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f646e59c700 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 0x558ea9a591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f646e59c700 1 -- 172.21.15.125:0/3455698223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646001a040 con 0x558ea9a60180 2023-11-28T11:11:20.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f646e59c700 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9ae2ee0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f646000a960 tx=0x7f6468010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0840b2f38003cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:20.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f644d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:11:20.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f644d7fa700 1 -- 172.21.15.125:0/3455698223 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460025e60 con 0x558ea9a60180 2023-11-28T11:11:20.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f644d7fa700 1 -- 172.21.15.125:0/3455698223 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6460034030 con 0x558ea9a60180 2023-11-28T11:11:20.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3455698223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ea99481b0 con 0x558ea9a60180 2023-11-28T11:11:20.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.415+0000 7f644d7fa700 1 -- 172.21.15.125:0/3455698223 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6460005a20 con 0x558ea9a60180 2023-11-28T11:11:20.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.416+0000 7f6480a0ab80 10 client.6060 fetch_fsmap learned FSMap version 23 2023-11-28T11:11:20.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.416+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3455698223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x558ea97df250 con 0x558ea9a60180 2023-11-28T11:11:20.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.416+0000 7f644d7fa700 1 -- 172.21.15.125:0/3455698223 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ea99481b0 con 0x558ea9a60180 2023-11-28T11:11:20.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.416+0000 7f644d7fa700 1 -- 172.21.15.125:0/3455698223 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f6460005b80 con 0x558ea9a60180 2023-11-28T11:11:20.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.416+0000 7f6480a0ab80 10 client.6060 fetch_fsmap finished waiting for FSMap version 23 2023-11-28T11:11:20.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.416+0000 7f6480a0ab80 10 client.6060 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-11-28T11:11:20.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.416+0000 7f6480a0ab80 20 client.6060 populate_metadata read hostname 'smithi125' 2023-11-28T11:11:20.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.416+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x558ea9a596f0 0x558ea9a60ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.416+0000 7f6480a0ab80 4 client.6060 mds_command: new command op to 5775 tid=0[{"prefix": "scrub status"}] 2023-11-28T11:11:20.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.416+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3455698223 --> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558ea99321c0 con 0x558ea9a596f0 2023-11-28T11:11:20.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.416+0000 7f646dd9b700 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x558ea9a596f0 0x558ea9a60ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f644d7fa700 10 client.6060 ms_handle_connect on v2:172.21.15.125:6835/3179120009 2023-11-28T11:11:20.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f646dd9b700 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x558ea9a596f0 0x558ea9a60ff0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49b80ee47ed48dc4 server_cookie=13667e828e5daec6 in_seq=0 out_seq=0 2023-11-28T11:11:20.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f644d7fa700 1 -- 172.21.15.125:0/3455698223 <== mds.0 v2:172.21.15.125:6835/3179120009 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558ea99321c0 con 0x558ea9a596f0 2023-11-28T11:11:20.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f644d7fa700 10 client.6060 handle_command_reply: tid=0 2023-11-28T11:11:20.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 1 client.6060 shutdown 2023-11-28T11:11:20.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3455698223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 msgr2=0x558ea9ae2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9ae2ee0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f646000a960 tx=0x7f6468010000 comp rx=0 tx=0).stop 2023-11-28T11:11:20.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3455698223 shutdown_connections 2023-11-28T11:11:20.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ea9a63170 0x558ea9a591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.125:6835/3179120009,v1:172.21.15.125:6837/3179120009] conn(0x558ea9a596f0 0x558ea9a60ff0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558ea9a60180 0x558ea9ae2ee0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f644d7fa700 0 client.6060 ms_handle_reset on v2:172.21.15.125:6835/3179120009 2023-11-28T11:11:20.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 1 --2- 172.21.15.125:0/3455698223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558ea9a62860 0x558ea9a96df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3455698223 >> 172.21.15.125:0/3455698223 conn(0x558ea9a35db0 msgr2=0x558ea9a851c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:20.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3455698223 shutdown_connections 2023-11-28T11:11:20.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 1 -- 172.21.15.125:0/3455698223 wait complete. 2023-11-28T11:11:20.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.417+0000 7f6480a0ab80 20 client.6060 trim_cache size 0 max 16384 2023-11-28T11:11:20.428 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:11:20.429 INFO:teuthology.orchestra.run.smithi125.stdout: "status": "no active scrubs running", 2023-11-28T11:11:20.429 INFO:teuthology.orchestra.run.smithi125.stdout: "scrubs": {} 2023-11-28T11:11:20.429 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:11:20.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 -- 172.21.15.125:0/4062265440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64500682f0 msgr2=0x7f645006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64500682f0 0x7f645006a7a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6460006fd0 tx=0x7f6460008040 comp rx=0 tx=0).stop 2023-11-28T11:11:20.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 -- 172.21.15.125:0/4062265440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64700718e0 msgr2=0x7f64700af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64700718e0 0x7f64700af600 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f646400c4d0 tx=0x7f646400c7e0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 -- 172.21.15.125:0/4062265440 shutdown_connections 2023-11-28T11:11:20.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f647015c810 0x7f6470156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64500682f0 0x7f645006a7a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f647006a270 0x7f647014e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 --2- 172.21.15.125:0/4062265440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64700718e0 0x7f64700af600 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 -- 172.21.15.125:0/4062265440 >> 172.21.15.125:0/4062265440 conn(0x7f647006c010 msgr2=0x7f64700cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:20.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 -- 172.21.15.125:0/4062265440 shutdown_connections 2023-11-28T11:11:20.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.418+0000 7f6474881700 1 -- 172.21.15.125:0/4062265440 wait complete. 2023-11-28T11:11:20.432 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-28T11:11:20.534 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:11:20.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.654+0000 7f212cb4d700 1 Processor -- start 2023-11-28T11:11:20.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.655+0000 7f212cb4d700 1 -- start start 2023-11-28T11:11:20.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.655+0000 7f212cb4d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212815cc80 0x7f212806de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.655+0000 7f212cb4d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280b1810 con 0x7f212806a270 2023-11-28T11:11:20.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.655+0000 7f212cb4d700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280b1af0 con 0x7f212806e3a0 2023-11-28T11:11:20.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.655+0000 7f212cb4d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21280b2490 con 0x7f212815cc80 2023-11-28T11:11:20.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f212659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f212806a270 0x7f212806a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44758/0 (socket says 172.21.15.125:44758) 2023-11-28T11:11:20.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f212659c700 1 -- 172.21.15.125:0/1459567083 learned_addr learned my addr 172.21.15.125:0/1459567083 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:20.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f2125d9b700 1 --2- 172.21.15.125:0/1459567083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212815cc80 0x7f212806de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f212559a700 1 -- 172.21.15.125:0/1459567083 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919757503 0 0) 0x7f21280b1810 con 0x7f212806a270 2023-11-28T11:11:20.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f212559a700 1 -- 172.21.15.125:0/1459567083 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21100035b0 con 0x7f212806a270 2023-11-28T11:11:20.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f2125d9b700 1 -- 172.21.15.125:0/1459567083 >> v1:172.21.15.167:6789/0 conn(0x7f212806e3a0 legacy=0x7f2128070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f2125d9b700 1 -- 172.21.15.125:0/1459567083 >> v1:172.21.15.125:6789/0 conn(0x7f212806a270 legacy=0x7f212806a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f2125d9b700 1 -- 172.21.15.125:0/1459567083 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280b1dd0 con 0x7f212815cc80 2023-11-28T11:11:20.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f2125d9b700 1 --2- 172.21.15.125:0/1459567083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212815cc80 0x7f212806de60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2118009870 tx=0x7f2118009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b8ab3952ffe2a17 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:20.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f212559a700 1 -- 172.21.15.125:0/1459567083 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118011830 con 0x7f212815cc80 2023-11-28T11:11:20.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f212559a700 1 -- 172.21.15.125:0/1459567083 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118011990 con 0x7f212815cc80 2023-11-28T11:11:20.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.656+0000 7f212559a700 1 -- 172.21.15.125:0/1459567083 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118011d20 con 0x7f212815cc80 2023-11-28T11:11:20.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.657+0000 7f212cb4d700 1 -- 172.21.15.125:0/1459567083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212815cc80 msgr2=0x7f212806de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.657+0000 7f212cb4d700 1 --2- 172.21.15.125:0/1459567083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212815cc80 0x7f212806de60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2118009870 tx=0x7f2118009b80 comp rx=0 tx=0).stop 2023-11-28T11:11:20.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.657+0000 7f212cb4d700 1 -- 172.21.15.125:0/1459567083 shutdown_connections 2023-11-28T11:11:20.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.657+0000 7f212cb4d700 1 --2- 172.21.15.125:0/1459567083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212815cc80 0x7f212806de60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.657+0000 7f212cb4d700 1 -- 172.21.15.125:0/1459567083 >> 172.21.15.125:0/1459567083 conn(0x7f212806c010 msgr2=0x7f21280cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:20.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.657+0000 7f212cb4d700 1 -- 172.21.15.125:0/1459567083 shutdown_connections 2023-11-28T11:11:20.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.657+0000 7f212cb4d700 1 -- 172.21.15.125:0/1459567083 wait complete. 2023-11-28T11:11:20.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.658+0000 7f212cb4d700 1 Processor -- start 2023-11-28T11:11:20.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.658+0000 7f212cb4d700 1 -- start start 2023-11-28T11:11:20.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212cb4d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f212806a270 0x7f21280b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212cb4d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212806e3a0 0x7f2128152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212cb4d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212815cc80 0x7f21280cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212cb4d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280af290 con 0x7f212806a270 2023-11-28T11:11:20.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212cb4d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c6dc0 con 0x7f212815cc80 2023-11-28T11:11:20.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212cb4d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2128152cb0 con 0x7f212806e3a0 2023-11-28T11:11:20.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f212806a270 0x7f21280b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f212806a270 0x7f21280b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60640/0 (socket says 172.21.15.125:60640) 2023-11-28T11:11:20.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212659c700 1 -- 172.21.15.125:0/3755227002 learned_addr learned my addr 172.21.15.125:0/3755227002 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:20.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212659c700 1 -- 172.21.15.125:0/3755227002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212806e3a0 msgr2=0x7f2128152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212659c700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212806e3a0 0x7f2128152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212659c700 1 -- 172.21.15.125:0/3755227002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212815cc80 msgr2=0x7f21280cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.659+0000 7f212659c700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212815cc80 0x7f21280cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.660+0000 7f212659c700 1 -- 172.21.15.125:0/3755227002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21180094a0 con 0x7f212806a270 2023-11-28T11:11:20.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.660+0000 7f212659c700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f212806a270 0x7f21280b1170 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f211c001eb0 tx=0x7f211c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:20.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.660+0000 7f2116ffd700 1 -- 172.21.15.125:0/3755227002 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c005d70 con 0x7f212806a270 2023-11-28T11:11:20.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.660+0000 7f2116ffd700 1 -- 172.21.15.125:0/3755227002 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c0070d0 con 0x7f212806a270 2023-11-28T11:11:20.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.660+0000 7f212cb4d700 1 -- 172.21.15.125:0/3755227002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212806e7e0 con 0x7f212806a270 2023-11-28T11:11:20.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.660+0000 7f2116ffd700 1 -- 172.21.15.125:0/3755227002 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c007460 con 0x7f212806a270 2023-11-28T11:11:20.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.660+0000 7f212cb4d700 1 -- 172.21.15.125:0/3755227002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21280b20b0 con 0x7f212806a270 2023-11-28T11:11:20.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.661+0000 7f212cb4d700 1 -- 172.21.15.125:0/3755227002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212815daa0 con 0x7f212806a270 2023-11-28T11:11:20.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.661+0000 7f2116ffd700 1 -- 172.21.15.125:0/3755227002 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f211c019030 con 0x7f212806a270 2023-11-28T11:11:20.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.661+0000 7f2116ffd700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21080682f0 0x7f210806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:20.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.662+0000 7f2125d9b700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21080682f0 0x7f210806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:20.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.662+0000 7f2116ffd700 1 -- 172.21.15.125:0/3755227002 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f211c0850a0 con 0x7f212806a270 2023-11-28T11:11:20.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.662+0000 7f2125d9b700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21080682f0 0x7f210806a7a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f21280c9e00 tx=0x7f2118010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:20.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.666+0000 7f2116ffd700 1 -- 172.21.15.125:0/3755227002 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f211c0518c0 con 0x7f212806a270 2023-11-28T11:11:20.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.891+0000 7f212cb4d700 1 -- 172.21.15.125:0/3755227002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21280743f0 con 0x7f212806a270 2023-11-28T11:11:20.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.891+0000 7f2116ffd700 1 -- 172.21.15.125:0/3755227002 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f211c054ee0 con 0x7f212806a270 2023-11-28T11:11:20.893 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:20.893 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/991177251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":991177251},{"type":"v1","addr":"172.21.15.167:6834","nonce":991177251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/289069328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":289069328},{"type":"v1","addr":"172.21.15.167:6835","nonce":289069328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3275492587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3275492587},{"type":"v1","addr":"172.21.15.125:6836","nonce":3275492587}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:10:36.508959+0000","modified":"2023-11-28T11:10:39.516894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5775":{"gid":5775,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3179120009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":3179120009},{"type":"v1","addr":"172.21.15.125:6837","nonce":3179120009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:11:20.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.893+0000 7f212cb4d700 1 -- 172.21.15.125:0/3755227002 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21080682f0 msgr2=0x7f210806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.893+0000 7f212cb4d700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21080682f0 0x7f210806a7a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f21280c9e00 tx=0x7f2118010000 comp rx=0 tx=0).stop 2023-11-28T11:11:20.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.893+0000 7f212cb4d700 1 -- 172.21.15.125:0/3755227002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f212806a270 msgr2=0x7f21280b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:20.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.893+0000 7f212cb4d700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f212806a270 0x7f21280b1170 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f211c001eb0 tx=0x7f211c00c860 comp rx=0 tx=0).stop 2023-11-28T11:11:20.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.893+0000 7f212cb4d700 1 -- 172.21.15.125:0/3755227002 shutdown_connections 2023-11-28T11:11:20.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.893+0000 7f212cb4d700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212815cc80 0x7f21280cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.893+0000 7f212cb4d700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f212806a270 0x7f21280b1170 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.893+0000 7f212cb4d700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21080682f0 0x7f210806a7a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.893+0000 7f212cb4d700 1 --2- 172.21.15.125:0/3755227002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212806e3a0 0x7f2128152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:20.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.893+0000 7f212cb4d700 1 -- 172.21.15.125:0/3755227002 >> 172.21.15.125:0/3755227002 conn(0x7f212806c010 msgr2=0x7f21280cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:20.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.894+0000 7f212cb4d700 1 -- 172.21.15.125:0/3755227002 shutdown_connections 2023-11-28T11:11:20.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:20.894+0000 7f212cb4d700 1 -- 172.21.15.125:0/3755227002 wait complete. 2023-11-28T11:11:20.900 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 23 2023-11-28T11:11:20.907 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-28T11:11:21.055 INFO:teuthology.orchestra.run.smithi125.stdout:{"message":"","return_code":0} 2023-11-28T11:11:21.056 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:11:21.056 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T11:11:21.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.098+0000 7f18140e6080 1 Processor -- start 2023-11-28T11:11:21.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.098+0000 7f18140e6080 1 -- start start 2023-11-28T11:11:21.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.098+0000 7f18140e6080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55be22a037a0 0x55be22a2c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.098+0000 7f18140e6080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 0x55be22ad22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.098+0000 7f18140e6080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be22ad9430 0x55be22a2cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.098+0000 7f18140e6080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2293bfe0 con 0x55be22a4a7b0 2023-11-28T11:11:21.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.098+0000 7f18140e6080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be22ad2bd0 con 0x55be22ad9430 2023-11-28T11:11:21.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.098+0000 7f18140e6080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be22ad6a90 con 0x55be22a037a0 2023-11-28T11:11:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.098+0000 7f18099e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 0x55be22ad22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18099e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 0x55be22ad22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60658/0 (socket says 172.21.15.125:60658) 2023-11-28T11:11:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18099e8700 1 -- 172.21.15.125:0/1928687018 learned_addr learned my addr 172.21.15.125:0/1928687018 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f180a9ea700 1 --2- 172.21.15.125:0/1928687018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be22ad9430 0x55be22a2cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f180a1e9700 1 --2- 172.21.15.125:0/1928687018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55be22a037a0 0x55be22a2c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18099e8700 1 -- 172.21.15.125:0/1928687018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55be22a037a0 msgr2=0x55be22a2c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18099e8700 1 --2- 172.21.15.125:0/1928687018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55be22a037a0 0x55be22a2c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18099e8700 1 -- 172.21.15.125:0/1928687018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be22ad9430 msgr2=0x55be22a2cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18099e8700 1 --2- 172.21.15.125:0/1928687018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be22ad9430 0x55be22a2cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18099e8700 1 -- 172.21.15.125:0/1928687018 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180400a1c0 con 0x55be22a4a7b0 2023-11-28T11:11:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18099e8700 1 --2- 172.21.15.125:0/1928687018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 0x55be22ad22a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1800001d50 tx=0x7f180000b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd736fcd55ac50a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18089e6700 1 -- 172.21.15.125:0/1928687018 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800014070 con 0x55be22a4a7b0 2023-11-28T11:11:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18089e6700 1 -- 172.21.15.125:0/1928687018 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1800008030 con 0x55be22a4a7b0 2023-11-28T11:11:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18089e6700 1 -- 172.21.15.125:0/1928687018 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800001ea0 con 0x55be22a4a7b0 2023-11-28T11:11:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18140e6080 1 -- 172.21.15.125:0/1928687018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 msgr2=0x55be22ad22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18140e6080 1 --2- 172.21.15.125:0/1928687018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 0x55be22ad22a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1800001d50 tx=0x7f180000b4c0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18140e6080 1 -- 172.21.15.125:0/1928687018 shutdown_connections 2023-11-28T11:11:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18140e6080 1 --2- 172.21.15.125:0/1928687018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be22ad9430 0x55be22a2cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18140e6080 1 --2- 172.21.15.125:0/1928687018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55be22a037a0 0x55be22a2c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18140e6080 1 --2- 172.21.15.125:0/1928687018 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 0x55be22ad22a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.099+0000 7f18140e6080 1 -- 172.21.15.125:0/1928687018 >> 172.21.15.125:0/1928687018 conn(0x55be22a2daf0 msgr2=0x55be22ad83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.100+0000 7f18140e6080 1 -- 172.21.15.125:0/1928687018 shutdown_connections 2023-11-28T11:11:21.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.100+0000 7f18140e6080 1 -- 172.21.15.125:0/1928687018 wait complete. 2023-11-28T11:11:21.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.100+0000 7f18140e6080 1 Processor -- start 2023-11-28T11:11:21.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.100+0000 7f18140e6080 1 -- start start 2023-11-28T11:11:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.101+0000 7f18140e6080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55be22a037a0 0x55be22ad7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.101+0000 7f18140e6080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 0x55be22ace920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.101+0000 7f18140e6080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be22ad9430 0x55be22acee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.101+0000 7f18140e6080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be22a2e0f0 con 0x55be22a4a7b0 2023-11-28T11:11:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.101+0000 7f18140e6080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be22a27860 con 0x55be22ad9430 2023-11-28T11:11:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.101+0000 7f18140e6080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be22ad49c0 con 0x55be22a037a0 2023-11-28T11:11:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.101+0000 7f18099e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 0x55be22ace920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.101+0000 7f18099e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 0x55be22ace920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60662/0 (socket says 172.21.15.125:60662) 2023-11-28T11:11:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.101+0000 7f18099e8700 1 -- 172.21.15.125:0/2824344761 learned_addr learned my addr 172.21.15.125:0/2824344761 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.101+0000 7f180a1e9700 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55be22a037a0 0x55be22ad7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.101+0000 7f180a9ea700 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be22ad9430 0x55be22acee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f18099e8700 1 -- 172.21.15.125:0/2824344761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55be22a037a0 msgr2=0x55be22ad7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f18099e8700 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55be22a037a0 0x55be22ad7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f18099e8700 1 -- 172.21.15.125:0/2824344761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be22ad9430 msgr2=0x55be22acee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f18099e8700 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be22ad9430 0x55be22acee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f18099e8700 1 -- 172.21.15.125:0/2824344761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180000a040 con 0x55be22a4a7b0 2023-11-28T11:11:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f180a9ea700 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55be22ad9430 0x55be22acee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f18099e8700 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 0x55be22ace920 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f180000b500 tx=0x7f1800000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f17fb7fe700 1 -- 172.21.15.125:0/2824344761 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800014040 con 0x55be22a4a7b0 2023-11-28T11:11:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f17fb7fe700 1 -- 172.21.15.125:0/2824344761 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180000fb20 con 0x55be22a4a7b0 2023-11-28T11:11:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f18140e6080 1 -- 172.21.15.125:0/2824344761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be22954120 con 0x55be22a4a7b0 2023-11-28T11:11:21.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f17fb7fe700 1 -- 172.21.15.125:0/2824344761 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800001ea0 con 0x55be22a4a7b0 2023-11-28T11:11:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.102+0000 7f18140e6080 1 -- 172.21.15.125:0/2824344761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be22947830 con 0x55be22a4a7b0 2023-11-28T11:11:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.103+0000 7f17fb7fe700 1 -- 172.21.15.125:0/2824344761 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f180001b430 con 0x55be22a4a7b0 2023-11-28T11:11:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.104+0000 7f17fb7fe700 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f17ec066c10 0x7f17ec0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.104+0000 7f17fb7fe700 1 -- 172.21.15.125:0/2824344761 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1800085c30 con 0x55be22a4a7b0 2023-11-28T11:11:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.104+0000 7f180a1e9700 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f17ec066c10 0x7f17ec0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.104+0000 7f18140e6080 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x55be22ad7a80 0x55be22a29a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.104+0000 7f18140e6080 1 -- 172.21.15.125:0/2824344761 --> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54) v8 -- 0x55be22ad4f90 con 0x55be22ad7a80 2023-11-28T11:11:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.104+0000 7f180a9ea700 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x55be22ad7a80 0x55be22a29a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.104+0000 7f180a1e9700 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f17ec066c10 0x7f17ec0690c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55be22ad4f60 tx=0x7f17fc005b60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.104+0000 7f180a9ea700 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x55be22ad7a80 0x55be22a29a80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:21.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f180a9ea700 1 -- 172.21.15.125:0/2824344761 <== osd.1 v2:172.21.15.125:6824/103588 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f1804017040 con 0x55be22ad7a80 2023-11-28T11:11:21.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f18140e6080 1 -- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x55be22ad7a80 msgr2=0x55be22a29a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f18140e6080 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x55be22ad7a80 0x55be22a29a80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f18140e6080 1 -- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f17ec066c10 msgr2=0x7f17ec0690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f18140e6080 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f17ec066c10 0x7f17ec0690c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55be22ad4f60 tx=0x7f17fc005b60 comp rx=0 tx=0).stop 2023-11-28T11:11:21.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f18140e6080 1 -- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 msgr2=0x55be22ace920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f18140e6080 1 --2- 172.21.15.125:0/2824344761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55be22a4a7b0 0x55be22ace920 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f180000b500 tx=0x7f1800000bc0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f180a9ea700 1 -- 172.21.15.125:0/2824344761 reap_dead start 2023-11-28T11:11:21.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f18140e6080 1 -- 172.21.15.125:0/2824344761 shutdown_connections 2023-11-28T11:11:21.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f18140e6080 1 -- 172.21.15.125:0/2824344761 >> 172.21.15.125:0/2824344761 conn(0x55be22a2daf0 msgr2=0x55be22a49e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:21.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f18140e6080 1 -- 172.21.15.125:0/2824344761 shutdown_connections 2023-11-28T11:11:21.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.105+0000 7f18140e6080 1 -- 172.21.15.125:0/2824344761 wait complete. 2023-11-28T11:11:21.113 INFO:teuthology.orchestra.run.smithi125.stdout:Yalphaparent_a 2023-11-28T11:11:21.114 DEBUG:teuthology.orchestra.run.smithi125:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T11:11:21.168 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:11:21.169 INFO:teuthology.orchestra.run.smithi125.stdout: "ino": 1099511627777, 2023-11-28T11:11:21.169 INFO:teuthology.orchestra.run.smithi125.stdout: "ancestors": [ 2023-11-28T11:11:21.169 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:21.169 INFO:teuthology.orchestra.run.smithi125.stdout: "dirino": 1099511627776, 2023-11-28T11:11:21.169 INFO:teuthology.orchestra.run.smithi125.stdout: "dname": "alpha", 2023-11-28T11:11:21.169 INFO:teuthology.orchestra.run.smithi125.stdout: "version": 4 2023-11-28T11:11:21.169 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:21.169 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:21.169 INFO:teuthology.orchestra.run.smithi125.stdout: "dirino": 1, 2023-11-28T11:11:21.169 INFO:teuthology.orchestra.run.smithi125.stdout: "dname": "parent_a", 2023-11-28T11:11:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: "version": 7 2023-11-28T11:11:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: ], 2023-11-28T11:11:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: "pool": 8, 2023-11-28T11:11:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: "old_pools": [] 2023-11-28T11:11:21.170 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:11:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:21.171 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:11:21.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:11:21.254 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:11:21.297 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:11:21.298 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:11:21.298 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:11:21.315 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:11:21.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.473+0000 7f0d246a4700 1 Processor -- start 2023-11-28T11:11:21.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.473+0000 7f0d246a4700 1 -- start start 2023-11-28T11:11:21.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.474+0000 7f0d246a4700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0d1c15ea70 0x7f0d1c070f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.474+0000 7f0d246a4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d1c06a270 0x7f0d1c06a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.474+0000 7f0d246a4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1c06ac10 con 0x7f0d1c15a530 2023-11-28T11:11:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.474+0000 7f0d246a4700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1c15eee0 con 0x7f0d1c15ea70 2023-11-28T11:11:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.474+0000 7f0d246a4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c0cb120 con 0x7f0d1c06a270 2023-11-28T11:11:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d22440700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0d1c15a530 0x7f0d1c0cbee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44794/0 (socket says 172.21.15.125:44794) 2023-11-28T11:11:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d22440700 1 -- 172.21.15.125:0/3309049164 learned_addr learned my addr 172.21.15.125:0/3309049164 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217044688 0 0) 0x7f0d1c06ac10 con 0x7f0d1c15a530 2023-11-28T11:11:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d080035b0 con 0x7f0d1c15a530 2023-11-28T11:11:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d22c41700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d1c06a270 0x7f0d1c06a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d21c3f700 1 --2- 172.21.15.125:0/3309049164 >> v2:172.21.15.167:3300/0 conn(0x7f0d1c15ea70 0x7f0d1c070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2817515655 0 0) 0x7f0d080035b0 con 0x7f0d1c15a530 2023-11-28T11:11:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d1c06a270 msgr2=0x7f0d1c06a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d1c06a270 0x7f0d1c06a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 >> v2:172.21.15.167:3300/0 conn(0x7f0d1c15ea70 msgr2=0x7f0d1c070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 --2- 172.21.15.125:0/3309049164 >> v2:172.21.15.167:3300/0 conn(0x7f0d1c15ea70 0x7f0d1c070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c0cb400 con 0x7f0d1c15a530 2023-11-28T11:11:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f0d18001670 con 0x7f0d1c15a530 2023-11-28T11:11:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 >> v1:172.21.15.125:6789/0 conn(0x7f0d1c15a530 legacy=0x7f0d1c0cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08003a00 0x7f0d08003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d1c06a270 0x7f0d08004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d08004d90 0x7f0d08005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c15eee0 con 0x7f0d08004d90 2023-11-28T11:11:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c0cb120 con 0x7f0d08003a00 2023-11-28T11:11:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0800ba10 con 0x7f0d1c06a270 2023-11-28T11:11:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d22c41700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d08004d90 0x7f0d08005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d22440700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08003a00 0x7f0d08003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.475+0000 7f0d21c3f700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d1c06a270 0x7f0d08004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d22c41700 1 -- 172.21.15.125:0/3309049164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d1c06a270 msgr2=0x7f0d08004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d22c41700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d1c06a270 0x7f0d08004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d22c41700 1 -- 172.21.15.125:0/3309049164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08003a00 msgr2=0x7f0d08003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d22c41700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08003a00 0x7f0d08003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d22c41700 1 -- 172.21.15.125:0/3309049164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d080035b0 con 0x7f0d08004d90 2023-11-28T11:11:21.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d22c41700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d08004d90 0x7f0d08005200 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009fc0 tx=0x7f0d08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec18c21b6a7ff2c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:21.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400ec30 con 0x7f0d08004d90 2023-11-28T11:11:21.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1400f040 con 0x7f0d08004d90 2023-11-28T11:11:21.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d2143e700 1 -- 172.21.15.125:0/3309049164 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14014480 con 0x7f0d08004d90 2023-11-28T11:11:21.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d246a4700 1 -- 172.21.15.125:0/3309049164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d08004d90 msgr2=0x7f0d08005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d246a4700 1 --2- 172.21.15.125:0/3309049164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d08004d90 0x7f0d08005200 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009fc0 tx=0x7f0d08005880 comp rx=0 tx=0).stop 2023-11-28T11:11:21.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d22c41700 1 -- 172.21.15.125:0/3309049164 reap_dead start 2023-11-28T11:11:21.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d246a4700 1 -- 172.21.15.125:0/3309049164 shutdown_connections 2023-11-28T11:11:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d246a4700 1 -- 172.21.15.125:0/3309049164 >> 172.21.15.125:0/3309049164 conn(0x7f0d1c06bfd0 msgr2=0x7f0d1c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.476+0000 7f0d246a4700 1 -- 172.21.15.125:0/3309049164 shutdown_connections 2023-11-28T11:11:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.477+0000 7f0d246a4700 1 -- 172.21.15.125:0/3309049164 wait complete. 2023-11-28T11:11:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.478+0000 7f0d246a4700 1 Processor -- start 2023-11-28T11:11:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.478+0000 7f0d246a4700 1 -- start start 2023-11-28T11:11:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d246a4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d08004d90 0x7f0d1c14df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d246a4700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1c0b1270 0x7f0d1c0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d246a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1c154b70 0x7f0d1c154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d246a4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c1e4a50 con 0x7f0d1c154b70 2023-11-28T11:11:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d246a4700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c155520 con 0x7f0d1c0b1270 2023-11-28T11:11:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d246a4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c14ea30 con 0x7f0d08004d90 2023-11-28T11:11:21.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d22c41700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1c154b70 0x7f0d1c154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d22c41700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1c154b70 0x7f0d1c154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60686/0 (socket says 172.21.15.125:60686) 2023-11-28T11:11:21.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d22c41700 1 -- 172.21.15.125:0/455727614 learned_addr learned my addr 172.21.15.125:0/455727614 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:21.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d21c3f700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1c0b1270 0x7f0d1c0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d22440700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d08004d90 0x7f0d1c14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d22c41700 1 -- 172.21.15.125:0/455727614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d08004d90 msgr2=0x7f0d1c14df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d22c41700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d08004d90 0x7f0d1c14df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d22c41700 1 -- 172.21.15.125:0/455727614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1c0b1270 msgr2=0x7f0d1c0b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d22c41700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1c0b1270 0x7f0d1c0b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.479+0000 7f0d22c41700 1 -- 172.21.15.125:0/455727614 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c0cb9c0 con 0x7f0d1c154b70 2023-11-28T11:11:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.480+0000 7f0d22c41700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1c154b70 0x7f0d1c154fe0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0d14017040 tx=0x7f0d14009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.480+0000 7f0d0effd700 1 -- 172.21.15.125:0/455727614 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14007000 con 0x7f0d1c154b70 2023-11-28T11:11:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.480+0000 7f0d0effd700 1 -- 172.21.15.125:0/455727614 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d14003e50 con 0x7f0d1c154b70 2023-11-28T11:11:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.480+0000 7f0d246a4700 1 -- 172.21.15.125:0/455727614 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1c0cb6e0 con 0x7f0d1c154b70 2023-11-28T11:11:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.480+0000 7f0d0effd700 1 -- 172.21.15.125:0/455727614 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14014b50 con 0x7f0d1c154b70 2023-11-28T11:11:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.480+0000 7f0d246a4700 1 -- 172.21.15.125:0/455727614 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1c15a900 con 0x7f0d1c154b70 2023-11-28T11:11:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.481+0000 7f0d246a4700 1 -- 172.21.15.125:0/455727614 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1c1e4b90 con 0x7f0d1c154b70 2023-11-28T11:11:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.481+0000 7f0d0effd700 1 -- 172.21.15.125:0/455727614 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0d1402d070 con 0x7f0d1c154b70 2023-11-28T11:11:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.482+0000 7f0d0effd700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d000682f0 0x7f0d0006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.482+0000 7f0d22440700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d000682f0 0x7f0d0006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.482+0000 7f0d0effd700 1 -- 172.21.15.125:0/455727614 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0d14087450 con 0x7f0d1c154b70 2023-11-28T11:11:21.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.482+0000 7f0d22440700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d000682f0 0x7f0d0006a7a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0d18001050 tx=0x7f0d18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:21.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.486+0000 7f0d0effd700 1 -- 172.21.15.125:0/455727614 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0d1c1e4b90 con 0x7f0d1c154b70 2023-11-28T11:11:21.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.674+0000 7f0d246a4700 1 -- 172.21.15.125:0/455727614 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d1c1e4b90 con 0x7f0d1c154b70 2023-11-28T11:11:21.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.675+0000 7f0d0effd700 1 -- 172.21.15.125:0/455727614 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18066 (secure 0 0 0) 0x7f0d1c1e4b90 con 0x7f0d1c154b70 2023-11-28T11:11:21.677 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:21.677 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":54,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:11:19.983429+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:10:34.306816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T11:10:35.470755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:11:21.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 -- 172.21.15.125:0/455727614 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d000682f0 msgr2=0x7f0d0006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d000682f0 0x7f0d0006a7a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0d18001050 tx=0x7f0d18009040 comp rx=0 tx=0).stop 2023-11-28T11:11:21.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 -- 172.21.15.125:0/455727614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1c154b70 msgr2=0x7f0d1c154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1c154b70 0x7f0d1c154fe0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0d14017040 tx=0x7f0d14009750 comp rx=0 tx=0).stop 2023-11-28T11:11:21.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 -- 172.21.15.125:0/455727614 shutdown_connections 2023-11-28T11:11:21.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1c154b70 0x7f0d1c154fe0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0d000682f0 0x7f0d0006a7a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d08004d90 0x7f0d1c14df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 --2- 172.21.15.125:0/455727614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1c0b1270 0x7f0d1c0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 -- 172.21.15.125:0/455727614 >> 172.21.15.125:0/455727614 conn(0x7f0d1c06bfd0 msgr2=0x7f0d1c0ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:21.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 -- 172.21.15.125:0/455727614 shutdown_connections 2023-11-28T11:11:21.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.677+0000 7f0d246a4700 1 -- 172.21.15.125:0/455727614 wait complete. 2023-11-28T11:11:21.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:10:34.306816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:10:35.470755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:11:21.692 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:11:21.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.814+0000 7f3c3fcfe700 1 Processor -- start 2023-11-28T11:11:21.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.814+0000 7f3c3fcfe700 1 -- start start 2023-11-28T11:11:21.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3fcfe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c380cf710 0x7f3c380ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3fcfe700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3c38071890 0x7f3c38071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3fcfe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c3806a270 0x7f3c3806a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3fcfe700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3806ac30 con 0x7f3c3806a270 2023-11-28T11:11:21.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3fcfe700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3815cc10 con 0x7f3c38071890 2023-11-28T11:11:21.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3fcfe700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3806c9b0 con 0x7f3c380cf710 2023-11-28T11:11:21.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3e29b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c3806a270 0x7f3c3806a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3e29b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c3806a270 0x7f3c3806a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60694/0 (socket says 172.21.15.125:60694) 2023-11-28T11:11:21.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3e29b700 1 -- 172.21.15.125:0/237083264 learned_addr learned my addr 172.21.15.125:0/237083264 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:21.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3da9a700 1 --2- 172.21.15.125:0/237083264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c380cf710 0x7f3c380ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3d299700 1 --2- 172.21.15.125:0/237083264 >> v2:172.21.15.167:3300/0 conn(0x7f3c38071890 0x7f3c38071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3e29b700 1 -- 172.21.15.125:0/237083264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c380cf710 msgr2=0x7f3c380ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:21.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3e29b700 1 --2- 172.21.15.125:0/237083264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c380cf710 0x7f3c380ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3e29b700 1 -- 172.21.15.125:0/237083264 >> v2:172.21.15.167:3300/0 conn(0x7f3c38071890 msgr2=0x7f3c38071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:21.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3e29b700 1 --2- 172.21.15.125:0/237083264 >> v2:172.21.15.167:3300/0 conn(0x7f3c38071890 0x7f3c38071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3e29b700 1 -- 172.21.15.125:0/237083264 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3806cc90 con 0x7f3c3806a270 2023-11-28T11:11:21.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.815+0000 7f3c3e29b700 1 --2- 172.21.15.125:0/237083264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c3806a270 0x7f3c3806a6f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3c380b2780 tx=0x7f3c3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8213c2da366e31fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:21.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3ca98700 1 -- 172.21.15.125:0/237083264 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000e070 con 0x7f3c3806a270 2023-11-28T11:11:21.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3ca98700 1 -- 172.21.15.125:0/237083264 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3000b9c0 con 0x7f3c3806a270 2023-11-28T11:11:21.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3ca98700 1 -- 172.21.15.125:0/237083264 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000bd70 con 0x7f3c3806a270 2023-11-28T11:11:21.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/237083264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c3806a270 msgr2=0x7f3c3806a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3fcfe700 1 --2- 172.21.15.125:0/237083264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c3806a270 0x7f3c3806a6f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3c380b2780 tx=0x7f3c3000b330 comp rx=0 tx=0).stop 2023-11-28T11:11:21.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/237083264 shutdown_connections 2023-11-28T11:11:21.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3fcfe700 1 --2- 172.21.15.125:0/237083264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c3806a270 0x7f3c3806a6f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3fcfe700 1 --2- 172.21.15.125:0/237083264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c380cf710 0x7f3c380ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3fcfe700 1 --2- 172.21.15.125:0/237083264 >> v2:172.21.15.167:3300/0 conn(0x7f3c38071890 0x7f3c38071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/237083264 >> 172.21.15.125:0/237083264 conn(0x7f3c3806c010 msgr2=0x7f3c380cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:21.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/237083264 shutdown_connections 2023-11-28T11:11:21.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.816+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/237083264 wait complete. 2023-11-28T11:11:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.817+0000 7f3c3fcfe700 1 Processor -- start 2023-11-28T11:11:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.818+0000 7f3c3fcfe700 1 -- start start 2023-11-28T11:11:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.818+0000 7f3c3fcfe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c3806a270 0x7f3c380c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.818+0000 7f3c3fcfe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c38071890 0x7f3c380c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.818+0000 7f3c3fcfe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c380cf710 0x7f3c3815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.818+0000 7f3c3fcfe700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c380c8830 con 0x7f3c38071890 2023-11-28T11:11:21.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.818+0000 7f3c3fcfe700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c380c8b10 con 0x7f3c3806a270 2023-11-28T11:11:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.818+0000 7f3c3fcfe700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c380c8df0 con 0x7f3c380cf710 2023-11-28T11:11:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.818+0000 7f3c3d299700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c38071890 0x7f3c380c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.818+0000 7f3c3d299700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c38071890 0x7f3c380c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60698/0 (socket says 172.21.15.125:60698) 2023-11-28T11:11:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.818+0000 7f3c3d299700 1 -- 172.21.15.125:0/1177117807 learned_addr learned my addr 172.21.15.125:0/1177117807 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3e29b700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c380cf710 0x7f3c3815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3d299700 1 -- 172.21.15.125:0/1177117807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c380cf710 msgr2=0x7f3c3815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3da9a700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c3806a270 0x7f3c380c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3d299700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c380cf710 0x7f3c3815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3d299700 1 -- 172.21.15.125:0/1177117807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c3806a270 msgr2=0x7f3c380c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:21.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3d299700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c3806a270 0x7f3c380c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:21.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3d299700 1 -- 172.21.15.125:0/1177117807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30009b30 con 0x7f3c38071890 2023-11-28T11:11:21.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3e29b700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c380cf710 0x7f3c3815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:21.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3da9a700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c3806a270 0x7f3c380c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:21.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3d299700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c38071890 0x7f3c380c7fc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800e810 tx=0x7f3c2800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:21.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c2e7fc700 1 -- 172.21.15.125:0/1177117807 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28013610 con 0x7f3c38071890 2023-11-28T11:11:21.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c2e7fc700 1 -- 172.21.15.125:0/1177117807 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28013770 con 0x7f3c38071890 2023-11-28T11:11:21.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/1177117807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3806d250 con 0x7f3c38071890 2023-11-28T11:11:21.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c2e7fc700 1 -- 172.21.15.125:0/1177117807 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28013b00 con 0x7f3c38071890 2023-11-28T11:11:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.819+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/1177117807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3806cf70 con 0x7f3c38071890 2023-11-28T11:11:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.820+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/1177117807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3806d530 con 0x7f3c38071890 2023-11-28T11:11:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.820+0000 7f3c2e7fc700 1 -- 172.21.15.125:0/1177117807 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3c28023070 con 0x7f3c38071890 2023-11-28T11:11:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.821+0000 7f3c2e7fc700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3c1c0682f0 0x7f3c1c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.821+0000 7f3c2e7fc700 1 -- 172.21.15.125:0/1177117807 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3c28085900 con 0x7f3c38071890 2023-11-28T11:11:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.821+0000 7f3c3da9a700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3c1c0682f0 0x7f3c1c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:21.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.821+0000 7f3c3da9a700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3c1c0682f0 0x7f3c1c06a7a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009a00 tx=0x7f3c34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:21.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:21.825+0000 7f3c2e7fc700 1 -- 172.21.15.125:0/1177117807 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3c28052120 con 0x7f3c38071890 2023-11-28T11:11:22.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.007+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/1177117807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c380743f0 con 0x7f3c38071890 2023-11-28T11:11:22.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.008+0000 7f3c2e7fc700 1 -- 172.21.15.125:0/1177117807 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c2800f040 con 0x7f3c38071890 2023-11-28T11:11:22.009 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:11:22.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/1177117807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3c1c0682f0 msgr2=0x7f3c1c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3c1c0682f0 0x7f3c1c06a7a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009a00 tx=0x7f3c34008040 comp rx=0 tx=0).stop 2023-11-28T11:11:22.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/1177117807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c38071890 msgr2=0x7f3c380c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c38071890 0x7f3c380c7fc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800e810 tx=0x7f3c2800ebd0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/1177117807 shutdown_connections 2023-11-28T11:11:22.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3c1c0682f0 0x7f3c1c06a7a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c380cf710 0x7f3c3815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c3806a270 0x7f3c380c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 --2- 172.21.15.125:0/1177117807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c38071890 0x7f3c380c7fc0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/1177117807 >> 172.21.15.125:0/1177117807 conn(0x7f3c3806c010 msgr2=0x7f3c380b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:22.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/1177117807 shutdown_connections 2023-11-28T11:11:22.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.010+0000 7f3c3fcfe700 1 -- 172.21.15.125:0/1177117807 wait complete. 2023-11-28T11:11:22.024 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:11:22.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.145+0000 7f2c6cabf700 1 Processor -- start 2023-11-28T11:11:22.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.145+0000 7f2c6cabf700 1 -- start start 2023-11-28T11:11:22.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6cabf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2c6815a5f0 0x7f2c680d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6cabf700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c680b2ee0 0x7f2c680ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6cabf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6815a9c0 con 0x7f2c680cc200 2023-11-28T11:11:22.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6cabf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c680c7b80 con 0x7f2c6815a5f0 2023-11-28T11:11:22.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6cabf700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680cc990 con 0x7f2c680b2ee0 2023-11-28T11:11:22.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2c6815a5f0 0x7f2c680d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c65d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2c680cc200 0x7f2c680b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44828/0 (socket says 172.21.15.125:44828) 2023-11-28T11:11:22.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c65d9b700 1 -- 172.21.15.125:0/428715558 learned_addr learned my addr 172.21.15.125:0/428715558 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:22.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6659c700 1 -- 172.21.15.125:0/428715558 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c680b2ee0 msgr2=0x7f2c680ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:22.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c66d9d700 1 --2- 172.21.15.125:0/428715558 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c680b2ee0 0x7f2c680ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6659c700 1 --2- 172.21.15.125:0/428715558 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c680b2ee0 0x7f2c680ced30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6659c700 1 -- 172.21.15.125:0/428715558 >> v1:172.21.15.125:6789/0 conn(0x7f2c680cc200 legacy=0x7f2c680b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6559a700 1 -- 172.21.15.125:0/428715558 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440681325 0 0) 0x7f2c6815a9c0 con 0x7f2c680cc200 2023-11-28T11:11:22.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6659c700 1 -- 172.21.15.125:0/428715558 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c680ccc70 con 0x7f2c6815a5f0 2023-11-28T11:11:22.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6659c700 1 --2- 172.21.15.125:0/428715558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c6815a5f0 0x7f2c680d0ad0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009840 tx=0x7f2c58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88a8151b8392230 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:22.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6559a700 1 -- 172.21.15.125:0/428715558 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58011830 con 0x7f2c6815a5f0 2023-11-28T11:11:22.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6559a700 1 -- 172.21.15.125:0/428715558 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c58011990 con 0x7f2c6815a5f0 2023-11-28T11:11:22.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.146+0000 7f2c6559a700 1 -- 172.21.15.125:0/428715558 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58011d20 con 0x7f2c6815a5f0 2023-11-28T11:11:22.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.147+0000 7f2c6cabf700 1 -- 172.21.15.125:0/428715558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c6815a5f0 msgr2=0x7f2c680d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.147+0000 7f2c6cabf700 1 --2- 172.21.15.125:0/428715558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c6815a5f0 0x7f2c680d0ad0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009840 tx=0x7f2c58009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:22.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.147+0000 7f2c6cabf700 1 -- 172.21.15.125:0/428715558 shutdown_connections 2023-11-28T11:11:22.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.147+0000 7f2c6cabf700 1 --2- 172.21.15.125:0/428715558 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c680b2ee0 0x7f2c680ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.147+0000 7f2c6cabf700 1 --2- 172.21.15.125:0/428715558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c6815a5f0 0x7f2c680d0ad0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.147+0000 7f2c6cabf700 1 -- 172.21.15.125:0/428715558 >> 172.21.15.125:0/428715558 conn(0x7f2c6806ea80 msgr2=0x7f2c6806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:22.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.147+0000 7f2c6cabf700 1 -- 172.21.15.125:0/428715558 shutdown_connections 2023-11-28T11:11:22.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.147+0000 7f2c6cabf700 1 -- 172.21.15.125:0/428715558 wait complete. 2023-11-28T11:11:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.148+0000 7f2c6cabf700 1 Processor -- start 2023-11-28T11:11:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.148+0000 7f2c6cabf700 1 -- start start 2023-11-28T11:11:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.149+0000 7f2c6cabf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c680b2ee0 0x7f2c681ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.149+0000 7f2c6cabf700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c680cc200 0x7f2c680b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.149+0000 7f2c6cabf700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c6815a5f0 0x7f2c680b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.149+0000 7f2c6cabf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680c7fa0 con 0x7f2c680b2ee0 2023-11-28T11:11:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.149+0000 7f2c6cabf700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680c8280 con 0x7f2c680cc200 2023-11-28T11:11:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.149+0000 7f2c6cabf700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680c8560 con 0x7f2c6815a5f0 2023-11-28T11:11:22.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.149+0000 7f2c6659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c680b2ee0 0x7f2c681ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.149+0000 7f2c6659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c680b2ee0 0x7f2c681ef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60708/0 (socket says 172.21.15.125:60708) 2023-11-28T11:11:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.149+0000 7f2c6659c700 1 -- 172.21.15.125:0/3863283405 learned_addr learned my addr 172.21.15.125:0/3863283405 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c6659c700 1 -- 172.21.15.125:0/3863283405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c6815a5f0 msgr2=0x7f2c680b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c66d9d700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c6815a5f0 0x7f2c680b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c65d9b700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c680cc200 0x7f2c680b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c6659c700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c6815a5f0 0x7f2c680b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c6659c700 1 -- 172.21.15.125:0/3863283405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c680cc200 msgr2=0x7f2c680b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c6659c700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c680cc200 0x7f2c680b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c6659c700 1 -- 172.21.15.125:0/3863283405 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c580094a0 con 0x7f2c680b2ee0 2023-11-28T11:11:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c66d9d700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c6815a5f0 0x7f2c680b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:22.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c65d9b700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c680cc200 0x7f2c680b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c6659c700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c680b2ee0 0x7f2c681ef760 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2c580090b0 tx=0x7f2c58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c56ffd700 1 -- 172.21.15.125:0/3863283405 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580045f0 con 0x7f2c680b2ee0 2023-11-28T11:11:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c56ffd700 1 -- 172.21.15.125:0/3863283405 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5801f070 con 0x7f2c680b2ee0 2023-11-28T11:11:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c6cabf700 1 -- 172.21.15.125:0/3863283405 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c680cd230 con 0x7f2c680b2ee0 2023-11-28T11:11:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c56ffd700 1 -- 172.21.15.125:0/3863283405 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58003b00 con 0x7f2c680b2ee0 2023-11-28T11:11:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.150+0000 7f2c6cabf700 1 -- 172.21.15.125:0/3863283405 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c680ccf50 con 0x7f2c680b2ee0 2023-11-28T11:11:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.151+0000 7f2c6cabf700 1 -- 172.21.15.125:0/3863283405 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c680cd510 con 0x7f2c680b2ee0 2023-11-28T11:11:22.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.151+0000 7f2c56ffd700 1 -- 172.21.15.125:0/3863283405 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2c5800f050 con 0x7f2c680b2ee0 2023-11-28T11:11:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.152+0000 7f2c56ffd700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c480682f0 0x7f2c4806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.152+0000 7f2c56ffd700 1 -- 172.21.15.125:0/3863283405 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2c58021070 con 0x7f2c680b2ee0 2023-11-28T11:11:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.152+0000 7f2c65d9b700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c480682f0 0x7f2c4806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.152+0000 7f2c65d9b700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c480682f0 0x7f2c4806a7a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c000f60 tx=0x7f2c5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:22.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.156+0000 7f2c56ffd700 1 -- 172.21.15.125:0/3863283405 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2c58053ff0 con 0x7f2c680b2ee0 2023-11-28T11:11:22.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.340+0000 7f2c6cabf700 1 -- 172.21.15.125:0/3863283405 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2c680743f0 con 0x7f2c680b2ee0 2023-11-28T11:11:22.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.340+0000 7f2c56ffd700 1 -- 172.21.15.125:0/3863283405 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2c58015020 con 0x7f2c680b2ee0 2023-11-28T11:11:22.342 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:11:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 -- 172.21.15.125:0/3863283405 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c480682f0 msgr2=0x7f2c4806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c480682f0 0x7f2c4806a7a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c000f60 tx=0x7f2c5c009040 comp rx=0 tx=0).stop 2023-11-28T11:11:22.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 -- 172.21.15.125:0/3863283405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c680b2ee0 msgr2=0x7f2c681ef760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c680b2ee0 0x7f2c681ef760 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2c580090b0 tx=0x7f2c58004750 comp rx=0 tx=0).stop 2023-11-28T11:11:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 -- 172.21.15.125:0/3863283405 shutdown_connections 2023-11-28T11:11:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2c480682f0 0x7f2c4806a7a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c6815a5f0 0x7f2c680b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c680b2ee0 0x7f2c681ef760 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 --2- 172.21.15.125:0/3863283405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c680cc200 0x7f2c680b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 -- 172.21.15.125:0/3863283405 >> 172.21.15.125:0/3863283405 conn(0x7f2c6806ea80 msgr2=0x7f2c680b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 -- 172.21.15.125:0/3863283405 shutdown_connections 2023-11-28T11:11:22.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.342+0000 7f2c6cabf700 1 -- 172.21.15.125:0/3863283405 wait complete. 2023-11-28T11:11:22.356 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:11:22.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.477+0000 7f40d4d2b700 1 Processor -- start 2023-11-28T11:11:22.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.477+0000 7f40d4d2b700 1 -- start start 2023-11-28T11:11:22.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.478+0000 7f40d4d2b700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f40d00718e0 0x7f40d006c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.478+0000 7f40d4d2b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d0160a50 con 0x7f40d015c810 2023-11-28T11:11:22.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.478+0000 7f40d4d2b700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d0160d30 con 0x7f40d006cdc0 2023-11-28T11:11:22.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.478+0000 7f40d4d2b700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d015cbe0 con 0x7f40d00718e0 2023-11-28T11:11:22.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.478+0000 7f40ce59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f40d015c810 0x7f40d0160260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44840/0 (socket says 172.21.15.125:44840) 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.478+0000 7f40ce59c700 1 -- 172.21.15.125:0/1236715182 learned_addr learned my addr 172.21.15.125:0/1236715182 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.478+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741078438 0 0) 0x7f40d0160a50 con 0x7f40d015c810 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.478+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b80035b0 con 0x7f40d015c810 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.478+0000 7f40cdd9b700 1 --2- 172.21.15.125:0/1236715182 >> v2:172.21.15.167:3300/0 conn(0x7f40d00718e0 0x7f40d006c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1259746655 0 0) 0x7f40b80035b0 con 0x7f40d015c810 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 >> v2:172.21.15.167:3300/0 conn(0x7f40d00718e0 msgr2=0x7f40d006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 --2- 172.21.15.125:0/1236715182 >> v2:172.21.15.167:3300/0 conn(0x7f40d00718e0 0x7f40d006c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 >> v1:172.21.15.167:6789/0 conn(0x7f40d006cdc0 legacy=0x7f40d006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0161010 con 0x7f40d015c810 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f40c4001670 con 0x7f40d015c810 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 >> v1:172.21.15.125:6789/0 conn(0x7f40d015c810 legacy=0x7f40d0160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40b8003a30 0x7f40b8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40b8004850 0x7f40b8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40b8005250 0x7f40b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015cbe0 con 0x7f40b8005250 2023-11-28T11:11:22.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b800c160 con 0x7f40b8003a30 2023-11-28T11:11:22.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b800c320 con 0x7f40b8004850 2023-11-28T11:11:22.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40ced9d700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40b8005250 0x7f40b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40ce59c700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40b8003a30 0x7f40b8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cdd9b700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40b8004850 0x7f40b8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40ced9d700 1 -- 172.21.15.125:0/1236715182 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40b8004850 msgr2=0x7f40b8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:22.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40ced9d700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40b8004850 0x7f40b8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40ced9d700 1 -- 172.21.15.125:0/1236715182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40b8003a30 msgr2=0x7f40b8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:22.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40ced9d700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40b8003a30 0x7f40b8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40ced9d700 1 -- 172.21.15.125:0/1236715182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b80035b0 con 0x7f40b8005250 2023-11-28T11:11:22.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cdd9b700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40b8004850 0x7f40b8004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:22.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40ced9d700 1 -- 172.21.15.125:0/1236715182 reap_dead start 2023-11-28T11:11:22.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40ced9d700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40b8005250 0x7f40b800ba10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f40c800c160 tx=0x7f40b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ab1f4f1e7dd955 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:22.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8001db0 con 0x7f40b8005250 2023-11-28T11:11:22.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c800ccc0 con 0x7f40b8005250 2023-11-28T11:11:22.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.479+0000 7f40cd59a700 1 -- 172.21.15.125:0/1236715182 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8003c40 con 0x7f40b8005250 2023-11-28T11:11:22.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.480+0000 7f40d4d2b700 1 -- 172.21.15.125:0/1236715182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40b8005250 msgr2=0x7f40b800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.480+0000 7f40d4d2b700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40b8005250 0x7f40b800ba10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f40c800c160 tx=0x7f40b8005880 comp rx=0 tx=0).stop 2023-11-28T11:11:22.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.480+0000 7f40d4d2b700 1 -- 172.21.15.125:0/1236715182 shutdown_connections 2023-11-28T11:11:22.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.480+0000 7f40d4d2b700 1 --2- 172.21.15.125:0/1236715182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40b8005250 0x7f40b800ba10 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.480+0000 7f40d4d2b700 1 -- 172.21.15.125:0/1236715182 >> 172.21.15.125:0/1236715182 conn(0x7f40d006c010 msgr2=0x7f40d00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:22.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.480+0000 7f40d4d2b700 1 -- 172.21.15.125:0/1236715182 shutdown_connections 2023-11-28T11:11:22.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.480+0000 7f40d4d2b700 1 -- 172.21.15.125:0/1236715182 wait complete. 2023-11-28T11:11:22.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.481+0000 7f40d4d2b700 1 Processor -- start 2023-11-28T11:11:22.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.481+0000 7f40d4d2b700 1 -- start start 2023-11-28T11:11:22.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.482+0000 7f40d4d2b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40b8005250 0x7f40d0156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.482+0000 7f40d4d2b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40d00aec90 0x7f40d00acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.482+0000 7f40d4d2b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d00af100 0x7f40d00ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.482+0000 7f40d4d2b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00b3d60 con 0x7f40d00aec90 2023-11-28T11:11:22.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.482+0000 7f40d4d2b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00b4040 con 0x7f40d00af100 2023-11-28T11:11:22.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.482+0000 7f40d4d2b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00b4320 con 0x7f40b8005250 2023-11-28T11:11:22.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.482+0000 7f40cdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40d00aec90 0x7f40d00acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.482+0000 7f40cdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40d00aec90 0x7f40d00acec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60730/0 (socket says 172.21.15.125:60730) 2023-11-28T11:11:22.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.482+0000 7f40cdd9b700 1 -- 172.21.15.125:0/537853190 learned_addr learned my addr 172.21.15.125:0/537853190 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:22.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.482+0000 7f40ce59c700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40b8005250 0x7f40d0156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.482+0000 7f40ced9d700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d00af100 0x7f40d00ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40cdd9b700 1 -- 172.21.15.125:0/537853190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40b8005250 msgr2=0x7f40d0156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40cdd9b700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40b8005250 0x7f40d0156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40cdd9b700 1 -- 172.21.15.125:0/537853190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d00af100 msgr2=0x7f40d00ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40cdd9b700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d00af100 0x7f40d00ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40cdd9b700 1 -- 172.21.15.125:0/537853190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00ce740 con 0x7f40d00aec90 2023-11-28T11:11:22.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40ced9d700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d00af100 0x7f40d00ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:22.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40ce59c700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40b8005250 0x7f40d0156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:22.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40cdd9b700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40d00aec90 0x7f40d00acec0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f40c0010890 tx=0x7f40c0010c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:22.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40beffd700 1 -- 172.21.15.125:0/537853190 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000c840 con 0x7f40d00aec90 2023-11-28T11:11:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40beffd700 1 -- 172.21.15.125:0/537853190 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c000c9a0 con 0x7f40d00aec90 2023-11-28T11:11:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40d4d2b700 1 -- 172.21.15.125:0/537853190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d00ceb20 con 0x7f40d00aec90 2023-11-28T11:11:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40beffd700 1 -- 172.21.15.125:0/537853190 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000cd50 con 0x7f40d00aec90 2023-11-28T11:11:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.483+0000 7f40d4d2b700 1 -- 172.21.15.125:0/537853190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d00ce8d0 con 0x7f40d00aec90 2023-11-28T11:11:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.484+0000 7f40d4d2b700 1 -- 172.21.15.125:0/537853190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d00743f0 con 0x7f40d00aec90 2023-11-28T11:11:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.484+0000 7f40beffd700 1 -- 172.21.15.125:0/537853190 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f40c0025070 con 0x7f40d00aec90 2023-11-28T11:11:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.485+0000 7f40beffd700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f40b00682f0 0x7f40b006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.485+0000 7f40beffd700 1 -- 172.21.15.125:0/537853190 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f40c0086050 con 0x7f40d00aec90 2023-11-28T11:11:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.485+0000 7f40ce59c700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f40b00682f0 0x7f40b006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.485+0000 7f40ce59c700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f40b00682f0 0x7f40b006a7a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f40c4001050 tx=0x7f40c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:22.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.489+0000 7f40beffd700 1 -- 172.21.15.125:0/537853190 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f40c0052870 con 0x7f40d00aec90 2023-11-28T11:11:22.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.671+0000 7f40d4d2b700 1 -- 172.21.15.125:0/537853190 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40d006ac40 con 0x7f40d00aec90 2023-11-28T11:11:22.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.671+0000 7f40beffd700 1 -- 172.21.15.125:0/537853190 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40c0055e90 con 0x7f40d00aec90 2023-11-28T11:11:22.673 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:11:22.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.673+0000 7f40d4d2b700 1 -- 172.21.15.125:0/537853190 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f40b00682f0 msgr2=0x7f40b006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.673+0000 7f40d4d2b700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f40b00682f0 0x7f40b006a7a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f40c4001050 tx=0x7f40c4009040 comp rx=0 tx=0).stop 2023-11-28T11:11:22.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.673+0000 7f40d4d2b700 1 -- 172.21.15.125:0/537853190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40d00aec90 msgr2=0x7f40d00acec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.673+0000 7f40d4d2b700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40d00aec90 0x7f40d00acec0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f40c0010890 tx=0x7f40c0010c50 comp rx=0 tx=0).stop 2023-11-28T11:11:22.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.673+0000 7f40d4d2b700 1 -- 172.21.15.125:0/537853190 shutdown_connections 2023-11-28T11:11:22.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.673+0000 7f40d4d2b700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d00af100 0x7f40d00ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.673+0000 7f40d4d2b700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f40b00682f0 0x7f40b006a7a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.673+0000 7f40d4d2b700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40b8005250 0x7f40d0156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.673+0000 7f40d4d2b700 1 --2- 172.21.15.125:0/537853190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40d00aec90 0x7f40d00acec0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.673+0000 7f40d4d2b700 1 -- 172.21.15.125:0/537853190 >> 172.21.15.125:0/537853190 conn(0x7f40d006c010 msgr2=0x7f40d00d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:22.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.674+0000 7f40d4d2b700 1 -- 172.21.15.125:0/537853190 shutdown_connections 2023-11-28T11:11:22.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.674+0000 7f40d4d2b700 1 -- 172.21.15.125:0/537853190 wait complete. 2023-11-28T11:11:22.687 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:11:22.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.808+0000 7fa73f857700 1 Processor -- start 2023-11-28T11:11:22.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.808+0000 7fa73f857700 1 -- start start 2023-11-28T11:11:22.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.809+0000 7fa73f857700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa73815c8c0 0x7fa738160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.809+0000 7fa73f857700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7380b5dc0 0x7fa73806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.809+0000 7fa73f857700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7380d2d30 con 0x7fa73806b050 2023-11-28T11:11:22.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.809+0000 7fa73f857700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73806b4d0 con 0x7fa7380b5dc0 2023-11-28T11:11:22.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.809+0000 7fa73f857700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380d0b40 con 0x7fa73815c8c0 2023-11-28T11:11:22.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.809+0000 7fa73cdf2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7380b5dc0 0x7fa73806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.809+0000 7fa73cdf2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7380b5dc0 0x7fa73806ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60738/0 (socket says 172.21.15.125:60738) 2023-11-28T11:11:22.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.809+0000 7fa73cdf2700 1 -- 172.21.15.125:0/1932719611 learned_addr learned my addr 172.21.15.125:0/1932719611 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:22.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.809+0000 7fa73ddf4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa73806b050 0x7fa7380d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44864/0 (socket says 172.21.15.125:44864) 2023-11-28T11:11:22.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.810+0000 7fa73d5f3700 1 --2- 172.21.15.125:0/1932719611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa73815c8c0 0x7fa738160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.810+0000 7fa73cdf2700 1 -- 172.21.15.125:0/1932719611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa73815c8c0 msgr2=0x7fa738160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:22.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.810+0000 7fa73cdf2700 1 --2- 172.21.15.125:0/1932719611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa73815c8c0 0x7fa738160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.810+0000 7fa73cdf2700 1 -- 172.21.15.125:0/1932719611 >> v1:172.21.15.125:6789/0 conn(0x7fa73806b050 legacy=0x7fa7380d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.810+0000 7fa73cdf2700 1 -- 172.21.15.125:0/1932719611 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7381611f0 con 0x7fa7380b5dc0 2023-11-28T11:11:22.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.810+0000 7fa72ffff700 1 -- 172.21.15.125:0/1932719611 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084711322 0 0) 0x7fa730001490 con 0x7fa73806b050 2023-11-28T11:11:22.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.810+0000 7fa73cdf2700 1 --2- 172.21.15.125:0/1932719611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7380b5dc0 0x7fa73806ab10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa7340098f0 tx=0x7fa734009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db664ca6c4e28c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:22.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.810+0000 7fa72ffff700 1 -- 172.21.15.125:0/1932719611 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400b8a0 con 0x7fa7380b5dc0 2023-11-28T11:11:22.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.810+0000 7fa72ffff700 1 -- 172.21.15.125:0/1932719611 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400ba00 con 0x7fa7380b5dc0 2023-11-28T11:11:22.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.810+0000 7fa72ffff700 1 -- 172.21.15.125:0/1932719611 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400bd90 con 0x7fa7380b5dc0 2023-11-28T11:11:22.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.811+0000 7fa73f857700 1 -- 172.21.15.125:0/1932719611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7380b5dc0 msgr2=0x7fa73806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.811+0000 7fa73f857700 1 --2- 172.21.15.125:0/1932719611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7380b5dc0 0x7fa73806ab10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa7340098f0 tx=0x7fa734009c00 comp rx=0 tx=0).stop 2023-11-28T11:11:22.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.811+0000 7fa73f857700 1 -- 172.21.15.125:0/1932719611 shutdown_connections 2023-11-28T11:11:22.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.811+0000 7fa73f857700 1 --2- 172.21.15.125:0/1932719611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa73815c8c0 0x7fa738160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.811+0000 7fa73f857700 1 --2- 172.21.15.125:0/1932719611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7380b5dc0 0x7fa73806ab10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.811+0000 7fa73f857700 1 -- 172.21.15.125:0/1932719611 >> 172.21.15.125:0/1932719611 conn(0x7fa73806c520 msgr2=0x7fa73806c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:22.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.811+0000 7fa73f857700 1 -- 172.21.15.125:0/1932719611 shutdown_connections 2023-11-28T11:11:22.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.811+0000 7fa73f857700 1 -- 172.21.15.125:0/1932719611 wait complete. 2023-11-28T11:11:22.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.812+0000 7fa73f857700 1 Processor -- start 2023-11-28T11:11:22.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.812+0000 7fa73f857700 1 -- start start 2023-11-28T11:11:22.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73f857700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa73806b050 0x7fa738154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73f857700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7380b5dc0 0x7fa7381f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73f857700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa73815c8c0 0x7fa7380b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73f857700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381f3240 con 0x7fa73806b050 2023-11-28T11:11:22.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73f857700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380c8920 con 0x7fa7380b5dc0 2023-11-28T11:11:22.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73f857700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380c7b50 con 0x7fa73815c8c0 2023-11-28T11:11:22.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73d5f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa73806b050 0x7fa738154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73d5f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa73806b050 0x7fa738154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60742/0 (socket says 172.21.15.125:60742) 2023-11-28T11:11:22.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73d5f3700 1 -- 172.21.15.125:0/2817552473 learned_addr learned my addr 172.21.15.125:0/2817552473 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:22.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73ddf4700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa73815c8c0 0x7fa7380b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73cdf2700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7380b5dc0 0x7fa7381f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73d5f3700 1 -- 172.21.15.125:0/2817552473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa73815c8c0 msgr2=0x7fa7380b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73d5f3700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa73815c8c0 0x7fa7380b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73d5f3700 1 -- 172.21.15.125:0/2817552473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7380b5dc0 msgr2=0x7fa7381f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:22.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73d5f3700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7380b5dc0 0x7fa7381f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:22.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73d5f3700 1 -- 172.21.15.125:0/2817552473 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734009550 con 0x7fa73806b050 2023-11-28T11:11:22.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73d5f3700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa73806b050 0x7fa738154540 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa72800e810 tx=0x7fa72800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:22.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa72dffb700 1 -- 172.21.15.125:0/2817552473 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728013610 con 0x7fa73806b050 2023-11-28T11:11:22.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa72dffb700 1 -- 172.21.15.125:0/2817552473 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa728013770 con 0x7fa73806b050 2023-11-28T11:11:22.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa72dffb700 1 -- 172.21.15.125:0/2817552473 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728013b20 con 0x7fa73806b050 2023-11-28T11:11:22.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.813+0000 7fa73f857700 1 -- 172.21.15.125:0/2817552473 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7380cd760 con 0x7fa73806b050 2023-11-28T11:11:22.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.814+0000 7fa73f857700 1 -- 172.21.15.125:0/2817552473 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7380d2a50 con 0x7fa73806b050 2023-11-28T11:11:22.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.814+0000 7fa73f857700 1 -- 172.21.15.125:0/2817552473 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7380cda40 con 0x7fa73806b050 2023-11-28T11:11:22.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.815+0000 7fa72dffb700 1 -- 172.21.15.125:0/2817552473 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa728023070 con 0x7fa73806b050 2023-11-28T11:11:22.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.815+0000 7fa72dffb700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa71c0682f0 0x7fa71c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:22.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.815+0000 7fa72dffb700 1 -- 172.21.15.125:0/2817552473 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa728085a50 con 0x7fa73806b050 2023-11-28T11:11:22.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.815+0000 7fa73cdf2700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa71c0682f0 0x7fa71c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:22.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.816+0000 7fa73cdf2700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa71c0682f0 0x7fa71c06a7a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa734000c00 tx=0x7fa734008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:22.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.819+0000 7fa72dffb700 1 -- 172.21.15.125:0/2817552473 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa7280521f0 con 0x7fa73806b050 2023-11-28T11:11:23.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.999+0000 7fa73f857700 1 -- 172.21.15.125:0/2817552473 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa738067d70 con 0x7fa73806b050 2023-11-28T11:11:23.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:22.999+0000 7fa72dffb700 1 -- 172.21.15.125:0/2817552473 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa728055810 con 0x7fa73806b050 2023-11-28T11:11:23.001 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:11:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 -- 172.21.15.125:0/2817552473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa71c0682f0 msgr2=0x7fa71c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa71c0682f0 0x7fa71c06a7a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa734000c00 tx=0x7fa734008030 comp rx=0 tx=0).stop 2023-11-28T11:11:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 -- 172.21.15.125:0/2817552473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa73806b050 msgr2=0x7fa738154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa73806b050 0x7fa738154540 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa72800e810 tx=0x7fa72800ebd0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 -- 172.21.15.125:0/2817552473 shutdown_connections 2023-11-28T11:11:23.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa71c0682f0 0x7fa71c06a7a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa73815c8c0 0x7fa7380b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa73806b050 0x7fa738154540 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 --2- 172.21.15.125:0/2817552473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7380b5dc0 0x7fa7381f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 -- 172.21.15.125:0/2817552473 >> 172.21.15.125:0/2817552473 conn(0x7fa73806c520 msgr2=0x7fa7380cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:23.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 -- 172.21.15.125:0/2817552473 shutdown_connections 2023-11-28T11:11:23.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.002+0000 7fa73f857700 1 -- 172.21.15.125:0/2817552473 wait complete. 2023-11-28T11:11:23.016 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:11:23.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.135+0000 7f665bb47700 1 Processor -- start 2023-11-28T11:11:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.135+0000 7f665bb47700 1 -- start start 2023-11-28T11:11:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.136+0000 7f665bb47700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f66540b1650 0x7f66540b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.136+0000 7f665bb47700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540af0a0 0x7f665415a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.136+0000 7f665bb47700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6654159ec0 con 0x7f66541599b0 2023-11-28T11:11:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.136+0000 7f665bb47700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66540b1f60 con 0x7f66540b1650 2023-11-28T11:11:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.136+0000 7f665bb47700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665415d8a0 con 0x7f66540af0a0 2023-11-28T11:11:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.136+0000 7f66598e3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f66540b1650 0x7f66540b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.136+0000 7f66598e3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f66540b1650 0x7f66540b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:57480/0 (socket says 172.21.15.125:57480) 2023-11-28T11:11:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.136+0000 7f665a0e4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540af0a0 0x7f665415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.136+0000 7f66598e3700 1 -- 172.21.15.125:0/710122062 learned_addr learned my addr 172.21.15.125:0/710122062 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.136+0000 7f66590e2700 1 --1- 172.21.15.125:0/710122062 >> v1:172.21.15.167:6789/0 conn(0x7f66541599b0 0x7f665415d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:47676/0 (socket says 172.21.15.125:47676) 2023-11-28T11:11:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f665a0e4700 1 -- 172.21.15.125:0/710122062 >> v2:172.21.15.167:3300/0 conn(0x7f66540b1650 msgr2=0x7f66540b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f665a0e4700 1 --2- 172.21.15.125:0/710122062 >> v2:172.21.15.167:3300/0 conn(0x7f66540b1650 0x7f66540b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f665a0e4700 1 -- 172.21.15.125:0/710122062 >> v1:172.21.15.167:6789/0 conn(0x7f66541599b0 legacy=0x7f665415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f665a0e4700 1 -- 172.21.15.125:0/710122062 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665415db80 con 0x7f66540af0a0 2023-11-28T11:11:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f66598e3700 1 --2- 172.21.15.125:0/710122062 >> v2:172.21.15.167:3300/0 conn(0x7f66540b1650 0x7f66540b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:11:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f665a0e4700 1 --2- 172.21.15.125:0/710122062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540af0a0 0x7f665415a350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f664c009d90 tx=0x7f664c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=367ca4ff88772b8b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f66588e1700 1 -- 172.21.15.125:0/710122062 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c00e070 con 0x7f66540af0a0 2023-11-28T11:11:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f66588e1700 1 -- 172.21.15.125:0/710122062 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c00bb20 con 0x7f66540af0a0 2023-11-28T11:11:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f66588e1700 1 -- 172.21.15.125:0/710122062 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c012430 con 0x7f66540af0a0 2023-11-28T11:11:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f665bb47700 1 -- 172.21.15.125:0/710122062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540af0a0 msgr2=0x7f665415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f665bb47700 1 --2- 172.21.15.125:0/710122062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540af0a0 0x7f665415a350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f664c009d90 tx=0x7f664c00b330 comp rx=0 tx=0).stop 2023-11-28T11:11:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f665bb47700 1 -- 172.21.15.125:0/710122062 shutdown_connections 2023-11-28T11:11:23.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f665bb47700 1 --2- 172.21.15.125:0/710122062 >> v2:172.21.15.167:3300/0 conn(0x7f66540b1650 0x7f66540b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f665bb47700 1 --2- 172.21.15.125:0/710122062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540af0a0 0x7f665415a350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.137+0000 7f665bb47700 1 -- 172.21.15.125:0/710122062 >> 172.21.15.125:0/710122062 conn(0x7f665406c010 msgr2=0x7f66540cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:23.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.138+0000 7f665bb47700 1 -- 172.21.15.125:0/710122062 shutdown_connections 2023-11-28T11:11:23.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.138+0000 7f665bb47700 1 -- 172.21.15.125:0/710122062 wait complete. 2023-11-28T11:11:23.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.139+0000 7f665bb47700 1 Processor -- start 2023-11-28T11:11:23.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.139+0000 7f665bb47700 1 -- start start 2023-11-28T11:11:23.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.139+0000 7f665bb47700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66540af0a0 0x7f6654145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.139+0000 7f665bb47700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540b1650 0x7f66540c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.139+0000 7f665bb47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66540c5c50 0x7f6654146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.139+0000 7f665bb47700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66540c60d0 con 0x7f66540c5c50 2023-11-28T11:11:23.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.139+0000 7f665bb47700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6654145790 con 0x7f66540af0a0 2023-11-28T11:11:23.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.139+0000 7f665bb47700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66541475a0 con 0x7f66540b1650 2023-11-28T11:11:23.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f665a0e4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66540c5c50 0x7f6654146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f665a0e4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66540c5c50 0x7f6654146870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60758/0 (socket says 172.21.15.125:60758) 2023-11-28T11:11:23.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f665a0e4700 1 -- 172.21.15.125:0/2552274440 learned_addr learned my addr 172.21.15.125:0/2552274440 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:23.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f66598e3700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66540af0a0 0x7f6654145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f66590e2700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540b1650 0x7f66540c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f665a0e4700 1 -- 172.21.15.125:0/2552274440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540b1650 msgr2=0x7f66540c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f665a0e4700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540b1650 0x7f66540c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f665a0e4700 1 -- 172.21.15.125:0/2552274440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66540af0a0 msgr2=0x7f6654145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f665a0e4700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66540af0a0 0x7f6654145250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f665a0e4700 1 -- 172.21.15.125:0/2552274440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648009550 con 0x7f66540c5c50 2023-11-28T11:11:23.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f66598e3700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66540af0a0 0x7f6654145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:23.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f66590e2700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540b1650 0x7f66540c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:23.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f665a0e4700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66540c5c50 0x7f6654146870 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f664c014040 tx=0x7f664c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:23.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f66467fc700 1 -- 172.21.15.125:0/2552274440 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c012430 con 0x7f66540c5c50 2023-11-28T11:11:23.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f66467fc700 1 -- 172.21.15.125:0/2552274440 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c020070 con 0x7f66540c5c50 2023-11-28T11:11:23.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f665bb47700 1 -- 172.21.15.125:0/2552274440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664c009a70 con 0x7f66540c5c50 2023-11-28T11:11:23.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f66467fc700 1 -- 172.21.15.125:0/2552274440 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c003ea0 con 0x7f66540c5c50 2023-11-28T11:11:23.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.140+0000 7f665bb47700 1 -- 172.21.15.125:0/2552274440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665415a890 con 0x7f66540c5c50 2023-11-28T11:11:23.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.141+0000 7f665bb47700 1 -- 172.21.15.125:0/2552274440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665415de60 con 0x7f66540c5c50 2023-11-28T11:11:23.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.142+0000 7f66467fc700 1 -- 172.21.15.125:0/2552274440 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f664c004280 con 0x7f66540c5c50 2023-11-28T11:11:23.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.142+0000 7f66467fc700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f66380682f0 0x7f663806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.142+0000 7f66467fc700 1 -- 172.21.15.125:0/2552274440 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f664c022070 con 0x7f66540c5c50 2023-11-28T11:11:23.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.142+0000 7f66598e3700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f66380682f0 0x7f663806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.142+0000 7f66598e3700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f66380682f0 0x7f663806a7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6648009c40 tx=0x7f6648008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:23.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.146+0000 7f66467fc700 1 -- 172.21.15.125:0/2552274440 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f664c054990 con 0x7f66540c5c50 2023-11-28T11:11:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.347+0000 7f665bb47700 1 -- 172.21.15.125:0/2552274440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f665415aa20 con 0x7f66540c5c50 2023-11-28T11:11:23.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.347+0000 7f66467fc700 1 -- 172.21.15.125:0/2552274440 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f664c057fb0 con 0x7f66540c5c50 2023-11-28T11:11:23.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 -- 172.21.15.125:0/2552274440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f66380682f0 msgr2=0x7f663806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f66380682f0 0x7f663806a7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6648009c40 tx=0x7f6648008040 comp rx=0 tx=0).stop 2023-11-28T11:11:23.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 -- 172.21.15.125:0/2552274440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66540c5c50 msgr2=0x7f6654146870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66540c5c50 0x7f6654146870 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f664c014040 tx=0x7f664c004ad0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 -- 172.21.15.125:0/2552274440 shutdown_connections 2023-11-28T11:11:23.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66540c5c50 0x7f6654146870 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66540af0a0 0x7f6654145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f66380682f0 0x7f663806a7a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 --2- 172.21.15.125:0/2552274440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66540b1650 0x7f66540c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 -- 172.21.15.125:0/2552274440 >> 172.21.15.125:0/2552274440 conn(0x7f665406c010 msgr2=0x7f66540b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:23.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 -- 172.21.15.125:0/2552274440 shutdown_connections 2023-11-28T11:11:23.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.349+0000 7f665bb47700 1 -- 172.21.15.125:0/2552274440 wait complete. 2023-11-28T11:11:23.352 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:11:23.362 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-11-28T11:11:23.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:23.363 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T11:11:23.397 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[123725]: fuse finished with error 0 and tester_r 0 2023-11-28T11:11:23.398 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:11:23.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:23.399 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:11:23.457 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:11:23.457 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:11:23.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:11:23.481 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:11:23.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:23.481 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T11:11:23.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:11:23.539 INFO:teuthology.orchestra.run.smithi167.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T11:11:23.540 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:11:23.540 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:11:23.557 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16093 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T11:11:23.557 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:11:23.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:23.557 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T11:11:23.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:11:23.614 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T11:11:23.614 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:11:23.614 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:11:23.632 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:11:23.632 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:11:23.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:23.633 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T11:11:23.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:11:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T11:11:23.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:11:23.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.809+0000 7f7dce250700 1 Processor -- start 2023-11-28T11:11:23.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.809+0000 7f7dce250700 1 -- start start 2023-11-28T11:11:23.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dce250700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7dc806a270 0x7f7dc806a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dce250700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7dc815e0b0 0x7f7dc815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dce250700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc8151a50 con 0x7f7dc8070d90 2023-11-28T11:11:23.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dce250700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc815b440 con 0x7f7dc806a270 2023-11-28T11:11:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dce250700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc806ab80 con 0x7f7dc815e0b0 2023-11-28T11:11:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dc77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7dc806a270 0x7f7dc806a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dc6ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7dc8070d90 0x7f7dc80711e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44888/0 (socket says 172.21.15.125:44888) 2023-11-28T11:11:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dc77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7dc806a270 0x7f7dc806a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60764/0 (socket says 172.21.15.125:60764) 2023-11-28T11:11:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dc6ffd700 1 -- 172.21.15.125:0/2352257340 learned_addr learned my addr 172.21.15.125:0/2352257340 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dc7fff700 1 --2- 172.21.15.125:0/2352257340 >> v2:172.21.15.167:3300/0 conn(0x7f7dc815e0b0 0x7f7dc815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dc77fe700 1 -- 172.21.15.125:0/2352257340 >> v2:172.21.15.167:3300/0 conn(0x7f7dc815e0b0 msgr2=0x7f7dc815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dc77fe700 1 --2- 172.21.15.125:0/2352257340 >> v2:172.21.15.167:3300/0 conn(0x7f7dc815e0b0 0x7f7dc815e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dc77fe700 1 -- 172.21.15.125:0/2352257340 >> v1:172.21.15.125:6789/0 conn(0x7f7dc8070d90 legacy=0x7f7dc80711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dc77fe700 1 -- 172.21.15.125:0/2352257340 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8071ac0 con 0x7f7dc806a270 2023-11-28T11:11:23.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dc67fc700 1 -- 172.21.15.125:0/2352257340 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705510763 0 0) 0x7f7dc8151a50 con 0x7f7dc8070d90 2023-11-28T11:11:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.810+0000 7f7dc7fff700 1 --2- 172.21.15.125:0/2352257340 >> v2:172.21.15.167:3300/0 conn(0x7f7dc815e0b0 0x7f7dc815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dc77fe700 1 --2- 172.21.15.125:0/2352257340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dc806a270 0x7f7dc806a640 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7dc815dff0 tx=0x7f7dbc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd9d7a9c6572305 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dc67fc700 1 -- 172.21.15.125:0/2352257340 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc011830 con 0x7f7dc806a270 2023-11-28T11:11:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dc67fc700 1 -- 172.21.15.125:0/2352257340 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc011990 con 0x7f7dc806a270 2023-11-28T11:11:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dc67fc700 1 -- 172.21.15.125:0/2352257340 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc011d20 con 0x7f7dc806a270 2023-11-28T11:11:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dce250700 1 -- 172.21.15.125:0/2352257340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dc806a270 msgr2=0x7f7dc806a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dce250700 1 --2- 172.21.15.125:0/2352257340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dc806a270 0x7f7dc806a640 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7dc815dff0 tx=0x7f7dbc009b20 comp rx=0 tx=0).stop 2023-11-28T11:11:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dce250700 1 -- 172.21.15.125:0/2352257340 shutdown_connections 2023-11-28T11:11:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dce250700 1 --2- 172.21.15.125:0/2352257340 >> v2:172.21.15.167:3300/0 conn(0x7f7dc815e0b0 0x7f7dc815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dce250700 1 --2- 172.21.15.125:0/2352257340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dc806a270 0x7f7dc806a640 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dce250700 1 -- 172.21.15.125:0/2352257340 >> 172.21.15.125:0/2352257340 conn(0x7f7dc806c010 msgr2=0x7f7dc80cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:23.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dce250700 1 -- 172.21.15.125:0/2352257340 shutdown_connections 2023-11-28T11:11:23.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.811+0000 7f7dce250700 1 -- 172.21.15.125:0/2352257340 wait complete. 2023-11-28T11:11:23.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.813+0000 7f7dce250700 1 Processor -- start 2023-11-28T11:11:23.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.813+0000 7f7dce250700 1 -- start start 2023-11-28T11:11:23.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.813+0000 7f7dce250700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dc806a270 0x7f7dc8150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.813+0000 7f7dce250700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dc8070d90 0x7f7dc80c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.813+0000 7f7dce250700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dc815e0b0 0x7f7dc80c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.813+0000 7f7dce250700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8151a50 con 0x7f7dc815e0b0 2023-11-28T11:11:23.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.813+0000 7f7dce250700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc81eff80 con 0x7f7dc806a270 2023-11-28T11:11:23.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.813+0000 7f7dce250700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8153e50 con 0x7f7dc8070d90 2023-11-28T11:11:23.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dc815e0b0 0x7f7dc80c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dc815e0b0 0x7f7dc80c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60774/0 (socket says 172.21.15.125:60774) 2023-11-28T11:11:23.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc7fff700 1 -- 172.21.15.125:0/1833646199 learned_addr learned my addr 172.21.15.125:0/1833646199 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:23.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc6ffd700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dc8070d90 0x7f7dc80c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc77fe700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dc806a270 0x7f7dc8150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc7fff700 1 -- 172.21.15.125:0/1833646199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dc8070d90 msgr2=0x7f7dc80c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc7fff700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dc8070d90 0x7f7dc80c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc7fff700 1 -- 172.21.15.125:0/1833646199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dc806a270 msgr2=0x7f7dc8150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:23.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc7fff700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dc806a270 0x7f7dc8150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:23.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc7fff700 1 -- 172.21.15.125:0/1833646199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc0094a0 con 0x7f7dc815e0b0 2023-11-28T11:11:23.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc6ffd700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dc8070d90 0x7f7dc80c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:23.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc77fe700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dc806a270 0x7f7dc8150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:23.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dc7fff700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dc815e0b0 0x7f7dc80c9690 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0007ef0 tx=0x7f7dc000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:23.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7daffff700 1 -- 172.21.15.125:0/1833646199 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc000de60 con 0x7f7dc815e0b0 2023-11-28T11:11:23.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7daffff700 1 -- 172.21.15.125:0/1833646199 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc000f040 con 0x7f7dc815e0b0 2023-11-28T11:11:23.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dce250700 1 -- 172.21.15.125:0/1833646199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc815b0d0 con 0x7f7dc815e0b0 2023-11-28T11:11:23.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7daffff700 1 -- 172.21.15.125:0/1833646199 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0003c60 con 0x7f7dc815e0b0 2023-11-28T11:11:23.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.814+0000 7f7dce250700 1 -- 172.21.15.125:0/1833646199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc815adf0 con 0x7f7dc815e0b0 2023-11-28T11:11:23.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.815+0000 7f7dce250700 1 -- 172.21.15.125:0/1833646199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc815aac0 con 0x7f7dc815e0b0 2023-11-28T11:11:23.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.816+0000 7f7daffff700 1 -- 172.21.15.125:0/1833646199 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7dc001c030 con 0x7f7dc815e0b0 2023-11-28T11:11:23.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.816+0000 7f7daffff700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7db40682f0 0x7f7db406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:23.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.816+0000 7f7daffff700 1 -- 172.21.15.125:0/1833646199 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7dc0085d60 con 0x7f7dc815e0b0 2023-11-28T11:11:23.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.816+0000 7f7dc77fe700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7db40682f0 0x7f7db406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:23.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.816+0000 7f7dc77fe700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7db40682f0 0x7f7db406a7a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0090b0 tx=0x7f7dbc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:23.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:23.820+0000 7f7daffff700 1 -- 172.21.15.125:0/1833646199 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7dc0052580 con 0x7f7dc815e0b0 2023-11-28T11:11:24.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.045+0000 7f7dce250700 1 -- 172.21.15.125:0/1833646199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dc80743f0 con 0x7f7dc815e0b0 2023-11-28T11:11:24.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.045+0000 7f7daffff700 1 -- 172.21.15.125:0/1833646199 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f7dc001a090 con 0x7f7dc815e0b0 2023-11-28T11:11:24.047 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:24.047 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/991177251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":991177251},{"type":"v1","addr":"172.21.15.167:6834","nonce":991177251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/289069328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":289069328},{"type":"v1","addr":"172.21.15.167:6835","nonce":289069328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3275492587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3275492587},{"type":"v1","addr":"172.21.15.125:6836","nonce":3275492587}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:10:36.508959+0000","modified":"2023-11-28T11:10:39.516894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5775":{"gid":5775,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3179120009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":3179120009},{"type":"v1","addr":"172.21.15.125:6837","nonce":3179120009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:11:24.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 -- 172.21.15.125:0/1833646199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7db40682f0 msgr2=0x7f7db406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7db40682f0 0x7f7db406a7a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0090b0 tx=0x7f7dbc008030 comp rx=0 tx=0).stop 2023-11-28T11:11:24.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 -- 172.21.15.125:0/1833646199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dc815e0b0 msgr2=0x7f7dc80c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dc815e0b0 0x7f7dc80c9690 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0007ef0 tx=0x7f7dc000d3b0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 -- 172.21.15.125:0/1833646199 shutdown_connections 2023-11-28T11:11:24.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dc815e0b0 0x7f7dc80c9690 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dc806a270 0x7f7dc8150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7db40682f0 0x7f7db406a7a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 --2- 172.21.15.125:0/1833646199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dc8070d90 0x7f7dc80c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 -- 172.21.15.125:0/1833646199 >> 172.21.15.125:0/1833646199 conn(0x7f7dc806c010 msgr2=0x7f7dc80b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:24.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 -- 172.21.15.125:0/1833646199 shutdown_connections 2023-11-28T11:11:24.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.047+0000 7f7dce250700 1 -- 172.21.15.125:0/1833646199 wait complete. 2023-11-28T11:11:24.051 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 23 2023-11-28T11:11:24.061 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:11:24.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.182+0000 7f18e527a700 1 Processor -- start 2023-11-28T11:11:24.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.182+0000 7f18e527a700 1 -- start start 2023-11-28T11:11:24.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.182+0000 7f18e527a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 0x7f18e006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.182+0000 7f18e527a700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f18e00cd5a0 0x7f18e0160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.182+0000 7f18e527a700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00d1ee0 con 0x7f18e00b22a0 2023-11-28T11:11:24.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.182+0000 7f18e527a700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e006b420 con 0x7f18e00cd5a0 2023-11-28T11:11:24.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.182+0000 7f18e527a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00cdb10 con 0x7f18e006ab10 2023-11-28T11:11:24.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18de7fc700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f18e00cd5a0 0x7f18e0160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18deffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 0x7f18e006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18de7fc700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f18e00cd5a0 0x7f18e0160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:57510/0 (socket says 172.21.15.125:57510) 2023-11-28T11:11:24.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18de7fc700 1 -- 172.21.15.125:0/1400013419 learned_addr learned my addr 172.21.15.125:0/1400013419 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:24.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18df7fe700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f18e00b22a0 0x7f18e0160840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:47708/0 (socket says 172.21.15.125:47708) 2023-11-28T11:11:24.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18deffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 0x7f18e006aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:55786/0 (socket says 172.21.15.125:55786) 2023-11-28T11:11:24.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18deffd700 1 -- 172.21.15.125:0/1400013419 >> v2:172.21.15.167:3300/0 conn(0x7f18e00cd5a0 msgr2=0x7f18e0160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:24.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18deffd700 1 --2- 172.21.15.125:0/1400013419 >> v2:172.21.15.167:3300/0 conn(0x7f18e00cd5a0 0x7f18e0160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18deffd700 1 -- 172.21.15.125:0/1400013419 >> v1:172.21.15.167:6789/0 conn(0x7f18e00b22a0 legacy=0x7f18e0160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18ddffb700 1 -- 172.21.15.125:0/1400013419 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955718777 0 0) 0x7f18e00d1ee0 con 0x7f18e00b22a0 2023-11-28T11:11:24.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18deffd700 1 -- 172.21.15.125:0/1400013419 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00d1890 con 0x7f18e006ab10 2023-11-28T11:11:24.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18de7fc700 1 --2- 172.21.15.125:0/1400013419 >> v2:172.21.15.167:3300/0 conn(0x7f18e00cd5a0 0x7f18e0160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:11:24.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.183+0000 7f18deffd700 1 --2- 172.21.15.125:0/1400013419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 0x7f18e006aee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009840 tx=0x7f18d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0906b33d09d0946 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:24.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.184+0000 7f18ddffb700 1 -- 172.21.15.125:0/1400013419 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011830 con 0x7f18e006ab10 2023-11-28T11:11:24.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.184+0000 7f18ddffb700 1 -- 172.21.15.125:0/1400013419 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0011990 con 0x7f18e006ab10 2023-11-28T11:11:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.184+0000 7f18ddffb700 1 -- 172.21.15.125:0/1400013419 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011d20 con 0x7f18e006ab10 2023-11-28T11:11:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.184+0000 7f18e527a700 1 -- 172.21.15.125:0/1400013419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 msgr2=0x7f18e006aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.184+0000 7f18e527a700 1 --2- 172.21.15.125:0/1400013419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 0x7f18e006aee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009840 tx=0x7f18d0009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.184+0000 7f18e527a700 1 -- 172.21.15.125:0/1400013419 shutdown_connections 2023-11-28T11:11:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.184+0000 7f18e527a700 1 --2- 172.21.15.125:0/1400013419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 0x7f18e006aee0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.184+0000 7f18e527a700 1 --2- 172.21.15.125:0/1400013419 >> v2:172.21.15.167:3300/0 conn(0x7f18e00cd5a0 0x7f18e0160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.184+0000 7f18e527a700 1 -- 172.21.15.125:0/1400013419 >> 172.21.15.125:0/1400013419 conn(0x7f18e006c520 msgr2=0x7f18e006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:24.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.184+0000 7f18e527a700 1 -- 172.21.15.125:0/1400013419 shutdown_connections 2023-11-28T11:11:24.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.184+0000 7f18e527a700 1 -- 172.21.15.125:0/1400013419 wait complete. 2023-11-28T11:11:24.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.186+0000 7f18e527a700 1 Processor -- start 2023-11-28T11:11:24.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.186+0000 7f18e527a700 1 -- start start 2023-11-28T11:11:24.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18e527a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 0x7f18e01f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18e527a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e00b22a0 0x7f18e0151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18e527a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18e00cd5a0 0x7f18e0152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18e527a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c8230 con 0x7f18e00cd5a0 2023-11-28T11:11:24.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18e527a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0154f50 con 0x7f18e00b22a0 2023-11-28T11:11:24.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18e527a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0155230 con 0x7f18e006ab10 2023-11-28T11:11:24.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18df7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18e00cd5a0 0x7f18e0152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18df7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18e00cd5a0 0x7f18e0152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60788/0 (socket says 172.21.15.125:60788) 2023-11-28T11:11:24.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18deffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 0x7f18e01f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18de7fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e00b22a0 0x7f18e0151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18df7fe700 1 -- 172.21.15.125:0/2639700884 learned_addr learned my addr 172.21.15.125:0/2639700884 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:24.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18df7fe700 1 -- 172.21.15.125:0/2639700884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 msgr2=0x7f18e01f2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18df7fe700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 0x7f18e01f2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18df7fe700 1 -- 172.21.15.125:0/2639700884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e00b22a0 msgr2=0x7f18e0151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18df7fe700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e00b22a0 0x7f18e0151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18df7fe700 1 -- 172.21.15.125:0/2639700884 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d4009550 con 0x7f18e00cd5a0 2023-11-28T11:11:24.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.187+0000 7f18df7fe700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18e00cd5a0 0x7f18e0152480 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f18d800cca0 tx=0x7f18d800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:24.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.188+0000 7f18c77fe700 1 -- 172.21.15.125:0/2639700884 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800ab70 con 0x7f18e00cd5a0 2023-11-28T11:11:24.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.188+0000 7f18c77fe700 1 -- 172.21.15.125:0/2639700884 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d800acd0 con 0x7f18e00cd5a0 2023-11-28T11:11:24.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.188+0000 7f18e527a700 1 -- 172.21.15.125:0/2639700884 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d00094a0 con 0x7f18e00cd5a0 2023-11-28T11:11:24.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.188+0000 7f18c77fe700 1 -- 172.21.15.125:0/2639700884 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8007310 con 0x7f18e00cd5a0 2023-11-28T11:11:24.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.188+0000 7f18e527a700 1 -- 172.21.15.125:0/2639700884 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e015cad0 con 0x7f18e00cd5a0 2023-11-28T11:11:24.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.189+0000 7f18e527a700 1 -- 172.21.15.125:0/2639700884 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e00d1b70 con 0x7f18e00cd5a0 2023-11-28T11:11:24.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.189+0000 7f18c77fe700 1 -- 172.21.15.125:0/2639700884 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f18d801a030 con 0x7f18e00cd5a0 2023-11-28T11:11:24.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.189+0000 7f18c77fe700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18cc0682f0 0x7f18cc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.190+0000 7f18c77fe700 1 -- 172.21.15.125:0/2639700884 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f18d8085950 con 0x7f18e00cd5a0 2023-11-28T11:11:24.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.190+0000 7f18deffd700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18cc0682f0 0x7f18cc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.190+0000 7f18deffd700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18cc0682f0 0x7f18cc06a7a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009fd0 tx=0x7f18d001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:24.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.194+0000 7f18c77fe700 1 -- 172.21.15.125:0/2639700884 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f18d8052110 con 0x7f18e00cd5a0 2023-11-28T11:11:24.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.377+0000 7f18e527a700 1 -- 172.21.15.125:0/2639700884 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18e00b1ec0 con 0x7f18e00cd5a0 2023-11-28T11:11:24.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.378+0000 7f18c77fe700 1 -- 172.21.15.125:0/2639700884 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18066 (secure 0 0 0) 0x7f18d8018090 con 0x7f18e00cd5a0 2023-11-28T11:11:24.380 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:24.380 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":54,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:11:19.983429+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:10:34.306816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T11:10:35.470755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:11:24.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 -- 172.21.15.125:0/2639700884 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18cc0682f0 msgr2=0x7f18cc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18cc0682f0 0x7f18cc06a7a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009fd0 tx=0x7f18d001c040 comp rx=0 tx=0).stop 2023-11-28T11:11:24.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 -- 172.21.15.125:0/2639700884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18e00cd5a0 msgr2=0x7f18e0152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18e00cd5a0 0x7f18e0152480 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f18d800cca0 tx=0x7f18d800a060 comp rx=0 tx=0).stop 2023-11-28T11:11:24.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 -- 172.21.15.125:0/2639700884 shutdown_connections 2023-11-28T11:11:24.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18e00cd5a0 0x7f18e0152480 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f18cc0682f0 0x7f18cc06a7a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18e006ab10 0x7f18e01f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 --2- 172.21.15.125:0/2639700884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e00b22a0 0x7f18e0151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 -- 172.21.15.125:0/2639700884 >> 172.21.15.125:0/2639700884 conn(0x7f18e006c520 msgr2=0x7f18e00b7460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:24.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 -- 172.21.15.125:0/2639700884 shutdown_connections 2023-11-28T11:11:24.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.380+0000 7f18e527a700 1 -- 172.21.15.125:0/2639700884 wait complete. 2023-11-28T11:11:24.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:10:34.306816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:10:35.470755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:11:24.395 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:11:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.515+0000 7f84116e3700 1 Processor -- start 2023-11-28T11:11:24.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.515+0000 7f84116e3700 1 -- start start 2023-11-28T11:11:24.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.516+0000 7f84116e3700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f840c15a4d0 0x7f840c06a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.516+0000 7f84116e3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f840c06a7b0 0x7f840c0cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.516+0000 7f84116e3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840c06ac00 con 0x7f840c0cdd50 2023-11-28T11:11:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.516+0000 7f84116e3700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c15e0d0 con 0x7f840c15a4d0 2023-11-28T11:11:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.516+0000 7f84116e3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0cc020 con 0x7f840c06a7b0 2023-11-28T11:11:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.516+0000 7f840b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f840c0cdd50 0x7f840c0b1650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44920/0 (socket says 172.21.15.125:44920) 2023-11-28T11:11:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.516+0000 7f840b7fe700 1 -- 172.21.15.125:0/3087142233 learned_addr learned my addr 172.21.15.125:0/3087142233 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f840affd700 1 --2- 172.21.15.125:0/3087142233 >> v2:172.21.15.167:3300/0 conn(0x7f840c15a4d0 0x7f840c06a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f840a7fc700 1 --2- 172.21.15.125:0/3087142233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f840c06a7b0 0x7f840c0cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f8409ffb700 1 -- 172.21.15.125:0/3087142233 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481679970 0 0) 0x7f8404001490 con 0x7f840c0cdd50 2023-11-28T11:11:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f8409ffb700 1 -- 172.21.15.125:0/3087142233 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83f40035b0 con 0x7f840c0cdd50 2023-11-28T11:11:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f840a7fc700 1 -- 172.21.15.125:0/3087142233 >> v2:172.21.15.167:3300/0 conn(0x7f840c15a4d0 msgr2=0x7f840c06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f840a7fc700 1 --2- 172.21.15.125:0/3087142233 >> v2:172.21.15.167:3300/0 conn(0x7f840c15a4d0 0x7f840c06a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f8409ffb700 1 -- 172.21.15.125:0/3087142233 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 225781445 0 0) 0x7f83f40035b0 con 0x7f840c0cdd50 2023-11-28T11:11:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f840a7fc700 1 -- 172.21.15.125:0/3087142233 >> v1:172.21.15.125:6789/0 conn(0x7f840c0cdd50 legacy=0x7f840c0b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f840a7fc700 1 -- 172.21.15.125:0/3087142233 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0ce560 con 0x7f840c06a7b0 2023-11-28T11:11:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f840affd700 1 --2- 172.21.15.125:0/3087142233 >> v2:172.21.15.167:3300/0 conn(0x7f840c15a4d0 0x7f840c06a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:11:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f840a7fc700 1 --2- 172.21.15.125:0/3087142233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f840c06a7b0 0x7f840c0cd810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009840 tx=0x7f83fc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a71d61345a7724 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f8409ffb700 1 -- 172.21.15.125:0/3087142233 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404001b80 con 0x7f840c06a7b0 2023-11-28T11:11:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f8409ffb700 1 -- 172.21.15.125:0/3087142233 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc004030 con 0x7f840c06a7b0 2023-11-28T11:11:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.517+0000 7f8409ffb700 1 -- 172.21.15.125:0/3087142233 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0043a0 con 0x7f840c06a7b0 2023-11-28T11:11:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.518+0000 7f84116e3700 1 -- 172.21.15.125:0/3087142233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f840c06a7b0 msgr2=0x7f840c0cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.518+0000 7f84116e3700 1 --2- 172.21.15.125:0/3087142233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f840c06a7b0 0x7f840c0cd810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009840 tx=0x7f83fc009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.518+0000 7f84116e3700 1 -- 172.21.15.125:0/3087142233 shutdown_connections 2023-11-28T11:11:24.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.518+0000 7f84116e3700 1 --2- 172.21.15.125:0/3087142233 >> v2:172.21.15.167:3300/0 conn(0x7f840c15a4d0 0x7f840c06a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.518+0000 7f84116e3700 1 --2- 172.21.15.125:0/3087142233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f840c06a7b0 0x7f840c0cd810 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.518+0000 7f84116e3700 1 -- 172.21.15.125:0/3087142233 >> 172.21.15.125:0/3087142233 conn(0x7f840c06c010 msgr2=0x7f840c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:24.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.518+0000 7f84116e3700 1 -- 172.21.15.125:0/3087142233 shutdown_connections 2023-11-28T11:11:24.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.518+0000 7f84116e3700 1 -- 172.21.15.125:0/3087142233 wait complete. 2023-11-28T11:11:24.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.519+0000 7f84116e3700 1 Processor -- start 2023-11-28T11:11:24.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.519+0000 7f84116e3700 1 -- start start 2023-11-28T11:11:24.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f84116e3700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f840c06a7b0 0x7f840c0af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f84116e3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0cdd50 0x7f840c14e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f84116e3700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f840c15a4d0 0x7f840c1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f84116e3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c15d800 con 0x7f840c0cdd50 2023-11-28T11:11:24.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f84116e3700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c15cf60 con 0x7f840c06a7b0 2023-11-28T11:11:24.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f84116e3700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c15d240 con 0x7f840c15a4d0 2023-11-28T11:11:24.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f840a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0cdd50 0x7f840c14e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f840a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0cdd50 0x7f840c14e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60800/0 (socket says 172.21.15.125:60800) 2023-11-28T11:11:24.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f840a7fc700 1 -- 172.21.15.125:0/630886685 learned_addr learned my addr 172.21.15.125:0/630886685 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:24.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f840affd700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f840c06a7b0 0x7f840c0af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f840b7fe700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f840c15a4d0 0x7f840c1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f840a7fc700 1 -- 172.21.15.125:0/630886685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f840c15a4d0 msgr2=0x7f840c1554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f840a7fc700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f840c15a4d0 0x7f840c1554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f840a7fc700 1 -- 172.21.15.125:0/630886685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f840c06a7b0 msgr2=0x7f840c0af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f840a7fc700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f840c06a7b0 0x7f840c0af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f840a7fc700 1 -- 172.21.15.125:0/630886685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000094a0 con 0x7f840c0cdd50 2023-11-28T11:11:24.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.520+0000 7f840a7fc700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0cdd50 0x7f840c14e9e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0090b0 tx=0x7f83fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.521+0000 7f83f37fe700 1 -- 172.21.15.125:0/630886685 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc003ea0 con 0x7f840c0cdd50 2023-11-28T11:11:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.521+0000 7f83f37fe700 1 -- 172.21.15.125:0/630886685 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc01f070 con 0x7f840c0cdd50 2023-11-28T11:11:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.521+0000 7f84116e3700 1 -- 172.21.15.125:0/630886685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc0094a0 con 0x7f840c0cdd50 2023-11-28T11:11:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.521+0000 7f83f37fe700 1 -- 172.21.15.125:0/630886685 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc011870 con 0x7f840c0cdd50 2023-11-28T11:11:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.521+0000 7f84116e3700 1 -- 172.21.15.125:0/630886685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c15e600 con 0x7f840c0cdd50 2023-11-28T11:11:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.522+0000 7f84116e3700 1 -- 172.21.15.125:0/630886685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c15e320 con 0x7f840c0cdd50 2023-11-28T11:11:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.523+0000 7f83f37fe700 1 -- 172.21.15.125:0/630886685 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f83fc017020 con 0x7f840c0cdd50 2023-11-28T11:11:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.523+0000 7f83f37fe700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83f80682f0 0x7f83f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.523+0000 7f840affd700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83f80682f0 0x7f83f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.523+0000 7f83f37fe700 1 -- 172.21.15.125:0/630886685 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f83fc021070 con 0x7f840c0cdd50 2023-11-28T11:11:24.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.524+0000 7f840affd700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83f80682f0 0x7f83f806a7a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8400009cd0 tx=0x7f8400009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:24.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.527+0000 7f83f37fe700 1 -- 172.21.15.125:0/630886685 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f83fc054260 con 0x7f840c0cdd50 2023-11-28T11:11:24.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.712+0000 7f84116e3700 1 -- 172.21.15.125:0/630886685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f840c15e8e0 con 0x7f840c0cdd50 2023-11-28T11:11:24.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.713+0000 7f83f37fe700 1 -- 172.21.15.125:0/630886685 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83fc0119d0 con 0x7f840c0cdd50 2023-11-28T11:11:24.714 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:11:24.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 -- 172.21.15.125:0/630886685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83f80682f0 msgr2=0x7f83f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83f80682f0 0x7f83f806a7a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8400009cd0 tx=0x7f8400009210 comp rx=0 tx=0).stop 2023-11-28T11:11:24.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 -- 172.21.15.125:0/630886685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0cdd50 msgr2=0x7f840c14e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0cdd50 0x7f840c14e9e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0090b0 tx=0x7f83fc004750 comp rx=0 tx=0).stop 2023-11-28T11:11:24.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 -- 172.21.15.125:0/630886685 shutdown_connections 2023-11-28T11:11:24.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f83f80682f0 0x7f83f806a7a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f840c15a4d0 0x7f840c1554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f840c06a7b0 0x7f840c0af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 --2- 172.21.15.125:0/630886685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0cdd50 0x7f840c14e9e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 -- 172.21.15.125:0/630886685 >> 172.21.15.125:0/630886685 conn(0x7f840c06c010 msgr2=0x7f840c154a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 -- 172.21.15.125:0/630886685 shutdown_connections 2023-11-28T11:11:24.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.715+0000 7f84116e3700 1 -- 172.21.15.125:0/630886685 wait complete. 2023-11-28T11:11:24.729 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:11:24.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.851+0000 7f0ce294b700 1 Processor -- start 2023-11-28T11:11:24.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.851+0000 7f0ce294b700 1 -- start start 2023-11-28T11:11:24.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.852+0000 7f0ce294b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc158e10 0x7f0cdc0cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.852+0000 7f0ce294b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc0ca140 con 0x7f0cdc0ae850 2023-11-28T11:11:24.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.852+0000 7f0ce294b700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc0c9b80 con 0x7f0cdc06cb50 2023-11-28T11:11:24.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.852+0000 7f0ce294b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc06ac30 con 0x7f0cdc158e10 2023-11-28T11:11:24.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0cdc0ae850 0x7f0cdc06c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44930/0 (socket says 172.21.15.125:44930) 2023-11-28T11:11:24.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdb7fe700 1 -- 172.21.15.125:0/1658634692 learned_addr learned my addr 172.21.15.125:0/1658634692 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:24.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883283670 0 0) 0x7f0cdc0ca140 con 0x7f0cdc0ae850 2023-11-28T11:11:24.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc40046c0 con 0x7f0cdc0ae850 2023-11-28T11:11:24.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdbfff700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc158e10 0x7f0cdc0cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3391725801 0 0) 0x7f0cc40046c0 con 0x7f0cdc0ae850 2023-11-28T11:11:24.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc158e10 msgr2=0x7f0cdc0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:24.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc158e10 0x7f0cdc0cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 >> v1:172.21.15.167:6789/0 conn(0x7f0cdc06cb50 legacy=0x7f0cdc070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc0c9e60 con 0x7f0cdc0ae850 2023-11-28T11:11:24.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f0ccc001670 con 0x7f0cdc0ae850 2023-11-28T11:11:24.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 >> v1:172.21.15.125:6789/0 conn(0x7f0cdc0ae850 legacy=0x7f0cdc06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4004b40 0x7f0cc4004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cc4005960 0x7f0cc4005dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc158e10 0x7f0cc4006330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc400cbf0 con 0x7f0cc4005960 2023-11-28T11:11:24.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc400cd60 con 0x7f0cc4004b40 2023-11-28T11:11:24.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4003630 con 0x7f0cdc158e10 2023-11-28T11:11:24.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdb7fe700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cc4005960 0x7f0cc4005dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0cdbfff700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4004b40 0x7f0cc4004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.853+0000 7f0ce0ee8700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc158e10 0x7f0cc4006330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0cdb7fe700 1 -- 172.21.15.125:0/1658634692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc158e10 msgr2=0x7f0cc4006330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:24.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0cdb7fe700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc158e10 0x7f0cc4006330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0cdb7fe700 1 -- 172.21.15.125:0/1658634692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4004b40 msgr2=0x7f0cc4004f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:24.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0cdb7fe700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4004b40 0x7f0cc4004f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0cdb7fe700 1 -- 172.21.15.125:0/1658634692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc40046c0 con 0x7f0cc4005960 2023-11-28T11:11:24.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0cdb7fe700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cc4005960 0x7f0cc4005dd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00c240 tx=0x7f0cc4006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88520fb9e5c71124 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:24.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc007c10 con 0x7f0cc4005960 2023-11-28T11:11:24.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc00cde0 con 0x7f0cc4005960 2023-11-28T11:11:24.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0cdaffd700 1 -- 172.21.15.125:0/1658634692 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc005ba0 con 0x7f0cc4005960 2023-11-28T11:11:24.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0ce294b700 1 -- 172.21.15.125:0/1658634692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cc4005960 msgr2=0x7f0cc4005dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0ce294b700 1 --2- 172.21.15.125:0/1658634692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cc4005960 0x7f0cc4005dd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00c240 tx=0x7f0cc4006990 comp rx=0 tx=0).stop 2023-11-28T11:11:24.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0ce0ee8700 1 -- 172.21.15.125:0/1658634692 reap_dead start 2023-11-28T11:11:24.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0ce294b700 1 -- 172.21.15.125:0/1658634692 shutdown_connections 2023-11-28T11:11:24.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0ce294b700 1 -- 172.21.15.125:0/1658634692 >> 172.21.15.125:0/1658634692 conn(0x7f0cdc0cf400 msgr2=0x7f0cdc0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:24.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0ce294b700 1 -- 172.21.15.125:0/1658634692 shutdown_connections 2023-11-28T11:11:24.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.854+0000 7f0ce294b700 1 -- 172.21.15.125:0/1658634692 wait complete. 2023-11-28T11:11:24.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.856+0000 7f0ce294b700 1 Processor -- start 2023-11-28T11:11:24.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.856+0000 7f0ce294b700 1 -- start start 2023-11-28T11:11:24.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce294b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4005960 0x7f0cdc14d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce294b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc0cb570 0x7f0cdc0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce294b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc0b4280 0x7f0cdc0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce294b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc0cbf20 con 0x7f0cdc0b4280 2023-11-28T11:11:24.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce294b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc0b4c30 con 0x7f0cc4005960 2023-11-28T11:11:24.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce294b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc159f90 con 0x7f0cdc0cb570 2023-11-28T11:11:24.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce0ee8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc0b4280 0x7f0cdc0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce0ee8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc0b4280 0x7f0cdc0b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60820/0 (socket says 172.21.15.125:60820) 2023-11-28T11:11:24.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce0ee8700 1 -- 172.21.15.125:0/1257789201 learned_addr learned my addr 172.21.15.125:0/1257789201 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:24.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0cdb7fe700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc0cb570 0x7f0cdc0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0cdbfff700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4005960 0x7f0cdc14d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce0ee8700 1 -- 172.21.15.125:0/1257789201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc0cb570 msgr2=0x7f0cdc0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce0ee8700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc0cb570 0x7f0cdc0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce0ee8700 1 -- 172.21.15.125:0/1257789201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4005960 msgr2=0x7f0cdc14d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:24.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce0ee8700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4005960 0x7f0cdc14d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:24.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0ce0ee8700 1 -- 172.21.15.125:0/1257789201 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc06b100 con 0x7f0cdc0b4280 2023-11-28T11:11:24.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0cdb7fe700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc0cb570 0x7f0cdc0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:24.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.857+0000 7f0cdbfff700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4005960 0x7f0cdc14d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:24.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.858+0000 7f0ce0ee8700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc0b4280 0x7f0cdc0b46f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc06d340 tx=0x7f0cd400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:24.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.858+0000 7f0cd8ff9700 1 -- 172.21.15.125:0/1257789201 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40020d0 con 0x7f0cdc0b4280 2023-11-28T11:11:24.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.858+0000 7f0cd8ff9700 1 -- 172.21.15.125:0/1257789201 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd4003c10 con 0x7f0cdc0b4280 2023-11-28T11:11:24.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.858+0000 7f0cd8ff9700 1 -- 172.21.15.125:0/1257789201 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400d930 con 0x7f0cdc0b4280 2023-11-28T11:11:24.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.858+0000 7f0ce294b700 1 -- 172.21.15.125:0/1257789201 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc06ae20 con 0x7f0cdc0b4280 2023-11-28T11:11:24.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.858+0000 7f0ce294b700 1 -- 172.21.15.125:0/1257789201 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc06b620 con 0x7f0cdc0b4280 2023-11-28T11:11:24.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.859+0000 7f0ce294b700 1 -- 172.21.15.125:0/1257789201 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc15a120 con 0x7f0cdc0b4280 2023-11-28T11:11:24.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.859+0000 7f0cd8ff9700 1 -- 172.21.15.125:0/1257789201 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0cd400da90 con 0x7f0cdc0b4280 2023-11-28T11:11:24.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.859+0000 7f0cd8ff9700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0cc80682f0 0x7f0cc806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:24.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.860+0000 7f0cd8ff9700 1 -- 172.21.15.125:0/1257789201 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0cd4085ff0 con 0x7f0cdc0b4280 2023-11-28T11:11:24.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.860+0000 7f0cdbfff700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0cc80682f0 0x7f0cc806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:24.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.860+0000 7f0cdbfff700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0cc80682f0 0x7f0cc806a7a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009c60 tx=0x7f0cd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:24.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:24.864+0000 7f0cd8ff9700 1 -- 172.21.15.125:0/1257789201 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0cd40527b0 con 0x7f0cdc0b4280 2023-11-28T11:11:25.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.048+0000 7f0ce294b700 1 -- 172.21.15.125:0/1257789201 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0cdc0743f0 con 0x7f0cdc0b4280 2023-11-28T11:11:25.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.048+0000 7f0cd8ff9700 1 -- 172.21.15.125:0/1257789201 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0cd4055dd0 con 0x7f0cdc0b4280 2023-11-28T11:11:25.050 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:11:25.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 -- 172.21.15.125:0/1257789201 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0cc80682f0 msgr2=0x7f0cc806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0cc80682f0 0x7f0cc806a7a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009c60 tx=0x7f0cd0008040 comp rx=0 tx=0).stop 2023-11-28T11:11:25.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 -- 172.21.15.125:0/1257789201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc0b4280 msgr2=0x7f0cdc0b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc0b4280 0x7f0cdc0b46f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc06d340 tx=0x7f0cd400d430 comp rx=0 tx=0).stop 2023-11-28T11:11:25.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 -- 172.21.15.125:0/1257789201 shutdown_connections 2023-11-28T11:11:25.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc0b4280 0x7f0cdc0b46f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4005960 0x7f0cdc14d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0cc80682f0 0x7f0cc806a7a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 --2- 172.21.15.125:0/1257789201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc0cb570 0x7f0cdc0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 -- 172.21.15.125:0/1257789201 >> 172.21.15.125:0/1257789201 conn(0x7f0cdc0cf400 msgr2=0x7f0cdc0af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:25.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 -- 172.21.15.125:0/1257789201 shutdown_connections 2023-11-28T11:11:25.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.050+0000 7f0ce294b700 1 -- 172.21.15.125:0/1257789201 wait complete. 2023-11-28T11:11:25.064 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:11:25.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.186+0000 7fa7a2d89700 1 Processor -- start 2023-11-28T11:11:25.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.186+0000 7fa7a2d89700 1 -- start start 2023-11-28T11:11:25.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa7a2d89700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa79c0cec00 0x7fa79c065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa7a2d89700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0cac90 0x7fa79c0cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa7a2d89700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c15ceb0 con 0x7fa79c160300 2023-11-28T11:11:25.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa7a2d89700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c0cb650 con 0x7fa79c0cec00 2023-11-28T11:11:25.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa7a2d89700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1608c0 con 0x7fa79c0cac90 2023-11-28T11:11:25.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79bfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa79c160300 0x7fa79c15d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44950/0 (socket says 172.21.15.125:44950) 2023-11-28T11:11:25.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79bfff700 1 -- 172.21.15.125:0/1363230467 learned_addr learned my addr 172.21.15.125:0/1363230467 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:25.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa7a0b25700 1 --2- 172.21.15.125:0/1363230467 >> v2:172.21.15.167:3300/0 conn(0x7fa79c0cec00 0x7fa79c065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa7a1326700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0cac90 0x7fa79c0cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302240816 0 0) 0x7fa79c15ceb0 con 0x7fa79c160300 2023-11-28T11:11:25.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7840035b0 con 0x7fa79c160300 2023-11-28T11:11:25.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1357275976 0 0) 0x7fa7840035b0 con 0x7fa79c160300 2023-11-28T11:11:25.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0cac90 msgr2=0x7fa79c0cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:25.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0cac90 0x7fa79c0cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 >> v2:172.21.15.167:3300/0 conn(0x7fa79c0cec00 msgr2=0x7fa79c065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:25.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 --2- 172.21.15.125:0/1363230467 >> v2:172.21.15.167:3300/0 conn(0x7fa79c0cec00 0x7fa79c065fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c160ba0 con 0x7fa79c160300 2023-11-28T11:11:25.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fa790001670 con 0x7fa79c160300 2023-11-28T11:11:25.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 >> v1:172.21.15.125:6789/0 conn(0x7fa79c160300 legacy=0x7fa79c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa784003a00 0x7fa784003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 0x7fa7840048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0cac90 0x7fa784004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0cb650 con 0x7fa784004430 2023-11-28T11:11:25.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1608c0 con 0x7fa784003a00 2023-11-28T11:11:25.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.188+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78400ba10 con 0x7fa79c0cac90 2023-11-28T11:11:25.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa79bfff700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 0x7fa7840048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa7a0b25700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa784003a00 0x7fa784003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa7a1326700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0cac90 0x7fa784004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa79bfff700 1 -- 172.21.15.125:0/1363230467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0cac90 msgr2=0x7fa784004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:25.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa79bfff700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0cac90 0x7fa784004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa79bfff700 1 -- 172.21.15.125:0/1363230467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa784003a00 msgr2=0x7fa784003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:25.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa79bfff700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa784003a00 0x7fa784003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa79bfff700 1 -- 172.21.15.125:0/1363230467 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7840035b0 con 0x7fa784004430 2023-11-28T11:11:25.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa79bfff700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 0x7fa7840048f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa79000c370 tx=0x7fa784005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b573381fe9096090 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:25.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790007c60 con 0x7fa784004430 2023-11-28T11:11:25.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790005960 con 0x7fa784004430 2023-11-28T11:11:25.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa79b7fe700 1 -- 172.21.15.125:0/1363230467 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790005d10 con 0x7fa784004430 2023-11-28T11:11:25.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa7a2d89700 1 -- 172.21.15.125:0/1363230467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 msgr2=0x7fa7840048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.189+0000 7fa7a2d89700 1 --2- 172.21.15.125:0/1363230467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 0x7fa7840048f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa79000c370 tx=0x7fa784005880 comp rx=0 tx=0).stop 2023-11-28T11:11:25.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.190+0000 7fa7a1326700 1 -- 172.21.15.125:0/1363230467 reap_dead start 2023-11-28T11:11:25.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.190+0000 7fa7a2d89700 1 -- 172.21.15.125:0/1363230467 shutdown_connections 2023-11-28T11:11:25.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.190+0000 7fa7a2d89700 1 -- 172.21.15.125:0/1363230467 >> 172.21.15.125:0/1363230467 conn(0x7fa79c0cf400 msgr2=0x7fa79c0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:25.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.190+0000 7fa7a2d89700 1 -- 172.21.15.125:0/1363230467 shutdown_connections 2023-11-28T11:11:25.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.190+0000 7fa7a2d89700 1 -- 172.21.15.125:0/1363230467 wait complete. 2023-11-28T11:11:25.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.191+0000 7fa7a2d89700 1 Processor -- start 2023-11-28T11:11:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.191+0000 7fa7a2d89700 1 -- start start 2023-11-28T11:11:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a2d89700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 0x7fa79c1549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a2d89700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa79c0c7110 0x7fa79c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a2d89700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0c7580 0x7fa79c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a2d89700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0c8c40 con 0x7fa784004430 2023-11-28T11:11:25.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a2d89700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0c8030 con 0x7fa79c0c7110 2023-11-28T11:11:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a2d89700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0c8310 con 0x7fa79c0c7580 2023-11-28T11:11:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a0b25700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 0x7fa79c1549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a0b25700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 0x7fa79c1549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60836/0 (socket says 172.21.15.125:60836) 2023-11-28T11:11:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a0b25700 1 -- 172.21.15.125:0/3099189808 learned_addr learned my addr 172.21.15.125:0/3099189808 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa79bfff700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa79c0c7110 0x7fa79c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a1326700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0c7580 0x7fa79c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a0b25700 1 -- 172.21.15.125:0/3099189808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0c7580 msgr2=0x7fa79c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a0b25700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0c7580 0x7fa79c15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a0b25700 1 -- 172.21.15.125:0/3099189808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa79c0c7110 msgr2=0x7fa79c15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a0b25700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa79c0c7110 0x7fa79c15efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a0b25700 1 -- 172.21.15.125:0/3099189808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c161160 con 0x7fa784004430 2023-11-28T11:11:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a0b25700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 0x7fa79c1549b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009f90 tx=0x7fa78c00f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7997fa700 1 -- 172.21.15.125:0/3099189808 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00e040 con 0x7fa784004430 2023-11-28T11:11:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7997fa700 1 -- 172.21.15.125:0/3099189808 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c00f040 con 0x7fa784004430 2023-11-28T11:11:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a2d89700 1 -- 172.21.15.125:0/3099189808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c160e80 con 0x7fa784004430 2023-11-28T11:11:25.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7997fa700 1 -- 172.21.15.125:0/3099189808 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c015430 con 0x7fa784004430 2023-11-28T11:11:25.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.192+0000 7fa7a2d89700 1 -- 172.21.15.125:0/3099189808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c066510 con 0x7fa784004430 2023-11-28T11:11:25.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.193+0000 7fa7a2d89700 1 -- 172.21.15.125:0/3099189808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c0c8f20 con 0x7fa784004430 2023-11-28T11:11:25.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.194+0000 7fa7997fa700 1 -- 172.21.15.125:0/3099189808 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa78c015590 con 0x7fa784004430 2023-11-28T11:11:25.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.194+0000 7fa7997fa700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa7880682f0 0x7fa78806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.194+0000 7fa7997fa700 1 -- 172.21.15.125:0/3099189808 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa78c0868f0 con 0x7fa784004430 2023-11-28T11:11:25.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.194+0000 7fa79bfff700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa7880682f0 0x7fa78806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.195+0000 7fa79bfff700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa7880682f0 0x7fa78806a7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0cccd0 tx=0x7fa79000a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:25.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.198+0000 7fa7997fa700 1 -- 172.21.15.125:0/3099189808 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa78c053110 con 0x7fa784004430 2023-11-28T11:11:25.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.380+0000 7fa7a2d89700 1 -- 172.21.15.125:0/3099189808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa79c0cefd0 con 0x7fa784004430 2023-11-28T11:11:25.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.381+0000 7fa7997fa700 1 -- 172.21.15.125:0/3099189808 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa78c056730 con 0x7fa784004430 2023-11-28T11:11:25.382 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:11:25.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.382+0000 7fa7a2d89700 1 -- 172.21.15.125:0/3099189808 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa7880682f0 msgr2=0x7fa78806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.382+0000 7fa7a2d89700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa7880682f0 0x7fa78806a7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0cccd0 tx=0x7fa79000a000 comp rx=0 tx=0).stop 2023-11-28T11:11:25.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.382+0000 7fa7a2d89700 1 -- 172.21.15.125:0/3099189808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 msgr2=0x7fa79c1549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.382+0000 7fa7a2d89700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 0x7fa79c1549b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009f90 tx=0x7fa78c00f490 comp rx=0 tx=0).stop 2023-11-28T11:11:25.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.383+0000 7fa7a2d89700 1 -- 172.21.15.125:0/3099189808 shutdown_connections 2023-11-28T11:11:25.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.383+0000 7fa7a2d89700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa7880682f0 0x7fa78806a7a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.383+0000 7fa7a2d89700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0c7580 0x7fa79c15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.383+0000 7fa7a2d89700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa784004430 0x7fa79c1549b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.383+0000 7fa7a2d89700 1 --2- 172.21.15.125:0/3099189808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa79c0c7110 0x7fa79c15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.383+0000 7fa7a2d89700 1 -- 172.21.15.125:0/3099189808 >> 172.21.15.125:0/3099189808 conn(0x7fa79c0cf400 msgr2=0x7fa79c155f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:25.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.383+0000 7fa7a2d89700 1 -- 172.21.15.125:0/3099189808 shutdown_connections 2023-11-28T11:11:25.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.383+0000 7fa7a2d89700 1 -- 172.21.15.125:0/3099189808 wait complete. 2023-11-28T11:11:25.396 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:11:25.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.517+0000 7f9ca5595700 1 Processor -- start 2023-11-28T11:11:25.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.517+0000 7f9ca5595700 1 -- start start 2023-11-28T11:11:25.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.518+0000 7f9ca5595700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9ca00b1650 0x7f9ca00b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.518+0000 7f9ca5595700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca01599b0 0x7f9ca015d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.518+0000 7f9ca5595700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca0159ec0 con 0x7f9ca00af0a0 2023-11-28T11:11:25.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.518+0000 7f9ca5595700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca015aa60 con 0x7f9ca00b1650 2023-11-28T11:11:25.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.518+0000 7f9ca5595700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00b1f60 con 0x7f9ca01599b0 2023-11-28T11:11:25.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.518+0000 7f9c9f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9ca00af0a0 0x7f9ca015a350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:44970/0 (socket says 172.21.15.125:44970) 2023-11-28T11:11:25.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.518+0000 7f9c9f7fe700 1 -- 172.21.15.125:0/283073243 learned_addr learned my addr 172.21.15.125:0/283073243 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:25.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.518+0000 7f9c9effd700 1 --2- 172.21.15.125:0/283073243 >> v2:172.21.15.167:3300/0 conn(0x7f9ca00b1650 0x7f9ca00b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.518+0000 7f9c9e7fc700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca01599b0 0x7f9ca015d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.518+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010149843 0 0) 0x7f9ca0159ec0 con 0x7f9ca00af0a0 2023-11-28T11:11:25.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c880035b0 con 0x7f9ca00af0a0 2023-11-28T11:11:25.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 110936249 0 0) 0x7f9c880035b0 con 0x7f9ca00af0a0 2023-11-28T11:11:25.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca01599b0 msgr2=0x7f9ca015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:25.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca01599b0 0x7f9ca015d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 >> v2:172.21.15.167:3300/0 conn(0x7f9ca00b1650 msgr2=0x7f9ca00b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:25.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 --2- 172.21.15.125:0/283073243 >> v2:172.21.15.167:3300/0 conn(0x7f9ca00b1650 0x7f9ca00b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca015d8a0 con 0x7f9ca00af0a0 2023-11-28T11:11:25.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f9c980019f0 con 0x7f9ca00af0a0 2023-11-28T11:11:25.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 >> v1:172.21.15.125:6789/0 conn(0x7f9ca00af0a0 legacy=0x7f9ca015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c88003a00 0x7f9c88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c88004350 0x7f9c88004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 0x7f9c880052f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca015aa60 con 0x7f9c88004e80 2023-11-28T11:11:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00b1f60 con 0x7f9c88004350 2023-11-28T11:11:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8800bd70 con 0x7f9c88003a00 2023-11-28T11:11:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9f7fe700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 0x7f9c880052f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9effd700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c88003a00 0x7f9c88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9e7fc700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c88004350 0x7f9c88004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9f7fe700 1 -- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c88003a00 msgr2=0x7f9c88003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9f7fe700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c88003a00 0x7f9c88003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9f7fe700 1 -- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c88004350 msgr2=0x7f9c88004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9f7fe700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c88004350 0x7f9c88004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9f7fe700 1 -- 172.21.15.125:0/283073243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c880035b0 con 0x7f9c88004e80 2023-11-28T11:11:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9e7fc700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c88004350 0x7f9c88004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:25.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9effd700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c88003a00 0x7f9c88003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9f7fe700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 0x7f9c880052f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800a8d0 tx=0x7f9c88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3522367d5dc6b294 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9800a340 con 0x7f9c88004e80 2023-11-28T11:11:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.519+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c98012600 con 0x7f9c88004e80 2023-11-28T11:11:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.520+0000 7f9c9dffb700 1 -- 172.21.15.125:0/283073243 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c980129b0 con 0x7f9c88004e80 2023-11-28T11:11:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.520+0000 7f9ca5595700 1 -- 172.21.15.125:0/283073243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 msgr2=0x7f9c880052f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.520+0000 7f9ca5595700 1 --2- 172.21.15.125:0/283073243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 0x7f9c880052f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800a8d0 tx=0x7f9c88005880 comp rx=0 tx=0).stop 2023-11-28T11:11:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.520+0000 7f9c9f7fe700 1 -- 172.21.15.125:0/283073243 reap_dead start 2023-11-28T11:11:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.520+0000 7f9ca5595700 1 -- 172.21.15.125:0/283073243 shutdown_connections 2023-11-28T11:11:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.520+0000 7f9ca5595700 1 -- 172.21.15.125:0/283073243 >> 172.21.15.125:0/283073243 conn(0x7f9ca006c010 msgr2=0x7f9ca00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:25.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.520+0000 7f9ca5595700 1 -- 172.21.15.125:0/283073243 shutdown_connections 2023-11-28T11:11:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.520+0000 7f9ca5595700 1 -- 172.21.15.125:0/283073243 wait complete. 2023-11-28T11:11:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.521+0000 7f9ca5595700 1 Processor -- start 2023-11-28T11:11:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.521+0000 7f9ca5595700 1 -- start start 2023-11-28T11:11:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.522+0000 7f9ca5595700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 0x7f9ca0158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.522+0000 7f9ca5595700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ca01f3760 0x7f9ca00cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.522+0000 7f9ca5595700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca00a89a0 0x7f9ca00a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.522+0000 7f9ca5595700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00a9380 con 0x7f9c88004e80 2023-11-28T11:11:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.522+0000 7f9ca5595700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca0158fc0 con 0x7f9ca01f3760 2023-11-28T11:11:25.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.522+0000 7f9ca5595700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca015ad40 con 0x7f9ca00a89a0 2023-11-28T11:11:25.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.522+0000 7f9c9effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 0x7f9ca0158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.522+0000 7f9c9effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 0x7f9ca0158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60854/0 (socket says 172.21.15.125:60854) 2023-11-28T11:11:25.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.522+0000 7f9c9effd700 1 -- 172.21.15.125:0/1390985514 learned_addr learned my addr 172.21.15.125:0/1390985514 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:25.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.522+0000 7f9c9effd700 1 -- 172.21.15.125:0/1390985514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca00a89a0 msgr2=0x7f9ca00a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.522+0000 7f9c9effd700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca00a89a0 0x7f9ca00a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.523+0000 7f9c9effd700 1 -- 172.21.15.125:0/1390985514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ca01f3760 msgr2=0x7f9ca00cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.523+0000 7f9c9effd700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ca01f3760 0x7f9ca00cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.523+0000 7f9c9effd700 1 -- 172.21.15.125:0/1390985514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca015de60 con 0x7f9c88004e80 2023-11-28T11:11:25.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.523+0000 7f9c9effd700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 0x7f9ca0158a80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9c94010910 tx=0x7f9c94010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:25.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.523+0000 7f9c877fe700 1 -- 172.21.15.125:0/1390985514 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94004020 con 0x7f9c88004e80 2023-11-28T11:11:25.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.523+0000 7f9c877fe700 1 -- 172.21.15.125:0/1390985514 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c94004180 con 0x7f9c88004e80 2023-11-28T11:11:25.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.523+0000 7f9c877fe700 1 -- 172.21.15.125:0/1390985514 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94004530 con 0x7f9c88004e80 2023-11-28T11:11:25.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.523+0000 7f9ca5595700 1 -- 172.21.15.125:0/1390985514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca015db80 con 0x7f9c88004e80 2023-11-28T11:11:25.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.523+0000 7f9ca5595700 1 -- 172.21.15.125:0/1390985514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca015d050 con 0x7f9c88004e80 2023-11-28T11:11:25.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.524+0000 7f9ca5595700 1 -- 172.21.15.125:0/1390985514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca015bbf0 con 0x7f9c88004e80 2023-11-28T11:11:25.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.524+0000 7f9c877fe700 1 -- 172.21.15.125:0/1390985514 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9c94025070 con 0x7f9c88004e80 2023-11-28T11:11:25.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.524+0000 7f9c877fe700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9c8c0682f0 0x7f9c8c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.525+0000 7f9c877fe700 1 -- 172.21.15.125:0/1390985514 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9c94085f00 con 0x7f9c88004e80 2023-11-28T11:11:25.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.525+0000 7f9c9e7fc700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9c8c0682f0 0x7f9c8c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.525+0000 7f9c9e7fc700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9c8c0682f0 0x7f9c8c06a7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9ca01e9690 tx=0x7f9c90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:25.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.529+0000 7f9c877fe700 1 -- 172.21.15.125:0/1390985514 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9c94052720 con 0x7f9c88004e80 2023-11-28T11:11:25.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.709+0000 7f9ca5595700 1 -- 172.21.15.125:0/1390985514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ca0068450 con 0x7f9c88004e80 2023-11-28T11:11:25.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.709+0000 7f9c877fe700 1 -- 172.21.15.125:0/1390985514 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c940230a0 con 0x7f9c88004e80 2023-11-28T11:11:25.711 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:11:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 -- 172.21.15.125:0/1390985514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9c8c0682f0 msgr2=0x7f9c8c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9c8c0682f0 0x7f9c8c06a7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9ca01e9690 tx=0x7f9c90008040 comp rx=0 tx=0).stop 2023-11-28T11:11:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 -- 172.21.15.125:0/1390985514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 msgr2=0x7f9ca0158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 0x7f9ca0158a80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9c94010910 tx=0x7f9c94010cd0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 -- 172.21.15.125:0/1390985514 shutdown_connections 2023-11-28T11:11:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f9c8c0682f0 0x7f9c8c06a7a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca00a89a0 0x7f9ca00a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c88004e80 0x7f9ca0158a80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 --2- 172.21.15.125:0/1390985514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ca01f3760 0x7f9ca00cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 -- 172.21.15.125:0/1390985514 >> 172.21.15.125:0/1390985514 conn(0x7f9ca006c010 msgr2=0x7f9ca006cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:25.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 -- 172.21.15.125:0/1390985514 shutdown_connections 2023-11-28T11:11:25.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.711+0000 7f9ca5595700 1 -- 172.21.15.125:0/1390985514 wait complete. 2023-11-28T11:11:25.724 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:11:25.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.842+0000 7f760cff4700 1 Processor -- start 2023-11-28T11:11:25.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.842+0000 7f760cff4700 1 -- start start 2023-11-28T11:11:25.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.843+0000 7f760cff4700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f760815cc80 0x7f760806de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.843+0000 7f760cff4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f760806e3a0 0x7f7608070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.843+0000 7f760cff4700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76080b1810 con 0x7f760806a270 2023-11-28T11:11:25.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.843+0000 7f760cff4700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76080b2490 con 0x7f760815cc80 2023-11-28T11:11:25.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.843+0000 7f760cff4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76080b1af0 con 0x7f760806e3a0 2023-11-28T11:11:25.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f7605d9b700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f760815cc80 0x7f760806de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f7606d9d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f760806e3a0 0x7f7608070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f760659c700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f760806a270 0x7f760806a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:47788/0 (socket says 172.21.15.125:47788) 2023-11-28T11:11:25.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f760659c700 1 -- 172.21.15.125:0/2067156734 learned_addr learned my addr 172.21.15.125:0/2067156734 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:25.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f7606d9d700 1 -- 172.21.15.125:0/2067156734 >> v2:172.21.15.167:3300/0 conn(0x7f760815cc80 msgr2=0x7f760806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:25.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f7606d9d700 1 --2- 172.21.15.125:0/2067156734 >> v2:172.21.15.167:3300/0 conn(0x7f760815cc80 0x7f760806de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f7606d9d700 1 -- 172.21.15.125:0/2067156734 >> v1:172.21.15.167:6789/0 conn(0x7f760806a270 legacy=0x7f760806a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f7606d9d700 1 -- 172.21.15.125:0/2067156734 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76080b1dd0 con 0x7f760806e3a0 2023-11-28T11:11:25.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f7605d9b700 1 --2- 172.21.15.125:0/2067156734 >> v2:172.21.15.167:3300/0 conn(0x7f760815cc80 0x7f760806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:11:25.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f7606d9d700 1 --2- 172.21.15.125:0/2067156734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f760806e3a0 0x7f7608070d20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7600009d90 tx=0x7f760000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=827ee58ca827919 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:25.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f760559a700 1 -- 172.21.15.125:0/2067156734 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760000e070 con 0x7f760806e3a0 2023-11-28T11:11:25.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f760559a700 1 -- 172.21.15.125:0/2067156734 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760000bb20 con 0x7f760806e3a0 2023-11-28T11:11:25.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.844+0000 7f760559a700 1 -- 172.21.15.125:0/2067156734 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600012430 con 0x7f760806e3a0 2023-11-28T11:11:25.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.845+0000 7f760cff4700 1 -- 172.21.15.125:0/2067156734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f760806e3a0 msgr2=0x7f7608070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.845+0000 7f760cff4700 1 --2- 172.21.15.125:0/2067156734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f760806e3a0 0x7f7608070d20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7600009d90 tx=0x7f760000b330 comp rx=0 tx=0).stop 2023-11-28T11:11:25.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.845+0000 7f760cff4700 1 -- 172.21.15.125:0/2067156734 shutdown_connections 2023-11-28T11:11:25.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.845+0000 7f760cff4700 1 --2- 172.21.15.125:0/2067156734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f760806e3a0 0x7f7608070d20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.845+0000 7f760cff4700 1 --2- 172.21.15.125:0/2067156734 >> v2:172.21.15.167:3300/0 conn(0x7f760815cc80 0x7f760806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.845+0000 7f760cff4700 1 -- 172.21.15.125:0/2067156734 >> 172.21.15.125:0/2067156734 conn(0x7f760806c010 msgr2=0x7f76080cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:25.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.845+0000 7f760cff4700 1 -- 172.21.15.125:0/2067156734 shutdown_connections 2023-11-28T11:11:25.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.845+0000 7f760cff4700 1 -- 172.21.15.125:0/2067156734 wait complete. 2023-11-28T11:11:25.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.846+0000 7f760cff4700 1 Processor -- start 2023-11-28T11:11:25.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.846+0000 7f760cff4700 1 -- start start 2023-11-28T11:11:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f760cff4700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f760806a270 0x7f7608153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f760cff4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760806e3a0 0x7f76080b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f760cff4700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f760815cc80 0x7f760815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f760cff4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7608153750 con 0x7f760806e3a0 2023-11-28T11:11:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f760cff4700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76080b4080 con 0x7f760806a270 2023-11-28T11:11:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f760cff4700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76080b3470 con 0x7f760815cc80 2023-11-28T11:11:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f7605d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760806e3a0 0x7f76080b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f7605d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760806e3a0 0x7f76080b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60868/0 (socket says 172.21.15.125:60868) 2023-11-28T11:11:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f7605d9b700 1 -- 172.21.15.125:0/3147458075 learned_addr learned my addr 172.21.15.125:0/3147458075 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f760659c700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f760806a270 0x7f7608153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f7606d9d700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f760815cc80 0x7f760815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f7605d9b700 1 -- 172.21.15.125:0/3147458075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f760815cc80 msgr2=0x7f760815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f7605d9b700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f760815cc80 0x7f760815edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f7605d9b700 1 -- 172.21.15.125:0/3147458075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f760806a270 msgr2=0x7f7608153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f7605d9b700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f760806a270 0x7f7608153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.847+0000 7f7605d9b700 1 -- 172.21.15.125:0/3147458075 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80094a0 con 0x7f760806e3a0 2023-11-28T11:11:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.848+0000 7f7605d9b700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760806e3a0 0x7f76080b2b20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f75f800ebe0 tx=0x7f75f800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.848+0000 7f75f6ffd700 1 -- 172.21.15.125:0/3147458075 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8009800 con 0x7f760806e3a0 2023-11-28T11:11:25.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.848+0000 7f75f6ffd700 1 -- 172.21.15.125:0/3147458075 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f800c8b0 con 0x7f760806e3a0 2023-11-28T11:11:25.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.848+0000 7f760cff4700 1 -- 172.21.15.125:0/3147458075 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7600009a70 con 0x7f760806e3a0 2023-11-28T11:11:25.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.848+0000 7f75f6ffd700 1 -- 172.21.15.125:0/3147458075 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f800cc20 con 0x7f760806e3a0 2023-11-28T11:11:25.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.848+0000 7f760cff4700 1 -- 172.21.15.125:0/3147458075 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760806e800 con 0x7f760806e3a0 2023-11-28T11:11:25.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.849+0000 7f760cff4700 1 -- 172.21.15.125:0/3147458075 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76080b20b0 con 0x7f760806e3a0 2023-11-28T11:11:25.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.849+0000 7f75f6ffd700 1 -- 172.21.15.125:0/3147458075 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f75f8019030 con 0x7f760806e3a0 2023-11-28T11:11:25.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.850+0000 7f75f6ffd700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75e80682f0 0x7f75e806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:25.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.850+0000 7f760659c700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75e80682f0 0x7f75e806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:25.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.850+0000 7f75f6ffd700 1 -- 172.21.15.125:0/3147458075 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f75f8085cb0 con 0x7f760806e3a0 2023-11-28T11:11:25.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.850+0000 7f760659c700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75e80682f0 0x7f75e806a7a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f75fc005910 tx=0x7f75fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:25.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:25.854+0000 7f75f6ffd700 1 -- 172.21.15.125:0/3147458075 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f75f8052470 con 0x7f760806e3a0 2023-11-28T11:11:26.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.079+0000 7f760cff4700 1 -- 172.21.15.125:0/3147458075 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f760815daa0 con 0x7f760806e3a0 2023-11-28T11:11:26.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.079+0000 7f75f6ffd700 1 -- 172.21.15.125:0/3147458075 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f75f8017090 con 0x7f760806e3a0 2023-11-28T11:11:26.081 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:26.082 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/991177251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":991177251},{"type":"v1","addr":"172.21.15.167:6834","nonce":991177251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/289069328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":289069328},{"type":"v1","addr":"172.21.15.167:6835","nonce":289069328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3275492587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3275492587},{"type":"v1","addr":"172.21.15.125:6836","nonce":3275492587}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:10:36.508959+0000","modified":"2023-11-28T11:10:39.516894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5775":{"gid":5775,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3179120009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":3179120009},{"type":"v1","addr":"172.21.15.125:6837","nonce":3179120009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:11:26.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.081+0000 7f760cff4700 1 -- 172.21.15.125:0/3147458075 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75e80682f0 msgr2=0x7f75e806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.081+0000 7f760cff4700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75e80682f0 0x7f75e806a7a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f75fc005910 tx=0x7f75fc009040 comp rx=0 tx=0).stop 2023-11-28T11:11:26.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.081+0000 7f760cff4700 1 -- 172.21.15.125:0/3147458075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760806e3a0 msgr2=0x7f76080b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.081+0000 7f760cff4700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760806e3a0 0x7f76080b2b20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f75f800ebe0 tx=0x7f75f800eef0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.081+0000 7f760cff4700 1 -- 172.21.15.125:0/3147458075 shutdown_connections 2023-11-28T11:11:26.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.081+0000 7f760cff4700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f75e80682f0 0x7f75e806a7a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.081+0000 7f760cff4700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f760815cc80 0x7f760815edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.081+0000 7f760cff4700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f760806a270 0x7f7608153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.081+0000 7f760cff4700 1 --2- 172.21.15.125:0/3147458075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f760806e3a0 0x7f76080b2b20 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.081+0000 7f760cff4700 1 -- 172.21.15.125:0/3147458075 >> 172.21.15.125:0/3147458075 conn(0x7f760806c010 msgr2=0x7f76080b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:26.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.082+0000 7f760cff4700 1 -- 172.21.15.125:0/3147458075 shutdown_connections 2023-11-28T11:11:26.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.082+0000 7f760cff4700 1 -- 172.21.15.125:0/3147458075 wait complete. 2023-11-28T11:11:26.085 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 23 2023-11-28T11:11:26.095 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:11:26.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.214+0000 7f47c37dc700 1 Processor -- start 2023-11-28T11:11:26.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.214+0000 7f47c37dc700 1 -- start start 2023-11-28T11:11:26.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c37dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f47bc06a270 0x7f47bc06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c37dc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc15cc80 0x7f47bc06de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c37dc700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f47bc06e3a0 0x7f47bc06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c37dc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc0b2490 con 0x7f47bc06a270 2023-11-28T11:11:26.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c37dc700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc06ab80 con 0x7f47bc06e3a0 2023-11-28T11:11:26.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c37dc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0b1810 con 0x7f47bc15cc80 2023-11-28T11:11:26.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c1578700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f47bc06a270 0x7f47bc06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c1578700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f47bc06a270 0x7f47bc06a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60874/0 (socket says 172.21.15.125:60874) 2023-11-28T11:11:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c1578700 1 -- 172.21.15.125:0/3838200063 learned_addr learned my addr 172.21.15.125:0/3838200063 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c0d77700 1 --2- 172.21.15.125:0/3838200063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc15cc80 0x7f47bc06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c1d79700 1 --2- 172.21.15.125:0/3838200063 >> v2:172.21.15.167:3300/0 conn(0x7f47bc06e3a0 0x7f47bc06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c1578700 1 -- 172.21.15.125:0/3838200063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc15cc80 msgr2=0x7f47bc06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c1578700 1 --2- 172.21.15.125:0/3838200063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc15cc80 0x7f47bc06de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c1578700 1 -- 172.21.15.125:0/3838200063 >> v2:172.21.15.167:3300/0 conn(0x7f47bc06e3a0 msgr2=0x7f47bc06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c1578700 1 --2- 172.21.15.125:0/3838200063 >> v2:172.21.15.167:3300/0 conn(0x7f47bc06e3a0 0x7f47bc06ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c1578700 1 -- 172.21.15.125:0/3838200063 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0b1af0 con 0x7f47bc06a270 2023-11-28T11:11:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47c1578700 1 --2- 172.21.15.125:0/3838200063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47bc06a270 0x7f47bc06a640 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0af700 tx=0x7f47b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c3836d84c5ab0f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47b3fff700 1 -- 172.21.15.125:0/3838200063 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b800b870 con 0x7f47bc06a270 2023-11-28T11:11:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47b3fff700 1 -- 172.21.15.125:0/3838200063 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b800b9d0 con 0x7f47bc06a270 2023-11-28T11:11:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.215+0000 7f47b3fff700 1 -- 172.21.15.125:0/3838200063 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b800bd60 con 0x7f47bc06a270 2023-11-28T11:11:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.216+0000 7f47c37dc700 1 -- 172.21.15.125:0/3838200063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47bc06a270 msgr2=0x7f47bc06a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.216+0000 7f47c37dc700 1 --2- 172.21.15.125:0/3838200063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47bc06a270 0x7f47bc06a640 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0af700 tx=0x7f47b8009bd0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.216+0000 7f47c37dc700 1 -- 172.21.15.125:0/3838200063 shutdown_connections 2023-11-28T11:11:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.216+0000 7f47c37dc700 1 --2- 172.21.15.125:0/3838200063 >> v2:172.21.15.167:3300/0 conn(0x7f47bc06e3a0 0x7f47bc06ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.216+0000 7f47c37dc700 1 --2- 172.21.15.125:0/3838200063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47bc06a270 0x7f47bc06a640 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.216+0000 7f47c37dc700 1 --2- 172.21.15.125:0/3838200063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc15cc80 0x7f47bc06de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.216+0000 7f47c37dc700 1 -- 172.21.15.125:0/3838200063 >> 172.21.15.125:0/3838200063 conn(0x7f47bc06c010 msgr2=0x7f47bc0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.216+0000 7f47c37dc700 1 -- 172.21.15.125:0/3838200063 shutdown_connections 2023-11-28T11:11:26.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.216+0000 7f47c37dc700 1 -- 172.21.15.125:0/3838200063 wait complete. 2023-11-28T11:11:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.217+0000 7f47c37dc700 1 Processor -- start 2023-11-28T11:11:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.217+0000 7f47c37dc700 1 -- start start 2023-11-28T11:11:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c37dc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc06a270 0x7f47bc1525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c37dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47bc06e3a0 0x7f47bc0ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c37dc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc15cc80 0x7f47bc0cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c37dc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0cb7d0 con 0x7f47bc06e3a0 2023-11-28T11:11:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c37dc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc152b10 con 0x7f47bc06a270 2023-11-28T11:11:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c37dc700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0cab50 con 0x7f47bc15cc80 2023-11-28T11:11:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c0d77700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47bc06e3a0 0x7f47bc0ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c0d77700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47bc06e3a0 0x7f47bc0ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60882/0 (socket says 172.21.15.125:60882) 2023-11-28T11:11:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c0d77700 1 -- 172.21.15.125:0/4167091707 learned_addr learned my addr 172.21.15.125:0/4167091707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c1d79700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc15cc80 0x7f47bc0cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c1578700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc06a270 0x7f47bc1525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c0d77700 1 -- 172.21.15.125:0/4167091707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc15cc80 msgr2=0x7f47bc0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c0d77700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc15cc80 0x7f47bc0cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c0d77700 1 -- 172.21.15.125:0/4167091707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc06a270 msgr2=0x7f47bc1525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c0d77700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc06a270 0x7f47bc1525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c0d77700 1 -- 172.21.15.125:0/4167091707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b8009550 con 0x7f47bc06e3a0 2023-11-28T11:11:26.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.218+0000 7f47c0d77700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47bc06e3a0 0x7f47bc0ca320 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00e810 tx=0x7f47ac00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:26.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.219+0000 7f47b1ffb700 1 -- 172.21.15.125:0/4167091707 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00c070 con 0x7f47bc06e3a0 2023-11-28T11:11:26.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.219+0000 7f47b1ffb700 1 -- 172.21.15.125:0/4167091707 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac013610 con 0x7f47bc06e3a0 2023-11-28T11:11:26.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.219+0000 7f47c37dc700 1 -- 172.21.15.125:0/4167091707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc0b20b0 con 0x7f47bc06e3a0 2023-11-28T11:11:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.219+0000 7f47b1ffb700 1 -- 172.21.15.125:0/4167091707 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0139c0 con 0x7f47bc06e3a0 2023-11-28T11:11:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.219+0000 7f47c37dc700 1 -- 172.21.15.125:0/4167091707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc0b1dd0 con 0x7f47bc06e3a0 2023-11-28T11:11:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.220+0000 7f47c37dc700 1 -- 172.21.15.125:0/4167091707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc06e7e0 con 0x7f47bc06e3a0 2023-11-28T11:11:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.220+0000 7f47b1ffb700 1 -- 172.21.15.125:0/4167091707 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f47ac023070 con 0x7f47bc06e3a0 2023-11-28T11:11:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.220+0000 7f47b1ffb700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f47a00682f0 0x7f47a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.221+0000 7f47c1578700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f47a00682f0 0x7f47a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.221+0000 7f47b1ffb700 1 -- 172.21.15.125:0/4167091707 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f47ac085a20 con 0x7f47bc06e3a0 2023-11-28T11:11:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.221+0000 7f47c1578700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f47a00682f0 0x7f47a006a7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f47b8014040 tx=0x7f47b8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.225+0000 7f47b1ffb700 1 -- 172.21.15.125:0/4167091707 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f47ac0521c0 con 0x7f47bc06e3a0 2023-11-28T11:11:26.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.409+0000 7f47c37dc700 1 -- 172.21.15.125:0/4167091707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47bc0cb910 con 0x7f47bc06e3a0 2023-11-28T11:11:26.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.410+0000 7f47b1ffb700 1 -- 172.21.15.125:0/4167091707 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18066 (secure 0 0 0) 0x7f47bc0cb910 con 0x7f47bc06e3a0 2023-11-28T11:11:26.412 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:26.412 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":54,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:11:19.983429+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:10:34.306816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T11:10:35.470755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:11:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 -- 172.21.15.125:0/4167091707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f47a00682f0 msgr2=0x7f47a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f47a00682f0 0x7f47a006a7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f47b8014040 tx=0x7f47b8008030 comp rx=0 tx=0).stop 2023-11-28T11:11:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 -- 172.21.15.125:0/4167091707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47bc06e3a0 msgr2=0x7f47bc0ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47bc06e3a0 0x7f47bc0ca320 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00e810 tx=0x7f47ac00eb20 comp rx=0 tx=0).stop 2023-11-28T11:11:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 -- 172.21.15.125:0/4167091707 shutdown_connections 2023-11-28T11:11:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f47a00682f0 0x7f47a006a7a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc15cc80 0x7f47bc0cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc06a270 0x7f47bc1525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 --2- 172.21.15.125:0/4167091707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47bc06e3a0 0x7f47bc0ca320 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 -- 172.21.15.125:0/4167091707 >> 172.21.15.125:0/4167091707 conn(0x7f47bc06c010 msgr2=0x7f47bc0afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:26.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 -- 172.21.15.125:0/4167091707 shutdown_connections 2023-11-28T11:11:26.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.412+0000 7f47c37dc700 1 -- 172.21.15.125:0/4167091707 wait complete. 2023-11-28T11:11:26.426 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:11:26.426 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:11:26.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.544+0000 7f5364564700 1 Processor -- start 2023-11-28T11:11:26.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.544+0000 7f5364564700 1 -- start start 2023-11-28T11:11:26.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5364564700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f535c06b7b0 0x7f535c072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5364564700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f535c0ad1f0 0x7f535c0ad650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5364564700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c0726c0 con 0x7f535c0b0880 2023-11-28T11:11:26.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5364564700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c06bc50 con 0x7f535c06b7b0 2023-11-28T11:11:26.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5364564700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0b43f0 con 0x7f535c0ad1f0 2023-11-28T11:11:26.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5361aff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f535c06b7b0 0x7f535c072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5362300700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f535c0b0880 0x7f535c0aeb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45012/0 (socket says 172.21.15.125:45012) 2023-11-28T11:11:26.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5362300700 1 -- 172.21.15.125:0/635979308 learned_addr learned my addr 172.21.15.125:0/635979308 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:26.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5362b01700 1 --2- 172.21.15.125:0/635979308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f535c0ad1f0 0x7f535c0ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5361aff700 1 -- 172.21.15.125:0/635979308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f535c0ad1f0 msgr2=0x7f535c0ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:26.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5361aff700 1 --2- 172.21.15.125:0/635979308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f535c0ad1f0 0x7f535c0ad650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5361aff700 1 -- 172.21.15.125:0/635979308 >> v1:172.21.15.125:6789/0 conn(0x7f535c0b0880 legacy=0x7f535c0aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5361aff700 1 -- 172.21.15.125:0/635979308 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c0adb90 con 0x7f535c06b7b0 2023-11-28T11:11:26.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f53612fe700 1 -- 172.21.15.125:0/635979308 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268400604 0 0) 0x7f535c0726c0 con 0x7f535c0b0880 2023-11-28T11:11:26.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f5361aff700 1 --2- 172.21.15.125:0/635979308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535c06b7b0 0x7f535c072180 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f534c009840 tx=0x7f534c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558e81c0a79b33b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:26.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f53612fe700 1 -- 172.21.15.125:0/635979308 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c011830 con 0x7f535c06b7b0 2023-11-28T11:11:26.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f53612fe700 1 -- 172.21.15.125:0/635979308 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c011990 con 0x7f535c06b7b0 2023-11-28T11:11:26.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.545+0000 7f53612fe700 1 -- 172.21.15.125:0/635979308 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c011d20 con 0x7f535c06b7b0 2023-11-28T11:11:26.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.546+0000 7f5364564700 1 -- 172.21.15.125:0/635979308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535c06b7b0 msgr2=0x7f535c072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.546+0000 7f5364564700 1 --2- 172.21.15.125:0/635979308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535c06b7b0 0x7f535c072180 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f534c009840 tx=0x7f534c009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:26.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.546+0000 7f5364564700 1 -- 172.21.15.125:0/635979308 shutdown_connections 2023-11-28T11:11:26.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.546+0000 7f5364564700 1 --2- 172.21.15.125:0/635979308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f535c0ad1f0 0x7f535c0ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.546+0000 7f5364564700 1 --2- 172.21.15.125:0/635979308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535c06b7b0 0x7f535c072180 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.546+0000 7f5364564700 1 -- 172.21.15.125:0/635979308 >> 172.21.15.125:0/635979308 conn(0x7f535c0b2fc0 msgr2=0x7f535c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:26.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.546+0000 7f5364564700 1 -- 172.21.15.125:0/635979308 shutdown_connections 2023-11-28T11:11:26.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.546+0000 7f5364564700 1 -- 172.21.15.125:0/635979308 wait complete. 2023-11-28T11:11:26.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.547+0000 7f5364564700 1 Processor -- start 2023-11-28T11:11:26.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.547+0000 7f5364564700 1 -- start start 2023-11-28T11:11:26.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5364564700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f535c06b7b0 0x7f535c0984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5364564700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535c0ad1f0 0x7f535c0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5364564700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f535c0b0880 0x7f535c158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5364564700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c098a20 con 0x7f535c0ad1f0 2023-11-28T11:11:26.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5364564700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c1574d0 con 0x7f535c06b7b0 2023-11-28T11:11:26.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5364564700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c1577b0 con 0x7f535c0b0880 2023-11-28T11:11:26.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5361aff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535c0ad1f0 0x7f535c0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5361aff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535c0ad1f0 0x7f535c0af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60896/0 (socket says 172.21.15.125:60896) 2023-11-28T11:11:26.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5361aff700 1 -- 172.21.15.125:0/3096018278 learned_addr learned my addr 172.21.15.125:0/3096018278 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:26.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5362b01700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f535c0b0880 0x7f535c158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5362300700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f535c06b7b0 0x7f535c0984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5361aff700 1 -- 172.21.15.125:0/3096018278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f535c0b0880 msgr2=0x7f535c158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5361aff700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f535c0b0880 0x7f535c158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5361aff700 1 -- 172.21.15.125:0/3096018278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f535c06b7b0 msgr2=0x7f535c0984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5361aff700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f535c06b7b0 0x7f535c0984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5361aff700 1 -- 172.21.15.125:0/3096018278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0094a0 con 0x7f535c0ad1f0 2023-11-28T11:11:26.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.548+0000 7f5361aff700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535c0ad1f0 0x7f535c0af0b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f534c000c00 tx=0x7f534c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:26.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.549+0000 7f5352ffd700 1 -- 172.21.15.125:0/3096018278 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c0036a0 con 0x7f535c0ad1f0 2023-11-28T11:11:26.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.549+0000 7f5352ffd700 1 -- 172.21.15.125:0/3096018278 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c01e070 con 0x7f535c0ad1f0 2023-11-28T11:11:26.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.549+0000 7f5352ffd700 1 -- 172.21.15.125:0/3096018278 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c003a60 con 0x7f535c0ad1f0 2023-11-28T11:11:26.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.549+0000 7f5364564700 1 -- 172.21.15.125:0/3096018278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535c0b4d00 con 0x7f535c0ad1f0 2023-11-28T11:11:26.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.549+0000 7f5364564700 1 -- 172.21.15.125:0/3096018278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c0b46d0 con 0x7f535c0ad1f0 2023-11-28T11:11:26.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.549+0000 7f5364564700 1 -- 172.21.15.125:0/3096018278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c0b4fe0 con 0x7f535c0ad1f0 2023-11-28T11:11:26.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.550+0000 7f5352ffd700 1 -- 172.21.15.125:0/3096018278 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f534c00f050 con 0x7f535c0ad1f0 2023-11-28T11:11:26.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.550+0000 7f5352ffd700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53400682f0 0x7f534006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.550+0000 7f5352ffd700 1 -- 172.21.15.125:0/3096018278 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f534c086d20 con 0x7f535c0ad1f0 2023-11-28T11:11:26.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.550+0000 7f5362300700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53400682f0 0x7f534006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.551+0000 7f5362300700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53400682f0 0x7f534006a7a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5358000f60 tx=0x7f5358007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:26.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.554+0000 7f5352ffd700 1 -- 172.21.15.125:0/3096018278 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f534c053540 con 0x7f535c0ad1f0 2023-11-28T11:11:26.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.778+0000 7f5364564700 1 -- 172.21.15.125:0/3096018278 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f535c0743f0 con 0x7f535c0ad1f0 2023-11-28T11:11:26.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.778+0000 7f5352ffd700 1 -- 172.21.15.125:0/3096018278 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f534c015090 con 0x7f535c0ad1f0 2023-11-28T11:11:26.780 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:26.780 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/991177251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":991177251},{"type":"v1","addr":"172.21.15.167:6834","nonce":991177251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/289069328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":289069328},{"type":"v1","addr":"172.21.15.167:6835","nonce":289069328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3275492587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3275492587},{"type":"v1","addr":"172.21.15.125:6836","nonce":3275492587}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:10:36.508959+0000","modified":"2023-11-28T11:10:39.516894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5775":{"gid":5775,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3179120009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":3179120009},{"type":"v1","addr":"172.21.15.125:6837","nonce":3179120009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:11:26.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 -- 172.21.15.125:0/3096018278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53400682f0 msgr2=0x7f534006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53400682f0 0x7f534006a7a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5358000f60 tx=0x7f5358007c00 comp rx=0 tx=0).stop 2023-11-28T11:11:26.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 -- 172.21.15.125:0/3096018278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535c0ad1f0 msgr2=0x7f535c0af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535c0ad1f0 0x7f535c0af0b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f534c000c00 tx=0x7f534c004750 comp rx=0 tx=0).stop 2023-11-28T11:11:26.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 -- 172.21.15.125:0/3096018278 shutdown_connections 2023-11-28T11:11:26.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53400682f0 0x7f534006a7a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f535c0b0880 0x7f535c158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f535c06b7b0 0x7f535c0984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 --2- 172.21.15.125:0/3096018278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535c0ad1f0 0x7f535c0af0b0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 -- 172.21.15.125:0/3096018278 >> 172.21.15.125:0/3096018278 conn(0x7f535c0b2fc0 msgr2=0x7f535c0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:26.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 -- 172.21.15.125:0/3096018278 shutdown_connections 2023-11-28T11:11:26.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.780+0000 7f5364564700 1 -- 172.21.15.125:0/3096018278 wait complete. 2023-11-28T11:11:26.783 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 23 2023-11-28T11:11:26.794 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:11:26.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.912+0000 7fd6666e7700 1 Processor -- start 2023-11-28T11:11:26.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.912+0000 7fd6666e7700 1 -- start start 2023-11-28T11:11:26.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.913+0000 7fd6666e7700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6600ce040 0x7fd66015d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.913+0000 7fd6666e7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6600b1770 0x7fd6600b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.913+0000 7fd6666e7700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66013fc90 con 0x7fd660142db0 2023-11-28T11:11:26.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.913+0000 7fd6666e7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6600b2130 con 0x7fd6600b1770 2023-11-28T11:11:26.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.913+0000 7fd6666e7700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66013f480 con 0x7fd6600ce040 2023-11-28T11:11:26.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.913+0000 7fd664c84700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6600b1770 0x7fd6600b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.913+0000 7fd664c84700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6600b1770 0x7fd6600b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60906/0 (socket says 172.21.15.125:60906) 2023-11-28T11:11:26.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.913+0000 7fd664c84700 1 -- 172.21.15.125:0/345947606 learned_addr learned my addr 172.21.15.125:0/345947606 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:26.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd664c84700 1 -- 172.21.15.125:0/345947606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6600ce040 msgr2=0x7fd66015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:26.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd664c84700 1 --2- 172.21.15.125:0/345947606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6600ce040 0x7fd66015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd664c84700 1 -- 172.21.15.125:0/345947606 >> v1:172.21.15.167:6789/0 conn(0x7fd660142db0 legacy=0x7fd66013ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd664c84700 1 -- 172.21.15.125:0/345947606 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66013f6d0 con 0x7fd6600b1770 2023-11-28T11:11:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd664c84700 1 --2- 172.21.15.125:0/345947606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6600b1770 0x7fd6600b1bf0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd658009e50 tx=0x7fd65800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00bd60371f36fe0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd65effd700 1 -- 172.21.15.125:0/345947606 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65800e070 con 0x7fd6600b1770 2023-11-28T11:11:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd65effd700 1 -- 172.21.15.125:0/345947606 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd658003a20 con 0x7fd6600b1770 2023-11-28T11:11:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd65effd700 1 -- 172.21.15.125:0/345947606 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658003dd0 con 0x7fd6600b1770 2023-11-28T11:11:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd6666e7700 1 -- 172.21.15.125:0/345947606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6600b1770 msgr2=0x7fd6600b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd6666e7700 1 --2- 172.21.15.125:0/345947606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6600b1770 0x7fd6600b1bf0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd658009e50 tx=0x7fd65800b330 comp rx=0 tx=0).stop 2023-11-28T11:11:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd6666e7700 1 -- 172.21.15.125:0/345947606 shutdown_connections 2023-11-28T11:11:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd6666e7700 1 --2- 172.21.15.125:0/345947606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6600b1770 0x7fd6600b1bf0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd6666e7700 1 --2- 172.21.15.125:0/345947606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6600ce040 0x7fd66015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd6666e7700 1 -- 172.21.15.125:0/345947606 >> 172.21.15.125:0/345947606 conn(0x7fd66006c010 msgr2=0x7fd6600cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd6666e7700 1 -- 172.21.15.125:0/345947606 shutdown_connections 2023-11-28T11:11:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.914+0000 7fd6666e7700 1 -- 172.21.15.125:0/345947606 wait complete. 2023-11-28T11:11:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.916+0000 7fd6666e7700 1 Processor -- start 2023-11-28T11:11:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.916+0000 7fd6666e7700 1 -- start start 2023-11-28T11:11:26.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.916+0000 7fd6666e7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6600b1770 0x7fd660155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.916+0000 7fd6666e7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6600ce040 0x7fd660156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.916+0000 7fd6666e7700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd660142db0 0x7fd6601e2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.916+0000 7fd6666e7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600c8c40 con 0x7fd6600ce040 2023-11-28T11:11:26.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.916+0000 7fd6666e7700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600c8070 con 0x7fd6600b1770 2023-11-28T11:11:26.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.916+0000 7fd6666e7700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600c8310 con 0x7fd660142db0 2023-11-28T11:11:26.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6600ce040 0x7fd660156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6600ce040 0x7fd660156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60910/0 (socket says 172.21.15.125:60910) 2023-11-28T11:11:26.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65f7fe700 1 -- 172.21.15.125:0/1585223443 learned_addr learned my addr 172.21.15.125:0/1585223443 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:26.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd664c84700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd660142db0 0x7fd6601e2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65ffff700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6600b1770 0x7fd660155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65f7fe700 1 -- 172.21.15.125:0/1585223443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd660142db0 msgr2=0x7fd6601e2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65f7fe700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd660142db0 0x7fd6601e2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65f7fe700 1 -- 172.21.15.125:0/1585223443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6600b1770 msgr2=0x7fd660155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:26.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65f7fe700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6600b1770 0x7fd660155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:26.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65f7fe700 1 -- 172.21.15.125:0/1585223443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd658009b30 con 0x7fd6600ce040 2023-11-28T11:11:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65f7fe700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6600ce040 0x7fd660156010 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c4a0 tx=0x7fd65400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65cff9700 1 -- 172.21.15.125:0/1585223443 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540054e0 con 0x7fd6600ce040 2023-11-28T11:11:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65cff9700 1 -- 172.21.15.125:0/1585223443 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd654003680 con 0x7fd6600ce040 2023-11-28T11:11:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd6666e7700 1 -- 172.21.15.125:0/1585223443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66015d100 con 0x7fd6600ce040 2023-11-28T11:11:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd65cff9700 1 -- 172.21.15.125:0/1585223443 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd654003a30 con 0x7fd6600ce040 2023-11-28T11:11:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.917+0000 7fd6666e7700 1 -- 172.21.15.125:0/1585223443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66013f9b0 con 0x7fd6600ce040 2023-11-28T11:11:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.918+0000 7fd6666e7700 1 -- 172.21.15.125:0/1585223443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66015d3e0 con 0x7fd6600ce040 2023-11-28T11:11:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.919+0000 7fd65cff9700 1 -- 172.21.15.125:0/1585223443 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd654019030 con 0x7fd6600ce040 2023-11-28T11:11:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.919+0000 7fd65cff9700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd64c068320 0x7fd64c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.919+0000 7fd65cff9700 1 -- 172.21.15.125:0/1585223443 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd6540850d0 con 0x7fd6600ce040 2023-11-28T11:11:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.919+0000 7fd65ffff700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd64c068320 0x7fd64c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.919+0000 7fd65ffff700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd64c068320 0x7fd64c06a7d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd650006fd0 tx=0x7fd650008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:26.923+0000 7fd65cff9700 1 -- 172.21.15.125:0/1585223443 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd6540518f0 con 0x7fd6600ce040 2023-11-28T11:11:27.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.148+0000 7fd6666e7700 1 -- 172.21.15.125:0/1585223443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6600743f0 con 0x7fd6600ce040 2023-11-28T11:11:27.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.148+0000 7fd65cff9700 1 -- 172.21.15.125:0/1585223443 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fd654054f10 con 0x7fd6600ce040 2023-11-28T11:11:27.151 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:27.151 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/991177251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":991177251},{"type":"v1","addr":"172.21.15.167:6834","nonce":991177251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/289069328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":289069328},{"type":"v1","addr":"172.21.15.167:6835","nonce":289069328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3275492587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3275492587},{"type":"v1","addr":"172.21.15.125:6836","nonce":3275492587}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:10:36.508959+0000","modified":"2023-11-28T11:10:39.516894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5775":{"gid":5775,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3179120009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":3179120009},{"type":"v1","addr":"172.21.15.125:6837","nonce":3179120009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:11:27.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 -- 172.21.15.125:0/1585223443 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd64c068320 msgr2=0x7fd64c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd64c068320 0x7fd64c06a7d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd650006fd0 tx=0x7fd650008040 comp rx=0 tx=0).stop 2023-11-28T11:11:27.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 -- 172.21.15.125:0/1585223443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6600ce040 msgr2=0x7fd660156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6600ce040 0x7fd660156010 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c4a0 tx=0x7fd65400c860 comp rx=0 tx=0).stop 2023-11-28T11:11:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 -- 172.21.15.125:0/1585223443 shutdown_connections 2023-11-28T11:11:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd64c068320 0x7fd64c06a7d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd660142db0 0x7fd6601e2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6600b1770 0x7fd660155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 --2- 172.21.15.125:0/1585223443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6600ce040 0x7fd660156010 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 -- 172.21.15.125:0/1585223443 >> 172.21.15.125:0/1585223443 conn(0x7fd66006c010 msgr2=0x7fd660156a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:27.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 -- 172.21.15.125:0/1585223443 shutdown_connections 2023-11-28T11:11:27.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.150+0000 7fd6666e7700 1 -- 172.21.15.125:0/1585223443 wait complete. 2023-11-28T11:11:27.155 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 23 2023-11-28T11:11:27.164 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:11:27.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.282+0000 7f98f9f85700 1 Processor -- start 2023-11-28T11:11:27.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.282+0000 7f98f9f85700 1 -- start start 2023-11-28T11:11:27.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.282+0000 7f98f9f85700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f98f415cc80 0x7f98f406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:27.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.282+0000 7f98f9f85700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f40b1810 con 0x7f98f406a270 2023-11-28T11:11:27.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.282+0000 7f98f9f85700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f40b1af0 con 0x7f98f406e3a0 2023-11-28T11:11:27.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.282+0000 7f98f9f85700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f40b2490 con 0x7f98f415cc80 2023-11-28T11:11:27.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.283+0000 7f98f2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f98f415cc80 0x7f98f406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:27.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.283+0000 7f98f37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f98f406a270 0x7f98f406a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45040/0 (socket says 172.21.15.125:45040) 2023-11-28T11:11:27.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.283+0000 7f98f37fe700 1 -- 172.21.15.125:0/4027812740 learned_addr learned my addr 172.21.15.125:0/4027812740 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:27.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.283+0000 7f98f2ffd700 1 -- 172.21.15.125:0/4027812740 >> v1:172.21.15.167:6789/0 conn(0x7f98f406e3a0 legacy=0x7f98f4070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:27.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.283+0000 7f98f2ffd700 1 -- 172.21.15.125:0/4027812740 >> v1:172.21.15.125:6789/0 conn(0x7f98f406a270 legacy=0x7f98f406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.283+0000 7f98f27fc700 1 -- 172.21.15.125:0/4027812740 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707955654 0 0) 0x7f98f40b1810 con 0x7f98f406a270 2023-11-28T11:11:27.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.283+0000 7f98f2ffd700 1 -- 172.21.15.125:0/4027812740 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f40b1dd0 con 0x7f98f415cc80 2023-11-28T11:11:27.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.283+0000 7f98f2ffd700 1 --2- 172.21.15.125:0/4027812740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98f415cc80 0x7f98f406de60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009840 tx=0x7f98e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a85522883a9edb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:27.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.283+0000 7f98f27fc700 1 -- 172.21.15.125:0/4027812740 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8004230 con 0x7f98f415cc80 2023-11-28T11:11:27.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.283+0000 7f98f27fc700 1 -- 172.21.15.125:0/4027812740 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e8004390 con 0x7f98f415cc80 2023-11-28T11:11:27.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.283+0000 7f98f27fc700 1 -- 172.21.15.125:0/4027812740 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e80036a0 con 0x7f98f415cc80 2023-11-28T11:11:27.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.284+0000 7f98f9f85700 1 -- 172.21.15.125:0/4027812740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98f415cc80 msgr2=0x7f98f406de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.284+0000 7f98f9f85700 1 --2- 172.21.15.125:0/4027812740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98f415cc80 0x7f98f406de60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009840 tx=0x7f98e8009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:27.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.284+0000 7f98f9f85700 1 -- 172.21.15.125:0/4027812740 shutdown_connections 2023-11-28T11:11:27.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.284+0000 7f98f9f85700 1 --2- 172.21.15.125:0/4027812740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98f415cc80 0x7f98f406de60 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.284+0000 7f98f9f85700 1 -- 172.21.15.125:0/4027812740 >> 172.21.15.125:0/4027812740 conn(0x7f98f406c010 msgr2=0x7f98f40cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:27.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.284+0000 7f98f9f85700 1 -- 172.21.15.125:0/4027812740 shutdown_connections 2023-11-28T11:11:27.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.284+0000 7f98f9f85700 1 -- 172.21.15.125:0/4027812740 wait complete. 2023-11-28T11:11:27.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.285+0000 7f98f9f85700 1 Processor -- start 2023-11-28T11:11:27.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.286+0000 7f98f9f85700 1 -- start start 2023-11-28T11:11:27.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.286+0000 7f98f9f85700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f406a270 0x7f98f4151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:27.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.286+0000 7f98f9f85700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98f406e3a0 0x7f98f40ad940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:27.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.286+0000 7f98f9f85700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98f415cc80 0x7f98f40ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:27.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.286+0000 7f98f9f85700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f41f2a30 con 0x7f98f415cc80 2023-11-28T11:11:27.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.286+0000 7f98f9f85700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40b3bd0 con 0x7f98f406a270 2023-11-28T11:11:27.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.286+0000 7f98f9f85700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40b3eb0 con 0x7f98f406e3a0 2023-11-28T11:11:27.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98f415cc80 0x7f98f40ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:27.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98f415cc80 0x7f98f40ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60926/0 (socket says 172.21.15.125:60926) 2023-11-28T11:11:27.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f3fff700 1 -- 172.21.15.125:0/3993723327 learned_addr learned my addr 172.21.15.125:0/3993723327 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:27.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f37fe700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f406a270 0x7f98f4151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:27.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f2ffd700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98f406e3a0 0x7f98f40ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:27.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f3fff700 1 -- 172.21.15.125:0/3993723327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98f406e3a0 msgr2=0x7f98f40ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f3fff700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98f406e3a0 0x7f98f40ad940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f3fff700 1 -- 172.21.15.125:0/3993723327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f406a270 msgr2=0x7f98f4151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f3fff700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f406a270 0x7f98f4151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f3fff700 1 -- 172.21.15.125:0/3993723327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80094a0 con 0x7f98f415cc80 2023-11-28T11:11:27.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f37fe700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f406a270 0x7f98f4151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:27.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f2ffd700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98f406e3a0 0x7f98f40ad940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:27.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f3fff700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98f415cc80 0x7f98f40ade80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00b970 tx=0x7f98ec00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:27.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98dbfff700 1 -- 172.21.15.125:0/3993723327 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec00c9b0 con 0x7f98f415cc80 2023-11-28T11:11:27.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98dbfff700 1 -- 172.21.15.125:0/3993723327 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec00cb10 con 0x7f98f415cc80 2023-11-28T11:11:27.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f9f85700 1 -- 172.21.15.125:0/3993723327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f406e7c0 con 0x7f98f415cc80 2023-11-28T11:11:27.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98dbfff700 1 -- 172.21.15.125:0/3993723327 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec014440 con 0x7f98f415cc80 2023-11-28T11:11:27.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.287+0000 7f98f9f85700 1 -- 172.21.15.125:0/3993723327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f40b20b0 con 0x7f98f415cc80 2023-11-28T11:11:27.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.288+0000 7f98f9f85700 1 -- 172.21.15.125:0/3993723327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f406e950 con 0x7f98f415cc80 2023-11-28T11:11:27.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.289+0000 7f98dbfff700 1 -- 172.21.15.125:0/3993723327 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f98ec01b030 con 0x7f98f415cc80 2023-11-28T11:11:27.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.289+0000 7f98dbfff700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f98e00682f0 0x7f98e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:27.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.289+0000 7f98dbfff700 1 -- 172.21.15.125:0/3993723327 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f98ec085840 con 0x7f98f415cc80 2023-11-28T11:11:27.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.289+0000 7f98f37fe700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f98e00682f0 0x7f98e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:27.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.289+0000 7f98f37fe700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f98e00682f0 0x7f98e006a7a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f98e4007fd0 tx=0x7f98e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:27.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.293+0000 7f98dbfff700 1 -- 172.21.15.125:0/3993723327 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f98f406e950 con 0x7f98f415cc80 2023-11-28T11:11:27.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.474+0000 7f98f9f85700 1 -- 172.21.15.125:0/3993723327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98f406e950 con 0x7f98f415cc80 2023-11-28T11:11:27.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.475+0000 7f98dbfff700 1 -- 172.21.15.125:0/3993723327 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18066 (secure 0 0 0) 0x7f98f406e950 con 0x7f98f415cc80 2023-11-28T11:11:27.477 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:27.477 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":54,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:11:19.983429+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:10:34.306816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T11:10:35.470755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:11:27.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 -- 172.21.15.125:0/3993723327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f98e00682f0 msgr2=0x7f98e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f98e00682f0 0x7f98e006a7a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f98e4007fd0 tx=0x7f98e4009040 comp rx=0 tx=0).stop 2023-11-28T11:11:27.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 -- 172.21.15.125:0/3993723327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98f415cc80 msgr2=0x7f98f40ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98f415cc80 0x7f98f40ade80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00b970 tx=0x7f98ec00bd30 comp rx=0 tx=0).stop 2023-11-28T11:11:27.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 -- 172.21.15.125:0/3993723327 shutdown_connections 2023-11-28T11:11:27.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f98f415cc80 0x7f98f40ade80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f406a270 0x7f98f4151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f98e00682f0 0x7f98e006a7a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 --2- 172.21.15.125:0/3993723327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98f406e3a0 0x7f98f40ad940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 -- 172.21.15.125:0/3993723327 >> 172.21.15.125:0/3993723327 conn(0x7f98f406c010 msgr2=0x7f98f406dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:27.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 -- 172.21.15.125:0/3993723327 shutdown_connections 2023-11-28T11:11:27.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.477+0000 7f98f9f85700 1 -- 172.21.15.125:0/3993723327 wait complete. 2023-11-28T11:11:27.491 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T11:11:27.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.610+0000 7f87e121a700 1 Processor -- start 2023-11-28T11:11:27.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.611+0000 7f87e121a700 1 -- start start 2023-11-28T11:11:27.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.611+0000 7f87e121a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87dc0ae850 0x7f87dc06c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:27.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.611+0000 7f87e121a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f87dc06c980 0x7f87dc070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:27.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.611+0000 7f87e121a700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87dc0cbcc0 con 0x7f87dc158e10 2023-11-28T11:11:27.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.611+0000 7f87e121a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87dc06ac30 con 0x7f87dc06c980 2023-11-28T11:11:27.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.611+0000 7f87e121a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc06ce00 con 0x7f87dc0ae850 2023-11-28T11:11:27.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.611+0000 7f87db59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f87dc06c980 0x7f87dc070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:27.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.611+0000 7f87db59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f87dc06c980 0x7f87dc070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60934/0 (socket says 172.21.15.125:60934) 2023-11-28T11:11:27.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.611+0000 7f87db59e700 1 -- 172.21.15.125:0/2735532232 learned_addr learned my addr 172.21.15.125:0/2735532232 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:27.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87da59c700 1 --2- 172.21.15.125:0/2735532232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87dc0ae850 0x7f87dc06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:27.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87db59e700 1 -- 172.21.15.125:0/2735532232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87dc0ae850 msgr2=0x7f87dc06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:27.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87db59e700 1 --2- 172.21.15.125:0/2735532232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87dc0ae850 0x7f87dc06c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87db59e700 1 -- 172.21.15.125:0/2735532232 >> v1:172.21.15.167:6789/0 conn(0x7f87dc158e10 legacy=0x7f87dc0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87db59e700 1 -- 172.21.15.125:0/2735532232 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0ca140 con 0x7f87dc06c980 2023-11-28T11:11:27.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87da59c700 1 --2- 172.21.15.125:0/2735532232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87dc0ae850 0x7f87dc06c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:27.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87db59e700 1 --2- 172.21.15.125:0/2735532232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87dc06c980 0x7f87dc070370 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009e50 tx=0x7f87d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf53e9cd3f244f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:27.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87d9d9b700 1 -- 172.21.15.125:0/2735532232 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400e070 con 0x7f87dc06c980 2023-11-28T11:11:27.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87d9d9b700 1 -- 172.21.15.125:0/2735532232 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d400b9c0 con 0x7f87dc06c980 2023-11-28T11:11:27.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87d9d9b700 1 -- 172.21.15.125:0/2735532232 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400bd70 con 0x7f87dc06c980 2023-11-28T11:11:27.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87e121a700 1 -- 172.21.15.125:0/2735532232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87dc06c980 msgr2=0x7f87dc070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.612+0000 7f87e121a700 1 --2- 172.21.15.125:0/2735532232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87dc06c980 0x7f87dc070370 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009e50 tx=0x7f87d400b330 comp rx=0 tx=0).stop 2023-11-28T11:11:27.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.613+0000 7f87e121a700 1 -- 172.21.15.125:0/2735532232 shutdown_connections 2023-11-28T11:11:27.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.613+0000 7f87e121a700 1 --2- 172.21.15.125:0/2735532232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87dc06c980 0x7f87dc070370 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.613+0000 7f87e121a700 1 --2- 172.21.15.125:0/2735532232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87dc0ae850 0x7f87dc06c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.613+0000 7f87e121a700 1 -- 172.21.15.125:0/2735532232 >> 172.21.15.125:0/2735532232 conn(0x7f87dc0cf400 msgr2=0x7f87dc0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:27.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.613+0000 7f87e121a700 1 -- 172.21.15.125:0/2735532232 shutdown_connections 2023-11-28T11:11:27.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.613+0000 7f87e121a700 1 -- 172.21.15.125:0/2735532232 wait complete. 2023-11-28T11:11:27.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.614+0000 7f87e121a700 1 Processor -- start 2023-11-28T11:11:27.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.614+0000 7f87e121a700 1 -- start start 2023-11-28T11:11:27.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87e121a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87dc06c980 0x7f87dc0b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:27.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87e121a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87dc0ae850 0x7f87dc0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:27.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87e121a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87dc158e10 0x7f87dc1542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:27.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87e121a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0c5d30 con 0x7f87dc0ae850 2023-11-28T11:11:27.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87e121a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc159300 con 0x7f87dc06c980 2023-11-28T11:11:27.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87e121a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc1595e0 con 0x7f87dc158e10 2023-11-28T11:11:27.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87da59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87dc0ae850 0x7f87dc0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:27.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87da59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87dc0ae850 0x7f87dc0b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60938/0 (socket says 172.21.15.125:60938) 2023-11-28T11:11:27.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87da59c700 1 -- 172.21.15.125:0/2675809999 learned_addr learned my addr 172.21.15.125:0/2675809999 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:27.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87db59e700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87dc158e10 0x7f87dc1542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:27.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87dad9d700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87dc06c980 0x7f87dc0b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:27.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87da59c700 1 -- 172.21.15.125:0/2675809999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87dc158e10 msgr2=0x7f87dc1542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87da59c700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87dc158e10 0x7f87dc1542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87da59c700 1 -- 172.21.15.125:0/2675809999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87dc06c980 msgr2=0x7f87dc0b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:27.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87da59c700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87dc06c980 0x7f87dc0b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:27.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87da59c700 1 -- 172.21.15.125:0/2675809999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4009b30 con 0x7f87dc0ae850 2023-11-28T11:11:27.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87dad9d700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87dc06c980 0x7f87dc0b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:27.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.615+0000 7f87da59c700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87dc0ae850 0x7f87dc0b4090 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00e810 tx=0x7f87cc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:27.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.616+0000 7f87d37fe700 1 -- 172.21.15.125:0/2675809999 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc004230 con 0x7f87dc0ae850 2023-11-28T11:11:27.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.616+0000 7f87d37fe700 1 -- 172.21.15.125:0/2675809999 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc0043b0 con 0x7f87dc0ae850 2023-11-28T11:11:27.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.616+0000 7f87e121a700 1 -- 172.21.15.125:0/2675809999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87dc0c9e60 con 0x7f87dc0ae850 2023-11-28T11:11:27.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.616+0000 7f87d37fe700 1 -- 172.21.15.125:0/2675809999 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0038e0 con 0x7f87dc0ae850 2023-11-28T11:11:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.616+0000 7f87e121a700 1 -- 172.21.15.125:0/2675809999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87dc0c9b80 con 0x7f87dc0ae850 2023-11-28T11:11:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.616+0000 7f87e121a700 1 -- 172.21.15.125:0/2675809999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87dc06ae20 con 0x7f87dc0ae850 2023-11-28T11:11:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.617+0000 7f87d37fe700 1 -- 172.21.15.125:0/2675809999 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f87cc022070 con 0x7f87dc0ae850 2023-11-28T11:11:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.617+0000 7f87d37fe700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87bc0682f0 0x7f87bc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.617+0000 7f87d37fe700 1 -- 172.21.15.125:0/2675809999 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f87cc085760 con 0x7f87dc0ae850 2023-11-28T11:11:27.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.617+0000 7f87dad9d700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87bc0682f0 0x7f87bc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.618+0000 7f87dad9d700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87bc0682f0 0x7f87bc06a7a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f87c4000f60 tx=0x7f87c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:27.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.621+0000 7f87d37fe700 1 -- 172.21.15.125:0/2675809999 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f87cc051f80 con 0x7f87dc0ae850 2023-11-28T11:11:27.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:27.848+0000 7f87e121a700 1 -- 172.21.15.125:0/2675809999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f87dc159f10 con 0x7f87dc0ae850 2023-11-28T11:11:28.022 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-11-28T11:11:28.021+0000 7f87cb91a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T11:11:28.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.033+0000 7f87d37fe700 1 -- 172.21.15.125:0/2675809999 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f87cc00f040 con 0x7f87dc0ae850 2023-11-28T11:11:28.036 INFO:tasks.ceph.mds.a.smithi125.stderr: -4732> 2023-11-28T11:10:37.096+0000 7fd6b2ac7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:11:28.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 -- 172.21.15.125:0/2675809999 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87bc0682f0 msgr2=0x7f87bc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:28.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87bc0682f0 0x7f87bc06a7a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f87c4000f60 tx=0x7f87c4009040 comp rx=0 tx=0).stop 2023-11-28T11:11:28.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 -- 172.21.15.125:0/2675809999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87dc0ae850 msgr2=0x7f87dc0b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:28.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87dc0ae850 0x7f87dc0b4090 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00e810 tx=0x7f87cc00eb20 comp rx=0 tx=0).stop 2023-11-28T11:11:28.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 -- 172.21.15.125:0/2675809999 shutdown_connections 2023-11-28T11:11:28.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f87bc0682f0 0x7f87bc06a7a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87dc158e10 0x7f87dc1542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87dc06c980 0x7f87dc0b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 --2- 172.21.15.125:0/2675809999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87dc0ae850 0x7f87dc0b4090 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 -- 172.21.15.125:0/2675809999 >> 172.21.15.125:0/2675809999 conn(0x7f87dc0cf400 msgr2=0x7f87dc0cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:28.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 -- 172.21.15.125:0/2675809999 shutdown_connections 2023-11-28T11:11:28.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.035+0000 7f87e121a700 1 -- 172.21.15.125:0/2675809999 wait complete. 2023-11-28T11:11:28.038 INFO:teuthology.orchestra.run.smithi125.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T11:11:28.039 INFO:tasks.ceph.mds.a.smithi125.stderr: -2984> 2023-11-28T11:10:50.023+0000 7fd6af2c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5970=0-4194304@1} caps={5970=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5970 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x563ba9e9b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T11:11:28.050 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T11:11:28.067 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-11-28T11:11:28.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.171+0000 7fe514d06700 1 Processor -- start 2023-11-28T11:11:28.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.171+0000 7fe514d06700 1 -- start start 2023-11-28T11:11:28.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.172+0000 7fe514d06700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe51015c810 0x7fe510160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:28.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.172+0000 7fe514d06700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe5100718e0 0x7fe51006c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:28.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.172+0000 7fe514d06700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe51006cdc0 0x7fe51006a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:28.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.172+0000 7fe514d06700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe51015cbe0 con 0x7fe51015c810 2023-11-28T11:11:28.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.172+0000 7fe514d06700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5101607a0 con 0x7fe5100718e0 2023-11-28T11:11:28.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.172+0000 7fe514d06700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe510160a50 con 0x7fe51006cdc0 2023-11-28T11:11:28.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.172+0000 7fe50e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe51015c810 0x7fe510160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:28.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.172+0000 7fe50e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe51015c810 0x7fe510160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60956/0 (socket says 172.21.15.125:60956) 2023-11-28T11:11:28.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.172+0000 7fe50e59c700 1 -- 172.21.15.125:0/3782359773 learned_addr learned my addr 172.21.15.125:0/3782359773 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:28.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.172+0000 7fe50dd9b700 1 --2- 172.21.15.125:0/3782359773 >> v2:172.21.15.167:3300/0 conn(0x7fe5100718e0 0x7fe51006c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:28.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.172+0000 7fe50ed9d700 1 --2- 172.21.15.125:0/3782359773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe51006cdc0 0x7fe51006a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:28.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe50e59c700 1 -- 172.21.15.125:0/3782359773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe51006cdc0 msgr2=0x7fe51006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:28.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe50e59c700 1 --2- 172.21.15.125:0/3782359773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe51006cdc0 0x7fe51006a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe50e59c700 1 -- 172.21.15.125:0/3782359773 >> v2:172.21.15.167:3300/0 conn(0x7fe5100718e0 msgr2=0x7fe51006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:28.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe50e59c700 1 --2- 172.21.15.125:0/3782359773 >> v2:172.21.15.167:3300/0 conn(0x7fe5100718e0 0x7fe51006c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe50e59c700 1 -- 172.21.15.125:0/3782359773 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe510160d30 con 0x7fe51015c810 2023-11-28T11:11:28.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe50e59c700 1 --2- 172.21.15.125:0/3782359773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe51015c810 0x7fe510160260 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe5100cc380 tx=0x7fe504009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709a2aec7089299c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:28.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe50d59a700 1 -- 172.21.15.125:0/3782359773 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50400b870 con 0x7fe51015c810 2023-11-28T11:11:28.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe50d59a700 1 -- 172.21.15.125:0/3782359773 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50400b9d0 con 0x7fe51015c810 2023-11-28T11:11:28.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe50d59a700 1 -- 172.21.15.125:0/3782359773 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50400bd60 con 0x7fe51015c810 2023-11-28T11:11:28.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe514d06700 1 -- 172.21.15.125:0/3782359773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe51015c810 msgr2=0x7fe510160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:28.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe514d06700 1 --2- 172.21.15.125:0/3782359773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe51015c810 0x7fe510160260 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe5100cc380 tx=0x7fe504009bd0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe514d06700 1 -- 172.21.15.125:0/3782359773 shutdown_connections 2023-11-28T11:11:28.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe514d06700 1 --2- 172.21.15.125:0/3782359773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe51006cdc0 0x7fe51006a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe514d06700 1 --2- 172.21.15.125:0/3782359773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe51015c810 0x7fe510160260 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe514d06700 1 --2- 172.21.15.125:0/3782359773 >> v2:172.21.15.167:3300/0 conn(0x7fe5100718e0 0x7fe51006c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.173+0000 7fe514d06700 1 -- 172.21.15.125:0/3782359773 >> 172.21.15.125:0/3782359773 conn(0x7fe51006c010 msgr2=0x7fe5100cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:28.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.174+0000 7fe514d06700 1 -- 172.21.15.125:0/3782359773 shutdown_connections 2023-11-28T11:11:28.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.174+0000 7fe514d06700 1 -- 172.21.15.125:0/3782359773 wait complete. 2023-11-28T11:11:28.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.175+0000 7fe514d06700 1 Processor -- start 2023-11-28T11:11:28.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.175+0000 7fe514d06700 1 -- start start 2023-11-28T11:11:28.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe514d06700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe51006cdc0 0x7fe5100aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:28.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe514d06700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5100718e0 0x7fe5101f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:28.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe514d06700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51015c810 0x7fe5100ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:28.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe514d06700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51015cf40 con 0x7fe51006cdc0 2023-11-28T11:11:28.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe514d06700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51015e300 con 0x7fe51015c810 2023-11-28T11:11:28.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe514d06700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100ad460 con 0x7fe5100718e0 2023-11-28T11:11:28.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe50e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe51006cdc0 0x7fe5100aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:28.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe50e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe51006cdc0 0x7fe5100aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60962/0 (socket says 172.21.15.125:60962) 2023-11-28T11:11:28.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe50e59c700 1 -- 172.21.15.125:0/1387189588 learned_addr learned my addr 172.21.15.125:0/1387189588 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:28.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe50dd9b700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5100718e0 0x7fe5101f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:28.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe50ed9d700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51015c810 0x7fe5100ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:28.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe50e59c700 1 -- 172.21.15.125:0/1387189588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5100718e0 msgr2=0x7fe5101f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:28.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe50e59c700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5100718e0 0x7fe5101f1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe50e59c700 1 -- 172.21.15.125:0/1387189588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51015c810 msgr2=0x7fe5100ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:28.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe50e59c700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51015c810 0x7fe5100ac8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:28.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe50e59c700 1 -- 172.21.15.125:0/1387189588 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe504009550 con 0x7fe51006cdc0 2023-11-28T11:11:28.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe50e59c700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe51006cdc0 0x7fe5100aecd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe504000c00 tx=0x7fe504004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:28.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe4feffd700 1 -- 172.21.15.125:0/1387189588 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504004520 con 0x7fe51006cdc0 2023-11-28T11:11:28.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe4feffd700 1 -- 172.21.15.125:0/1387189588 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50401e070 con 0x7fe51006cdc0 2023-11-28T11:11:28.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe514d06700 1 -- 172.21.15.125:0/1387189588 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5100ceb20 con 0x7fe51006cdc0 2023-11-28T11:11:28.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe4feffd700 1 -- 172.21.15.125:0/1387189588 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5040038c0 con 0x7fe51006cdc0 2023-11-28T11:11:28.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.176+0000 7fe514d06700 1 -- 172.21.15.125:0/1387189588 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe510161010 con 0x7fe51006cdc0 2023-11-28T11:11:28.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.177+0000 7fe514d06700 1 -- 172.21.15.125:0/1387189588 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5100ce740 con 0x7fe51006cdc0 2023-11-28T11:11:28.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.178+0000 7fe4feffd700 1 -- 172.21.15.125:0/1387189588 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe50400f050 con 0x7fe51006cdc0 2023-11-28T11:11:28.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.178+0000 7fe4feffd700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4f00682f0 0x7fe4f006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:28.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.178+0000 7fe4feffd700 1 -- 172.21.15.125:0/1387189588 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fe504020070 con 0x7fe51006cdc0 2023-11-28T11:11:28.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.178+0000 7fe50dd9b700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4f00682f0 0x7fe4f006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:28.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.178+0000 7fe50dd9b700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4f00682f0 0x7fe4f006a7a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe5100cceb0 tx=0x7fe500008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:28.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.182+0000 7fe4feffd700 1 -- 172.21.15.125:0/1387189588 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe504053ad0 con 0x7fe51006cdc0 2023-11-28T11:11:28.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:28.408+0000 7fe514d06700 1 -- 172.21.15.125:0/1387189588 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe5100743f0 con 0x7fe51006cdc0 2023-11-28T11:11:29.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.040+0000 7fe4feffd700 1 -- 172.21.15.125:0/1387189588 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe5040570f0 con 0x7fe51006cdc0 2023-11-28T11:11:29.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.042+0000 7fe514d06700 1 -- 172.21.15.125:0/1387189588 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4f00682f0 msgr2=0x7fe4f006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.042+0000 7fe514d06700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4f00682f0 0x7fe4f006a7a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe5100cceb0 tx=0x7fe500008040 comp rx=0 tx=0).stop 2023-11-28T11:11:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.043+0000 7fe514d06700 1 -- 172.21.15.125:0/1387189588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe51006cdc0 msgr2=0x7fe5100aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.043+0000 7fe514d06700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe51006cdc0 0x7fe5100aecd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe504000c00 tx=0x7fe504004750 comp rx=0 tx=0).stop 2023-11-28T11:11:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.043+0000 7fe514d06700 1 -- 172.21.15.125:0/1387189588 shutdown_connections 2023-11-28T11:11:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.043+0000 7fe514d06700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51015c810 0x7fe5100ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.043+0000 7fe514d06700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe51006cdc0 0x7fe5100aecd0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.043+0000 7fe514d06700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe4f00682f0 0x7fe4f006a7a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.043+0000 7fe514d06700 1 --2- 172.21.15.125:0/1387189588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5100718e0 0x7fe5101f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.043+0000 7fe514d06700 1 -- 172.21.15.125:0/1387189588 >> 172.21.15.125:0/1387189588 conn(0x7fe51006c010 msgr2=0x7fe5100cb660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.043+0000 7fe514d06700 1 -- 172.21.15.125:0/1387189588 shutdown_connections 2023-11-28T11:11:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.043+0000 7fe514d06700 1 -- 172.21.15.125:0/1387189588 wait complete. 2023-11-28T11:11:29.061 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T11:11:29.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.225+0000 7ff813368700 1 Processor -- start 2023-11-28T11:11:29.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.225+0000 7ff813368700 1 -- start start 2023-11-28T11:11:29.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.226+0000 7ff813368700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff80c06ba90 0x7ff80c15a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:29.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.226+0000 7ff813368700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff80c0ceea0 0x7ff80c15a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:29.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.226+0000 7ff813368700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80c0cea10 con 0x7ff80c15e070 2023-11-28T11:11:29.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.226+0000 7ff813368700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c15ae80 con 0x7ff80c0ceea0 2023-11-28T11:11:29.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.226+0000 7ff813368700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c15abd0 con 0x7ff80c06ba90 2023-11-28T11:11:29.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.226+0000 7ff811905700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff80c0ceea0 0x7ff80c15a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:29.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.226+0000 7ff811905700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff80c0ceea0 0x7ff80c15a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60976/0 (socket says 172.21.15.125:60976) 2023-11-28T11:11:29.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.226+0000 7ff811905700 1 -- 172.21.15.125:0/1019420126 learned_addr learned my addr 172.21.15.125:0/1019420126 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:29.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.227+0000 7ff810903700 1 --2- 172.21.15.125:0/1019420126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff80c06ba90 0x7ff80c15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:29.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.227+0000 7ff811905700 1 -- 172.21.15.125:0/1019420126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff80c06ba90 msgr2=0x7ff80c15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:29.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.227+0000 7ff811905700 1 --2- 172.21.15.125:0/1019420126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff80c06ba90 0x7ff80c15a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:29.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.227+0000 7ff811905700 1 -- 172.21.15.125:0/1019420126 >> v1:172.21.15.167:6789/0 conn(0x7ff80c15e070 legacy=0x7ff80c06b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:29.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.227+0000 7ff811905700 1 -- 172.21.15.125:0/1019420126 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c0cbd10 con 0x7ff80c0ceea0 2023-11-28T11:11:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.227+0000 7ff811905700 1 --2- 172.21.15.125:0/1019420126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80c0ceea0 0x7ff80c15a690 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff80400d150 tx=0x7ff80400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa725ea04b7df646 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.227+0000 7ff803fff700 1 -- 172.21.15.125:0/1019420126 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804010070 con 0x7ff80c0ceea0 2023-11-28T11:11:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.227+0000 7ff803fff700 1 -- 172.21.15.125:0/1019420126 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80400ddc0 con 0x7ff80c0ceea0 2023-11-28T11:11:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.227+0000 7ff803fff700 1 -- 172.21.15.125:0/1019420126 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80400b310 con 0x7ff80c0ceea0 2023-11-28T11:11:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.228+0000 7ff813368700 1 -- 172.21.15.125:0/1019420126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80c0ceea0 msgr2=0x7ff80c15a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.228+0000 7ff813368700 1 --2- 172.21.15.125:0/1019420126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80c0ceea0 0x7ff80c15a690 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff80400d150 tx=0x7ff80400d460 comp rx=0 tx=0).stop 2023-11-28T11:11:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.228+0000 7ff813368700 1 -- 172.21.15.125:0/1019420126 shutdown_connections 2023-11-28T11:11:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.228+0000 7ff813368700 1 --2- 172.21.15.125:0/1019420126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80c0ceea0 0x7ff80c15a690 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.228+0000 7ff813368700 1 --2- 172.21.15.125:0/1019420126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff80c06ba90 0x7ff80c15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.228+0000 7ff813368700 1 -- 172.21.15.125:0/1019420126 >> 172.21.15.125:0/1019420126 conn(0x7ff80c0cfc30 msgr2=0x7ff80c0d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.228+0000 7ff813368700 1 -- 172.21.15.125:0/1019420126 shutdown_connections 2023-11-28T11:11:29.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.228+0000 7ff813368700 1 -- 172.21.15.125:0/1019420126 wait complete. 2023-11-28T11:11:29.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.229+0000 7ff813368700 1 Processor -- start 2023-11-28T11:11:29.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.229+0000 7ff813368700 1 -- start start 2023-11-28T11:11:29.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff813368700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff80c06ba90 0x7ff80c0b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:29.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff813368700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80c0ceea0 0x7ff80c0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:29.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff813368700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff80c15e070 0x7ff80c142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:29.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff813368700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c0b3490 con 0x7ff80c0ceea0 2023-11-28T11:11:29.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff813368700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c0b48c0 con 0x7ff80c06ba90 2023-11-28T11:11:29.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff813368700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c0b4ba0 con 0x7ff80c15e070 2023-11-28T11:11:29.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff810903700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80c0ceea0 0x7ff80c0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:29.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff810903700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80c0ceea0 0x7ff80c0b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60980/0 (socket says 172.21.15.125:60980) 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff810903700 1 -- 172.21.15.125:0/386239667 learned_addr learned my addr 172.21.15.125:0/386239667 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff811104700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff80c06ba90 0x7ff80c0b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff811905700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff80c15e070 0x7ff80c142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff810903700 1 -- 172.21.15.125:0/386239667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff80c15e070 msgr2=0x7ff80c142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff810903700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff80c15e070 0x7ff80c142240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff810903700 1 -- 172.21.15.125:0/386239667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff80c06ba90 msgr2=0x7ff80c0b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff810903700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff80c06ba90 0x7ff80c0b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff810903700 1 -- 172.21.15.125:0/386239667 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80400bd40 con 0x7ff80c0ceea0 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff810903700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80c0ceea0 0x7ff80c0b0a10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff80800e7e0 tx=0x7ff80800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff801ffb700 1 -- 172.21.15.125:0/386239667 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff808013610 con 0x7ff80c0ceea0 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff801ffb700 1 -- 172.21.15.125:0/386239667 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8080137b0 con 0x7ff80c0ceea0 2023-11-28T11:11:29.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff801ffb700 1 -- 172.21.15.125:0/386239667 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff808013b60 con 0x7ff80c0ceea0 2023-11-28T11:11:29.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff813368700 1 -- 172.21.15.125:0/386239667 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80c0ce3c0 con 0x7ff80c0ceea0 2023-11-28T11:11:29.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff813368700 1 -- 172.21.15.125:0/386239667 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c0ce0e0 con 0x7ff80c0ceea0 2023-11-28T11:11:29.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.231+0000 7ff813368700 1 -- 172.21.15.125:0/386239667 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80c0ce6a0 con 0x7ff80c0ceea0 2023-11-28T11:11:29.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.232+0000 7ff801ffb700 1 -- 172.21.15.125:0/386239667 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff808023070 con 0x7ff80c0ceea0 2023-11-28T11:11:29.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.232+0000 7ff801ffb700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff7f00682f0 0x7ff7f006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:29.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.232+0000 7ff801ffb700 1 -- 172.21.15.125:0/386239667 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6206+0+0 (secure 0 0 0) 0x7ff808085a20 con 0x7ff80c0ceea0 2023-11-28T11:11:29.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.232+0000 7ff811104700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff7f00682f0 0x7ff7f006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:29.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.233+0000 7ff811104700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff7f00682f0 0x7ff7f006a7a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc000f60 tx=0x7ff7fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:29.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.237+0000 7ff801ffb700 1 -- 172.21.15.125:0/386239667 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff8080521f0 con 0x7ff80c0ceea0 2023-11-28T11:11:29.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:29.420+0000 7ff813368700 1 -- 172.21.15.125:0/386239667 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff80c0743f0 con 0x7ff80c0ceea0 2023-11-28T11:11:30.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.045+0000 7ff801ffb700 1 -- 172.21.15.125:0/386239667 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff808055810 con 0x7ff80c0ceea0 2023-11-28T11:11:30.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 -- 172.21.15.125:0/386239667 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff7f00682f0 msgr2=0x7ff7f006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:30.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff7f00682f0 0x7ff7f006a7a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc000f60 tx=0x7ff7fc009040 comp rx=0 tx=0).stop 2023-11-28T11:11:30.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 -- 172.21.15.125:0/386239667 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80c0ceea0 msgr2=0x7ff80c0b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:30.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80c0ceea0 0x7ff80c0b0a10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff80800e7e0 tx=0x7ff80800eba0 comp rx=0 tx=0).stop 2023-11-28T11:11:30.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 -- 172.21.15.125:0/386239667 shutdown_connections 2023-11-28T11:11:30.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff7f00682f0 0x7ff7f006a7a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:30.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff80c15e070 0x7ff80c142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:30.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff80c06ba90 0x7ff80c0b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:30.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 --2- 172.21.15.125:0/386239667 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff80c0ceea0 0x7ff80c0b0a10 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:30.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 -- 172.21.15.125:0/386239667 >> 172.21.15.125:0/386239667 conn(0x7ff80c0cfc30 msgr2=0x7ff80c0c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:30.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 -- 172.21.15.125:0/386239667 shutdown_connections 2023-11-28T11:11:30.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.049+0000 7ff813368700 1 -- 172.21.15.125:0/386239667 wait complete. 2023-11-28T11:11:30.051 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' removed 2023-11-28T11:11:30.064 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T11:11:30.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.193+0000 7fc767981700 1 Processor -- start 2023-11-28T11:11:30.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.193+0000 7fc767981700 1 -- start start 2023-11-28T11:11:30.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc767981700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc76015a4a0 0x7fc7600ad980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:30.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc767981700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc7600af4e0 0x7fc7600ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:30.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc767981700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7600af050 con 0x7fc7600adec0 2023-11-28T11:11:30.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc767981700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76015a870 con 0x7fc7600af4e0 2023-11-28T11:11:30.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc767981700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7600ae440 con 0x7fc76015a4a0 2023-11-28T11:11:30.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc764f1c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc7600af4e0 0x7fc7600ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:30.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc765f1e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc7600adec0 0x7fc76015df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45114/0 (socket says 172.21.15.125:45114) 2023-11-28T11:11:30.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc765f1e700 1 -- 172.21.15.125:0/274640345 learned_addr learned my addr 172.21.15.125:0/274640345 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:30.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc76571d700 1 --2- 172.21.15.125:0/274640345 >> v2:172.21.15.167:3300/0 conn(0x7fc76015a4a0 0x7fc7600ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:30.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc764f1c700 1 -- 172.21.15.125:0/274640345 >> v2:172.21.15.167:3300/0 conn(0x7fc76015a4a0 msgr2=0x7fc7600ad980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:30.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc764f1c700 1 --2- 172.21.15.125:0/274640345 >> v2:172.21.15.167:3300/0 conn(0x7fc76015a4a0 0x7fc7600ad980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:30.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc764f1c700 1 -- 172.21.15.125:0/274640345 >> v1:172.21.15.125:6789/0 conn(0x7fc7600adec0 legacy=0x7fc76015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:30.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc764f1c700 1 -- 172.21.15.125:0/274640345 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600ae720 con 0x7fc7600af4e0 2023-11-28T11:11:30.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc76571d700 1 --2- 172.21.15.125:0/274640345 >> v2:172.21.15.167:3300/0 conn(0x7fc76015a4a0 0x7fc7600ad980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:30.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc764f1c700 1 --2- 172.21.15.125:0/274640345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7600af4e0 0x7fc7600ce920 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc7600b3920 tx=0x7fc750009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1008edf5b459bb90 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:30.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.194+0000 7fc757fff700 1 -- 172.21.15.125:0/274640345 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750011830 con 0x7fc7600af4e0 2023-11-28T11:11:30.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.195+0000 7fc757fff700 1 -- 172.21.15.125:0/274640345 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750011990 con 0x7fc7600af4e0 2023-11-28T11:11:30.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.195+0000 7fc757fff700 1 -- 172.21.15.125:0/274640345 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750011d20 con 0x7fc7600af4e0 2023-11-28T11:11:30.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.195+0000 7fc767981700 1 -- 172.21.15.125:0/274640345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7600af4e0 msgr2=0x7fc7600ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:30.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.195+0000 7fc767981700 1 --2- 172.21.15.125:0/274640345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7600af4e0 0x7fc7600ce920 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc7600b3920 tx=0x7fc750009b20 comp rx=0 tx=0).stop 2023-11-28T11:11:30.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.195+0000 7fc767981700 1 -- 172.21.15.125:0/274640345 shutdown_connections 2023-11-28T11:11:30.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.195+0000 7fc767981700 1 --2- 172.21.15.125:0/274640345 >> v2:172.21.15.167:3300/0 conn(0x7fc76015a4a0 0x7fc7600ad980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:30.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.195+0000 7fc767981700 1 --2- 172.21.15.125:0/274640345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7600af4e0 0x7fc7600ce920 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:30.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.195+0000 7fc767981700 1 -- 172.21.15.125:0/274640345 >> 172.21.15.125:0/274640345 conn(0x7fc76006ab90 msgr2=0x7fc760099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:30.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.195+0000 7fc767981700 1 -- 172.21.15.125:0/274640345 shutdown_connections 2023-11-28T11:11:30.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.195+0000 7fc767981700 1 -- 172.21.15.125:0/274640345 wait complete. 2023-11-28T11:11:30.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.196+0000 7fc767981700 1 Processor -- start 2023-11-28T11:11:30.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.196+0000 7fc767981700 1 -- start start 2023-11-28T11:11:30.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc767981700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7600adec0 0x7fc760157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:30.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc767981700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7600af4e0 0x7fc760157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:30.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc767981700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc76015a4a0 0x7fc7600c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:30.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc767981700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76006d3e0 con 0x7fc7600af4e0 2023-11-28T11:11:30.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc767981700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7600c6a20 con 0x7fc7600adec0 2023-11-28T11:11:30.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc767981700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc760157890 con 0x7fc76015a4a0 2023-11-28T11:11:30.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc764f1c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7600af4e0 0x7fc760157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:30.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc764f1c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7600af4e0 0x7fc760157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60994/0 (socket says 172.21.15.125:60994) 2023-11-28T11:11:30.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc764f1c700 1 -- 172.21.15.125:0/128465789 learned_addr learned my addr 172.21.15.125:0/128465789 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:30.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc76571d700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7600adec0 0x7fc760157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:30.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc764f1c700 1 -- 172.21.15.125:0/128465789 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc76015a4a0 msgr2=0x7fc7600c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:30.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc764f1c700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc76015a4a0 0x7fc7600c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:30.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc764f1c700 1 -- 172.21.15.125:0/128465789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7600adec0 msgr2=0x7fc760157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:30.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc764f1c700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7600adec0 0x7fc760157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:30.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc764f1c700 1 -- 172.21.15.125:0/128465789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500094a0 con 0x7fc7600af4e0 2023-11-28T11:11:30.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.197+0000 7fc76571d700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7600adec0 0x7fc760157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:30.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.198+0000 7fc764f1c700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7600af4e0 0x7fc760157350 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc750013000 tx=0x7fc750004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:30.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.198+0000 7fc755ffb700 1 -- 172.21.15.125:0/128465789 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7500045f0 con 0x7fc7600af4e0 2023-11-28T11:11:30.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.198+0000 7fc755ffb700 1 -- 172.21.15.125:0/128465789 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75001f070 con 0x7fc7600af4e0 2023-11-28T11:11:30.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.198+0000 7fc767981700 1 -- 172.21.15.125:0/128465789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7600aece0 con 0x7fc7600af4e0 2023-11-28T11:11:30.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.198+0000 7fc755ffb700 1 -- 172.21.15.125:0/128465789 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750003b00 con 0x7fc7600af4e0 2023-11-28T11:11:30.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.198+0000 7fc767981700 1 -- 172.21.15.125:0/128465789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7600aea00 con 0x7fc7600af4e0 2023-11-28T11:11:30.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.199+0000 7fc767981700 1 -- 172.21.15.125:0/128465789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7600d0bd0 con 0x7fc7600af4e0 2023-11-28T11:11:30.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.199+0000 7fc755ffb700 1 -- 172.21.15.125:0/128465789 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc75000f050 con 0x7fc7600af4e0 2023-11-28T11:11:30.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.200+0000 7fc755ffb700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7440682f0 0x7fc74406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:30.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.200+0000 7fc755ffb700 1 -- 172.21.15.125:0/128465789 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fc750021070 con 0x7fc7600af4e0 2023-11-28T11:11:30.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.200+0000 7fc76571d700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7440682f0 0x7fc74406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:30.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.200+0000 7fc76571d700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7440682f0 0x7fc74406a7a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc75c006fd0 tx=0x7fc75c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:30.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.203+0000 7fc755ffb700 1 -- 172.21.15.125:0/128465789 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc7500545d0 con 0x7fc7600af4e0 2023-11-28T11:11:30.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:30.386+0000 7fc767981700 1 -- 172.21.15.125:0/128465789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7600743f0 con 0x7fc7600af4e0 2023-11-28T11:11:31.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.051+0000 7fc755ffb700 1 -- 172.21.15.125:0/128465789 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc7500150d0 con 0x7fc7600af4e0 2023-11-28T11:11:31.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 -- 172.21.15.125:0/128465789 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7440682f0 msgr2=0x7fc74406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7440682f0 0x7fc74406a7a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc75c006fd0 tx=0x7fc75c008040 comp rx=0 tx=0).stop 2023-11-28T11:11:31.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 -- 172.21.15.125:0/128465789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7600af4e0 msgr2=0x7fc760157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7600af4e0 0x7fc760157350 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc750013000 tx=0x7fc750004750 comp rx=0 tx=0).stop 2023-11-28T11:11:31.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 -- 172.21.15.125:0/128465789 shutdown_connections 2023-11-28T11:11:31.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc7440682f0 0x7fc74406a7a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc76015a4a0 0x7fc7600c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7600adec0 0x7fc760157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 --2- 172.21.15.125:0/128465789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7600af4e0 0x7fc760157350 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 -- 172.21.15.125:0/128465789 >> 172.21.15.125:0/128465789 conn(0x7fc76006ab90 msgr2=0x7fc7600b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:31.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 -- 172.21.15.125:0/128465789 shutdown_connections 2023-11-28T11:11:31.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.058+0000 7fc767981700 1 -- 172.21.15.125:0/128465789 wait complete. 2023-11-28T11:11:31.060 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' removed 2023-11-28T11:11:31.076 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T11:11:31.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.202+0000 7f60b550f700 1 Processor -- start 2023-11-28T11:11:31.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.203+0000 7f60b550f700 1 -- start start 2023-11-28T11:11:31.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.203+0000 7f60b550f700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60b015c8c0 0x7f60b0160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.203+0000 7f60b550f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60b00b5dc0 0x7f60b006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.203+0000 7f60b550f700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b00d2d30 con 0x7f60b006b050 2023-11-28T11:11:31.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.203+0000 7f60b550f700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b006b4d0 con 0x7f60b015c8c0 2023-11-28T11:11:31.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.203+0000 7f60b550f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00d0b40 con 0x7f60b00b5dc0 2023-11-28T11:11:31.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60aeffd700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60b015c8c0 0x7f60b0160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60ae7fc700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60b00b5dc0 0x7f60b006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60af7fe700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f60b006b050 0x7f60b00d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:47928/0 (socket says 172.21.15.125:47928) 2023-11-28T11:11:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60af7fe700 1 -- 172.21.15.125:0/373859479 learned_addr learned my addr 172.21.15.125:0/373859479 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60aeffd700 1 -- 172.21.15.125:0/373859479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60b00b5dc0 msgr2=0x7f60b006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60aeffd700 1 --2- 172.21.15.125:0/373859479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60b00b5dc0 0x7f60b006ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60aeffd700 1 -- 172.21.15.125:0/373859479 >> v1:172.21.15.167:6789/0 conn(0x7f60b006b050 legacy=0x7f60b00d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60aeffd700 1 -- 172.21.15.125:0/373859479 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b01611f0 con 0x7f60b015c8c0 2023-11-28T11:11:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60adffb700 1 -- 172.21.15.125:0/373859479 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265949721 0 0) 0x7f60a8001490 con 0x7f60b006b050 2023-11-28T11:11:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60aeffd700 1 --2- 172.21.15.125:0/373859479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b015c8c0 0x7f60b0160cb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009840 tx=0x7f60a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da3bacc49eac304a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60adffb700 1 -- 172.21.15.125:0/373859479 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4011830 con 0x7f60b015c8c0 2023-11-28T11:11:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60adffb700 1 -- 172.21.15.125:0/373859479 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a4011990 con 0x7f60b015c8c0 2023-11-28T11:11:31.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.204+0000 7f60adffb700 1 -- 172.21.15.125:0/373859479 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4011d20 con 0x7f60b015c8c0 2023-11-28T11:11:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.205+0000 7f60b550f700 1 -- 172.21.15.125:0/373859479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b015c8c0 msgr2=0x7f60b0160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.205+0000 7f60b550f700 1 --2- 172.21.15.125:0/373859479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b015c8c0 0x7f60b0160cb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009840 tx=0x7f60a4009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.205+0000 7f60b550f700 1 -- 172.21.15.125:0/373859479 shutdown_connections 2023-11-28T11:11:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.205+0000 7f60b550f700 1 --2- 172.21.15.125:0/373859479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b015c8c0 0x7f60b0160cb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.205+0000 7f60b550f700 1 --2- 172.21.15.125:0/373859479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60b00b5dc0 0x7f60b006ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.205+0000 7f60b550f700 1 -- 172.21.15.125:0/373859479 >> 172.21.15.125:0/373859479 conn(0x7f60b006c520 msgr2=0x7f60b006c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:31.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.205+0000 7f60b550f700 1 -- 172.21.15.125:0/373859479 shutdown_connections 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.205+0000 7f60b550f700 1 -- 172.21.15.125:0/373859479 wait complete. 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.206+0000 7f60b550f700 1 Processor -- start 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.206+0000 7f60b550f700 1 -- start start 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60b550f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60b006b050 0x7f60b0155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60b550f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60b00b5dc0 0x7f60b015bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60b550f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b015c8c0 0x7f60b00ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60b550f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b0156860 con 0x7f60b00b5dc0 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60b550f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00cb890 con 0x7f60b015c8c0 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60b550f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00cbb70 con 0x7f60b006b050 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60ae7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60b00b5dc0 0x7f60b015bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60ae7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60b00b5dc0 0x7f60b015bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32774/0 (socket says 172.21.15.125:32774) 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60ae7fc700 1 -- 172.21.15.125:0/612063685 learned_addr learned my addr 172.21.15.125:0/612063685 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:31.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60af7fe700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b015c8c0 0x7f60b00ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60aeffd700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60b006b050 0x7f60b0155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.207+0000 7f60ae7fc700 1 -- 172.21.15.125:0/612063685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60b006b050 msgr2=0x7f60b0155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.208+0000 7f60ae7fc700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60b006b050 0x7f60b0155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.208+0000 7f60ae7fc700 1 -- 172.21.15.125:0/612063685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b015c8c0 msgr2=0x7f60b00ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.208+0000 7f60ae7fc700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b015c8c0 0x7f60b00ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.208+0000 7f60ae7fc700 1 -- 172.21.15.125:0/612063685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a40094a0 con 0x7f60b00b5dc0 2023-11-28T11:11:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.208+0000 7f60ae7fc700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60b00b5dc0 0x7f60b015bd00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f60a000e9b0 tx=0x7f60a000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.208+0000 7f60977fe700 1 -- 172.21.15.125:0/612063685 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0009710 con 0x7f60b00b5dc0 2023-11-28T11:11:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.208+0000 7f60977fe700 1 -- 172.21.15.125:0/612063685 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a000ee50 con 0x7f60b00b5dc0 2023-11-28T11:11:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.208+0000 7f60977fe700 1 -- 172.21.15.125:0/612063685 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a000ca50 con 0x7f60b00b5dc0 2023-11-28T11:11:31.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.208+0000 7f60b550f700 1 -- 172.21.15.125:0/612063685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b00cd760 con 0x7f60b00b5dc0 2023-11-28T11:11:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.208+0000 7f60b550f700 1 -- 172.21.15.125:0/612063685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b00d2a50 con 0x7f60b00b5dc0 2023-11-28T11:11:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.209+0000 7f60b550f700 1 -- 172.21.15.125:0/612063685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b00cda40 con 0x7f60b00b5dc0 2023-11-28T11:11:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.209+0000 7f60977fe700 1 -- 172.21.15.125:0/612063685 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f60a0019030 con 0x7f60b00b5dc0 2023-11-28T11:11:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.210+0000 7f60977fe700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f609c0682f0 0x7f609c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.210+0000 7f60977fe700 1 -- 172.21.15.125:0/612063685 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f60a00858e0 con 0x7f60b00b5dc0 2023-11-28T11:11:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.210+0000 7f60aeffd700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f609c0682f0 0x7f609c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.210+0000 7f60aeffd700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f609c0682f0 0x7f609c06a7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f60a4000c00 tx=0x7f60a401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:31.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.214+0000 7f60977fe700 1 -- 172.21.15.125:0/612063685 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f60a0052360 con 0x7f60b00b5dc0 2023-11-28T11:11:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.401+0000 7f60b550f700 1 -- 172.21.15.125:0/612063685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f60b0067d70 con 0x7f60b00b5dc0 2023-11-28T11:11:31.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.405+0000 7f60977fe700 1 -- 172.21.15.125:0/612063685 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f60a0055980 con 0x7f60b00b5dc0 2023-11-28T11:11:31.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 -- 172.21.15.125:0/612063685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f609c0682f0 msgr2=0x7f609c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f609c0682f0 0x7f609c06a7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f60a4000c00 tx=0x7f60a401c040 comp rx=0 tx=0).stop 2023-11-28T11:11:31.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 -- 172.21.15.125:0/612063685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60b00b5dc0 msgr2=0x7f60b015bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60b00b5dc0 0x7f60b015bd00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f60a000e9b0 tx=0x7f60a000ecc0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 -- 172.21.15.125:0/612063685 shutdown_connections 2023-11-28T11:11:31.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b015c8c0 0x7f60b00ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f609c0682f0 0x7f609c06a7a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60b006b050 0x7f60b0155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 --2- 172.21.15.125:0/612063685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60b00b5dc0 0x7f60b015bd00 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 -- 172.21.15.125:0/612063685 >> 172.21.15.125:0/612063685 conn(0x7f60b006c520 msgr2=0x7f60b00b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:31.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 -- 172.21.15.125:0/612063685 shutdown_connections 2023-11-28T11:11:31.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.407+0000 7f60b550f700 1 -- 172.21.15.125:0/612063685 wait complete. 2023-11-28T11:11:31.420 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-28T11:11:31.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.539+0000 7fc2d3fe5700 1 Processor -- start 2023-11-28T11:11:31.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.539+0000 7fc2d3fe5700 1 -- start start 2023-11-28T11:11:31.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d3fe5700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc2cc06e400 0x7fc2cc06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d3fe5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2cc15af30 con 0x7fc2cc15e010 2023-11-28T11:11:31.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d3fe5700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2cc15ef40 con 0x7fc2cc0d15f0 2023-11-28T11:11:31.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d3fe5700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2cc15a9d0 con 0x7fc2cc06e400 2023-11-28T11:11:31.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d2582700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc2cc15e010 0x7fc2cc0ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45138/0 (socket says 172.21.15.125:45138) 2023-11-28T11:11:31.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d2582700 1 -- 172.21.15.125:0/2050191935 learned_addr learned my addr 172.21.15.125:0/2050191935 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:31.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d1d81700 1 --2- 172.21.15.125:0/2050191935 >> v2:172.21.15.167:3300/0 conn(0x7fc2cc06e400 0x7fc2cc06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661629697 0 0) 0x7fc2cc15af30 con 0x7fc2cc15e010 2023-11-28T11:11:31.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b80035b0 con 0x7fc2cc15e010 2023-11-28T11:11:31.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1153321587 0 0) 0x7fc2b80035b0 con 0x7fc2cc15e010 2023-11-28T11:11:31.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 >> v2:172.21.15.167:3300/0 conn(0x7fc2cc06e400 msgr2=0x7fc2cc06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:31.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 --2- 172.21.15.125:0/2050191935 >> v2:172.21.15.167:3300/0 conn(0x7fc2cc06e400 0x7fc2cc06e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 >> v1:172.21.15.167:6789/0 conn(0x7fc2cc0d15f0 legacy=0x7fc2cc15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc06ed10 con 0x7fc2cc15e010 2023-11-28T11:11:31.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fc2c40019f0 con 0x7fc2cc15e010 2023-11-28T11:11:31.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 >> v1:172.21.15.125:6789/0 conn(0x7fc2cc15e010 legacy=0x7fc2cc0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 --2- 172.21.15.125:0/2050191935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b8003a00 0x7fc2b8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 --2- 172.21.15.125:0/2050191935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2b8004850 0x7fc2b8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 --2- 172.21.15.125:0/2050191935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 0x7fc2b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b800c050 con 0x7fc2b8005200 2023-11-28T11:11:31.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b800c1c0 con 0x7fc2b8003a00 2023-11-28T11:11:31.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.540+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b800c380 con 0x7fc2b8004850 2023-11-28T11:11:31.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d2582700 1 --2- 172.21.15.125:0/2050191935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 0x7fc2b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d1d81700 1 --2- 172.21.15.125:0/2050191935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b8003a00 0x7fc2b8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d1580700 1 --2- 172.21.15.125:0/2050191935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2b8004850 0x7fc2b8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d2582700 1 -- 172.21.15.125:0/2050191935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2b8004850 msgr2=0x7fc2b8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:31.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d2582700 1 --2- 172.21.15.125:0/2050191935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2b8004850 0x7fc2b8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d2582700 1 -- 172.21.15.125:0/2050191935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b8003a00 msgr2=0x7fc2b8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:31.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d2582700 1 --2- 172.21.15.125:0/2050191935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b8003a00 0x7fc2b8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d2582700 1 -- 172.21.15.125:0/2050191935 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80035b0 con 0x7fc2b8005200 2023-11-28T11:11:31.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d2582700 1 -- 172.21.15.125:0/2050191935 reap_dead start 2023-11-28T11:11:31.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d2582700 1 --2- 172.21.15.125:0/2050191935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 0x7fc2b800ba10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40013d0 tx=0x7fc2b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7774595b12d3d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:31.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4012600 con 0x7fc2b8005200 2023-11-28T11:11:31.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c40127a0 con 0x7fc2b8005200 2023-11-28T11:11:31.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.541+0000 7fc2d0d7f700 1 -- 172.21.15.125:0/2050191935 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4012b50 con 0x7fc2b8005200 2023-11-28T11:11:31.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.542+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/2050191935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 msgr2=0x7fc2b800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.542+0000 7fc2d3fe5700 1 --2- 172.21.15.125:0/2050191935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 0x7fc2b800ba10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40013d0 tx=0x7fc2b8005880 comp rx=0 tx=0).stop 2023-11-28T11:11:31.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.542+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/2050191935 shutdown_connections 2023-11-28T11:11:31.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.542+0000 7fc2d3fe5700 1 --2- 172.21.15.125:0/2050191935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 0x7fc2b800ba10 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.542+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/2050191935 >> 172.21.15.125:0/2050191935 conn(0x7fc2cc06a270 msgr2=0x7fc2cc06a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:31.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.542+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/2050191935 shutdown_connections 2023-11-28T11:11:31.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.542+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/2050191935 wait complete. 2023-11-28T11:11:31.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.543+0000 7fc2d3fe5700 1 Processor -- start 2023-11-28T11:11:31.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.543+0000 7fc2d3fe5700 1 -- start start 2023-11-28T11:11:31.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d3fe5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 0x7fc2cc13f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d3fe5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2cc1e44f0 0x7fc2cc1e4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d3fe5700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2cc15bca0 0x7fc2cc15c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d3fe5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc15cc70 con 0x7fc2b8005200 2023-11-28T11:11:31.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d3fe5700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc13fd00 con 0x7fc2cc15bca0 2023-11-28T11:11:31.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d3fe5700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc1e4ea0 con 0x7fc2cc1e44f0 2023-11-28T11:11:31.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d1d81700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 0x7fc2cc13f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d1d81700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 0x7fc2cc13f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32790/0 (socket says 172.21.15.125:32790) 2023-11-28T11:11:31.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d1d81700 1 -- 172.21.15.125:0/61974477 learned_addr learned my addr 172.21.15.125:0/61974477 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:31.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d2582700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2cc15bca0 0x7fc2cc15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d1580700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2cc1e44f0 0x7fc2cc1e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d1d81700 1 -- 172.21.15.125:0/61974477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2cc1e44f0 msgr2=0x7fc2cc1e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d1d81700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2cc1e44f0 0x7fc2cc1e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d1d81700 1 -- 172.21.15.125:0/61974477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2cc15bca0 msgr2=0x7fc2cc15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d1d81700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2cc15bca0 0x7fc2cc15c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d1d81700 1 -- 172.21.15.125:0/61974477 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc15ec60 con 0x7fc2b8005200 2023-11-28T11:11:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d2582700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2cc15bca0 0x7fc2cc15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d1d81700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 0x7fc2cc13f7c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80119d0 tx=0x7fc2c8011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2c27fc700 1 -- 172.21.15.125:0/61974477 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800f940 con 0x7fc2b8005200 2023-11-28T11:11:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2c27fc700 1 -- 172.21.15.125:0/61974477 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c800faa0 con 0x7fc2b8005200 2023-11-28T11:11:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/61974477 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc15e980 con 0x7fc2b8005200 2023-11-28T11:11:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2c27fc700 1 -- 172.21.15.125:0/61974477 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800fe30 con 0x7fc2b8005200 2023-11-28T11:11:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.544+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/61974477 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc15abc0 con 0x7fc2b8005200 2023-11-28T11:11:31.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.545+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/61974477 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc0743f0 con 0x7fc2b8005200 2023-11-28T11:11:31.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.546+0000 7fc2c27fc700 1 -- 172.21.15.125:0/61974477 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc2c801d400 con 0x7fc2b8005200 2023-11-28T11:11:31.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.546+0000 7fc2c27fc700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc2b00682f0 0x7fc2b006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:31.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.546+0000 7fc2c27fc700 1 -- 172.21.15.125:0/61974477 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc2c80861f0 con 0x7fc2b8005200 2023-11-28T11:11:31.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.546+0000 7fc2d1580700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc2b00682f0 0x7fc2b006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:31.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.547+0000 7fc2d1580700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc2b00682f0 0x7fc2b006a7a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0b5150 tx=0x7fc2bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:31.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.550+0000 7fc2c27fc700 1 -- 172.21.15.125:0/61974477 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc2c8052cf0 con 0x7fc2b8005200 2023-11-28T11:11:31.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:31.809+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/61974477 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7fc2cc06dcd0 con 0x7fc2b8005200 2023-11-28T11:11:32.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.051+0000 7fc2c27fc700 1 -- 172.21.15.125:0/61974477 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v166) v1 ==== 149+0+0 (secure 0 0 0) 0x7fc2c8056310 con 0x7fc2b8005200 2023-11-28T11:11:32.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/61974477 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc2b00682f0 msgr2=0x7fc2b006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc2b00682f0 0x7fc2b006a7a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0b5150 tx=0x7fc2bc009040 comp rx=0 tx=0).stop 2023-11-28T11:11:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/61974477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 msgr2=0x7fc2cc13f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 0x7fc2cc13f7c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80119d0 tx=0x7fc2c8011d90 comp rx=0 tx=0).stop 2023-11-28T11:11:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/61974477 shutdown_connections 2023-11-28T11:11:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2cc15bca0 0x7fc2cc15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b8005200 0x7fc2cc13f7c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc2b00682f0 0x7fc2b006a7a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 --2- 172.21.15.125:0/61974477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2cc1e44f0 0x7fc2cc1e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/61974477 >> 172.21.15.125:0/61974477 conn(0x7fc2cc06a270 msgr2=0x7fc2cc1570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/61974477 shutdown_connections 2023-11-28T11:11:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.053+0000 7fc2d3fe5700 1 -- 172.21.15.125:0/61974477 wait complete. 2023-11-28T11:11:32.065 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2023-11-28T11:11:32.066 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2023-11-28T11:11:32.066 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:11:32.066 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-28T11:11:32.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.186+0000 7fe7fb39e700 1 Processor -- start 2023-11-28T11:11:32.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.186+0000 7fe7fb39e700 1 -- start start 2023-11-28T11:11:32.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.187+0000 7fe7fb39e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe7f415a400 0x7fe7f40cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:32.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.187+0000 7fe7fb39e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f40cc290 con 0x7fe7f415e890 2023-11-28T11:11:32.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.187+0000 7fe7fb39e700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f40cfb90 con 0x7fe7f40b29e0 2023-11-28T11:11:32.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.187+0000 7fe7fb39e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f40cbff0 con 0x7fe7f415a400 2023-11-28T11:11:32.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.188+0000 7fe7fab9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe7f415e890 0x7fe7f40cc720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45158/0 (socket says 172.21.15.125:45158) 2023-11-28T11:11:32.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.188+0000 7fe7fa39c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe7f415a400 0x7fe7f40cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:32.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.188+0000 7fe7fab9d700 1 -- 172.21.15.125:0/1947666887 learned_addr learned my addr 172.21.15.125:0/1947666887 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:32.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.188+0000 7fe7fa39c700 1 -- 172.21.15.125:0/1947666887 >> v1:172.21.15.167:6789/0 conn(0x7fe7f40b29e0 legacy=0x7fe7f415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:32.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.188+0000 7fe7f939a700 1 -- 172.21.15.125:0/1947666887 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609154730 0 0) 0x7fe7f40cc290 con 0x7fe7f415e890 2023-11-28T11:11:32.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.188+0000 7fe7fa39c700 1 -- 172.21.15.125:0/1947666887 >> v1:172.21.15.125:6789/0 conn(0x7fe7f415e890 legacy=0x7fe7f40cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:32.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.188+0000 7fe7fa39c700 1 -- 172.21.15.125:0/1947666887 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f40cfe70 con 0x7fe7f415a400 2023-11-28T11:11:32.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.188+0000 7fe7fa39c700 1 --2- 172.21.15.125:0/1947666887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7f415a400 0x7fe7f40cf220 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4009840 tx=0x7fe7e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1782e1bac7e909 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:32.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.188+0000 7fe7f939a700 1 -- 172.21.15.125:0/1947666887 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4004230 con 0x7fe7f415a400 2023-11-28T11:11:32.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.188+0000 7fe7f939a700 1 -- 172.21.15.125:0/1947666887 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e4004390 con 0x7fe7f415a400 2023-11-28T11:11:32.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.188+0000 7fe7f939a700 1 -- 172.21.15.125:0/1947666887 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40036a0 con 0x7fe7f415a400 2023-11-28T11:11:32.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.189+0000 7fe7fb39e700 1 -- 172.21.15.125:0/1947666887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7f415a400 msgr2=0x7fe7f40cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:32.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.189+0000 7fe7fb39e700 1 --2- 172.21.15.125:0/1947666887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7f415a400 0x7fe7f40cf220 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4009840 tx=0x7fe7e4009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:32.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.189+0000 7fe7fb39e700 1 -- 172.21.15.125:0/1947666887 shutdown_connections 2023-11-28T11:11:32.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.189+0000 7fe7fb39e700 1 --2- 172.21.15.125:0/1947666887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7f415a400 0x7fe7f40cf220 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:32.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.189+0000 7fe7fb39e700 1 -- 172.21.15.125:0/1947666887 >> 172.21.15.125:0/1947666887 conn(0x7fe7f406f6b0 msgr2=0x7fe7f406fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:32.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.189+0000 7fe7fb39e700 1 -- 172.21.15.125:0/1947666887 shutdown_connections 2023-11-28T11:11:32.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.189+0000 7fe7fb39e700 1 -- 172.21.15.125:0/1947666887 wait complete. 2023-11-28T11:11:32.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.190+0000 7fe7fb39e700 1 Processor -- start 2023-11-28T11:11:32.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.190+0000 7fe7fb39e700 1 -- start start 2023-11-28T11:11:32.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7fb39e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7f40b29e0 0x7fe7f41f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:32.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7fb39e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7f415a400 0x7fe7f415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:32.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7fb39e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7f415e890 0x7fe7f40c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:32.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7fb39e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f41f5760 con 0x7fe7f415a400 2023-11-28T11:11:32.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7fb39e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f415b000 con 0x7fe7f40b29e0 2023-11-28T11:11:32.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7fb39e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f415b2e0 con 0x7fe7f415e890 2023-11-28T11:11:32.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7f9b9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7f415a400 0x7fe7f415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:32.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7f9b9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7f415a400 0x7fe7f415a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32806/0 (socket says 172.21.15.125:32806) 2023-11-28T11:11:32.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7f9b9b700 1 -- 172.21.15.125:0/2510455058 learned_addr learned my addr 172.21.15.125:0/2510455058 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:32.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7fa39c700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7f40b29e0 0x7fe7f41f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:32.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7fab9d700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7f415e890 0x7fe7f40c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:32.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7f9b9b700 1 -- 172.21.15.125:0/2510455058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7f415e890 msgr2=0x7fe7f40c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:32.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7f9b9b700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7f415e890 0x7fe7f40c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:32.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7f9b9b700 1 -- 172.21.15.125:0/2510455058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7f40b29e0 msgr2=0x7fe7f41f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:32.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7f9b9b700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7f40b29e0 0x7fe7f41f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:32.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7f9b9b700 1 -- 172.21.15.125:0/2510455058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e40094a0 con 0x7fe7f415a400 2023-11-28T11:11:32.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7fab9d700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7f415e890 0x7fe7f40c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:32.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7f9b9b700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7f415a400 0x7fe7f415a7d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000b470 tx=0x7fe7f000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:32.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.191+0000 7fe7eaffd700 1 -- 172.21.15.125:0/2510455058 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0011830 con 0x7fe7f415a400 2023-11-28T11:11:32.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.192+0000 7fe7eaffd700 1 -- 172.21.15.125:0/2510455058 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f00119b0 con 0x7fe7f415a400 2023-11-28T11:11:32.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.192+0000 7fe7fb39e700 1 -- 172.21.15.125:0/2510455058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f40d0430 con 0x7fe7f415a400 2023-11-28T11:11:32.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.192+0000 7fe7eaffd700 1 -- 172.21.15.125:0/2510455058 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0011d60 con 0x7fe7f415a400 2023-11-28T11:11:32.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.192+0000 7fe7fb39e700 1 -- 172.21.15.125:0/2510455058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f40d0150 con 0x7fe7f415a400 2023-11-28T11:11:32.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.193+0000 7fe7fb39e700 1 -- 172.21.15.125:0/2510455058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f40cf760 con 0x7fe7f415a400 2023-11-28T11:11:32.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.193+0000 7fe7eaffd700 1 -- 172.21.15.125:0/2510455058 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe7f0021070 con 0x7fe7f415a400 2023-11-28T11:11:32.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.193+0000 7fe7eaffd700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe7d80682f0 0x7fe7d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:32.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.193+0000 7fe7eaffd700 1 -- 172.21.15.125:0/2510455058 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe7f00858d0 con 0x7fe7f415a400 2023-11-28T11:11:32.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.193+0000 7fe7fa39c700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe7d80682f0 0x7fe7d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:32.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.194+0000 7fe7fa39c700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe7d80682f0 0x7fe7d806a7a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40090b0 tx=0x7fe7e401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:32.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.198+0000 7fe7eaffd700 1 -- 172.21.15.125:0/2510455058 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe7f00523d0 con 0x7fe7f415a400 2023-11-28T11:11:32.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:32.453+0000 7fe7fb39e700 1 -- 172.21.15.125:0/2510455058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7fe7f40b3620 con 0x7fe7f415a400 2023-11-28T11:11:33.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.053+0000 7fe7eaffd700 1 -- 172.21.15.125:0/2510455058 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v167) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe7f0015020 con 0x7fe7f415a400 2023-11-28T11:11:33.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 -- 172.21.15.125:0/2510455058 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe7d80682f0 msgr2=0x7fe7d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe7d80682f0 0x7fe7d806a7a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40090b0 tx=0x7fe7e401c040 comp rx=0 tx=0).stop 2023-11-28T11:11:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 -- 172.21.15.125:0/2510455058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7f415a400 msgr2=0x7fe7f415a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7f415a400 0x7fe7f415a7d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000b470 tx=0x7fe7f000b780 comp rx=0 tx=0).stop 2023-11-28T11:11:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 -- 172.21.15.125:0/2510455058 shutdown_connections 2023-11-28T11:11:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe7d80682f0 0x7fe7d806a7a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7f415e890 0x7fe7f40c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7f40b29e0 0x7fe7f41f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 --2- 172.21.15.125:0/2510455058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7f415a400 0x7fe7f415a7d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 -- 172.21.15.125:0/2510455058 >> 172.21.15.125:0/2510455058 conn(0x7fe7f406f6b0 msgr2=0x7fe7f40d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 -- 172.21.15.125:0/2510455058 shutdown_connections 2023-11-28T11:11:33.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.056+0000 7fe7fb39e700 1 -- 172.21.15.125:0/2510455058 wait complete. 2023-11-28T11:11:33.071 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T11:11:33.123 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:11:33.125 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:11:33.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.203+0000 7fb09a19a700 1 Processor -- start 2023-11-28T11:11:33.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.203+0000 7fb09a19a700 1 -- start start 2023-11-28T11:11:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.203+0000 7fb09a19a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0940cf710 0x7fb0940ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.203+0000 7fb09a19a700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb094071890 0x7fb094071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.203+0000 7fb09a19a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09415cc10 con 0x7fb09406a270 2023-11-28T11:11:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.203+0000 7fb09a19a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09406c9b0 con 0x7fb0940cf710 2023-11-28T11:11:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.203+0000 7fb09a19a700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09406cc90 con 0x7fb094071890 2023-11-28T11:11:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb0937fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0940cf710 0x7fb0940ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb093fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb09406a270 0x7fb0940b1650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45168/0 (socket says 172.21.15.125:45168) 2023-11-28T11:11:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb093fff700 1 -- 172.21.15.125:0/3090090440 learned_addr learned my addr 172.21.15.125:0/3090090440 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb092ffd700 1 --2- 172.21.15.125:0/3090090440 >> v2:172.21.15.167:3300/0 conn(0x7fb094071890 0x7fb094071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb0927fc700 1 -- 172.21.15.125:0/3090090440 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959809730 0 0) 0x7fb09415cc10 con 0x7fb09406a270 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb0927fc700 1 -- 172.21.15.125:0/3090090440 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c0035b0 con 0x7fb09406a270 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb0937fe700 1 -- 172.21.15.125:0/3090090440 >> v2:172.21.15.167:3300/0 conn(0x7fb094071890 msgr2=0x7fb094071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb0937fe700 1 --2- 172.21.15.125:0/3090090440 >> v2:172.21.15.167:3300/0 conn(0x7fb094071890 0x7fb094071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb0937fe700 1 -- 172.21.15.125:0/3090090440 >> v1:172.21.15.125:6789/0 conn(0x7fb09406a270 legacy=0x7fb0940b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb0937fe700 1 -- 172.21.15.125:0/3090090440 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09406cf70 con 0x7fb0940cf710 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb0937fe700 1 --2- 172.21.15.125:0/3090090440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0940cf710 0x7fb0940ce740 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb084009840 tx=0x7fb084009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28615a55fd5ecb94 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb0927fc700 1 -- 172.21.15.125:0/3090090440 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084011830 con 0x7fb0940cf710 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb0927fc700 1 -- 172.21.15.125:0/3090090440 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb084011990 con 0x7fb0940cf710 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.204+0000 7fb0927fc700 1 -- 172.21.15.125:0/3090090440 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084011d20 con 0x7fb0940cf710 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.205+0000 7fb09a19a700 1 -- 172.21.15.125:0/3090090440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0940cf710 msgr2=0x7fb0940ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.205+0000 7fb09a19a700 1 --2- 172.21.15.125:0/3090090440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0940cf710 0x7fb0940ce740 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb084009840 tx=0x7fb084009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.205+0000 7fb09a19a700 1 -- 172.21.15.125:0/3090090440 shutdown_connections 2023-11-28T11:11:33.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.205+0000 7fb09a19a700 1 --2- 172.21.15.125:0/3090090440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0940cf710 0x7fb0940ce740 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.205+0000 7fb09a19a700 1 --2- 172.21.15.125:0/3090090440 >> v2:172.21.15.167:3300/0 conn(0x7fb094071890 0x7fb094071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.205+0000 7fb09a19a700 1 -- 172.21.15.125:0/3090090440 >> 172.21.15.125:0/3090090440 conn(0x7fb09406c010 msgr2=0x7fb0940cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:33.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.205+0000 7fb09a19a700 1 -- 172.21.15.125:0/3090090440 shutdown_connections 2023-11-28T11:11:33.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.205+0000 7fb09a19a700 1 -- 172.21.15.125:0/3090090440 wait complete. 2023-11-28T11:11:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.206+0000 7fb09a19a700 1 Processor -- start 2023-11-28T11:11:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.206+0000 7fb09a19a700 1 -- start start 2023-11-28T11:11:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb09a19a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb09406a270 0x7fb09415fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb09a19a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb094071890 0x7fb094155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb09a19a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0940cf710 0x7fb0941571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb09a19a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb094158630 con 0x7fb094071890 2023-11-28T11:11:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb09a19a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb094156350 con 0x7fb0940cf710 2023-11-28T11:11:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb09a19a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb094157a20 con 0x7fb09406a270 2023-11-28T11:11:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb092ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb094071890 0x7fb094155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb092ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb094071890 0x7fb094155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32820/0 (socket says 172.21.15.125:32820) 2023-11-28T11:11:33.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb092ffd700 1 -- 172.21.15.125:0/464572540 learned_addr learned my addr 172.21.15.125:0/464572540 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:33.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb093fff700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0940cf710 0x7fb0941571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb0937fe700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb09406a270 0x7fb09415fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb092ffd700 1 -- 172.21.15.125:0/464572540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb09406a270 msgr2=0x7fb09415fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb092ffd700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb09406a270 0x7fb09415fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb092ffd700 1 -- 172.21.15.125:0/464572540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0940cf710 msgr2=0x7fb0941571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb092ffd700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0940cf710 0x7fb0941571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb092ffd700 1 -- 172.21.15.125:0/464572540 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840094a0 con 0x7fb094071890 2023-11-28T11:11:33.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb092ffd700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb094071890 0x7fb094155e10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb08800e810 tx=0x7fb08800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:33.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb07bfff700 1 -- 172.21.15.125:0/464572540 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08800c070 con 0x7fb094071890 2023-11-28T11:11:33.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.207+0000 7fb07bfff700 1 -- 172.21.15.125:0/464572540 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb088013610 con 0x7fb094071890 2023-11-28T11:11:33.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.208+0000 7fb07bfff700 1 -- 172.21.15.125:0/464572540 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0880139c0 con 0x7fb094071890 2023-11-28T11:11:33.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.208+0000 7fb09a19a700 1 -- 172.21.15.125:0/464572540 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09406d530 con 0x7fb094071890 2023-11-28T11:11:33.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.208+0000 7fb09a19a700 1 -- 172.21.15.125:0/464572540 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09406d250 con 0x7fb094071890 2023-11-28T11:11:33.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.209+0000 7fb09a19a700 1 -- 172.21.15.125:0/464572540 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09406a6b0 con 0x7fb094071890 2023-11-28T11:11:33.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.209+0000 7fb07bfff700 1 -- 172.21.15.125:0/464572540 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb088023070 con 0x7fb094071890 2023-11-28T11:11:33.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.209+0000 7fb07bfff700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb080068320 0x7fb08006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.210+0000 7fb07bfff700 1 -- 172.21.15.125:0/464572540 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb0880856b0 con 0x7fb094071890 2023-11-28T11:11:33.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.210+0000 7fb0937fe700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb080068320 0x7fb08006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.210+0000 7fb0937fe700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb080068320 0x7fb08006a7d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb0840090b0 tx=0x7fb08401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:33.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.214+0000 7fb07bfff700 1 -- 172.21.15.125:0/464572540 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb088052190 con 0x7fb094071890 2023-11-28T11:11:33.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.399+0000 7fb09a19a700 1 -- 172.21.15.125:0/464572540 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb0940b5b50 con 0x7fb094071890 2023-11-28T11:11:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.405+0000 7fb07bfff700 1 -- 172.21.15.125:0/464572540 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb08800f040 con 0x7fb094071890 2023-11-28T11:11:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 -- 172.21.15.125:0/464572540 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb080068320 msgr2=0x7fb08006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb080068320 0x7fb08006a7d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb0840090b0 tx=0x7fb08401c040 comp rx=0 tx=0).stop 2023-11-28T11:11:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 -- 172.21.15.125:0/464572540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb094071890 msgr2=0x7fb094155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb094071890 0x7fb094155e10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb08800e810 tx=0x7fb08800eb20 comp rx=0 tx=0).stop 2023-11-28T11:11:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 -- 172.21.15.125:0/464572540 shutdown_connections 2023-11-28T11:11:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0940cf710 0x7fb0941571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb080068320 0x7fb08006a7d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb09406a270 0x7fb09415fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 --2- 172.21.15.125:0/464572540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb094071890 0x7fb094155e10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 -- 172.21.15.125:0/464572540 >> 172.21.15.125:0/464572540 conn(0x7fb09406c010 msgr2=0x7fb09415bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 -- 172.21.15.125:0/464572540 shutdown_connections 2023-11-28T11:11:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.407+0000 7fb09a19a700 1 -- 172.21.15.125:0/464572540 wait complete. 2023-11-28T11:11:33.420 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:11:33.420 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:11:33.508 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:11:33.554 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:11:33.554 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:11:33.554 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:11:33.572 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16093 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T11:11:33.572 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:11:33.572 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:11:33.592 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:11:33.593 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:11:33.593 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:11:33.631 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16093 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T11:11:33.631 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:11:33.631 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:11:33.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:11:33.652 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T11:11:33.652 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:11:33.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.790+0000 7f93bd314700 1 Processor -- start 2023-11-28T11:11:33.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.790+0000 7f93bd314700 1 -- start start 2023-11-28T11:11:33.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.791+0000 7f93bd314700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f93b8070d90 0x7f93b80711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.791+0000 7f93bd314700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b815e0b0 0x7f93b815e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.791+0000 7f93bd314700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b8151a50 con 0x7f93b806a270 2023-11-28T11:11:33.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.791+0000 7f93bd314700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b815b440 con 0x7f93b8070d90 2023-11-28T11:11:33.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.791+0000 7f93bd314700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8071ac0 con 0x7f93b815e0b0 2023-11-28T11:11:33.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.791+0000 7f93b67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f93b8070d90 0x7f93b80711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.791+0000 7f93b6ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f93b806a270 0x7f93b806a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45182/0 (socket says 172.21.15.125:45182) 2023-11-28T11:11:33.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.791+0000 7f93b6ffd700 1 -- 172.21.15.125:0/719183643 learned_addr learned my addr 172.21.15.125:0/719183643 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:33.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93b67fc700 1 -- 172.21.15.125:0/719183643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b815e0b0 msgr2=0x7f93b815e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:33.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93b77fe700 1 --2- 172.21.15.125:0/719183643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b815e0b0 0x7f93b815e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93b5ffb700 1 -- 172.21.15.125:0/719183643 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015006801 0 0) 0x7f93b8151a50 con 0x7f93b806a270 2023-11-28T11:11:33.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93b67fc700 1 --2- 172.21.15.125:0/719183643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b815e0b0 0x7f93b815e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93b67fc700 1 -- 172.21.15.125:0/719183643 >> v1:172.21.15.125:6789/0 conn(0x7f93b806a270 legacy=0x7f93b806a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93b67fc700 1 -- 172.21.15.125:0/719183643 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b815adf0 con 0x7f93b8070d90 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93b77fe700 1 --2- 172.21.15.125:0/719183643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b815e0b0 0x7f93b815e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93b67fc700 1 --2- 172.21.15.125:0/719183643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93b8070d90 0x7f93b80711e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009840 tx=0x7f93a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16d6c99a836a3a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93b5ffb700 1 -- 172.21.15.125:0/719183643 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8011830 con 0x7f93b8070d90 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93b5ffb700 1 -- 172.21.15.125:0/719183643 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8011990 con 0x7f93b8070d90 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93b5ffb700 1 -- 172.21.15.125:0/719183643 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8011d20 con 0x7f93b8070d90 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93bd314700 1 -- 172.21.15.125:0/719183643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93b8070d90 msgr2=0x7f93b80711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93bd314700 1 --2- 172.21.15.125:0/719183643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93b8070d90 0x7f93b80711e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009840 tx=0x7f93a8009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93bd314700 1 -- 172.21.15.125:0/719183643 shutdown_connections 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93bd314700 1 --2- 172.21.15.125:0/719183643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b815e0b0 0x7f93b815e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.792+0000 7f93bd314700 1 --2- 172.21.15.125:0/719183643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93b8070d90 0x7f93b80711e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.793+0000 7f93bd314700 1 -- 172.21.15.125:0/719183643 >> 172.21.15.125:0/719183643 conn(0x7f93b806c010 msgr2=0x7f93b80cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.793+0000 7f93bd314700 1 -- 172.21.15.125:0/719183643 shutdown_connections 2023-11-28T11:11:33.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.793+0000 7f93bd314700 1 -- 172.21.15.125:0/719183643 wait complete. 2023-11-28T11:11:33.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.794+0000 7f93bd314700 1 Processor -- start 2023-11-28T11:11:33.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.794+0000 7f93bd314700 1 -- start start 2023-11-28T11:11:33.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93bd314700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93b806a270 0x7f93b80cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93bd314700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8070d90 0x7f93b81f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93bd314700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93b815e0b0 0x7f93b80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93bd314700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80ce2f0 con 0x7f93b815e0b0 2023-11-28T11:11:33.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93bd314700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80ce5d0 con 0x7f93b806a270 2023-11-28T11:11:33.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93bd314700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80ce8b0 con 0x7f93b8070d90 2023-11-28T11:11:33.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93b815e0b0 0x7f93b80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93b815e0b0 0x7f93b80cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32836/0 (socket says 172.21.15.125:32836) 2023-11-28T11:11:33.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b77fe700 1 -- 172.21.15.125:0/4192603035 learned_addr learned my addr 172.21.15.125:0/4192603035 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:33.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b67fc700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8070d90 0x7f93b81f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b6ffd700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93b806a270 0x7f93b80cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b77fe700 1 -- 172.21.15.125:0/4192603035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8070d90 msgr2=0x7f93b81f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b77fe700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8070d90 0x7f93b81f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b77fe700 1 -- 172.21.15.125:0/4192603035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93b806a270 msgr2=0x7f93b80cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:33.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b77fe700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93b806a270 0x7f93b80cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b77fe700 1 -- 172.21.15.125:0/4192603035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80094a0 con 0x7f93b815e0b0 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b67fc700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8070d90 0x7f93b81f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93b77fe700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93b815e0b0 0x7f93b80cd8c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f93b000cd50 tx=0x7f93b000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f939f7fe700 1 -- 172.21.15.125:0/4192603035 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000f480 con 0x7f93b815e0b0 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f939f7fe700 1 -- 172.21.15.125:0/4192603035 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b000f600 con 0x7f93b815e0b0 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93bd314700 1 -- 172.21.15.125:0/4192603035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b815aac0 con 0x7f93b815e0b0 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f939f7fe700 1 -- 172.21.15.125:0/4192603035 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000f9b0 con 0x7f93b815e0b0 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.795+0000 7f93bd314700 1 -- 172.21.15.125:0/4192603035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b815b0d0 con 0x7f93b815e0b0 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.796+0000 7f93bd314700 1 -- 172.21.15.125:0/4192603035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b8071720 con 0x7f93b815e0b0 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.797+0000 7f939f7fe700 1 -- 172.21.15.125:0/4192603035 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f93b0009030 con 0x7f93b815e0b0 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.797+0000 7f939f7fe700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f93a40682f0 0x7f93a406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:33.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.797+0000 7f939f7fe700 1 -- 172.21.15.125:0/4192603035 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f93b0086390 con 0x7f93b815e0b0 2023-11-28T11:11:33.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.797+0000 7f93b6ffd700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f93a40682f0 0x7f93a406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:33.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.798+0000 7f93b6ffd700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f93a40682f0 0x7f93a406a7a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f93ac000f60 tx=0x7f93ac007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:33.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:33.801+0000 7f939f7fe700 1 -- 172.21.15.125:0/4192603035 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f93b0052ef0 con 0x7f93b815e0b0 2023-11-28T11:11:34.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.027+0000 7f93bd314700 1 -- 172.21.15.125:0/4192603035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93b8068450 con 0x7f93b815e0b0 2023-11-28T11:11:34.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.027+0000 7f939f7fe700 1 -- 172.21.15.125:0/4192603035 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f93b0056510 con 0x7f93b815e0b0 2023-11-28T11:11:34.028 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:34.028 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/991177251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":991177251},{"type":"v1","addr":"172.21.15.167:6834","nonce":991177251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/289069328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":289069328},{"type":"v1","addr":"172.21.15.167:6835","nonce":289069328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/3275492587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3275492587},{"type":"v1","addr":"172.21.15.125:6836","nonce":3275492587}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/3395157093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":3395157093},{"type":"v1","addr":"172.21.15.125:6837","nonce":3395157093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2023-11-28T11:11:34.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 -- 172.21.15.125:0/4192603035 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f93a40682f0 msgr2=0x7f93a406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:34.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f93a40682f0 0x7f93a406a7a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f93ac000f60 tx=0x7f93ac007c00 comp rx=0 tx=0).stop 2023-11-28T11:11:34.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 -- 172.21.15.125:0/4192603035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93b815e0b0 msgr2=0x7f93b80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:34.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93b815e0b0 0x7f93b80cd8c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f93b000cd50 tx=0x7f93b000a560 comp rx=0 tx=0).stop 2023-11-28T11:11:34.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 -- 172.21.15.125:0/4192603035 shutdown_connections 2023-11-28T11:11:34.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f93b815e0b0 0x7f93b80cd8c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:34.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93b806a270 0x7f93b80cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:34.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f93a40682f0 0x7f93a406a7a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:34.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 --2- 172.21.15.125:0/4192603035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8070d90 0x7f93b81f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:34.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 -- 172.21.15.125:0/4192603035 >> 172.21.15.125:0/4192603035 conn(0x7f93b806c010 msgr2=0x7f93b80cbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:34.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 -- 172.21.15.125:0/4192603035 shutdown_connections 2023-11-28T11:11:34.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.029+0000 7f93bd314700 1 -- 172.21.15.125:0/4192603035 wait complete. 2023-11-28T11:11:34.033 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 25 2023-11-28T11:11:34.042 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:11:34.042 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T11:11:34.043 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T11:11:34.043 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:11:34.043 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:11:34.043 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T11:11:34.043 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T11:11:34.043 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:11:34.044 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:11:34.044 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T11:11:34.044 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T11:11:34.044 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:11:34.044 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:11:34.044 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T11:11:34.044 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T11:11:34.045 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:11:34.053 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T11:11:34.053 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:11:34.054 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T11:11:34.054 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:11:34.055 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T11:11:34.055 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:11:34.056 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T11:11:34.056 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:11:34.097 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:11:34.097 DEBUG:teuthology.parallel:result is None 2023-11-28T11:11:34.098 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:11:34.098 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:11:34.099 DEBUG:teuthology.parallel:result is None 2023-11-28T11:11:34.099 DEBUG:teuthology.parallel:result is None 2023-11-28T11:11:34.099 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:11:34.099 DEBUG:teuthology.parallel:result is None 2023-11-28T11:11:34.100 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T11:11:34.175 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-11-28T11:11:34.176 INFO:tasks.ceph.mds.c.smithi125.stdout:starting mds.c at 2023-11-28T11:11:34.186 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2023-11-28T11:11:34.186 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2023-11-28T11:11:34.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.230+0000 7fd0b8099700 1 Processor -- start 2023-11-28T11:11:34.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.230+0000 7fd0b8099700 1 -- start start 2023-11-28T11:11:34.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b8099700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd0b01599b0 0x7fd0b015d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:34.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b8099700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0b00af0a0 0x7fd0b015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:34.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b8099700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b0159ec0 con 0x7fd0b00b1650 2023-11-28T11:11:34.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b8099700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b015d8a0 con 0x7fd0b01599b0 2023-11-28T11:11:34.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b8099700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b015db80 con 0x7fd0b00af0a0 2023-11-28T11:11:34.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b5634700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd0b01599b0 0x7fd0b015d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:34.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b5634700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd0b01599b0 0x7fd0b015d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32866/0 (socket says 172.21.15.125:32866) 2023-11-28T11:11:34.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b5634700 1 -- 172.21.15.125:0/2849932731 learned_addr learned my addr 172.21.15.125:0/2849932731 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:34.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b6636700 1 --2- 172.21.15.125:0/2849932731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0b00af0a0 0x7fd0b015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:34.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b5634700 1 -- 172.21.15.125:0/2849932731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0b00af0a0 msgr2=0x7fd0b015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:34.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b5634700 1 --2- 172.21.15.125:0/2849932731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0b00af0a0 0x7fd0b015a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:34.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b5634700 1 -- 172.21.15.125:0/2849932731 >> v1:172.21.15.167:6789/0 conn(0x7fd0b00b1650 legacy=0x7fd0b00b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:34.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.231+0000 7fd0b5634700 1 -- 172.21.15.125:0/2849932731 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b015de60 con 0x7fd0b01599b0 2023-11-28T11:11:34.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b5634700 1 --2- 172.21.15.125:0/2849932731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b01599b0 0x7fd0b015d050 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0098f0 tx=0x7fd0ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda7604a18ab16d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:34.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b4e33700 1 -- 172.21.15.125:0/2849932731 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac011830 con 0x7fd0b01599b0 2023-11-28T11:11:34.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b4e33700 1 -- 172.21.15.125:0/2849932731 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac011990 con 0x7fd0b01599b0 2023-11-28T11:11:34.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b4e33700 1 -- 172.21.15.125:0/2849932731 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac011d20 con 0x7fd0b01599b0 2023-11-28T11:11:34.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b8099700 1 -- 172.21.15.125:0/2849932731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b01599b0 msgr2=0x7fd0b015d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:34.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b8099700 1 --2- 172.21.15.125:0/2849932731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b01599b0 0x7fd0b015d050 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0098f0 tx=0x7fd0ac009c00 comp rx=0 tx=0).stop 2023-11-28T11:11:34.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b8099700 1 -- 172.21.15.125:0/2849932731 shutdown_connections 2023-11-28T11:11:34.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b8099700 1 --2- 172.21.15.125:0/2849932731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0b00af0a0 0x7fd0b015a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:34.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b8099700 1 --2- 172.21.15.125:0/2849932731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b01599b0 0x7fd0b015d050 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:34.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b8099700 1 -- 172.21.15.125:0/2849932731 >> 172.21.15.125:0/2849932731 conn(0x7fd0b006c010 msgr2=0x7fd0b00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:34.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b8099700 1 -- 172.21.15.125:0/2849932731 shutdown_connections 2023-11-28T11:11:34.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.232+0000 7fd0b8099700 1 -- 172.21.15.125:0/2849932731 wait complete. 2023-11-28T11:11:34.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.234+0000 7fd0b8099700 1 Processor -- start 2023-11-28T11:11:34.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.234+0000 7fd0b8099700 1 -- start start 2023-11-28T11:11:34.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.234+0000 7fd0b8099700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0b00af0a0 0x7fd0b00cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:34.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.234+0000 7fd0b8099700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0b00b1650 0x7fd0b0148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:34.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.234+0000 7fd0b8099700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b014bb00 0x7fd0b01486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:34.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.234+0000 7fd0b8099700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b014b6e0 con 0x7fd0b014bb00 2023-11-28T11:11:34.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.234+0000 7fd0b8099700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01f4540 con 0x7fd0b00b1650 2023-11-28T11:11:34.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.234+0000 7fd0b8099700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b014b020 con 0x7fd0b00af0a0 2023-11-28T11:11:34.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.234+0000 7fd0b6636700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b014bb00 0x7fd0b01486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:34.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.234+0000 7fd0b6636700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b014bb00 0x7fd0b01486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32874/0 (socket says 172.21.15.125:32874) 2023-11-28T11:11:34.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.234+0000 7fd0b6636700 1 -- 172.21.15.125:0/899805694 learned_addr learned my addr 172.21.15.125:0/899805694 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:34.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0b5634700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0b00b1650 0x7fd0b0148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:34.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0b6636700 1 -- 172.21.15.125:0/899805694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0b00af0a0 msgr2=0x7fd0b00cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:34.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0b5e35700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0b00af0a0 0x7fd0b00cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:34.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0b6636700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0b00af0a0 0x7fd0b00cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:34.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0b6636700 1 -- 172.21.15.125:0/899805694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0b00b1650 msgr2=0x7fd0b0148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:34.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0b6636700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0b00b1650 0x7fd0b0148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:34.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0b6636700 1 -- 172.21.15.125:0/899805694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac009550 con 0x7fd0b014bb00 2023-11-28T11:11:34.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0b5634700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0b00b1650 0x7fd0b0148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:34.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0b6636700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b014bb00 0x7fd0b01486c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800efc0 tx=0x7fd0a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:34.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0a67fc700 1 -- 172.21.15.125:0/899805694 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8009ba0 con 0x7fd0b014bb00 2023-11-28T11:11:34.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0a67fc700 1 -- 172.21.15.125:0/899805694 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a800f040 con 0x7fd0b014bb00 2023-11-28T11:11:34.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0b8099700 1 -- 172.21.15.125:0/899805694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b015a890 con 0x7fd0b014bb00 2023-11-28T11:11:34.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0a67fc700 1 -- 172.21.15.125:0/899805694 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8014480 con 0x7fd0b014bb00 2023-11-28T11:11:34.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.235+0000 7fd0b8099700 1 -- 172.21.15.125:0/899805694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b015d590 con 0x7fd0b014bb00 2023-11-28T11:11:34.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.236+0000 7fd0b8099700 1 -- 172.21.15.125:0/899805694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b015aa20 con 0x7fd0b014bb00 2023-11-28T11:11:34.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.236+0000 7fd0a67fc700 1 -- 172.21.15.125:0/899805694 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd0a80145e0 con 0x7fd0b014bb00 2023-11-28T11:11:34.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.237+0000 7fd0a67fc700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd0940682f0 0x7fd09406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:34.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.237+0000 7fd0a67fc700 1 -- 172.21.15.125:0/899805694 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd0a8086390 con 0x7fd0b014bb00 2023-11-28T11:11:34.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.237+0000 7fd0b5e35700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd0940682f0 0x7fd09406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:34.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.237+0000 7fd0b5e35700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd0940682f0 0x7fd09406a7a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0000f60 tx=0x7fd0a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:34.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.241+0000 7fd0a67fc700 1 -- 172.21.15.125:0/899805694 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd0a8052ef0 con 0x7fd0b014bb00 2023-11-28T11:11:34.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:34.442+0000 7fd0b8099700 1 -- 172.21.15.125:0/899805694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd0b014ae80 con 0x7fd0b014bb00 2023-11-28T11:11:35.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.408+0000 7fd0a67fc700 1 -- 172.21.15.125:0/899805694 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd0b014ae80 con 0x7fd0b014bb00 2023-11-28T11:11:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 -- 172.21.15.125:0/899805694 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd0940682f0 msgr2=0x7fd09406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd0940682f0 0x7fd09406a7a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0000f60 tx=0x7fd0a0009040 comp rx=0 tx=0).stop 2023-11-28T11:11:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 -- 172.21.15.125:0/899805694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b014bb00 msgr2=0x7fd0b01486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b014bb00 0x7fd0b01486c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800efc0 tx=0x7fd0a800c3a0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 -- 172.21.15.125:0/899805694 shutdown_connections 2023-11-28T11:11:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b014bb00 0x7fd0b01486c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd0940682f0 0x7fd09406a7a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0b00af0a0 0x7fd0b00cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 --2- 172.21.15.125:0/899805694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0b00b1650 0x7fd0b0148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 -- 172.21.15.125:0/899805694 >> 172.21.15.125:0/899805694 conn(0x7fd0b006c010 msgr2=0x7fd0b0158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 -- 172.21.15.125:0/899805694 shutdown_connections 2023-11-28T11:11:35.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.411+0000 7fd0b8099700 1 -- 172.21.15.125:0/899805694 wait complete. 2023-11-28T11:11:35.413 INFO:teuthology.orchestra.run.smithi125.stderr: removed all blocklist entries 2023-11-28T11:11:35.427 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T11:11:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.552+0000 7fb0b53f6700 1 Processor -- start 2023-11-28T11:11:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.552+0000 7fb0b53f6700 1 -- start start 2023-11-28T11:11:35.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.552+0000 7fb0b53f6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b00ce290 0x7fb0b0163a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.552+0000 7fb0b53f6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b00718e0 con 0x7fb0b0158cd0 2023-11-28T11:11:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.552+0000 7fb0b53f6700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b00c9760 con 0x7fb0b00c92c0 2023-11-28T11:11:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.552+0000 7fb0b53f6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b01590a0 con 0x7fb0b00ce290 2023-11-28T11:11:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.552+0000 7fb0aeffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb0b0158cd0 0x7fb0b00cd1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45238/0 (socket says 172.21.15.125:45238) 2023-11-28T11:11:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.552+0000 7fb0aeffd700 1 -- 172.21.15.125:0/1969584284 learned_addr learned my addr 172.21.15.125:0/1969584284 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541536086 0 0) 0x7fb0a0001110 con 0x7fb0b0158cd0 2023-11-28T11:11:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0980035b0 con 0x7fb0b0158cd0 2023-11-28T11:11:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0af7fe700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b00ce290 0x7fb0b0163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1238589078 0 0) 0x7fb0980035b0 con 0x7fb0b0158cd0 2023-11-28T11:11:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b00ce290 msgr2=0x7fb0b0163a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b00ce290 0x7fb0b0163a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 >> v1:172.21.15.167:6789/0 conn(0x7fb0b00c92c0 legacy=0x7fb0b00cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b006be90 con 0x7fb0b0158cd0 2023-11-28T11:11:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fb0a0001800 con 0x7fb0b0158cd0 2023-11-28T11:11:35.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 >> v1:172.21.15.125:6789/0 conn(0x7fb0b0158cd0 legacy=0x7fb0b00cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb098003a30 0x7fb098003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098004850 0x7fb098004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b00ce290 0x7fb0980052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b01590a0 con 0x7fb098003a30 2023-11-28T11:11:35.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09800bbd0 con 0x7fb098004850 2023-11-28T11:11:35.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09800dfa0 con 0x7fb0b00ce290 2023-11-28T11:11:35.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0aeffd700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb098003a30 0x7fb098003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0af7fe700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b00ce290 0x7fb0980052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0ae7fc700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098004850 0x7fb098004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0aeffd700 1 -- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b00ce290 msgr2=0x7fb0980052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0aeffd700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b00ce290 0x7fb0980052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0aeffd700 1 -- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098004850 msgr2=0x7fb098004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0aeffd700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098004850 0x7fb098004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0aeffd700 1 -- 172.21.15.125:0/1969584284 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0980035b0 con 0x7fb098003a30 2023-11-28T11:11:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0ae7fc700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098004850 0x7fb098004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.553+0000 7fb0af7fe700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0b00ce290 0x7fb0980052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.554+0000 7fb0aeffd700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb098003a30 0x7fb098003e40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c210 tx=0x7fb098005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70fba3076d67314 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.554+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0007db0 con 0x7fb098003a30 2023-11-28T11:11:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.554+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a000cdb0 con 0x7fb098003a30 2023-11-28T11:11:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.554+0000 7fb0adffb700 1 -- 172.21.15.125:0/1969584284 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0005b80 con 0x7fb098003a30 2023-11-28T11:11:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.554+0000 7fb0b53f6700 1 -- 172.21.15.125:0/1969584284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb098003a30 msgr2=0x7fb098003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.554+0000 7fb0b53f6700 1 --2- 172.21.15.125:0/1969584284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb098003a30 0x7fb098003e40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c210 tx=0x7fb098005880 comp rx=0 tx=0).stop 2023-11-28T11:11:35.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.554+0000 7fb0af7fe700 1 -- 172.21.15.125:0/1969584284 reap_dead start 2023-11-28T11:11:35.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.554+0000 7fb0b53f6700 1 -- 172.21.15.125:0/1969584284 shutdown_connections 2023-11-28T11:11:35.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.554+0000 7fb0b53f6700 1 -- 172.21.15.125:0/1969584284 >> 172.21.15.125:0/1969584284 conn(0x7fb0b00cb660 msgr2=0x7fb0b00cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:35.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.554+0000 7fb0b53f6700 1 -- 172.21.15.125:0/1969584284 shutdown_connections 2023-11-28T11:11:35.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.554+0000 7fb0b53f6700 1 -- 172.21.15.125:0/1969584284 wait complete. 2023-11-28T11:11:35.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.556+0000 7fb0b53f6700 1 Processor -- start 2023-11-28T11:11:35.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.556+0000 7fb0b53f6700 1 -- start start 2023-11-28T11:11:35.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.556+0000 7fb0b53f6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb098003a30 0x7fb0b01eed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.556+0000 7fb0b53f6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b00c4ea0 0x7fb0b0157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.556+0000 7fb0b53f6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b00c5310 0x7fb0b0158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.556+0000 7fb0b53f6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00c5e50 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.556+0000 7fb0b53f6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00c6130 con 0x7fb0b00c5310 2023-11-28T11:11:35.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.556+0000 7fb0b53f6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00c6410 con 0x7fb098003a30 2023-11-28T11:11:35.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.556+0000 7fb0ae7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b00c4ea0 0x7fb0b0157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.556+0000 7fb0ae7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b00c4ea0 0x7fb0b0157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32896/0 (socket says 172.21.15.125:32896) 2023-11-28T11:11:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.556+0000 7fb0ae7fc700 1 -- 172.21.15.125:0/408956669 learned_addr learned my addr 172.21.15.125:0/408956669 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0ae7fc700 1 -- 172.21.15.125:0/408956669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb098003a30 msgr2=0x7fb0b01eed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0ae7fc700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb098003a30 0x7fb0b01eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0ae7fc700 1 -- 172.21.15.125:0/408956669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b00c5310 msgr2=0x7fb0b0158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0af7fe700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b00c5310 0x7fb0b0158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0ae7fc700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b00c5310 0x7fb0b0158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0ae7fc700 1 -- 172.21.15.125:0/408956669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00cb010 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0ae7fc700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b00c4ea0 0x7fb0b0157d50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400e7b0 tx=0x7fb0a400eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0977fe700 1 -- 172.21.15.125:0/408956669 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40052e0 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0977fe700 1 -- 172.21.15.125:0/408956669 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a4005440 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0b53f6700 1 -- 172.21.15.125:0/408956669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b00cad30 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0977fe700 1 -- 172.21.15.125:0/408956669 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40038c0 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.557+0000 7fb0b53f6700 1 -- 172.21.15.125:0/408956669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b00cb2f0 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.558+0000 7fb0b53f6700 1 -- 172.21.15.125:0/408956669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b00743f0 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.558+0000 7fb0977fe700 1 -- 172.21.15.125:0/408956669 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb0a401b030 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.559+0000 7fb0977fe700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 0x7fb09c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.559+0000 7fb0977fe700 1 -- 172.21.15.125:0/408956669 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb0a4084f20 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.559+0000 7fb0aeffd700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 0x7fb09c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.559+0000 7fb0aeffd700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 0x7fb09c06a7a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0000c00 tx=0x7fb0a000a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:35.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.563+0000 7fb0977fe700 1 -- 172.21.15.125:0/408956669 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb0a404d5e0 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.819+0000 7fb0b53f6700 1 -- 172.21.15.125:0/408956669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb0b006dc10 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.820+0000 7fb0977fe700 1 -- 172.21.15.125:0/408956669 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fb0a4019090 con 0x7fb0b00c4ea0 2023-11-28T11:11:35.821 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:35.821 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:11:35.821 INFO:teuthology.orchestra.run.smithi125.stdout: "auth_dump": [ 2023-11-28T11:11:35.821 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.821 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.a", 2023-11-28T11:11:35.821 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlKEkAABAAXjMnHGmTU8Gdre/P6kooJw==", 2023-11-28T11:11:35.822 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.822 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:11:35.822 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:11:35.822 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:11:35.822 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.822 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.822 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.822 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.823 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.b", 2023-11-28T11:11:35.823 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlxhVJDBAAxVivRKj7W5EO227bsIQ1dA==", 2023-11-28T11:11:35.823 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.823 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:11:35.823 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:11:35.823 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:11:35.823 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.824 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.824 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.824 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.824 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.c", 2023-11-28T11:11:35.824 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVltF09BxAAjhpf029IQe6awVbeYEV8qQ==", 2023-11-28T11:11:35.824 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.824 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:11:35.824 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:11:35.825 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:11:35.825 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.825 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.825 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.825 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.825 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.d", 2023-11-28T11:11:35.826 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVl3cCKExAAWAOqQnPUf3vKABnsfyJTKQ==", 2023-11-28T11:11:35.826 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.826 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:11:35.826 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:11:35.826 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:11:35.826 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.827 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.827 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.827 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.827 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.0", 2023-11-28T11:11:35.827 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD6yWVlZHGALxAAwg7519g4L+22B6q8avNECw==", 2023-11-28T11:11:35.827 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.827 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:11:35.827 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:11:35.828 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.828 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.828 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.828 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.828 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.1", 2023-11-28T11:11:35.828 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD9yWVlxElTLxAAWU/HwnR+qTecCapxOKTCBQ==", 2023-11-28T11:11:35.828 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.829 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:11:35.829 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:11:35.829 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.829 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.829 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.829 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.829 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.2", 2023-11-28T11:11:35.830 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAAymVllpzBLhAA1iR/VKxQoh+ekp0oO6Ku2g==", 2023-11-28T11:11:35.830 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.830 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:11:35.830 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:11:35.830 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.830 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.830 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.830 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.831 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.3", 2023-11-28T11:11:35.831 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADymVl9jx+LhAAG+PnOiHMTWVr0p98muHA1Q==", 2023-11-28T11:11:35.831 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.831 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:11:35.831 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:11:35.831 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.831 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.832 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.832 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.832 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.4", 2023-11-28T11:11:35.832 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAJymVlCGY+NxAAO5zScvdHMyOEFJcLjlY6qQ==", 2023-11-28T11:11:35.832 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.832 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:11:35.832 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:11:35.832 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.833 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.833 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.833 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.833 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.5", 2023-11-28T11:11:35.833 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAMymVlkPG0NxAAL9zxg4JfD/Gm7bVEY8aEzA==", 2023-11-28T11:11:35.833 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.833 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:11:35.833 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:11:35.833 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.834 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.834 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.834 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.834 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.6", 2023-11-28T11:11:35.834 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAPymVlh0cjNxAACCUdBgzqGw/yMw7P5RKBlQ==", 2023-11-28T11:11:35.834 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.834 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:11:35.835 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:11:35.835 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.835 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.835 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.835 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.835 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.7", 2023-11-28T11:11:35.835 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQASymVltqqRNhAACw31V5Uw92UYbsoOFAt4NA==", 2023-11-28T11:11:35.835 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.836 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-11-28T11:11:35.836 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-11-28T11:11:35.836 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.836 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.836 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.836 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.836 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.0", 2023-11-28T11:11:35.836 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlAiP9FxAAuKva+izyr8tPFad19nH2Pg==", 2023-11-28T11:11:35.837 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.837 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:11:35.837 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow r", 2023-11-28T11:11:35.837 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-28T11:11:35.837 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.837 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.837 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.838 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.1", 2023-11-28T11:11:35.838 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlcuuuHhAAxxFaW2Ya8S/0QqSKt6+irw==", 2023-11-28T11:11:35.838 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.838 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:11:35.838 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-11-28T11:11:35.838 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-11-28T11:11:35.838 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-11-28T11:11:35.839 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.839 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.839 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.839 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.2", 2023-11-28T11:11:35.839 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVlzC5aGxAA+1p7VO2KIABIvIQUxsEpkw==", 2023-11-28T11:11:35.839 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.839 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:11:35.839 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-11-28T11:11:35.839 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-11-28T11:11:35.840 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-11-28T11:11:35.840 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.840 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.840 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.840 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.3", 2023-11-28T11:11:35.840 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD3yWVl0A9rJBAAbjYfiY1Ya0jOeM20lriemg==", 2023-11-28T11:11:35.840 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.841 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-11-28T11:11:35.841 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-11-28T11:11:35.841 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-11-28T11:11:35.841 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-11-28T11:11:35.841 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.841 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.841 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.842 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.admin", 2023-11-28T11:11:35.842 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD2yWVlAxDCHhAAbGHarjun9Ha0bFjpBnroEA==", 2023-11-28T11:11:35.842 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.842 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-11-28T11:11:35.842 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-11-28T11:11:35.842 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-11-28T11:11:35.842 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.842 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.843 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.843 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.843 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.x", 2023-11-28T11:11:35.843 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD2yWVlf7E9OBAAT4ET3xArqHRvXN3Y+fN/hQ==", 2023-11-28T11:11:35.843 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.843 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-11-28T11:11:35.843 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-11-28T11:11:35.843 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.844 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.844 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:35.844 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:35.844 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.y", 2023-11-28T11:11:35.844 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQD2yWVldPhFNBAA/wTA2fq+CmRAx3pWX82SkA==", 2023-11-28T11:11:35.844 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-11-28T11:11:35.844 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-11-28T11:11:35.844 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-11-28T11:11:35.845 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-11-28T11:11:35.845 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.845 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:35.845 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-11-28T11:11:35.845 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:11:35.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 -- 172.21.15.125:0/408956669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 msgr2=0x7fb09c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 0x7fb09c06a7a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0000c00 tx=0x7fb0a000a000 comp rx=0 tx=0).stop 2023-11-28T11:11:35.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 -- 172.21.15.125:0/408956669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b00c4ea0 msgr2=0x7fb0b0157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b00c4ea0 0x7fb0b0157d50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400e7b0 tx=0x7fb0a400eb70 comp rx=0 tx=0).stop 2023-11-28T11:11:35.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 -- 172.21.15.125:0/408956669 shutdown_connections 2023-11-28T11:11:35.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b00c5310 0x7fb0b0158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb09c0682f0 0x7fb09c06a7a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb098003a30 0x7fb0b01eed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 --2- 172.21.15.125:0/408956669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0b00c4ea0 0x7fb0b0157d50 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 -- 172.21.15.125:0/408956669 >> 172.21.15.125:0/408956669 conn(0x7fb0b00cb660 msgr2=0x7fb0b00cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 -- 172.21.15.125:0/408956669 shutdown_connections 2023-11-28T11:11:35.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.822+0000 7fb0b53f6700 1 -- 172.21.15.125:0/408956669 wait complete. 2023-11-28T11:11:35.849 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:11:35.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.968+0000 7f68993da700 1 Processor -- start 2023-11-28T11:11:35.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.968+0000 7f68993da700 1 -- start start 2023-11-28T11:11:35.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f68993da700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68940ad900 0x7f6894072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f68993da700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68940726c0 con 0x7f68940b0880 2023-11-28T11:11:35.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f68993da700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68940b43f0 con 0x7f689406b7b0 2023-11-28T11:11:35.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f68993da700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689406bc50 con 0x7f68940ad900 2023-11-28T11:11:35.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6892ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f68940b0880 0x7f68940aeb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45258/0 (socket says 172.21.15.125:45258) 2023-11-28T11:11:35.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6892ffd700 1 -- 172.21.15.125:0/790167411 learned_addr learned my addr 172.21.15.125:0/790167411 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:35.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f68937fe700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68940ad900 0x7f6894072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965147511 0 0) 0x7f68940726c0 con 0x7f68940b0880 2023-11-28T11:11:35.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f687c0035b0 con 0x7f68940b0880 2023-11-28T11:11:35.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 655565542 0 0) 0x7f687c0035b0 con 0x7f68940b0880 2023-11-28T11:11:35.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68940ad900 msgr2=0x7f6894072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:35.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68940ad900 0x7f6894072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 >> v1:172.21.15.167:6789/0 conn(0x7f689406b7b0 legacy=0x7f68940ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68940b46d0 con 0x7f68940b0880 2023-11-28T11:11:35.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f6884001670 con 0x7f68940b0880 2023-11-28T11:11:35.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 >> v1:172.21.15.125:6789/0 conn(0x7f68940b0880 legacy=0x7f68940aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68940ad900 0x7f687c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f687c003f70 0x7f687c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f687c004d90 0x7f687c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689406bc50 con 0x7f687c004d90 2023-11-28T11:11:35.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c00bac0 con 0x7f687c003f70 2023-11-28T11:11:35.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c00bc80 con 0x7f68940ad900 2023-11-28T11:11:35.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f68937fe700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f687c004d90 0x7f687c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f6892ffd700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68940ad900 0x7f687c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.969+0000 7f68927fc700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f687c003f70 0x7f687c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f68937fe700 1 -- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68940ad900 msgr2=0x7f687c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:35.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f68937fe700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68940ad900 0x7f687c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f68937fe700 1 -- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f687c003f70 msgr2=0x7f687c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:35.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f68937fe700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f687c003f70 0x7f687c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f68937fe700 1 -- 172.21.15.125:0/790167411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c0035b0 con 0x7f687c004d90 2023-11-28T11:11:35.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f6892ffd700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68940ad900 0x7f687c003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:35.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f68937fe700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f687c004d90 0x7f687c005200 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6894073d10 tx=0x7f687c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0f3d4cdcc9831d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:35.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c00ebd0 con 0x7f687c004d90 2023-11-28T11:11:35.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c00f040 con 0x7f687c004d90 2023-11-28T11:11:35.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f6891ffb700 1 -- 172.21.15.125:0/790167411 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c014480 con 0x7f687c004d90 2023-11-28T11:11:35.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f68993da700 1 -- 172.21.15.125:0/790167411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f687c004d90 msgr2=0x7f687c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f68993da700 1 --2- 172.21.15.125:0/790167411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f687c004d90 0x7f687c005200 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6894073d10 tx=0x7f687c005880 comp rx=0 tx=0).stop 2023-11-28T11:11:35.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f68937fe700 1 -- 172.21.15.125:0/790167411 reap_dead start 2023-11-28T11:11:35.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f68993da700 1 -- 172.21.15.125:0/790167411 shutdown_connections 2023-11-28T11:11:35.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.970+0000 7f68993da700 1 -- 172.21.15.125:0/790167411 >> 172.21.15.125:0/790167411 conn(0x7f68940b2fc0 msgr2=0x7f6894071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:35.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.971+0000 7f68993da700 1 -- 172.21.15.125:0/790167411 shutdown_connections 2023-11-28T11:11:35.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.971+0000 7f68993da700 1 -- 172.21.15.125:0/790167411 wait complete. 2023-11-28T11:11:35.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.972+0000 7f68993da700 1 Processor -- start 2023-11-28T11:11:35.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.972+0000 7f68993da700 1 -- start start 2023-11-28T11:11:35.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.972+0000 7f68993da700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689415f2a0 0x7f68940c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68993da700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f689415f670 0x7f6894149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68993da700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f689415da60 0x7f6894149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68993da700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689415e000 con 0x7f689415f670 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68993da700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689415e2e0 con 0x7f689415da60 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68993da700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689415e5c0 con 0x7f689415f2a0 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68927fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f689415f670 0x7f6894149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68927fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f689415f670 0x7f6894149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32916/0 (socket says 172.21.15.125:32916) 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68927fc700 1 -- 172.21.15.125:0/2907265626 learned_addr learned my addr 172.21.15.125:0/2907265626 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68937fe700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f689415da60 0x7f6894149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f6892ffd700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689415f2a0 0x7f68940c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68927fc700 1 -- 172.21.15.125:0/2907265626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689415f2a0 msgr2=0x7f68940c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68927fc700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689415f2a0 0x7f68940c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68927fc700 1 -- 172.21.15.125:0/2907265626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f689415da60 msgr2=0x7f6894149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68927fc700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f689415da60 0x7f6894149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68927fc700 1 -- 172.21.15.125:0/2907265626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68940b4fe0 con 0x7f689415f670 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68927fc700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f689415f670 0x7f6894149a30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f688800f7c0 tx=0x7f688800fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f687b7fe700 1 -- 172.21.15.125:0/2907265626 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68880052e0 con 0x7f689415f670 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f687b7fe700 1 -- 172.21.15.125:0/2907265626 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6888005460 con 0x7f689415f670 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68993da700 1 -- 172.21.15.125:0/2907265626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68940b4d00 con 0x7f689415f670 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f687b7fe700 1 -- 172.21.15.125:0/2907265626 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68880038c0 con 0x7f689415f670 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.973+0000 7f68993da700 1 -- 172.21.15.125:0/2907265626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68940b49b0 con 0x7f689415f670 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.974+0000 7f68993da700 1 -- 172.21.15.125:0/2907265626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689415e140 con 0x7f689415f670 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.974+0000 7f687b7fe700 1 -- 172.21.15.125:0/2907265626 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6888003a20 con 0x7f689415f670 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.975+0000 7f687b7fe700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68800682f0 0x7f688006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.975+0000 7f687b7fe700 1 -- 172.21.15.125:0/2907265626 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f68880859b0 con 0x7f689415f670 2023-11-28T11:11:35.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.975+0000 7f6892ffd700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68800682f0 0x7f688006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:35.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.975+0000 7f6892ffd700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68800682f0 0x7f688006a7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6884000fd0 tx=0x7f6884009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:35.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:35.979+0000 7f687b7fe700 1 -- 172.21.15.125:0/2907265626 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f689415e140 con 0x7f689415f670 2023-11-28T11:11:36.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.163+0000 7f68993da700 1 -- 172.21.15.125:0/2907265626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f689415e140 con 0x7f689415f670 2023-11-28T11:11:36.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.163+0000 7f687b7fe700 1 -- 172.21.15.125:0/2907265626 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+14315 (secure 0 0 0) 0x7f689415e140 con 0x7f689415f670 2023-11-28T11:11:36.164 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:36.164 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":62,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:11:35.404728+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:11:36.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.165+0000 7f68993da700 1 -- 172.21.15.125:0/2907265626 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68800682f0 msgr2=0x7f688006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.165+0000 7f68993da700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68800682f0 0x7f688006a7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6884000fd0 tx=0x7f6884009040 comp rx=0 tx=0).stop 2023-11-28T11:11:36.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.165+0000 7f68993da700 1 -- 172.21.15.125:0/2907265626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f689415f670 msgr2=0x7f6894149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.165+0000 7f68993da700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f689415f670 0x7f6894149a30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f688800f7c0 tx=0x7f688800fb80 comp rx=0 tx=0).stop 2023-11-28T11:11:36.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.166+0000 7f68993da700 1 -- 172.21.15.125:0/2907265626 shutdown_connections 2023-11-28T11:11:36.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.166+0000 7f68993da700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f689415da60 0x7f6894149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.166+0000 7f68993da700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f68800682f0 0x7f688006a7a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.166+0000 7f68993da700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689415f2a0 0x7f68940c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.166+0000 7f68993da700 1 --2- 172.21.15.125:0/2907265626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f689415f670 0x7f6894149a30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.166+0000 7f68993da700 1 -- 172.21.15.125:0/2907265626 >> 172.21.15.125:0/2907265626 conn(0x7f68940b2fc0 msgr2=0x7f68940730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:36.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.166+0000 7f68993da700 1 -- 172.21.15.125:0/2907265626 shutdown_connections 2023-11-28T11:11:36.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.166+0000 7f68993da700 1 -- 172.21.15.125:0/2907265626 wait complete. 2023-11-28T11:11:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:11:36.179 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:11:36.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.301+0000 7fc26b666700 1 Processor -- start 2023-11-28T11:11:36.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.301+0000 7fc26b666700 1 -- start start 2023-11-28T11:11:36.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.302+0000 7fc26b666700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc264159710 0x7fc264070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.302+0000 7fc26b666700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2640cee40 0x7fc2640cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.302+0000 7fc26b666700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26406a310 con 0x7fc2640c9a50 2023-11-28T11:11:36.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.302+0000 7fc26b666700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2640cf290 con 0x7fc264159710 2023-11-28T11:11:36.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.302+0000 7fc26b666700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640ce530 con 0x7fc2640cee40 2023-11-28T11:11:36.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.302+0000 7fc269c03700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc2640c9a50 0x7fc26406adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45282/0 (socket says 172.21.15.125:45282) 2023-11-28T11:11:36.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.302+0000 7fc269c03700 1 -- 172.21.15.125:0/4074109690 learned_addr learned my addr 172.21.15.125:0/4074109690 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:36.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.302+0000 7fc269402700 1 --2- 172.21.15.125:0/4074109690 >> v2:172.21.15.125:3300/0 conn(0x7fc264159710 0x7fc264070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.302+0000 7fc268c01700 1 --2- 172.21.15.125:0/4074109690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2640cee40 0x7fc2640cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.303+0000 7fc25bfff700 1 -- 172.21.15.125:0/4074109690 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018659703 0 0) 0x7fc26406a310 con 0x7fc2640c9a50 2023-11-28T11:11:36.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.303+0000 7fc25bfff700 1 -- 172.21.15.125:0/4074109690 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2500035b0 con 0x7fc2640c9a50 2023-11-28T11:11:36.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.303+0000 7fc269402700 1 -- 172.21.15.125:0/4074109690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2640cee40 msgr2=0x7fc2640cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:36.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.303+0000 7fc269402700 1 --2- 172.21.15.125:0/4074109690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2640cee40 0x7fc2640cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.303+0000 7fc269402700 1 -- 172.21.15.125:0/4074109690 >> v1:172.21.15.125:6789/0 conn(0x7fc2640c9a50 legacy=0x7fc26406adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.303+0000 7fc269402700 1 -- 172.21.15.125:0/4074109690 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2640ce7e0 con 0x7fc264159710 2023-11-28T11:11:36.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.303+0000 7fc269402700 1 --2- 172.21.15.125:0/4074109690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc264159710 0x7fc264070370 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc254009840 tx=0x7fc254009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5139a516fa25d790 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:36.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.303+0000 7fc25bfff700 1 -- 172.21.15.125:0/4074109690 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254011830 con 0x7fc264159710 2023-11-28T11:11:36.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.303+0000 7fc25bfff700 1 -- 172.21.15.125:0/4074109690 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254011990 con 0x7fc264159710 2023-11-28T11:11:36.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.303+0000 7fc25bfff700 1 -- 172.21.15.125:0/4074109690 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254011d20 con 0x7fc264159710 2023-11-28T11:11:36.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.304+0000 7fc26b666700 1 -- 172.21.15.125:0/4074109690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc264159710 msgr2=0x7fc264070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.304+0000 7fc26b666700 1 --2- 172.21.15.125:0/4074109690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc264159710 0x7fc264070370 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc254009840 tx=0x7fc254009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:36.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.304+0000 7fc26b666700 1 -- 172.21.15.125:0/4074109690 shutdown_connections 2023-11-28T11:11:36.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.304+0000 7fc26b666700 1 --2- 172.21.15.125:0/4074109690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc264159710 0x7fc264070370 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.304+0000 7fc26b666700 1 --2- 172.21.15.125:0/4074109690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2640cee40 0x7fc2640cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.304+0000 7fc26b666700 1 -- 172.21.15.125:0/4074109690 >> 172.21.15.125:0/4074109690 conn(0x7fc2640cf400 msgr2=0x7fc2640cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:36.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.304+0000 7fc26b666700 1 -- 172.21.15.125:0/4074109690 shutdown_connections 2023-11-28T11:11:36.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.304+0000 7fc26b666700 1 -- 172.21.15.125:0/4074109690 wait complete. 2023-11-28T11:11:36.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.305+0000 7fc26b666700 1 Processor -- start 2023-11-28T11:11:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.305+0000 7fc26b666700 1 -- start start 2023-11-28T11:11:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc26b666700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2640c9a50 0x7fc2640b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc26b666700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2640cee40 0x7fc264157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc26b666700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc264159710 0x7fc2640c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc26b666700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc264158d00 con 0x7fc2640cee40 2023-11-28T11:11:36.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc26b666700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640b38b0 con 0x7fc2640c9a50 2023-11-28T11:11:36.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc26b666700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640c4e80 con 0x7fc264159710 2023-11-28T11:11:36.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc268c01700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2640cee40 0x7fc264157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc268c01700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2640cee40 0x7fc264157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32930/0 (socket says 172.21.15.125:32930) 2023-11-28T11:11:36.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc268c01700 1 -- 172.21.15.125:0/4086861268 learned_addr learned my addr 172.21.15.125:0/4086861268 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:36.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc269c03700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc264159710 0x7fc2640c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc269402700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2640c9a50 0x7fc2640b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc268c01700 1 -- 172.21.15.125:0/4086861268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc264159710 msgr2=0x7fc2640c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc268c01700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc264159710 0x7fc2640c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc268c01700 1 -- 172.21.15.125:0/4086861268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2640c9a50 msgr2=0x7fc2640b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc268c01700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2640c9a50 0x7fc2640b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc268c01700 1 -- 172.21.15.125:0/4086861268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2540094a0 con 0x7fc2640cee40 2023-11-28T11:11:36.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc268c01700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2640cee40 0x7fc264157c20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc26000e9b0 tx=0x7fc26000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:36.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc259ffb700 1 -- 172.21.15.125:0/4086861268 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260009710 con 0x7fc2640cee40 2023-11-28T11:11:36.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc259ffb700 1 -- 172.21.15.125:0/4086861268 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000c850 con 0x7fc2640cee40 2023-11-28T11:11:36.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.306+0000 7fc26b666700 1 -- 172.21.15.125:0/4086861268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26406a890 con 0x7fc2640cee40 2023-11-28T11:11:36.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.307+0000 7fc259ffb700 1 -- 172.21.15.125:0/4086861268 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000cbc0 con 0x7fc2640cee40 2023-11-28T11:11:36.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.307+0000 7fc26b666700 1 -- 172.21.15.125:0/4086861268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26406a5b0 con 0x7fc2640cee40 2023-11-28T11:11:36.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.308+0000 7fc26b666700 1 -- 172.21.15.125:0/4086861268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2640ceac0 con 0x7fc2640cee40 2023-11-28T11:11:36.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.308+0000 7fc259ffb700 1 -- 172.21.15.125:0/4086861268 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc260019030 con 0x7fc2640cee40 2023-11-28T11:11:36.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.308+0000 7fc259ffb700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc248068320 0x7fc24806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.309+0000 7fc259ffb700 1 -- 172.21.15.125:0/4086861268 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc2600858c0 con 0x7fc2640cee40 2023-11-28T11:11:36.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.309+0000 7fc269402700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc248068320 0x7fc24806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.309+0000 7fc269402700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc248068320 0x7fc24806a7d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc254000c00 tx=0x7fc254008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:36.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.313+0000 7fc259ffb700 1 -- 172.21.15.125:0/4086861268 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc260052470 con 0x7fc2640cee40 2023-11-28T11:11:36.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.496+0000 7fc26b666700 1 -- 172.21.15.125:0/4086861268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2640743f0 con 0x7fc2640cee40 2023-11-28T11:11:36.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.496+0000 7fc259ffb700 1 -- 172.21.15.125:0/4086861268 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2600170a0 con 0x7fc2640cee40 2023-11-28T11:11:36.497 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:11:36.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 -- 172.21.15.125:0/4086861268 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc248068320 msgr2=0x7fc24806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc248068320 0x7fc24806a7d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc254000c00 tx=0x7fc254008030 comp rx=0 tx=0).stop 2023-11-28T11:11:36.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 -- 172.21.15.125:0/4086861268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2640cee40 msgr2=0x7fc264157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2640cee40 0x7fc264157c20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc26000e9b0 tx=0x7fc26000ed70 comp rx=0 tx=0).stop 2023-11-28T11:11:36.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 -- 172.21.15.125:0/4086861268 shutdown_connections 2023-11-28T11:11:36.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc248068320 0x7fc24806a7d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc264159710 0x7fc2640c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2640c9a50 0x7fc2640b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 --2- 172.21.15.125:0/4086861268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2640cee40 0x7fc264157c20 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 -- 172.21.15.125:0/4086861268 >> 172.21.15.125:0/4086861268 conn(0x7fc2640cf400 msgr2=0x7fc2640afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:36.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 -- 172.21.15.125:0/4086861268 shutdown_connections 2023-11-28T11:11:36.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.498+0000 7fc26b666700 1 -- 172.21.15.125:0/4086861268 wait complete. 2023-11-28T11:11:36.511 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:11:36.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.633+0000 7f7598686700 1 Processor -- start 2023-11-28T11:11:36.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.633+0000 7f7598686700 1 -- start start 2023-11-28T11:11:36.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.634+0000 7f7598686700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75900b1650 0x7f75900b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.634+0000 7f7598686700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75900af0a0 0x7f759015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.634+0000 7f7598686700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7590159ec0 con 0x7f75901599b0 2023-11-28T11:11:36.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.634+0000 7f7598686700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75900b1f60 con 0x7f75900af0a0 2023-11-28T11:11:36.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.634+0000 7f7598686700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759015d8a0 con 0x7f75900b1650 2023-11-28T11:11:36.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7596422700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75900b1650 0x7f75900b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7596c23700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75900af0a0 0x7f759015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7596c23700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75900af0a0 0x7f759015a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:57902/0 (socket says 172.21.15.125:57902) 2023-11-28T11:11:36.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7596422700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75900b1650 0x7f75900b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:56176/0 (socket says 172.21.15.125:56176) 2023-11-28T11:11:36.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7595c21700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f75901599b0 0x7f759015d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:48096/0 (socket says 172.21.15.125:48096) 2023-11-28T11:11:36.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7596c23700 1 -- 172.21.15.125:0/1620031855 learned_addr learned my addr 172.21.15.125:0/1620031855 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:36.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7596c23700 1 -- 172.21.15.125:0/1620031855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75900b1650 msgr2=0x7f75900b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:36.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7596c23700 1 --2- 172.21.15.125:0/1620031855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75900b1650 0x7f75900b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7596c23700 1 -- 172.21.15.125:0/1620031855 >> v1:172.21.15.167:6789/0 conn(0x7f75901599b0 legacy=0x7f759015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7596c23700 1 -- 172.21.15.125:0/1620031855 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759015db80 con 0x7f75900af0a0 2023-11-28T11:11:36.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7595420700 1 -- 172.21.15.125:0/1620031855 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213918050 0 0) 0x7f7590159ec0 con 0x7f75901599b0 2023-11-28T11:11:36.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.635+0000 7f7596c23700 1 --2- 172.21.15.125:0/1620031855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75900af0a0 0x7f759015a350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7588009e50 tx=0x7f758800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8a6b96f911862ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:36.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.636+0000 7f7595420700 1 -- 172.21.15.125:0/1620031855 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800e070 con 0x7f75900af0a0 2023-11-28T11:11:36.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.636+0000 7f7595420700 1 -- 172.21.15.125:0/1620031855 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758800b910 con 0x7f75900af0a0 2023-11-28T11:11:36.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.636+0000 7f7595420700 1 -- 172.21.15.125:0/1620031855 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800bcc0 con 0x7f75900af0a0 2023-11-28T11:11:36.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.636+0000 7f7598686700 1 -- 172.21.15.125:0/1620031855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75900af0a0 msgr2=0x7f759015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.636+0000 7f7598686700 1 --2- 172.21.15.125:0/1620031855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75900af0a0 0x7f759015a350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7588009e50 tx=0x7f758800b330 comp rx=0 tx=0).stop 2023-11-28T11:11:36.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.636+0000 7f7598686700 1 -- 172.21.15.125:0/1620031855 shutdown_connections 2023-11-28T11:11:36.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.636+0000 7f7598686700 1 --2- 172.21.15.125:0/1620031855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75900af0a0 0x7f759015a350 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.636+0000 7f7598686700 1 --2- 172.21.15.125:0/1620031855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75900b1650 0x7f75900b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.636+0000 7f7598686700 1 -- 172.21.15.125:0/1620031855 >> 172.21.15.125:0/1620031855 conn(0x7f759006c010 msgr2=0x7f75900cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:36.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.636+0000 7f7598686700 1 -- 172.21.15.125:0/1620031855 shutdown_connections 2023-11-28T11:11:36.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.636+0000 7f7598686700 1 -- 172.21.15.125:0/1620031855 wait complete. 2023-11-28T11:11:36.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.637+0000 7f7598686700 1 Processor -- start 2023-11-28T11:11:36.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.637+0000 7f7598686700 1 -- start start 2023-11-28T11:11:36.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.638+0000 7f7598686700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75900af0a0 0x7f75900b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.638+0000 7f7598686700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75900b1650 0x7f7590154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.638+0000 7f7598686700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75901579e0 0x7f7590143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.638+0000 7f7598686700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75900b4360 con 0x7f75900af0a0 2023-11-28T11:11:36.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.638+0000 7f7598686700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75900b4640 con 0x7f75901579e0 2023-11-28T11:11:36.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.638+0000 7f7598686700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75900b4920 con 0x7f75900b1650 2023-11-28T11:11:36.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.638+0000 7f7596422700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75900af0a0 0x7f75900b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.638+0000 7f7596422700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75900af0a0 0x7f75900b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32942/0 (socket says 172.21.15.125:32942) 2023-11-28T11:11:36.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.638+0000 7f7596422700 1 -- 172.21.15.125:0/2164420923 learned_addr learned my addr 172.21.15.125:0/2164420923 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:36.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7595c21700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75900b1650 0x7f7590154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7596c23700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75901579e0 0x7f7590143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7596422700 1 -- 172.21.15.125:0/2164420923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75900b1650 msgr2=0x7f7590154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7596422700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75900b1650 0x7f7590154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7596422700 1 -- 172.21.15.125:0/2164420923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75901579e0 msgr2=0x7f7590143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7596422700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75901579e0 0x7f7590143100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7596422700 1 -- 172.21.15.125:0/2164420923 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7588009b30 con 0x7f75900af0a0 2023-11-28T11:11:36.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7596c23700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75901579e0 0x7f7590143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:36.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7596422700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75900af0a0 0x7f75900b3a50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7580010df0 tx=0x7f758000e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:36.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7586ffd700 1 -- 172.21.15.125:0/2164420923 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758000b850 con 0x7f75900af0a0 2023-11-28T11:11:36.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7586ffd700 1 -- 172.21.15.125:0/2164420923 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7580011670 con 0x7f75900af0a0 2023-11-28T11:11:36.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7598686700 1 -- 172.21.15.125:0/2164420923 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759015a890 con 0x7f75900af0a0 2023-11-28T11:11:36.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7586ffd700 1 -- 172.21.15.125:0/2164420923 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580011a20 con 0x7f75900af0a0 2023-11-28T11:11:36.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.639+0000 7f7598686700 1 -- 172.21.15.125:0/2164420923 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759015de60 con 0x7f75900af0a0 2023-11-28T11:11:36.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.640+0000 7f7598686700 1 -- 172.21.15.125:0/2164420923 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759015aa20 con 0x7f75900af0a0 2023-11-28T11:11:36.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.640+0000 7f7586ffd700 1 -- 172.21.15.125:0/2164420923 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7580020030 con 0x7f75900af0a0 2023-11-28T11:11:36.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.641+0000 7f7586ffd700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7574068320 0x7f757406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.641+0000 7f7586ffd700 1 -- 172.21.15.125:0/2164420923 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7580088370 con 0x7f75900af0a0 2023-11-28T11:11:36.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.641+0000 7f7595c21700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7574068320 0x7f757406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.641+0000 7f7595c21700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7574068320 0x7f757406a7d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f75901565c0 tx=0x7f758c007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:36.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.645+0000 7f7586ffd700 1 -- 172.21.15.125:0/2164420923 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7580054e90 con 0x7f75900af0a0 2023-11-28T11:11:36.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.826+0000 7f7598686700 1 -- 172.21.15.125:0/2164420923 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7590068450 con 0x7f75900af0a0 2023-11-28T11:11:36.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.827+0000 7f7586ffd700 1 -- 172.21.15.125:0/2164420923 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7f758001e0a0 con 0x7f75900af0a0 2023-11-28T11:11:36.827 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:11:36.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.828+0000 7f7598686700 1 -- 172.21.15.125:0/2164420923 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7574068320 msgr2=0x7f757406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.828+0000 7f7598686700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7574068320 0x7f757406a7d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f75901565c0 tx=0x7f758c007c00 comp rx=0 tx=0).stop 2023-11-28T11:11:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.828+0000 7f7598686700 1 -- 172.21.15.125:0/2164420923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75900af0a0 msgr2=0x7f75900b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.828+0000 7f7598686700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75900af0a0 0x7f75900b3a50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7580010df0 tx=0x7f758000e640 comp rx=0 tx=0).stop 2023-11-28T11:11:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.829+0000 7f7598686700 1 -- 172.21.15.125:0/2164420923 shutdown_connections 2023-11-28T11:11:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.829+0000 7f7598686700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75901579e0 0x7f7590143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.829+0000 7f7598686700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75900af0a0 0x7f75900b3a50 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.829+0000 7f7598686700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7574068320 0x7f757406a7d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.829+0000 7f7598686700 1 --2- 172.21.15.125:0/2164420923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75900b1650 0x7f7590154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.829+0000 7f7598686700 1 -- 172.21.15.125:0/2164420923 >> 172.21.15.125:0/2164420923 conn(0x7f759006c010 msgr2=0x7f75900716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:36.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.829+0000 7f7598686700 1 -- 172.21.15.125:0/2164420923 shutdown_connections 2023-11-28T11:11:36.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.829+0000 7f7598686700 1 -- 172.21.15.125:0/2164420923 wait complete. 2023-11-28T11:11:36.842 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:11:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.961+0000 7f5e0a11c700 1 Processor -- start 2023-11-28T11:11:36.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.961+0000 7f5e0a11c700 1 -- start start 2023-11-28T11:11:36.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e0a11c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e040d0c60 0x7f5e040b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e0a11c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0406e900 con 0x7f5e0406e400 2023-11-28T11:11:36.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e0a11c700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e04160390 con 0x7f5e04160e70 2023-11-28T11:11:36.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e0a11c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e04160670 con 0x7f5e040d0c60 2023-11-28T11:11:36.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e037fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e040d0c60 0x7f5e040b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e02ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5e0406e400 0x7f5e040d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45308/0 (socket says 172.21.15.125:45308) 2023-11-28T11:11:36.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e02ffd700 1 -- 172.21.15.125:0/1218362685 learned_addr learned my addr 172.21.15.125:0/1218362685 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:36.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e037fe700 1 -- 172.21.15.125:0/1218362685 >> v1:172.21.15.167:6789/0 conn(0x7f5e04160e70 legacy=0x7f5e0415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:36.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e037fe700 1 -- 172.21.15.125:0/1218362685 >> v1:172.21.15.125:6789/0 conn(0x7f5e0406e400 legacy=0x7f5e040d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e027fc700 1 -- 172.21.15.125:0/1218362685 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177078274 0 0) 0x7f5e0406e900 con 0x7f5e0406e400 2023-11-28T11:11:36.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e037fe700 1 -- 172.21.15.125:0/1218362685 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04160950 con 0x7f5e040d0c60 2023-11-28T11:11:36.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.962+0000 7f5e037fe700 1 --2- 172.21.15.125:0/1218362685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e040d0c60 0x7f5e040b5be0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009840 tx=0x7f5df8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4300495287273f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:36.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.963+0000 7f5e027fc700 1 -- 172.21.15.125:0/1218362685 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8004230 con 0x7f5e040d0c60 2023-11-28T11:11:36.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.963+0000 7f5e027fc700 1 -- 172.21.15.125:0/1218362685 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df8004390 con 0x7f5e040d0c60 2023-11-28T11:11:36.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.963+0000 7f5e027fc700 1 -- 172.21.15.125:0/1218362685 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df80036a0 con 0x7f5e040d0c60 2023-11-28T11:11:36.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.963+0000 7f5e0a11c700 1 -- 172.21.15.125:0/1218362685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e040d0c60 msgr2=0x7f5e040b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.963+0000 7f5e0a11c700 1 --2- 172.21.15.125:0/1218362685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e040d0c60 0x7f5e040b5be0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009840 tx=0x7f5df8009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:36.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.963+0000 7f5e0a11c700 1 -- 172.21.15.125:0/1218362685 shutdown_connections 2023-11-28T11:11:36.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.963+0000 7f5e0a11c700 1 --2- 172.21.15.125:0/1218362685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e040d0c60 0x7f5e040b5be0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.963+0000 7f5e0a11c700 1 -- 172.21.15.125:0/1218362685 >> 172.21.15.125:0/1218362685 conn(0x7f5e0406a270 msgr2=0x7f5e0406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:36.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.963+0000 7f5e0a11c700 1 -- 172.21.15.125:0/1218362685 shutdown_connections 2023-11-28T11:11:36.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.963+0000 7f5e0a11c700 1 -- 172.21.15.125:0/1218362685 wait complete. 2023-11-28T11:11:36.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.964+0000 7f5e0a11c700 1 Processor -- start 2023-11-28T11:11:36.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.964+0000 7f5e0a11c700 1 -- start start 2023-11-28T11:11:36.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.965+0000 7f5e0a11c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e0406e400 0x7f5e0413ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.965+0000 7f5e0a11c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e040d0c60 0x7f5e0415d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.965+0000 7f5e0a11c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e04160e70 0x7f5e0415db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.965+0000 7f5e0a11c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0415b9f0 con 0x7f5e04160e70 2023-11-28T11:11:36.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.965+0000 7f5e0a11c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0415ae60 con 0x7f5e040d0c60 2023-11-28T11:11:36.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.965+0000 7f5e0a11c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0415b0e0 con 0x7f5e0406e400 2023-11-28T11:11:36.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.965+0000 7f5e03fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e04160e70 0x7f5e0415db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.965+0000 7f5e03fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e04160e70 0x7f5e0415db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32960/0 (socket says 172.21.15.125:32960) 2023-11-28T11:11:36.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.965+0000 7f5e03fff700 1 -- 172.21.15.125:0/3470760589 learned_addr learned my addr 172.21.15.125:0/3470760589 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.965+0000 7f5e037fe700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e0406e400 0x7f5e0413ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.965+0000 7f5e02ffd700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e040d0c60 0x7f5e0415d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5e03fff700 1 -- 172.21.15.125:0/3470760589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e0406e400 msgr2=0x7f5e0413ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5e03fff700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e0406e400 0x7f5e0413ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5e03fff700 1 -- 172.21.15.125:0/3470760589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e040d0c60 msgr2=0x7f5e0415d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5e03fff700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e040d0c60 0x7f5e0415d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5e03fff700 1 -- 172.21.15.125:0/3470760589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80094a0 con 0x7f5e04160e70 2023-11-28T11:11:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5e02ffd700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e040d0c60 0x7f5e0415d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5e03fff700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e04160e70 0x7f5e0415db20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00ba10 tx=0x7f5dfc00bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5debfff700 1 -- 172.21.15.125:0/3470760589 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00c930 con 0x7f5e04160e70 2023-11-28T11:11:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5debfff700 1 -- 172.21.15.125:0/3470760589 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc00ca90 con 0x7f5e04160e70 2023-11-28T11:11:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5e0a11c700 1 -- 172.21.15.125:0/3470760589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0415d080 con 0x7f5e04160e70 2023-11-28T11:11:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5debfff700 1 -- 172.21.15.125:0/3470760589 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00ce40 con 0x7f5e04160e70 2023-11-28T11:11:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.966+0000 7f5e0a11c700 1 -- 172.21.15.125:0/3470760589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e040d0740 con 0x7f5e04160e70 2023-11-28T11:11:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.967+0000 7f5e0a11c700 1 -- 172.21.15.125:0/3470760589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0415d210 con 0x7f5e04160e70 2023-11-28T11:11:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.967+0000 7f5debfff700 1 -- 172.21.15.125:0/3470760589 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5dfc01b030 con 0x7f5e04160e70 2023-11-28T11:11:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.968+0000 7f5debfff700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5df00682f0 0x7f5df006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.968+0000 7f5debfff700 1 -- 172.21.15.125:0/3470760589 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5dfc0854d0 con 0x7f5e04160e70 2023-11-28T11:11:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.968+0000 7f5e037fe700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5df00682f0 0x7f5df006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.968+0000 7f5e037fe700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5df00682f0 0x7f5df006a7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5df80090b0 tx=0x7f5df801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:36.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:36.972+0000 7f5debfff700 1 -- 172.21.15.125:0/3470760589 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5dfc052080 con 0x7f5e04160e70 2023-11-28T11:11:37.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.160+0000 7f5e0a11c700 1 -- 172.21.15.125:0/3470760589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5e040743f0 con 0x7f5e04160e70 2023-11-28T11:11:37.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.161+0000 7f5debfff700 1 -- 172.21.15.125:0/3470760589 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5dfc019090 con 0x7f5e04160e70 2023-11-28T11:11:37.161 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:37.162 INFO:teuthology.orchestra.run.smithi125.stdout:[ 2023-11-28T11:11:37.162 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:37.162 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 1, 2023-11-28T11:11:37.162 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": ".mgr" 2023-11-28T11:11:37.162 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:37.162 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:37.162 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 2, 2023-11-28T11:11:37.162 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": "rbd" 2023-11-28T11:11:37.162 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:37.162 INFO:teuthology.orchestra.run.smithi125.stdout:] 2023-11-28T11:11:37.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 -- 172.21.15.125:0/3470760589 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5df00682f0 msgr2=0x7f5df006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:37.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5df00682f0 0x7f5df006a7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5df80090b0 tx=0x7f5df801c040 comp rx=0 tx=0).stop 2023-11-28T11:11:37.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 -- 172.21.15.125:0/3470760589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e04160e70 msgr2=0x7f5e0415db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:37.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e04160e70 0x7f5e0415db20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00ba10 tx=0x7f5dfc00bd20 comp rx=0 tx=0).stop 2023-11-28T11:11:37.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 -- 172.21.15.125:0/3470760589 shutdown_connections 2023-11-28T11:11:37.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e04160e70 0x7f5e0415db20 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:37.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5df00682f0 0x7f5df006a7a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:37.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e0406e400 0x7f5e0413ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:37.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 --2- 172.21.15.125:0/3470760589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e040d0c60 0x7f5e0415d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:37.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 -- 172.21.15.125:0/3470760589 >> 172.21.15.125:0/3470760589 conn(0x7f5e0406a270 msgr2=0x7f5e0406f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:37.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 -- 172.21.15.125:0/3470760589 shutdown_connections 2023-11-28T11:11:37.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.163+0000 7f5e0a11c700 1 -- 172.21.15.125:0/3470760589 wait complete. 2023-11-28T11:11:37.175 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:11:37.176 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:11:37.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.299+0000 7f6b8ce0e700 1 Processor -- start 2023-11-28T11:11:37.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.299+0000 7f6b8ce0e700 1 -- start start 2023-11-28T11:11:37.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.300+0000 7f6b8ce0e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b88071320 0x7f6b880af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:37.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.300+0000 7f6b8ce0e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b88161160 0x7f6b8806a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:37.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.300+0000 7f6b8ce0e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b880cf3e0 con 0x7f6b8815cc50 2023-11-28T11:11:37.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.300+0000 7f6b8ce0e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b880cd800 con 0x7f6b88071320 2023-11-28T11:11:37.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.300+0000 7f6b8ce0e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880cdae0 con 0x7f6b88161160 2023-11-28T11:11:37.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.300+0000 7f6b85d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b88071320 0x7f6b880af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:37.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.300+0000 7f6b8659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6b8815cc50 0x7f6b88070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45320/0 (socket says 172.21.15.125:45320) 2023-11-28T11:11:37.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.300+0000 7f6b8659c700 1 -- 172.21.15.125:0/601999865 learned_addr learned my addr 172.21.15.125:0/601999865 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:37.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.301+0000 7f6b85d9b700 1 -- 172.21.15.125:0/601999865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b88161160 msgr2=0x7f6b8806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:37.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.301+0000 7f6b85d9b700 1 --2- 172.21.15.125:0/601999865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b88161160 0x7f6b8806a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:37.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.301+0000 7f6b85d9b700 1 -- 172.21.15.125:0/601999865 >> v1:172.21.15.125:6789/0 conn(0x7f6b8815cc50 legacy=0x7f6b88070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:37.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.301+0000 7f6b8559a700 1 -- 172.21.15.125:0/601999865 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174802697 0 0) 0x7f6b880cf3e0 con 0x7f6b8815cc50 2023-11-28T11:11:37.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.301+0000 7f6b85d9b700 1 -- 172.21.15.125:0/601999865 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b880cdf70 con 0x7f6b88071320 2023-11-28T11:11:37.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.301+0000 7f6b85d9b700 1 --2- 172.21.15.125:0/601999865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b88071320 0x7f6b880af1f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009840 tx=0x7f6b78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788dfa9880483d7c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:37.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.301+0000 7f6b8559a700 1 -- 172.21.15.125:0/601999865 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78011830 con 0x7f6b88071320 2023-11-28T11:11:37.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.301+0000 7f6b8559a700 1 -- 172.21.15.125:0/601999865 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78011990 con 0x7f6b88071320 2023-11-28T11:11:37.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.301+0000 7f6b8559a700 1 -- 172.21.15.125:0/601999865 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78011d20 con 0x7f6b88071320 2023-11-28T11:11:37.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.302+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/601999865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b88071320 msgr2=0x7f6b880af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:37.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.302+0000 7f6b8ce0e700 1 --2- 172.21.15.125:0/601999865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b88071320 0x7f6b880af1f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009840 tx=0x7f6b78009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:37.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.302+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/601999865 shutdown_connections 2023-11-28T11:11:37.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.302+0000 7f6b8ce0e700 1 --2- 172.21.15.125:0/601999865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b88161160 0x7f6b8806a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:37.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.302+0000 7f6b8ce0e700 1 --2- 172.21.15.125:0/601999865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b88071320 0x7f6b880af1f0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:37.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.302+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/601999865 >> 172.21.15.125:0/601999865 conn(0x7f6b880cfc30 msgr2=0x7f6b880d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:37.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.302+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/601999865 shutdown_connections 2023-11-28T11:11:37.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.302+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/601999865 wait complete. 2023-11-28T11:11:37.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.303+0000 7f6b8ce0e700 1 Processor -- start 2023-11-28T11:11:37.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.303+0000 7f6b8ce0e700 1 -- start start 2023-11-28T11:11:37.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8ce0e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b88071320 0x7f6b88156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:37.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8ce0e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b8815cc50 0x7f6b880b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:37.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8ce0e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b88161160 0x7f6b880b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:37.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8ce0e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8806f2b0 con 0x7f6b88071320 2023-11-28T11:11:37.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8ce0e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8806d7e0 con 0x7f6b8815cc50 2023-11-28T11:11:37.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8ce0e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8806e560 con 0x7f6b88161160 2023-11-28T11:11:37.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b88071320 0x7f6b88156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:37.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b88071320 0x7f6b88156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32970/0 (socket says 172.21.15.125:32970) 2023-11-28T11:11:37.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8659c700 1 -- 172.21.15.125:0/3099851562 learned_addr learned my addr 172.21.15.125:0/3099851562 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:37.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b85d9b700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b8815cc50 0x7f6b880b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:37.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b86d9d700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b88161160 0x7f6b880b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:37.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8659c700 1 -- 172.21.15.125:0/3099851562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b88161160 msgr2=0x7f6b880b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:37.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8659c700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b88161160 0x7f6b880b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:37.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8659c700 1 -- 172.21.15.125:0/3099851562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b8815cc50 msgr2=0x7f6b880b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:37.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8659c700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b8815cc50 0x7f6b880b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:37.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8659c700 1 -- 172.21.15.125:0/3099851562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780094a0 con 0x7f6b88071320 2023-11-28T11:11:37.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b85d9b700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b8815cc50 0x7f6b880b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:37.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8659c700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b88071320 0x7f6b88156f90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0011e0 tx=0x7f6b7c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:37.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b76ffd700 1 -- 172.21.15.125:0/3099851562 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c004c80 con 0x7f6b88071320 2023-11-28T11:11:37.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b76ffd700 1 -- 172.21.15.125:0/3099851562 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c004e00 con 0x7f6b88071320 2023-11-28T11:11:37.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/3099851562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b880cf610 con 0x7f6b88071320 2023-11-28T11:11:37.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.304+0000 7f6b76ffd700 1 -- 172.21.15.125:0/3099851562 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c007310 con 0x7f6b88071320 2023-11-28T11:11:37.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.305+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/3099851562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b881616b0 con 0x7f6b88071320 2023-11-28T11:11:37.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.305+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/3099851562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8815d020 con 0x7f6b88071320 2023-11-28T11:11:37.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.306+0000 7f6b76ffd700 1 -- 172.21.15.125:0/3099851562 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6b7c01a020 con 0x7f6b88071320 2023-11-28T11:11:37.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.306+0000 7f6b76ffd700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6b680682f0 0x7f6b6806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:37.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.306+0000 7f6b76ffd700 1 -- 172.21.15.125:0/3099851562 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6b7c085610 con 0x7f6b88071320 2023-11-28T11:11:37.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.306+0000 7f6b85d9b700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6b680682f0 0x7f6b6806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:37.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.307+0000 7f6b85d9b700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6b680682f0 0x7f6b6806a7a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6b88071710 tx=0x7f6b78008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:37.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.310+0000 7f6b76ffd700 1 -- 172.21.15.125:0/3099851562 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6b7c0521c0 con 0x7f6b88071320 2023-11-28T11:11:37.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:37.494+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/3099851562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6b880743f0 con 0x7f6b88071320 2023-11-28T11:11:38.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.075+0000 7f6b76ffd700 1 -- 172.21.15.125:0/3099851562 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v63) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6b7c0557e0 con 0x7f6b88071320 2023-11-28T11:11:38.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/3099851562 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6b680682f0 msgr2=0x7f6b6806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:38.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6b680682f0 0x7f6b6806a7a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6b88071710 tx=0x7f6b78008030 comp rx=0 tx=0).stop 2023-11-28T11:11:38.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/3099851562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b88071320 msgr2=0x7f6b88156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:38.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b88071320 0x7f6b88156f90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0011e0 tx=0x7f6b7c00cae0 comp rx=0 tx=0).stop 2023-11-28T11:11:38.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/3099851562 shutdown_connections 2023-11-28T11:11:38.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6b680682f0 0x7f6b6806a7a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:38.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b88161160 0x7f6b880b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:38.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b88071320 0x7f6b88156f90 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:38.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 --2- 172.21.15.125:0/3099851562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b8815cc50 0x7f6b880b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:38.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/3099851562 >> 172.21.15.125:0/3099851562 conn(0x7f6b880cfc30 msgr2=0x7f6b880aea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:38.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/3099851562 shutdown_connections 2023-11-28T11:11:38.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.080+0000 7f6b8ce0e700 1 -- 172.21.15.125:0/3099851562 wait complete. 2023-11-28T11:11:38.082 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' created 2023-11-28T11:11:38.094 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:11:38.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.223+0000 7fa63039a700 1 Processor -- start 2023-11-28T11:11:38.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.223+0000 7fa63039a700 1 -- start start 2023-11-28T11:11:38.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.224+0000 7fa63039a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6280b1650 0x7fa6280b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.224+0000 7fa63039a700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa6280af0a0 0x7fa62815a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.224+0000 7fa63039a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa628159ec0 con 0x7fa6281599b0 2023-11-28T11:11:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.224+0000 7fa63039a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6280b1f60 con 0x7fa6280b1650 2023-11-28T11:11:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.224+0000 7fa63039a700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62815d8a0 con 0x7fa6280af0a0 2023-11-28T11:11:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.224+0000 7fa62e136700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6280b1650 0x7fa6280b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.224+0000 7fa62d935700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa6281599b0 0x7fa62815d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45334/0 (socket says 172.21.15.125:45334) 2023-11-28T11:11:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.224+0000 7fa62d935700 1 -- 172.21.15.125:0/2362071008 learned_addr learned my addr 172.21.15.125:0/2362071008 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.225+0000 7fa62e136700 1 -- 172.21.15.125:0/2362071008 >> v2:172.21.15.167:3300/0 conn(0x7fa6280af0a0 msgr2=0x7fa62815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.225+0000 7fa62e937700 1 --2- 172.21.15.125:0/2362071008 >> v2:172.21.15.167:3300/0 conn(0x7fa6280af0a0 0x7fa62815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.225+0000 7fa62e136700 1 --2- 172.21.15.125:0/2362071008 >> v2:172.21.15.167:3300/0 conn(0x7fa6280af0a0 0x7fa62815a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.225+0000 7fa62e136700 1 -- 172.21.15.125:0/2362071008 >> v1:172.21.15.125:6789/0 conn(0x7fa6281599b0 legacy=0x7fa62815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.225+0000 7fa62d134700 1 -- 172.21.15.125:0/2362071008 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189693303 0 0) 0x7fa628159ec0 con 0x7fa6281599b0 2023-11-28T11:11:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.225+0000 7fa62e136700 1 -- 172.21.15.125:0/2362071008 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62815db80 con 0x7fa6280b1650 2023-11-28T11:11:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.225+0000 7fa62e136700 1 --2- 172.21.15.125:0/2362071008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6280b1650 0x7fa6280b1a20 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa62806e010 tx=0x7fa618009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb342e551103abd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.225+0000 7fa62d134700 1 -- 172.21.15.125:0/2362071008 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618011830 con 0x7fa6280b1650 2023-11-28T11:11:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.225+0000 7fa62d134700 1 -- 172.21.15.125:0/2362071008 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa618011990 con 0x7fa6280b1650 2023-11-28T11:11:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.225+0000 7fa62d134700 1 -- 172.21.15.125:0/2362071008 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618011d20 con 0x7fa6280b1650 2023-11-28T11:11:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.225+0000 7fa63039a700 1 -- 172.21.15.125:0/2362071008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6280b1650 msgr2=0x7fa6280b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.226+0000 7fa63039a700 1 --2- 172.21.15.125:0/2362071008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6280b1650 0x7fa6280b1a20 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa62806e010 tx=0x7fa618009b20 comp rx=0 tx=0).stop 2023-11-28T11:11:38.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.226+0000 7fa63039a700 1 -- 172.21.15.125:0/2362071008 shutdown_connections 2023-11-28T11:11:38.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.226+0000 7fa63039a700 1 --2- 172.21.15.125:0/2362071008 >> v2:172.21.15.167:3300/0 conn(0x7fa6280af0a0 0x7fa62815a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:38.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.226+0000 7fa63039a700 1 --2- 172.21.15.125:0/2362071008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6280b1650 0x7fa6280b1a20 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:38.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.226+0000 7fa63039a700 1 -- 172.21.15.125:0/2362071008 >> 172.21.15.125:0/2362071008 conn(0x7fa62806c010 msgr2=0x7fa6280cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:38.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.226+0000 7fa63039a700 1 -- 172.21.15.125:0/2362071008 shutdown_connections 2023-11-28T11:11:38.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.226+0000 7fa63039a700 1 -- 172.21.15.125:0/2362071008 wait complete. 2023-11-28T11:11:38.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.227+0000 7fa63039a700 1 Processor -- start 2023-11-28T11:11:38.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.227+0000 7fa63039a700 1 -- start start 2023-11-28T11:11:38.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.228+0000 7fa63039a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6280af0a0 0x7fa6281ee180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:38.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.228+0000 7fa63039a700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6280b1650 0x7fa628157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:38.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.228+0000 7fa63039a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa628152200 0x7fa628151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:38.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.228+0000 7fa63039a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280b4ab0 con 0x7fa628152200 2023-11-28T11:11:38.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.228+0000 7fa63039a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280b3ea0 con 0x7fa6280af0a0 2023-11-28T11:11:38.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.228+0000 7fa63039a700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280b4180 con 0x7fa6280b1650 2023-11-28T11:11:38.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.228+0000 7fa62e937700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa628152200 0x7fa628151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:38.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.228+0000 7fa62e937700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa628152200 0x7fa628151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32988/0 (socket says 172.21.15.125:32988) 2023-11-28T11:11:38.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.228+0000 7fa62e937700 1 -- 172.21.15.125:0/1579964639 learned_addr learned my addr 172.21.15.125:0/1579964639 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:38.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa62d935700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6280b1650 0x7fa628157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:38.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa62e937700 1 -- 172.21.15.125:0/1579964639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6280b1650 msgr2=0x7fa628157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:38.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa62e937700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6280b1650 0x7fa628157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:38.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa62e937700 1 -- 172.21.15.125:0/1579964639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6280af0a0 msgr2=0x7fa6281ee180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:38.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa62e937700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6280af0a0 0x7fa6281ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:38.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa62e937700 1 -- 172.21.15.125:0/1579964639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6180094a0 con 0x7fa628152200 2023-11-28T11:11:38.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa62e937700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa628152200 0x7fa628151130 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa62000cd70 tx=0x7fa62000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:38.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa61effd700 1 -- 172.21.15.125:0/1579964639 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620003a20 con 0x7fa628152200 2023-11-28T11:11:38.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa61effd700 1 -- 172.21.15.125:0/1579964639 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa620003b80 con 0x7fa628152200 2023-11-28T11:11:38.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa63039a700 1 -- 172.21.15.125:0/1579964639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62815a890 con 0x7fa628152200 2023-11-28T11:11:38.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa61effd700 1 -- 172.21.15.125:0/1579964639 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620004020 con 0x7fa628152200 2023-11-28T11:11:38.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.229+0000 7fa63039a700 1 -- 172.21.15.125:0/1579964639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62815de60 con 0x7fa628152200 2023-11-28T11:11:38.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.230+0000 7fa63039a700 1 -- 172.21.15.125:0/1579964639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62815aa20 con 0x7fa628152200 2023-11-28T11:11:38.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.230+0000 7fa61effd700 1 -- 172.21.15.125:0/1579964639 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa62001c020 con 0x7fa628152200 2023-11-28T11:11:38.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.231+0000 7fa61effd700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa60c0682f0 0x7fa60c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:38.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.231+0000 7fa61effd700 1 -- 172.21.15.125:0/1579964639 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fa620012070 con 0x7fa628152200 2023-11-28T11:11:38.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.231+0000 7fa62e136700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa60c0682f0 0x7fa60c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:38.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.231+0000 7fa62e136700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa60c0682f0 0x7fa60c06a7a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa618000c00 tx=0x7fa618010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:38.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.235+0000 7fa61effd700 1 -- 172.21.15.125:0/1579964639 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa620052d00 con 0x7fa628152200 2023-11-28T11:11:38.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:38.417+0000 7fa63039a700 1 -- 172.21.15.125:0/1579964639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa6280b4bf0 con 0x7fa628152200 2023-11-28T11:11:39.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.076+0000 7fa61effd700 1 -- 172.21.15.125:0/1579964639 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v64) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa6280b4bf0 con 0x7fa628152200 2023-11-28T11:11:39.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.081+0000 7fa63039a700 1 -- 172.21.15.125:0/1579964639 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa60c0682f0 msgr2=0x7fa60c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.081+0000 7fa63039a700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa60c0682f0 0x7fa60c06a7a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa618000c00 tx=0x7fa618010000 comp rx=0 tx=0).stop 2023-11-28T11:11:39.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.081+0000 7fa63039a700 1 -- 172.21.15.125:0/1579964639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa628152200 msgr2=0x7fa628151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.081+0000 7fa63039a700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa628152200 0x7fa628151130 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa62000cd70 tx=0x7fa62000a570 comp rx=0 tx=0).stop 2023-11-28T11:11:39.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.083+0000 7fa63039a700 1 -- 172.21.15.125:0/1579964639 shutdown_connections 2023-11-28T11:11:39.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.083+0000 7fa63039a700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa628152200 0x7fa628151130 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.083+0000 7fa63039a700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6280af0a0 0x7fa6281ee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.083+0000 7fa63039a700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa60c0682f0 0x7fa60c06a7a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.083+0000 7fa63039a700 1 --2- 172.21.15.125:0/1579964639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6280b1650 0x7fa628157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.083+0000 7fa63039a700 1 -- 172.21.15.125:0/1579964639 >> 172.21.15.125:0/1579964639 conn(0x7fa62806c010 msgr2=0x7fa6280d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:39.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.084+0000 7fa63039a700 1 -- 172.21.15.125:0/1579964639 shutdown_connections 2023-11-28T11:11:39.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.085+0000 7fa63039a700 1 -- 172.21.15.125:0/1579964639 wait complete. 2023-11-28T11:11:39.088 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' created 2023-11-28T11:11:39.106 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:11:39.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.233+0000 7f97c7b92700 1 Processor -- start 2023-11-28T11:11:39.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.233+0000 7f97c7b92700 1 -- start start 2023-11-28T11:11:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.234+0000 7f97c7b92700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c006a980 0x7f97c00ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.234+0000 7f97c7b92700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f97c0071890 0x7f97c0071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.234+0000 7f97c7b92700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c015cc10 con 0x7f97c00cf710 2023-11-28T11:11:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.234+0000 7f97c7b92700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c006c9b0 con 0x7f97c0071890 2023-11-28T11:11:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.234+0000 7f97c7b92700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c006cc90 con 0x7f97c006a980 2023-11-28T11:11:39.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.234+0000 7f97c512d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c006a980 0x7f97c00ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.234+0000 7f97c612f700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f97c0071890 0x7f97c0071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.234+0000 7f97c592e700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f97c00cf710 0x7f97c006a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:48150/0 (socket says 172.21.15.125:48150) 2023-11-28T11:11:39.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.234+0000 7f97c612f700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f97c0071890 0x7f97c0071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:57958/0 (socket says 172.21.15.125:57958) 2023-11-28T11:11:39.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.234+0000 7f97c592e700 1 -- 172.21.15.125:0/1959784767 learned_addr learned my addr 172.21.15.125:0/1959784767 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:39.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c612f700 1 -- 172.21.15.125:0/1959784767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c006a980 msgr2=0x7f97c00ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:39.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c612f700 1 --2- 172.21.15.125:0/1959784767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c006a980 0x7f97c00ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c612f700 1 -- 172.21.15.125:0/1959784767 >> v1:172.21.15.167:6789/0 conn(0x7f97c00cf710 legacy=0x7f97c006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c612f700 1 -- 172.21.15.125:0/1959784767 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c006cf70 con 0x7f97c0071890 2023-11-28T11:11:39.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c512d700 1 --2- 172.21.15.125:0/1959784767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c006a980 0x7f97c00ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:11:39.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c612f700 1 --2- 172.21.15.125:0/1959784767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c0071890 0x7f97c0071220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009d90 tx=0x7f97b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311d6a69bff5b652 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:39.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c492c700 1 -- 172.21.15.125:0/1959784767 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b800e070 con 0x7f97c0071890 2023-11-28T11:11:39.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c492c700 1 -- 172.21.15.125:0/1959784767 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b800bb20 con 0x7f97c0071890 2023-11-28T11:11:39.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c492c700 1 -- 172.21.15.125:0/1959784767 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8012430 con 0x7f97c0071890 2023-11-28T11:11:39.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c7b92700 1 -- 172.21.15.125:0/1959784767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c0071890 msgr2=0x7f97c0071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c7b92700 1 --2- 172.21.15.125:0/1959784767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c0071890 0x7f97c0071220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009d90 tx=0x7f97b800b330 comp rx=0 tx=0).stop 2023-11-28T11:11:39.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c7b92700 1 -- 172.21.15.125:0/1959784767 shutdown_connections 2023-11-28T11:11:39.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c7b92700 1 --2- 172.21.15.125:0/1959784767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c0071890 0x7f97c0071220 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c7b92700 1 --2- 172.21.15.125:0/1959784767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c006a980 0x7f97c00ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.235+0000 7f97c7b92700 1 -- 172.21.15.125:0/1959784767 >> 172.21.15.125:0/1959784767 conn(0x7f97c006c010 msgr2=0x7f97c00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:39.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.236+0000 7f97c7b92700 1 -- 172.21.15.125:0/1959784767 shutdown_connections 2023-11-28T11:11:39.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.236+0000 7f97c7b92700 1 -- 172.21.15.125:0/1959784767 wait complete. 2023-11-28T11:11:39.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.237+0000 7f97c7b92700 1 Processor -- start 2023-11-28T11:11:39.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.237+0000 7f97c7b92700 1 -- start start 2023-11-28T11:11:39.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.237+0000 7f97c7b92700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c006a980 0x7f97c00c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.237+0000 7f97c7b92700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c0071890 0x7f97c015dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.237+0000 7f97c7b92700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c00cf710 0x7f97c00cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.237+0000 7f97c7b92700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c015e220 con 0x7f97c006a980 2023-11-28T11:11:39.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.237+0000 7f97c7b92700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00cc9e0 con 0x7f97c0071890 2023-11-28T11:11:39.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.237+0000 7f97c7b92700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c015e410 con 0x7f97c00cf710 2023-11-28T11:11:39.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c592e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c006a980 0x7f97c00c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c592e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c006a980 0x7f97c00c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33000/0 (socket says 172.21.15.125:33000) 2023-11-28T11:11:39.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c592e700 1 -- 172.21.15.125:0/3749291487 learned_addr learned my addr 172.21.15.125:0/3749291487 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:39.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c512d700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c0071890 0x7f97c015dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c612f700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c00cf710 0x7f97c00cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c592e700 1 -- 172.21.15.125:0/3749291487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c00cf710 msgr2=0x7f97c00cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c592e700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c00cf710 0x7f97c00cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c592e700 1 -- 172.21.15.125:0/3749291487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c0071890 msgr2=0x7f97c015dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c592e700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c0071890 0x7f97c015dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c592e700 1 -- 172.21.15.125:0/3749291487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc0094a0 con 0x7f97c006a980 2023-11-28T11:11:39.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c612f700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c00cf710 0x7f97c00cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:39.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c512d700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c0071890 0x7f97c015dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:39.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c592e700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c006a980 0x7f97c00c7260 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f97b000c460 tx=0x7f97b000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:39.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97b67fc700 1 -- 172.21.15.125:0/3749291487 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0005d70 con 0x7f97c006a980 2023-11-28T11:11:39.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97b67fc700 1 -- 172.21.15.125:0/3749291487 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b00070d0 con 0x7f97c006a980 2023-11-28T11:11:39.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c7b92700 1 -- 172.21.15.125:0/3749291487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b8009a70 con 0x7f97c006a980 2023-11-28T11:11:39.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97b67fc700 1 -- 172.21.15.125:0/3749291487 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0007460 con 0x7f97c006a980 2023-11-28T11:11:39.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.238+0000 7f97c7b92700 1 -- 172.21.15.125:0/3749291487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c006d530 con 0x7f97c006a980 2023-11-28T11:11:39.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.239+0000 7f97c7b92700 1 -- 172.21.15.125:0/3749291487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c006d250 con 0x7f97c006a980 2023-11-28T11:11:39.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.240+0000 7f97b67fc700 1 -- 172.21.15.125:0/3749291487 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f97b0019030 con 0x7f97c006a980 2023-11-28T11:11:39.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.240+0000 7f97b67fc700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a40682f0 0x7f97a406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.240+0000 7f97b67fc700 1 -- 172.21.15.125:0/3749291487 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f97b0084f50 con 0x7f97c006a980 2023-11-28T11:11:39.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.240+0000 7f97c512d700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a40682f0 0x7f97a406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.240+0000 7f97c512d700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a40682f0 0x7f97a406a7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f97c00adf80 tx=0x7f97bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:39.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.244+0000 7f97b67fc700 1 -- 172.21.15.125:0/3749291487 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f97b0051810 con 0x7f97c006a980 2023-11-28T11:11:39.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.472+0000 7f97c7b92700 1 -- 172.21.15.125:0/3749291487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f97c0160480 con 0x7f97c006a980 2023-11-28T11:11:39.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.477+0000 7f97b67fc700 1 -- 172.21.15.125:0/3749291487 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7f97b00170c0 con 0x7f97c006a980 2023-11-28T11:11:39.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 -- 172.21.15.125:0/3749291487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a40682f0 msgr2=0x7f97a406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a40682f0 0x7f97a406a7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f97c00adf80 tx=0x7f97bc008040 comp rx=0 tx=0).stop 2023-11-28T11:11:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 -- 172.21.15.125:0/3749291487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c006a980 msgr2=0x7f97c00c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c006a980 0x7f97c00c7260 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f97b000c460 tx=0x7f97b000c820 comp rx=0 tx=0).stop 2023-11-28T11:11:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 -- 172.21.15.125:0/3749291487 shutdown_connections 2023-11-28T11:11:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a40682f0 0x7f97a406a7a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c00cf710 0x7f97c00cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c006a980 0x7f97c00c7260 secure :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f97b000c460 tx=0x7f97b000c820 comp rx=0 tx=0).stop 2023-11-28T11:11:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 --2- 172.21.15.125:0/3749291487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c0071890 0x7f97c015dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 -- 172.21.15.125:0/3749291487 >> 172.21.15.125:0/3749291487 conn(0x7f97c006c010 msgr2=0x7f97c015c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:39.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 -- 172.21.15.125:0/3749291487 shutdown_connections 2023-11-28T11:11:39.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.481+0000 7f97c7b92700 1 -- 172.21.15.125:0/3749291487 wait complete. 2023-11-28T11:11:39.485 INFO:teuthology.orchestra.run.smithi125.stderr:new fs with metadata pool 9 and data pool 10 2023-11-28T11:11:39.504 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:11:39.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.623+0000 7f7398abe700 1 Processor -- start 2023-11-28T11:11:39.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.623+0000 7f7398abe700 1 -- start start 2023-11-28T11:11:39.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f7398abe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f739406e400 0x7f739406e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f7398abe700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f73940d15f0 0x7f739415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f7398abe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f739415e010 0x7f73940ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f7398abe700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739415a9d0 con 0x7f739406e400 2023-11-28T11:11:39.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f7398abe700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73941584e0 con 0x7f73940d15f0 2023-11-28T11:11:39.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f7398abe700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739415af30 con 0x7f739415e010 2023-11-28T11:11:39.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f739259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f739406e400 0x7f739406e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f739259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f739406e400 0x7f739406e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33006/0 (socket says 172.21.15.125:33006) 2023-11-28T11:11:39.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f739259c700 1 -- 172.21.15.125:0/2225619706 learned_addr learned my addr 172.21.15.125:0/2225619706 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:39.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f7391d9b700 1 --2- 172.21.15.125:0/2225619706 >> v2:172.21.15.167:3300/0 conn(0x7f73940d15f0 0x7f739415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f7392d9d700 1 --2- 172.21.15.125:0/2225619706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f739415e010 0x7f73940ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f739259c700 1 -- 172.21.15.125:0/2225619706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f739415e010 msgr2=0x7f73940ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:39.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f739259c700 1 --2- 172.21.15.125:0/2225619706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f739415e010 0x7f73940ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f739259c700 1 -- 172.21.15.125:0/2225619706 >> v2:172.21.15.167:3300/0 conn(0x7f73940d15f0 msgr2=0x7f739415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:39.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f739259c700 1 --2- 172.21.15.125:0/2225619706 >> v2:172.21.15.167:3300/0 conn(0x7f73940d15f0 0x7f739415b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.624+0000 7f739259c700 1 -- 172.21.15.125:0/2225619706 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739415ef40 con 0x7f739406e400 2023-11-28T11:11:39.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f739259c700 1 --2- 172.21.15.125:0/2225619706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f739406e400 0x7f739406e7d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f73940ce6e0 tx=0x7f7388009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62300a00f73dcdc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:39.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f739159a700 1 -- 172.21.15.125:0/2225619706 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800b870 con 0x7f739406e400 2023-11-28T11:11:39.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f739159a700 1 -- 172.21.15.125:0/2225619706 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738800b9d0 con 0x7f739406e400 2023-11-28T11:11:39.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f739159a700 1 -- 172.21.15.125:0/2225619706 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800bd60 con 0x7f739406e400 2023-11-28T11:11:39.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f7398abe700 1 -- 172.21.15.125:0/2225619706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f739406e400 msgr2=0x7f739406e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f7398abe700 1 --2- 172.21.15.125:0/2225619706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f739406e400 0x7f739406e7d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f73940ce6e0 tx=0x7f7388009bd0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f7398abe700 1 -- 172.21.15.125:0/2225619706 shutdown_connections 2023-11-28T11:11:39.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f7398abe700 1 --2- 172.21.15.125:0/2225619706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f739415e010 0x7f73940ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f7398abe700 1 --2- 172.21.15.125:0/2225619706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f739406e400 0x7f739406e7d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f7398abe700 1 --2- 172.21.15.125:0/2225619706 >> v2:172.21.15.167:3300/0 conn(0x7f73940d15f0 0x7f739415b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f7398abe700 1 -- 172.21.15.125:0/2225619706 >> 172.21.15.125:0/2225619706 conn(0x7f739406a270 msgr2=0x7f739406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:39.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f7398abe700 1 -- 172.21.15.125:0/2225619706 shutdown_connections 2023-11-28T11:11:39.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.625+0000 7f7398abe700 1 -- 172.21.15.125:0/2225619706 wait complete. 2023-11-28T11:11:39.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.627+0000 7f7398abe700 1 Processor -- start 2023-11-28T11:11:39.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.627+0000 7f7398abe700 1 -- start start 2023-11-28T11:11:39.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.627+0000 7f7398abe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f739406e400 0x7f7394140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.627+0000 7f7398abe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73940d15f0 0x7f73940cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.627+0000 7f7398abe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f739415e010 0x7f73940d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.627+0000 7f7398abe700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739415b3c0 con 0x7f739415e010 2023-11-28T11:11:39.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7398abe700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739415b610 con 0x7f739406e400 2023-11-28T11:11:39.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7398abe700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739415b8f0 con 0x7f73940d15f0 2023-11-28T11:11:39.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7392d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f739415e010 0x7f73940d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7392d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f739415e010 0x7f73940d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33016/0 (socket says 172.21.15.125:33016) 2023-11-28T11:11:39.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7392d9d700 1 -- 172.21.15.125:0/1506814747 learned_addr learned my addr 172.21.15.125:0/1506814747 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:39.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7392d9d700 1 -- 172.21.15.125:0/1506814747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73940d15f0 msgr2=0x7f73940cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7391d9b700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73940d15f0 0x7f73940cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f739259c700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f739406e400 0x7f7394140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7392d9d700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73940d15f0 0x7f73940cfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7392d9d700 1 -- 172.21.15.125:0/1506814747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f739406e400 msgr2=0x7f7394140840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7392d9d700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f739406e400 0x7f7394140840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7392d9d700 1 -- 172.21.15.125:0/1506814747 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388009550 con 0x7f739415e010 2023-11-28T11:11:39.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7392d9d700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f739415e010 0x7f73940d0300 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f738c007e60 tx=0x7f738c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:39.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7382ffd700 1 -- 172.21.15.125:0/1506814747 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c00ede0 con 0x7f739415e010 2023-11-28T11:11:39.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7382ffd700 1 -- 172.21.15.125:0/1506814747 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c014420 con 0x7f739415e010 2023-11-28T11:11:39.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7382ffd700 1 -- 172.21.15.125:0/1506814747 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0147d0 con 0x7f739415e010 2023-11-28T11:11:39.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7398abe700 1 -- 172.21.15.125:0/1506814747 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739415e980 con 0x7f739415e010 2023-11-28T11:11:39.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.628+0000 7f7398abe700 1 -- 172.21.15.125:0/1506814747 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739406ed10 con 0x7f739415e010 2023-11-28T11:11:39.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.629+0000 7f7398abe700 1 -- 172.21.15.125:0/1506814747 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739415ec60 con 0x7f739415e010 2023-11-28T11:11:39.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.629+0000 7f7382ffd700 1 -- 172.21.15.125:0/1506814747 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f738c012050 con 0x7f739415e010 2023-11-28T11:11:39.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.630+0000 7f7382ffd700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f73740682f0 0x7f737406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.630+0000 7f7382ffd700 1 -- 172.21.15.125:0/1506814747 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f738c0862b0 con 0x7f739415e010 2023-11-28T11:11:39.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.630+0000 7f739259c700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f73740682f0 0x7f737406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.630+0000 7f739259c700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f73740682f0 0x7f737406a7a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f739415cd50 tx=0x7f7388008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:39.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.634+0000 7f7382ffd700 1 -- 172.21.15.125:0/1506814747 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f738c052b10 con 0x7f739415e010 2023-11-28T11:11:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.821+0000 7f7398abe700 1 -- 172.21.15.125:0/1506814747 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7394068450 con 0x7f739415e010 2023-11-28T11:11:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.822+0000 7f7382ffd700 1 -- 172.21.15.125:0/1506814747 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+17982 (secure 0 0 0) 0x7f738c056130 con 0x7f739415e010 2023-11-28T11:11:39.823 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:39.823 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":65,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:11:39.472775+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:11:37.512888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T11:11:38.435309+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:11:39.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.824+0000 7f7398abe700 1 -- 172.21.15.125:0/1506814747 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f73740682f0 msgr2=0x7f737406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.824+0000 7f7398abe700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f73740682f0 0x7f737406a7a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f739415cd50 tx=0x7f7388008030 comp rx=0 tx=0).stop 2023-11-28T11:11:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.825+0000 7f7398abe700 1 -- 172.21.15.125:0/1506814747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f739415e010 msgr2=0x7f73940d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.825+0000 7f7398abe700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f739415e010 0x7f73940d0300 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f738c007e60 tx=0x7f738c00e3c0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.825+0000 7f7398abe700 1 -- 172.21.15.125:0/1506814747 shutdown_connections 2023-11-28T11:11:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.825+0000 7f7398abe700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f739415e010 0x7f73940d0300 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.825+0000 7f7398abe700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f739406e400 0x7f7394140840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.825+0000 7f7398abe700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f73740682f0 0x7f737406a7a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.825+0000 7f7398abe700 1 --2- 172.21.15.125:0/1506814747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73940d15f0 0x7f73940cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.825+0000 7f7398abe700 1 -- 172.21.15.125:0/1506814747 >> 172.21.15.125:0/1506814747 conn(0x7f739406a270 msgr2=0x7f7394159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.825+0000 7f7398abe700 1 -- 172.21.15.125:0/1506814747 shutdown_connections 2023-11-28T11:11:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.825+0000 7f7398abe700 1 -- 172.21.15.125:0/1506814747 wait complete. 2023-11-28T11:11:39.838 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:11:39.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.957+0000 7f524dcc6700 1 Processor -- start 2023-11-28T11:11:39.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.957+0000 7f524dcc6700 1 -- start start 2023-11-28T11:11:39.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.957+0000 7f524dcc6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5248160e70 0x7f52480b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.957+0000 7f524dcc6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524806e900 con 0x7f524806e400 2023-11-28T11:11:39.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f524dcc6700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5248160390 con 0x7f52480d0c60 2023-11-28T11:11:39.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f524dcc6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5248160670 con 0x7f5248160e70 2023-11-28T11:11:39.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f5247fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5248160e70 0x7f52480b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f5246ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f524806e400 0x7f524815c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45376/0 (socket says 172.21.15.125:45376) 2023-11-28T11:11:39.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f5246ffd700 1 -- 172.21.15.125:0/622341238 learned_addr learned my addr 172.21.15.125:0/622341238 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:39.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f5247fff700 1 -- 172.21.15.125:0/622341238 >> v1:172.21.15.167:6789/0 conn(0x7f52480d0c60 legacy=0x7f52480d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:39.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f5247fff700 1 -- 172.21.15.125:0/622341238 >> v1:172.21.15.125:6789/0 conn(0x7f524806e400 legacy=0x7f524815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f5247fff700 1 -- 172.21.15.125:0/622341238 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5248160950 con 0x7f5248160e70 2023-11-28T11:11:39.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f5247fff700 1 --2- 172.21.15.125:0/622341238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5248160e70 0x7f52480b5be0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5240009d90 tx=0x7f524000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3147b681f159f20 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:39.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f52467fc700 1 -- 172.21.15.125:0/622341238 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000e070 con 0x7f5248160e70 2023-11-28T11:11:39.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f52467fc700 1 -- 172.21.15.125:0/622341238 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524000bb90 con 0x7f5248160e70 2023-11-28T11:11:39.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.958+0000 7f52467fc700 1 -- 172.21.15.125:0/622341238 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240003a20 con 0x7f5248160e70 2023-11-28T11:11:39.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.959+0000 7f524dcc6700 1 -- 172.21.15.125:0/622341238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5248160e70 msgr2=0x7f52480b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.959+0000 7f524dcc6700 1 --2- 172.21.15.125:0/622341238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5248160e70 0x7f52480b5be0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5240009d90 tx=0x7f524000b330 comp rx=0 tx=0).stop 2023-11-28T11:11:39.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.959+0000 7f524dcc6700 1 -- 172.21.15.125:0/622341238 shutdown_connections 2023-11-28T11:11:39.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.959+0000 7f524dcc6700 1 --2- 172.21.15.125:0/622341238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5248160e70 0x7f52480b5be0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.959+0000 7f524dcc6700 1 -- 172.21.15.125:0/622341238 >> 172.21.15.125:0/622341238 conn(0x7f524806a270 msgr2=0x7f524806a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:39.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.959+0000 7f524dcc6700 1 -- 172.21.15.125:0/622341238 shutdown_connections 2023-11-28T11:11:39.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.959+0000 7f524dcc6700 1 -- 172.21.15.125:0/622341238 wait complete. 2023-11-28T11:11:39.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.960+0000 7f524dcc6700 1 Processor -- start 2023-11-28T11:11:39.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.960+0000 7f524dcc6700 1 -- start start 2023-11-28T11:11:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f524dcc6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f524806e400 0x7f5248155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f524dcc6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52480d0c60 0x7f524815f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f524dcc6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5248160e70 0x7f5248151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f524dcc6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52480b3770 con 0x7f52480d0c60 2023-11-28T11:11:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f524dcc6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5248155a20 con 0x7f5248160e70 2023-11-28T11:11:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f524dcc6700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524815f850 con 0x7f524806e400 2023-11-28T11:11:39.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f5246ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52480d0c60 0x7f524815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f5246ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52480d0c60 0x7f524815f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33028/0 (socket says 172.21.15.125:33028) 2023-11-28T11:11:39.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f5246ffd700 1 -- 172.21.15.125:0/307165791 learned_addr learned my addr 172.21.15.125:0/307165791 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:39.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f52477fe700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f524806e400 0x7f5248155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f5247fff700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5248160e70 0x7f5248151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f5246ffd700 1 -- 172.21.15.125:0/307165791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f524806e400 msgr2=0x7f5248155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f5246ffd700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f524806e400 0x7f5248155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f5246ffd700 1 -- 172.21.15.125:0/307165791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5248160e70 msgr2=0x7f5248151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:39.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f5246ffd700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5248160e70 0x7f5248151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:39.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f5246ffd700 1 -- 172.21.15.125:0/307165791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5240009a70 con 0x7f52480d0c60 2023-11-28T11:11:39.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f5246ffd700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52480d0c60 0x7f524815f310 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f523c00c500 tx=0x7f523c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:39.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f522ffff700 1 -- 172.21.15.125:0/307165791 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c005d70 con 0x7f52480d0c60 2023-11-28T11:11:39.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.961+0000 7f522ffff700 1 -- 172.21.15.125:0/307165791 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c0070d0 con 0x7f52480d0c60 2023-11-28T11:11:39.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.962+0000 7f524dcc6700 1 -- 172.21.15.125:0/307165791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524815d080 con 0x7f52480d0c60 2023-11-28T11:11:39.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.962+0000 7f522ffff700 1 -- 172.21.15.125:0/307165791 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c007460 con 0x7f52480d0c60 2023-11-28T11:11:39.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.962+0000 7f524dcc6700 1 -- 172.21.15.125:0/307165791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52480d0740 con 0x7f52480d0c60 2023-11-28T11:11:39.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.962+0000 7f524dcc6700 1 -- 172.21.15.125:0/307165791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524815d210 con 0x7f52480d0c60 2023-11-28T11:11:39.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.963+0000 7f522ffff700 1 -- 172.21.15.125:0/307165791 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f523c019030 con 0x7f52480d0c60 2023-11-28T11:11:39.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.963+0000 7f522ffff700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52340682f0 0x7f523406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.963+0000 7f522ffff700 1 -- 172.21.15.125:0/307165791 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f523c084fe0 con 0x7f52480d0c60 2023-11-28T11:11:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.963+0000 7f52477fe700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52340682f0 0x7f523406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.964+0000 7f52477fe700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52340682f0 0x7f523406a7a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5248151f50 tx=0x7f5238009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:39.967+0000 7f522ffff700 1 -- 172.21.15.125:0/307165791 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f523c051840 con 0x7f52480d0c60 2023-11-28T11:11:40.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.151+0000 7f524dcc6700 1 -- 172.21.15.125:0/307165791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52480743f0 con 0x7f52480d0c60 2023-11-28T11:11:40.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.153+0000 7f522ffff700 1 -- 172.21.15.125:0/307165791 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+17982 (secure 0 0 0) 0x7f523c017090 con 0x7f52480d0c60 2023-11-28T11:11:40.153 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:40.153 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":65,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:11:39.472775+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:11:37.512888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T11:11:38.435309+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:11:40.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 -- 172.21.15.125:0/307165791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52340682f0 msgr2=0x7f523406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:40.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52340682f0 0x7f523406a7a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5248151f50 tx=0x7f5238009040 comp rx=0 tx=0).stop 2023-11-28T11:11:40.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 -- 172.21.15.125:0/307165791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52480d0c60 msgr2=0x7f524815f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:40.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52480d0c60 0x7f524815f310 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f523c00c500 tx=0x7f523c00c8c0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 -- 172.21.15.125:0/307165791 shutdown_connections 2023-11-28T11:11:40.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5248160e70 0x7f5248151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52340682f0 0x7f523406a7a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f524806e400 0x7f5248155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 --2- 172.21.15.125:0/307165791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52480d0c60 0x7f524815f310 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 -- 172.21.15.125:0/307165791 >> 172.21.15.125:0/307165791 conn(0x7f524806a270 msgr2=0x7f524806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:40.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 -- 172.21.15.125:0/307165791 shutdown_connections 2023-11-28T11:11:40.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.155+0000 7f524dcc6700 1 -- 172.21.15.125:0/307165791 wait complete. 2023-11-28T11:11:40.168 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:11:40.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.290+0000 7fbadfe2f700 1 Processor -- start 2023-11-28T11:11:40.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.290+0000 7fbadfe2f700 1 -- start start 2023-11-28T11:11:40.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbadfe2f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbad815a4d0 0x7fbad806a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:40.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbadfe2f700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbad806a7b0 0x7fbad80cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:40.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbadfe2f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbad80cdd50 0x7fbad80b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:40.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbadfe2f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad806ac30 con 0x7fbad815a4d0 2023-11-28T11:11:40.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbadfe2f700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad815e0d0 con 0x7fbad806a7b0 2023-11-28T11:11:40.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbadfe2f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80ce560 con 0x7fbad80cdd50 2023-11-28T11:11:40.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbaddbcb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbad815a4d0 0x7fbad806a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:40.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbaddbcb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbad815a4d0 0x7fbad806a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33034/0 (socket says 172.21.15.125:33034) 2023-11-28T11:11:40.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbaddbcb700 1 -- 172.21.15.125:0/3520143388 learned_addr learned my addr 172.21.15.125:0/3520143388 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbade3cc700 1 --2- 172.21.15.125:0/3520143388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbad80cdd50 0x7fbad80b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbaddbcb700 1 -- 172.21.15.125:0/3520143388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbad80cdd50 msgr2=0x7fbad80b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbadd3ca700 1 --2- 172.21.15.125:0/3520143388 >> v2:172.21.15.167:3300/0 conn(0x7fbad806a7b0 0x7fbad80cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:40.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbaddbcb700 1 --2- 172.21.15.125:0/3520143388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbad80cdd50 0x7fbad80b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbaddbcb700 1 -- 172.21.15.125:0/3520143388 >> v2:172.21.15.167:3300/0 conn(0x7fbad806a7b0 msgr2=0x7fbad80cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:40.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbaddbcb700 1 --2- 172.21.15.125:0/3520143388 >> v2:172.21.15.167:3300/0 conn(0x7fbad806a7b0 0x7fbad80cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbaddbcb700 1 -- 172.21.15.125:0/3520143388 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad815e320 con 0x7fbad815a4d0 2023-11-28T11:11:40.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbaddbcb700 1 --2- 172.21.15.125:0/3520143388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbad815a4d0 0x7fbad806a270 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbad8070e20 tx=0x7fbad4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52d3f756690f408 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:40.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbadcbc9700 1 -- 172.21.15.125:0/3520143388 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad400b870 con 0x7fbad815a4d0 2023-11-28T11:11:40.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbadcbc9700 1 -- 172.21.15.125:0/3520143388 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad400b9d0 con 0x7fbad815a4d0 2023-11-28T11:11:40.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.291+0000 7fbadcbc9700 1 -- 172.21.15.125:0/3520143388 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad400bd60 con 0x7fbad815a4d0 2023-11-28T11:11:40.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.292+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3520143388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbad815a4d0 msgr2=0x7fbad806a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:40.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.292+0000 7fbadfe2f700 1 --2- 172.21.15.125:0/3520143388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbad815a4d0 0x7fbad806a270 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbad8070e20 tx=0x7fbad4009bd0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.292+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3520143388 shutdown_connections 2023-11-28T11:11:40.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.292+0000 7fbadfe2f700 1 --2- 172.21.15.125:0/3520143388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbad80cdd50 0x7fbad80b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.292+0000 7fbadfe2f700 1 --2- 172.21.15.125:0/3520143388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbad815a4d0 0x7fbad806a270 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.292+0000 7fbadfe2f700 1 --2- 172.21.15.125:0/3520143388 >> v2:172.21.15.167:3300/0 conn(0x7fbad806a7b0 0x7fbad80cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.292+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3520143388 >> 172.21.15.125:0/3520143388 conn(0x7fbad806c010 msgr2=0x7fbad80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.292+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3520143388 shutdown_connections 2023-11-28T11:11:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.292+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3520143388 wait complete. 2023-11-28T11:11:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.293+0000 7fbadfe2f700 1 Processor -- start 2023-11-28T11:11:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.293+0000 7fbadfe2f700 1 -- start start 2023-11-28T11:11:40.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadfe2f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbad806a7b0 0x7fbad81519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadfe2f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbad80cdd50 0x7fbad8151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadfe2f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbad815a4d0 0x7fbad80b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadfe2f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad81f1850 con 0x7fbad80cdd50 2023-11-28T11:11:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadfe2f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8150140 con 0x7fbad815a4d0 2023-11-28T11:11:40.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadfe2f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad815c0a0 con 0x7fbad806a7b0 2023-11-28T11:11:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadd3ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbad80cdd50 0x7fbad8151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadd3ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbad80cdd50 0x7fbad8151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33040/0 (socket says 172.21.15.125:33040) 2023-11-28T11:11:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadd3ca700 1 -- 172.21.15.125:0/3903294814 learned_addr learned my addr 172.21.15.125:0/3903294814 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbaddbcb700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbad806a7b0 0x7fbad81519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:40.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbade3cc700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbad815a4d0 0x7fbad80b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:40.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadd3ca700 1 -- 172.21.15.125:0/3903294814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbad806a7b0 msgr2=0x7fbad81519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:40.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadd3ca700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbad806a7b0 0x7fbad81519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadd3ca700 1 -- 172.21.15.125:0/3903294814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbad815a4d0 msgr2=0x7fbad80b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:40.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadd3ca700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbad815a4d0 0x7fbad80b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadd3ca700 1 -- 172.21.15.125:0/3903294814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad4009550 con 0x7fbad80cdd50 2023-11-28T11:11:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbadd3ca700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbad80cdd50 0x7fbad8151ef0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbac800c7f0 tx=0x7fbac800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.294+0000 7fbace7fc700 1 -- 172.21.15.125:0/3903294814 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8004220 con 0x7fbad80cdd50 2023-11-28T11:11:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.295+0000 7fbace7fc700 1 -- 172.21.15.125:0/3903294814 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac8004380 con 0x7fbad80cdd50 2023-11-28T11:11:40.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.295+0000 7fbace7fc700 1 -- 172.21.15.125:0/3903294814 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80036a0 con 0x7fbad80cdd50 2023-11-28T11:11:40.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.295+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3903294814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad815e8e0 con 0x7fbad80cdd50 2023-11-28T11:11:40.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.295+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3903294814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad815e600 con 0x7fbad80cdd50 2023-11-28T11:11:40.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.295+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3903294814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad815a8a0 con 0x7fbad80cdd50 2023-11-28T11:11:40.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.296+0000 7fbace7fc700 1 -- 172.21.15.125:0/3903294814 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbac8020070 con 0x7fbad80cdd50 2023-11-28T11:11:40.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.296+0000 7fbace7fc700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbabc0682f0 0x7fbabc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:40.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.296+0000 7fbace7fc700 1 -- 172.21.15.125:0/3903294814 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbac80855c0 con 0x7fbad80cdd50 2023-11-28T11:11:40.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.296+0000 7fbaddbcb700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbabc0682f0 0x7fbabc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:40.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.297+0000 7fbaddbcb700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbabc0682f0 0x7fbabc06a7a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbad4014040 tx=0x7fbad4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:40.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.300+0000 7fbace7fc700 1 -- 172.21.15.125:0/3903294814 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbac8051e20 con 0x7fbad80cdd50 2023-11-28T11:11:40.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:40.529+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3903294814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbad81502b0 con 0x7fbad80cdd50 2023-11-28T11:11:41.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.493+0000 7fbace7fc700 1 -- 172.21.15.125:0/3903294814 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbac8055440 con 0x7fbad80cdd50 2023-11-28T11:11:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3903294814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbabc0682f0 msgr2=0x7fbabc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbabc0682f0 0x7fbabc06a7a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbad4014040 tx=0x7fbad4008030 comp rx=0 tx=0).stop 2023-11-28T11:11:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3903294814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbad80cdd50 msgr2=0x7fbad8151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbad80cdd50 0x7fbad8151ef0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbac800c7f0 tx=0x7fbac800cb00 comp rx=0 tx=0).stop 2023-11-28T11:11:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3903294814 shutdown_connections 2023-11-28T11:11:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbad815a4d0 0x7fbad80b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbabc0682f0 0x7fbabc06a7a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbad806a7b0 0x7fbad81519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 --2- 172.21.15.125:0/3903294814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbad80cdd50 0x7fbad8151ef0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3903294814 >> 172.21.15.125:0/3903294814 conn(0x7fbad806c010 msgr2=0x7fbad81559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3903294814 shutdown_connections 2023-11-28T11:11:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.496+0000 7fbadfe2f700 1 -- 172.21.15.125:0/3903294814 wait complete. 2023-11-28T11:11:41.511 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T11:11:41.511 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.640+0000 7fb204021700 1 Processor -- start 2023-11-28T11:11:41.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.640+0000 7fb204021700 1 -- start start 2023-11-28T11:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.641+0000 7fb204021700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc06a980 0x7fb1fc0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.641+0000 7fb204021700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc15cc10 con 0x7fb1fc0cf710 2023-11-28T11:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.641+0000 7fb204021700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc06c9b0 con 0x7fb1fc071890 2023-11-28T11:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.641+0000 7fb204021700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc06cc90 con 0x7fb1fc06a980 2023-11-28T11:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.641+0000 7fb201dbd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb1fc0cf710 0x7fb1fc06a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45402/0 (socket says 172.21.15.125:45402) 2023-11-28T11:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.641+0000 7fb201dbd700 1 -- 172.21.15.125:0/3725786307 learned_addr learned my addr 172.21.15.125:0/3725786307 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:41.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.641+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158361005 0 0) 0x7fb1fc15cc10 con 0x7fb1fc0cf710 2023-11-28T11:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.641+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e80035b0 con 0x7fb1fc0cf710 2023-11-28T11:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.641+0000 7fb2015bc700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc06a980 0x7fb1fc0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 224739282 0 0) 0x7fb1e80035b0 con 0x7fb1fc0cf710 2023-11-28T11:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc06a980 msgr2=0x7fb1fc0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc06a980 0x7fb1fc0ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 >> v1:172.21.15.167:6789/0 conn(0x7fb1fc071890 legacy=0x7fb1fc160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc06cf70 con 0x7fb1fc0cf710 2023-11-28T11:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fb1ec001670 con 0x7fb1fc0cf710 2023-11-28T11:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 >> v1:172.21.15.125:6789/0 conn(0x7fb1fc0cf710 legacy=0x7fb1fc06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 0x7fb1e8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:41.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1e8004850 0x7fb1e8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc06a980 0x7fb1e8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc06cc90 con 0x7fb1e8003a30 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e800bb40 con 0x7fb1e8004850 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e800bd00 con 0x7fb1fc06a980 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb201dbd700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 0x7fb1e8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb2015bc700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1e8004850 0x7fb1e8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb2025be700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc06a980 0x7fb1e8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb201dbd700 1 -- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc06a980 msgr2=0x7fb1e8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb201dbd700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc06a980 0x7fb1e8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb201dbd700 1 -- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1e8004850 msgr2=0x7fb1e8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb201dbd700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1e8004850 0x7fb1e8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:41.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb201dbd700 1 -- 172.21.15.125:0/3725786307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80035b0 con 0x7fb1e8003a30 2023-11-28T11:11:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb2015bc700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1e8004850 0x7fb1e8004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb201dbd700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 0x7fb1e8003e40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec00c240 tx=0x7fb1e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c19e1993deedc7a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec007c10 con 0x7fb1e8003a30 2023-11-28T11:11:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec00cde0 con 0x7fb1e8003a30 2023-11-28T11:11:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.642+0000 7fb200dbb700 1 -- 172.21.15.125:0/3725786307 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec005ba0 con 0x7fb1e8003a30 2023-11-28T11:11:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.643+0000 7fb204021700 1 -- 172.21.15.125:0/3725786307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 msgr2=0x7fb1e8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.643+0000 7fb204021700 1 --2- 172.21.15.125:0/3725786307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 0x7fb1e8003e40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec00c240 tx=0x7fb1e8005880 comp rx=0 tx=0).stop 2023-11-28T11:11:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.643+0000 7fb2025be700 1 -- 172.21.15.125:0/3725786307 reap_dead start 2023-11-28T11:11:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.643+0000 7fb204021700 1 -- 172.21.15.125:0/3725786307 shutdown_connections 2023-11-28T11:11:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.643+0000 7fb204021700 1 -- 172.21.15.125:0/3725786307 >> 172.21.15.125:0/3725786307 conn(0x7fb1fc06c010 msgr2=0x7fb1fc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:41.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.643+0000 7fb204021700 1 -- 172.21.15.125:0/3725786307 shutdown_connections 2023-11-28T11:11:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.643+0000 7fb204021700 1 -- 172.21.15.125:0/3725786307 wait complete. 2023-11-28T11:11:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.644+0000 7fb204021700 1 Processor -- start 2023-11-28T11:11:41.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.644+0000 7fb204021700 1 -- start start 2023-11-28T11:11:41.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb204021700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 0x7fb1fc148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb204021700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc151e70 0x7fb1fc155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb204021700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1fc15f4d0 0x7fb1fc0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb204021700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc1494d0 con 0x7fb1e8003a30 2023-11-28T11:11:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb204021700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc152680 con 0x7fb1fc15f4d0 2023-11-28T11:11:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb204021700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc155d80 con 0x7fb1fc151e70 2023-11-28T11:11:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb201dbd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 0x7fb1fc148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb201dbd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 0x7fb1fc148f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33058/0 (socket says 172.21.15.125:33058) 2023-11-28T11:11:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb201dbd700 1 -- 172.21.15.125:0/3476603021 learned_addr learned my addr 172.21.15.125:0/3476603021 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb2015bc700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc151e70 0x7fb1fc155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb2025be700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1fc15f4d0 0x7fb1fc0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:41.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb201dbd700 1 -- 172.21.15.125:0/3476603021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc151e70 msgr2=0x7fb1fc155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb201dbd700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc151e70 0x7fb1fc155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb201dbd700 1 -- 172.21.15.125:0/3476603021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1fc15f4d0 msgr2=0x7fb1fc0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb201dbd700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1fc15f4d0 0x7fb1fc0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb201dbd700 1 -- 172.21.15.125:0/3476603021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc06d530 con 0x7fb1e8003a30 2023-11-28T11:11:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.645+0000 7fb201dbd700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 0x7fb1fc148f90 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec00c830 tx=0x7fb1ec001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.646+0000 7fb1f27fc700 1 -- 172.21.15.125:0/3476603021 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec001640 con 0x7fb1e8003a30 2023-11-28T11:11:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.646+0000 7fb1f27fc700 1 -- 172.21.15.125:0/3476603021 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec0070d0 con 0x7fb1e8003a30 2023-11-28T11:11:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.646+0000 7fb204021700 1 -- 172.21.15.125:0/3476603021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc06d250 con 0x7fb1e8003a30 2023-11-28T11:11:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.646+0000 7fb1f27fc700 1 -- 172.21.15.125:0/3476603021 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0074a0 con 0x7fb1e8003a30 2023-11-28T11:11:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.646+0000 7fb204021700 1 -- 172.21.15.125:0/3476603021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc0ce740 con 0x7fb1e8003a30 2023-11-28T11:11:41.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.647+0000 7fb204021700 1 -- 172.21.15.125:0/3476603021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc0743f0 con 0x7fb1e8003a30 2023-11-28T11:11:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.647+0000 7fb1f27fc700 1 -- 172.21.15.125:0/3476603021 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb1ec010070 con 0x7fb1e8003a30 2023-11-28T11:11:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.647+0000 7fb1f27fc700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb1e0068320 0x7fb1e006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.647+0000 7fb1f27fc700 1 -- 172.21.15.125:0/3476603021 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb1ec0870d0 con 0x7fb1e8003a30 2023-11-28T11:11:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.647+0000 7fb2015bc700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb1e0068320 0x7fb1e006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.648+0000 7fb2015bc700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb1e0068320 0x7fb1e006a7d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc1555d0 tx=0x7fb1f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:41.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.652+0000 7fb1f27fc700 1 -- 172.21.15.125:0/3476603021 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb1ec053930 con 0x7fb1e8003a30 2023-11-28T11:11:41.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:41.879+0000 7fb204021700 1 -- 172.21.15.125:0/3476603021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb1fc0afe00 con 0x7fb1e8003a30 2023-11-28T11:11:42.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.498+0000 7fb1f27fc700 1 -- 172.21.15.125:0/3476603021 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb1ec056f50 con 0x7fb1e8003a30 2023-11-28T11:11:42.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 -- 172.21.15.125:0/3476603021 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb1e0068320 msgr2=0x7fb1e006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:42.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb1e0068320 0x7fb1e006a7d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc1555d0 tx=0x7fb1f8008040 comp rx=0 tx=0).stop 2023-11-28T11:11:42.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 -- 172.21.15.125:0/3476603021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 msgr2=0x7fb1fc148f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:42.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 0x7fb1fc148f90 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec00c830 tx=0x7fb1ec001a00 comp rx=0 tx=0).stop 2023-11-28T11:11:42.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 -- 172.21.15.125:0/3476603021 shutdown_connections 2023-11-28T11:11:42.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1fc15f4d0 0x7fb1fc0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e8003a30 0x7fb1fc148f90 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb1e0068320 0x7fb1e006a7d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 --2- 172.21.15.125:0/3476603021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1fc151e70 0x7fb1fc155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 -- 172.21.15.125:0/3476603021 >> 172.21.15.125:0/3476603021 conn(0x7fb1fc06c010 msgr2=0x7fb1fc0ae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:42.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 -- 172.21.15.125:0/3476603021 shutdown_connections 2023-11-28T11:11:42.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.500+0000 7fb204021700 1 -- 172.21.15.125:0/3476603021 wait complete. 2023-11-28T11:11:42.515 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:11:42.515 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:11:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.637+0000 7f5ed2fe9700 1 Processor -- start 2023-11-28T11:11:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.637+0000 7f5ed2fe9700 1 -- start start 2023-11-28T11:11:42.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.638+0000 7f5ed2fe9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ecc06e400 0x7f5ecc06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:42.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.638+0000 7f5ed2fe9700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ecc15e010 0x7f5ecc0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:42.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.638+0000 7f5ed2fe9700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc15af30 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.638+0000 7f5ed2fe9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc15a9d0 con 0x7f5ecc06e400 2023-11-28T11:11:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.638+0000 7f5ed2fe9700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc1584e0 con 0x7f5ecc15e010 2023-11-28T11:11:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.638+0000 7f5ed0d85700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ecc06e400 0x7f5ecc06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.638+0000 7f5ed0d85700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ecc06e400 0x7f5ecc06e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33066/0 (socket says 172.21.15.125:33066) 2023-11-28T11:11:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.638+0000 7f5ed0d85700 1 -- 172.21.15.125:0/2077510728 learned_addr learned my addr 172.21.15.125:0/2077510728 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.638+0000 7f5ed1586700 1 --2- 172.21.15.125:0/2077510728 >> v2:172.21.15.167:3300/0 conn(0x7f5ecc15e010 0x7f5ecc0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed0d85700 1 -- 172.21.15.125:0/2077510728 >> v2:172.21.15.167:3300/0 conn(0x7f5ecc15e010 msgr2=0x7f5ecc0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed0d85700 1 --2- 172.21.15.125:0/2077510728 >> v2:172.21.15.167:3300/0 conn(0x7f5ecc15e010 0x7f5ecc0ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed0d85700 1 -- 172.21.15.125:0/2077510728 >> v1:172.21.15.167:6789/0 conn(0x7f5ecc0d15f0 legacy=0x7f5ecc15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed0d85700 1 -- 172.21.15.125:0/2077510728 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc15ef40 con 0x7f5ecc06e400 2023-11-28T11:11:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed0d85700 1 --2- 172.21.15.125:0/2077510728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ecc06e400 0x7f5ecc06e7d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0b60f0 tx=0x7f5ec0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7da4b7f19f8aee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ecb7fe700 1 -- 172.21.15.125:0/2077510728 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000b870 con 0x7f5ecc06e400 2023-11-28T11:11:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ecb7fe700 1 -- 172.21.15.125:0/2077510728 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec000b9d0 con 0x7f5ecc06e400 2023-11-28T11:11:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ecb7fe700 1 -- 172.21.15.125:0/2077510728 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000bd60 con 0x7f5ecc06e400 2023-11-28T11:11:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/2077510728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ecc06e400 msgr2=0x7f5ecc06e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed2fe9700 1 --2- 172.21.15.125:0/2077510728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ecc06e400 0x7f5ecc06e7d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0b60f0 tx=0x7f5ec0009bd0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/2077510728 shutdown_connections 2023-11-28T11:11:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed2fe9700 1 --2- 172.21.15.125:0/2077510728 >> v2:172.21.15.167:3300/0 conn(0x7f5ecc15e010 0x7f5ecc0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed2fe9700 1 --2- 172.21.15.125:0/2077510728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ecc06e400 0x7f5ecc06e7d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/2077510728 >> 172.21.15.125:0/2077510728 conn(0x7f5ecc06a270 msgr2=0x7f5ecc06a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/2077510728 shutdown_connections 2023-11-28T11:11:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.639+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/2077510728 wait complete. 2023-11-28T11:11:42.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.641+0000 7f5ed2fe9700 1 Processor -- start 2023-11-28T11:11:42.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.641+0000 7f5ed2fe9700 1 -- start start 2023-11-28T11:11:42.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.641+0000 7f5ed2fe9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ecc06e400 0x7f5ecc15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.641+0000 7f5ed2fe9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ecc0d15f0 0x7f5ecc0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.641+0000 7f5ed2fe9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ecc15e010 0x7f5ecc147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.641+0000 7f5ed2fe9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc147e80 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.641+0000 7f5ed2fe9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0b0e60 con 0x7f5ecc06e400 2023-11-28T11:11:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ed2fe9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0b1140 con 0x7f5ecc15e010 2023-11-28T11:11:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ecbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ecc0d15f0 0x7f5ecc0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ecbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ecc0d15f0 0x7f5ecc0b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33074/0 (socket says 172.21.15.125:33074) 2023-11-28T11:11:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ecbfff700 1 -- 172.21.15.125:0/1513634069 learned_addr learned my addr 172.21.15.125:0/1513634069 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ed1586700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ecc15e010 0x7f5ecc147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ed0d85700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ecc06e400 0x7f5ecc15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ecbfff700 1 -- 172.21.15.125:0/1513634069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ecc15e010 msgr2=0x7f5ecc147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:42.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ecbfff700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ecc15e010 0x7f5ecc147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ecbfff700 1 -- 172.21.15.125:0/1513634069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ecc06e400 msgr2=0x7f5ecc15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:42.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ecbfff700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ecc06e400 0x7f5ecc15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ecbfff700 1 -- 172.21.15.125:0/1513634069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec0009550 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ed1586700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ecc15e010 0x7f5ecc147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:42.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ecbfff700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ecc0d15f0 0x7f5ecc0b0760 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800c4b0 tx=0x7f5eb800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:42.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ec97fa700 1 -- 172.21.15.125:0/1513634069 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80052d0 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ec97fa700 1 -- 172.21.15.125:0/1513634069 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb8005430 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/1513634069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc15e980 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ec97fa700 1 -- 172.21.15.125:0/1513634069 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80038c0 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.642+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/1513634069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc06ed10 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.643+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/1513634069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc15ec60 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.644+0000 7f5ec97fa700 1 -- 172.21.15.125:0/1513634069 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5eb8019030 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.644+0000 7f5ec97fa700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5eb00682f0 0x7f5eb006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.644+0000 7f5ec97fa700 1 -- 172.21.15.125:0/1513634069 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5eb8084ff0 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.644+0000 7f5ed0d85700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5eb00682f0 0x7f5eb006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.644+0000 7f5ed0d85700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5eb00682f0 0x7f5eb006a7a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0000c00 tx=0x7f5ec0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.648+0000 7f5ec97fa700 1 -- 172.21.15.125:0/1513634069 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5eb8051850 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.871+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/1513634069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ecc0743f0 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.872+0000 7f5ec97fa700 1 -- 172.21.15.125:0/1513634069 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4661 (secure 0 0 0) 0x7f5eb8054e70 con 0x7f5ecc0d15f0 2023-11-28T11:11:42.874 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:42.874 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5710,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3518974696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3518974696},{"type":"v1","addr":"172.21.15.167:6834","nonce":3518974696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/2475008501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2475008501},{"type":"v1","addr":"172.21.15.125:6836","nonce":2475008501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2392518832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":2392518832},{"type":"v1","addr":"172.21.15.125:6837","nonce":2392518832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:11:39.473096+0000","modified":"2023-11-28T11:11:42.492030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/1701437437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1701437437},{"type":"v1","addr":"172.21.15.167:6835","nonce":1701437437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:11:42.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/1513634069 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5eb00682f0 msgr2=0x7f5eb006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:42.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5eb00682f0 0x7f5eb006a7a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0000c00 tx=0x7f5ec0008030 comp rx=0 tx=0).stop 2023-11-28T11:11:42.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/1513634069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ecc0d15f0 msgr2=0x7f5ecc0b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:42.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ecc0d15f0 0x7f5ecc0b0760 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800c4b0 tx=0x7f5eb800c870 comp rx=0 tx=0).stop 2023-11-28T11:11:42.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/1513634069 shutdown_connections 2023-11-28T11:11:42.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5eb00682f0 0x7f5eb006a7a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ecc15e010 0x7f5ecc147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ecc06e400 0x7f5ecc15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 --2- 172.21.15.125:0/1513634069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ecc0d15f0 0x7f5ecc0b0760 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:42.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/1513634069 >> 172.21.15.125:0/1513634069 conn(0x7f5ecc06a270 msgr2=0x7f5ecc159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:42.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/1513634069 shutdown_connections 2023-11-28T11:11:42.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:42.874+0000 7f5ed2fe9700 1 -- 172.21.15.125:0/1513634069 wait complete. 2023-11-28T11:11:42.876 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 31 2023-11-28T11:11:42.887 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:11:43.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.006+0000 7f354b364700 1 Processor -- start 2023-11-28T11:11:43.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.006+0000 7f354b364700 1 -- start start 2023-11-28T11:11:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.007+0000 7f354b364700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35440d0c60 0x7f35440b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.007+0000 7f354b364700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f354406e400 0x7f35440d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.007+0000 7f354b364700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35440d1570 con 0x7f3544160e70 2023-11-28T11:11:43.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.007+0000 7f354b364700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354406e900 con 0x7f354406e400 2023-11-28T11:11:43.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.007+0000 7f354b364700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3544160390 con 0x7f35440d0c60 2023-11-28T11:11:43.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.007+0000 7f3549901700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3544160e70 0x7f354406f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45440/0 (socket says 172.21.15.125:45440) 2023-11-28T11:11:43.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.007+0000 7f3549901700 1 -- 172.21.15.125:0/3901200009 learned_addr learned my addr 172.21.15.125:0/3901200009 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:43.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.007+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792649285 0 0) 0x7f35440d1570 con 0x7f3544160e70 2023-11-28T11:11:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.007+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35300035b0 con 0x7f3544160e70 2023-11-28T11:11:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.007+0000 7f35488ff700 1 --2- 172.21.15.125:0/3901200009 >> v2:172.21.15.167:3300/0 conn(0x7f354406e400 0x7f35440d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.007+0000 7f3549100700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35440d0c60 0x7f35440b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3903937239 0 0) 0x7f35300035b0 con 0x7f3544160e70 2023-11-28T11:11:43.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35440d0c60 msgr2=0x7f35440b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:43.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35440d0c60 0x7f35440b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 >> v2:172.21.15.167:3300/0 conn(0x7f354406e400 msgr2=0x7f35440d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:43.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 --2- 172.21.15.125:0/3901200009 >> v2:172.21.15.167:3300/0 conn(0x7f354406e400 0x7f35440d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3544160670 con 0x7f3544160e70 2023-11-28T11:11:43.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f353c0019f0 con 0x7f3544160e70 2023-11-28T11:11:43.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 >> v1:172.21.15.125:6789/0 conn(0x7f3544160e70 legacy=0x7f354406f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3530003a00 0x7f3530003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35440d0c60 0x7f3530004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3530004d90 0x7f3530005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354406e900 con 0x7f3530004d90 2023-11-28T11:11:43.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544160390 con 0x7f3530003a00 2023-11-28T11:11:43.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353000ba10 con 0x7f35440d0c60 2023-11-28T11:11:43.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f3549901700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3530004d90 0x7f3530005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f35488ff700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35440d0c60 0x7f3530004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f3549100700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3530003a00 0x7f3530003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f3549901700 1 -- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35440d0c60 msgr2=0x7f3530004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f3549901700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35440d0c60 0x7f3530004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f3549901700 1 -- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3530003a00 msgr2=0x7f3530003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f3549901700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3530003a00 0x7f3530003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f3549901700 1 -- 172.21.15.125:0/3901200009 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300035b0 con 0x7f3530004d90 2023-11-28T11:11:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f35488ff700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35440d0c60 0x7f3530004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f3549100700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3530003a00 0x7f3530003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f3549901700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3530004d90 0x7f3530005200 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f35441612f0 tx=0x7f3530005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2114750987ce567a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c00a340 con 0x7f3530004d90 2023-11-28T11:11:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c012600 con 0x7f3530004d90 2023-11-28T11:11:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.008+0000 7f353bfff700 1 -- 172.21.15.125:0/3901200009 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0129b0 con 0x7f3530004d90 2023-11-28T11:11:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.009+0000 7f354b364700 1 -- 172.21.15.125:0/3901200009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3530004d90 msgr2=0x7f3530005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.009+0000 7f354b364700 1 --2- 172.21.15.125:0/3901200009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3530004d90 0x7f3530005200 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f35441612f0 tx=0x7f3530005880 comp rx=0 tx=0).stop 2023-11-28T11:11:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.009+0000 7f3549901700 1 -- 172.21.15.125:0/3901200009 reap_dead start 2023-11-28T11:11:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.009+0000 7f354b364700 1 -- 172.21.15.125:0/3901200009 shutdown_connections 2023-11-28T11:11:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.009+0000 7f354b364700 1 -- 172.21.15.125:0/3901200009 >> 172.21.15.125:0/3901200009 conn(0x7f354406a270 msgr2=0x7f354406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.009+0000 7f354b364700 1 -- 172.21.15.125:0/3901200009 shutdown_connections 2023-11-28T11:11:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.009+0000 7f354b364700 1 -- 172.21.15.125:0/3901200009 wait complete. 2023-11-28T11:11:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.010+0000 7f354b364700 1 Processor -- start 2023-11-28T11:11:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.010+0000 7f354b364700 1 -- start start 2023-11-28T11:11:43.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f354b364700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3530004d90 0x7f35441484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f354b364700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35441e6ee0 0x7f35440b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f354b364700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35441e7350 0x7f35440b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f354b364700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35441e6ac0 con 0x7f35441e6ee0 2023-11-28T11:11:43.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f354b364700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354415b990 con 0x7f35441e7350 2023-11-28T11:11:43.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f354b364700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35441e6160 con 0x7f3530004d90 2023-11-28T11:11:43.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f35488ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35441e6ee0 0x7f35440b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f35488ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35441e6ee0 0x7f35440b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33092/0 (socket says 172.21.15.125:33092) 2023-11-28T11:11:43.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f35488ff700 1 -- 172.21.15.125:0/2655365429 learned_addr learned my addr 172.21.15.125:0/2655365429 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:43.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f3549100700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3530004d90 0x7f35441484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f3549901700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35441e7350 0x7f35440b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f35488ff700 1 -- 172.21.15.125:0/2655365429 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3530004d90 msgr2=0x7f35441484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f35488ff700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3530004d90 0x7f35441484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f35488ff700 1 -- 172.21.15.125:0/2655365429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35441e7350 msgr2=0x7f35440b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f35488ff700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35441e7350 0x7f35440b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.011+0000 7f35488ff700 1 -- 172.21.15.125:0/2655365429 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35440d0740 con 0x7f35441e6ee0 2023-11-28T11:11:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.012+0000 7f35488ff700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35441e6ee0 0x7f35440b2990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3540010810 tx=0x7f3540010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.012+0000 7f3539ffb700 1 -- 172.21.15.125:0/2655365429 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540015880 con 0x7f35441e6ee0 2023-11-28T11:11:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.012+0000 7f3539ffb700 1 -- 172.21.15.125:0/2655365429 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354000c050 con 0x7f35441e6ee0 2023-11-28T11:11:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.012+0000 7f354b364700 1 -- 172.21.15.125:0/2655365429 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3544160950 con 0x7f35441e6ee0 2023-11-28T11:11:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.012+0000 7f3539ffb700 1 -- 172.21.15.125:0/2655365429 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540015c00 con 0x7f35441e6ee0 2023-11-28T11:11:43.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.012+0000 7f354b364700 1 -- 172.21.15.125:0/2655365429 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354415d980 con 0x7f35441e6ee0 2023-11-28T11:11:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.013+0000 7f354b364700 1 -- 172.21.15.125:0/2655365429 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35440743f0 con 0x7f35441e6ee0 2023-11-28T11:11:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.013+0000 7f3539ffb700 1 -- 172.21.15.125:0/2655365429 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3540026070 con 0x7f35441e6ee0 2023-11-28T11:11:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.014+0000 7f3539ffb700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35280682f0 0x7f352806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.014+0000 7f3539ffb700 1 -- 172.21.15.125:0/2655365429 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3540086620 con 0x7f35441e6ee0 2023-11-28T11:11:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.014+0000 7f3549100700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35280682f0 0x7f352806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.014+0000 7f3549100700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35280682f0 0x7f352806a7a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3534009a90 tx=0x7f3534008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:43.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.018+0000 7f3539ffb700 1 -- 172.21.15.125:0/2655365429 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3540052d90 con 0x7f35441e6ee0 2023-11-28T11:11:43.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.202+0000 7f354b364700 1 -- 172.21.15.125:0/2655365429 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f354406dcd0 con 0x7f35441e6ee0 2023-11-28T11:11:43.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.203+0000 7f3539ffb700 1 -- 172.21.15.125:0/2655365429 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+17969 (secure 0 0 0) 0x7f3540027350 con 0x7f35441e6ee0 2023-11-28T11:11:43.204 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:43.204 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":66,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:11:40.474921+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:11:37.512888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T11:11:38.435309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:11:43.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.205+0000 7f354b364700 1 -- 172.21.15.125:0/2655365429 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35280682f0 msgr2=0x7f352806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.205+0000 7f354b364700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35280682f0 0x7f352806a7a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3534009a90 tx=0x7f3534008040 comp rx=0 tx=0).stop 2023-11-28T11:11:43.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.205+0000 7f354b364700 1 -- 172.21.15.125:0/2655365429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35441e6ee0 msgr2=0x7f35440b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.205+0000 7f354b364700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35441e6ee0 0x7f35440b2990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3540010810 tx=0x7f3540010bd0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.205+0000 7f354b364700 1 -- 172.21.15.125:0/2655365429 shutdown_connections 2023-11-28T11:11:43.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.205+0000 7f354b364700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35441e7350 0x7f35440b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.205+0000 7f354b364700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35280682f0 0x7f352806a7a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.205+0000 7f354b364700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3530004d90 0x7f35441484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.205+0000 7f354b364700 1 --2- 172.21.15.125:0/2655365429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35441e6ee0 0x7f35440b2990 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.205+0000 7f354b364700 1 -- 172.21.15.125:0/2655365429 >> 172.21.15.125:0/2655365429 conn(0x7f354406a270 msgr2=0x7f354415f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:43.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.205+0000 7f354b364700 1 -- 172.21.15.125:0/2655365429 shutdown_connections 2023-11-28T11:11:43.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.206+0000 7f354b364700 1 -- 172.21.15.125:0/2655365429 wait complete. 2023-11-28T11:11:43.219 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:11:43.219 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:11:43.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.338+0000 7fdd4bf7f700 1 Processor -- start 2023-11-28T11:11:43.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.338+0000 7fdd4bf7f700 1 -- start start 2023-11-28T11:11:43.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4bf7f700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdd4406e400 0x7fdd4406e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4bf7f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd440d15f0 0x7fdd4415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4bf7f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4415af30 con 0x7fdd4415e010 2023-11-28T11:11:43.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4bf7f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4415a9d0 con 0x7fdd440d15f0 2023-11-28T11:11:43.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4bf7f700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd441584e0 con 0x7fdd4406e400 2023-11-28T11:11:43.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4951a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd440d15f0 0x7fdd4415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4a51c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdd4415e010 0x7fdd440ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45460/0 (socket says 172.21.15.125:45460) 2023-11-28T11:11:43.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4a51c700 1 -- 172.21.15.125:0/669329413 learned_addr learned my addr 172.21.15.125:0/669329413 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:43.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd49d1b700 1 --2- 172.21.15.125:0/669329413 >> v2:172.21.15.167:3300/0 conn(0x7fdd4406e400 0x7fdd4406e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4951a700 1 -- 172.21.15.125:0/669329413 >> v2:172.21.15.167:3300/0 conn(0x7fdd4406e400 msgr2=0x7fdd4406e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:43.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4951a700 1 --2- 172.21.15.125:0/669329413 >> v2:172.21.15.167:3300/0 conn(0x7fdd4406e400 0x7fdd4406e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4951a700 1 -- 172.21.15.125:0/669329413 >> v1:172.21.15.125:6789/0 conn(0x7fdd4415e010 legacy=0x7fdd440ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd48d19700 1 -- 172.21.15.125:0/669329413 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686584056 0 0) 0x7fdd4415af30 con 0x7fdd4415e010 2023-11-28T11:11:43.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4951a700 1 -- 172.21.15.125:0/669329413 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4415ef40 con 0x7fdd440d15f0 2023-11-28T11:11:43.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd49d1b700 1 --2- 172.21.15.125:0/669329413 >> v2:172.21.15.167:3300/0 conn(0x7fdd4406e400 0x7fdd4406e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:43.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.339+0000 7fdd4951a700 1 --2- 172.21.15.125:0/669329413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd440d15f0 0x7fdd4415b3c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fdd440cd900 tx=0x7fdd34009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574ebc0a86fd1ab0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:43.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.340+0000 7fdd48d19700 1 -- 172.21.15.125:0/669329413 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34011830 con 0x7fdd440d15f0 2023-11-28T11:11:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.340+0000 7fdd48d19700 1 -- 172.21.15.125:0/669329413 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd34011990 con 0x7fdd440d15f0 2023-11-28T11:11:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.340+0000 7fdd48d19700 1 -- 172.21.15.125:0/669329413 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34011d20 con 0x7fdd440d15f0 2023-11-28T11:11:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.340+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/669329413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd440d15f0 msgr2=0x7fdd4415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.340+0000 7fdd4bf7f700 1 --2- 172.21.15.125:0/669329413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd440d15f0 0x7fdd4415b3c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fdd440cd900 tx=0x7fdd34009b20 comp rx=0 tx=0).stop 2023-11-28T11:11:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.340+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/669329413 shutdown_connections 2023-11-28T11:11:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.340+0000 7fdd4bf7f700 1 --2- 172.21.15.125:0/669329413 >> v2:172.21.15.167:3300/0 conn(0x7fdd4406e400 0x7fdd4406e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.340+0000 7fdd4bf7f700 1 --2- 172.21.15.125:0/669329413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd440d15f0 0x7fdd4415b3c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.340+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/669329413 >> 172.21.15.125:0/669329413 conn(0x7fdd4406a270 msgr2=0x7fdd4406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.340+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/669329413 shutdown_connections 2023-11-28T11:11:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.340+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/669329413 wait complete. 2023-11-28T11:11:43.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.341+0000 7fdd4bf7f700 1 Processor -- start 2023-11-28T11:11:43.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.341+0000 7fdd4bf7f700 1 -- start start 2023-11-28T11:11:43.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.342+0000 7fdd4bf7f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd4406e400 0x7fdd440cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.342+0000 7fdd4bf7f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd440d15f0 0x7fdd4406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.342+0000 7fdd4bf7f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd4415e010 0x7fdd440cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.342+0000 7fdd4bf7f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4414ce60 con 0x7fdd440d15f0 2023-11-28T11:11:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.342+0000 7fdd4bf7f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd440cc9c0 con 0x7fdd4406e400 2023-11-28T11:11:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.342+0000 7fdd4bf7f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4414c890 con 0x7fdd4415e010 2023-11-28T11:11:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.342+0000 7fdd4951a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd440d15f0 0x7fdd4406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.342+0000 7fdd4951a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd440d15f0 0x7fdd4406cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33108/0 (socket says 172.21.15.125:33108) 2023-11-28T11:11:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.342+0000 7fdd4951a700 1 -- 172.21.15.125:0/3119904877 learned_addr learned my addr 172.21.15.125:0/3119904877 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.342+0000 7fdd49d1b700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd4406e400 0x7fdd440cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.342+0000 7fdd4a51c700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd4415e010 0x7fdd440cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd4951a700 1 -- 172.21.15.125:0/3119904877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd4415e010 msgr2=0x7fdd440cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd4951a700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd4415e010 0x7fdd440cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd4951a700 1 -- 172.21.15.125:0/3119904877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd4406e400 msgr2=0x7fdd440cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd4951a700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd4406e400 0x7fdd440cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd4951a700 1 -- 172.21.15.125:0/3119904877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd340094a0 con 0x7fdd440d15f0 2023-11-28T11:11:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd49d1b700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd4406e400 0x7fdd440cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd4951a700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd440d15f0 0x7fdd4406cf30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009b60 tx=0x7fdd34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd3a7fc700 1 -- 172.21.15.125:0/3119904877 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd340036a0 con 0x7fdd440d15f0 2023-11-28T11:11:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd3a7fc700 1 -- 172.21.15.125:0/3119904877 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3401f070 con 0x7fdd440d15f0 2023-11-28T11:11:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd3a7fc700 1 -- 172.21.15.125:0/3119904877 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34003a20 con 0x7fdd440d15f0 2023-11-28T11:11:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/3119904877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4415e980 con 0x7fdd440d15f0 2023-11-28T11:11:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.343+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/3119904877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4406ed10 con 0x7fdd440d15f0 2023-11-28T11:11:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.344+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/3119904877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4415ec60 con 0x7fdd440d15f0 2023-11-28T11:11:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.344+0000 7fdd3a7fc700 1 -- 172.21.15.125:0/3119904877 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdd3400f050 con 0x7fdd440d15f0 2023-11-28T11:11:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.344+0000 7fdd3a7fc700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd280682f0 0x7fdd2806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.345+0000 7fdd3a7fc700 1 -- 172.21.15.125:0/3119904877 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd34021070 con 0x7fdd440d15f0 2023-11-28T11:11:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.345+0000 7fdd49d1b700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd280682f0 0x7fdd2806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.345+0000 7fdd49d1b700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd280682f0 0x7fdd2806a7a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdd400099f0 tx=0x7fdd40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.349+0000 7fdd3a7fc700 1 -- 172.21.15.125:0/3119904877 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdd34053f20 con 0x7fdd440d15f0 2023-11-28T11:11:43.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.527+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/3119904877 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd440743f0 con 0x7fdd280682f0 2023-11-28T11:11:43.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.536+0000 7fdd3a7fc700 1 -- 172.21.15.125:0/3119904877 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311217 (secure 0 0 0) 0x7fdd440743f0 con 0x7fdd280682f0 2023-11-28T11:11:43.541 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:43.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/3119904877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd280682f0 msgr2=0x7fdd2806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd280682f0 0x7fdd2806a7a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdd400099f0 tx=0x7fdd40008040 comp rx=0 tx=0).stop 2023-11-28T11:11:43.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/3119904877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd440d15f0 msgr2=0x7fdd4406cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd440d15f0 0x7fdd4406cf30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009b60 tx=0x7fdd34004750 comp rx=0 tx=0).stop 2023-11-28T11:11:43.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/3119904877 shutdown_connections 2023-11-28T11:11:43.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd280682f0 0x7fdd2806a7a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd4415e010 0x7fdd440cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd4406e400 0x7fdd440cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 --2- 172.21.15.125:0/3119904877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd440d15f0 0x7fdd4406cf30 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/3119904877 >> 172.21.15.125:0/3119904877 conn(0x7fdd4406a270 msgr2=0x7fdd44159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:43.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/3119904877 shutdown_connections 2023-11-28T11:11:43.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.539+0000 7fdd4bf7f700 1 -- 172.21.15.125:0/3119904877 wait complete. 2023-11-28T11:11:43.544 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:11:43.552 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2023-11-28T11:11:41.662814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":78068,"kb_used_data":7156,"kb_used_omap":0,"kb_used_meta":70848,"kb_avail":754896652,"statfs":{"total":773094113280,"available":773014171648,"internally_reserved":0,"allocated":7327744,"data_stored":3868766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":72548352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000847"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500398+0000","last_change":"2023-11-28T11:11:39.498060+0000","last_active":"2023-11-28T11:11:39.500398+0000","last_peered":"2023-11-28T11:11:39.500398+0000","last_clean":"2023-11-28T11:11:39.500398+0000","last_became_active":"2023-11-28T11:11:39.497782+0000","last_became_peered":"2023-11-28T11:11:39.497782+0000","last_unstale":"2023-11-28T11:11:39.500398+0000","last_undegraded":"2023-11-28T11:11:39.500398+0000","last_fullsized":"2023-11-28T11:11:39.500398+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:17.219666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.484579+0000","last_change":"2023-11-28T11:11:39.480913+0000","last_active":"2023-11-28T11:11:39.484579+0000","last_peered":"2023-11-28T11:11:39.484579+0000","last_clean":"2023-11-28T11:11:39.484579+0000","last_became_active":"2023-11-28T11:11:39.480649+0000","last_became_peered":"2023-11-28T11:11:39.480649+0000","last_unstale":"2023-11-28T11:11:39.484579+0000","last_undegraded":"2023-11-28T11:11:39.484579+0000","last_fullsized":"2023-11-28T11:11:39.484579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:47:04.753595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504982+0000","last_change":"2023-11-28T11:11:39.498504+0000","last_active":"2023-11-28T11:11:39.504982+0000","last_peered":"2023-11-28T11:11:39.504982+0000","last_clean":"2023-11-28T11:11:39.504982+0000","last_became_active":"2023-11-28T11:11:39.498258+0000","last_became_peered":"2023-11-28T11:11:39.498258+0000","last_unstale":"2023-11-28T11:11:39.504982+0000","last_undegraded":"2023-11-28T11:11:39.504982+0000","last_fullsized":"2023-11-28T11:11:39.504982+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:37.649020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.507693+0000","last_change":"2023-11-28T11:11:39.502276+0000","last_active":"2023-11-28T11:11:39.507693+0000","last_peered":"2023-11-28T11:11:39.507693+0000","last_clean":"2023-11-28T11:11:39.507693+0000","last_became_active":"2023-11-28T11:11:39.499862+0000","last_became_peered":"2023-11-28T11:11:39.499862+0000","last_unstale":"2023-11-28T11:11:39.507693+0000","last_undegraded":"2023-11-28T11:11:39.507693+0000","last_fullsized":"2023-11-28T11:11:39.507693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:47:04.753595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504874+0000","last_change":"2023-11-28T11:11:39.501829+0000","last_active":"2023-11-28T11:11:39.504874+0000","last_peered":"2023-11-28T11:11:39.504874+0000","last_clean":"2023-11-28T11:11:39.504874+0000","last_became_active":"2023-11-28T11:11:39.501556+0000","last_became_peered":"2023-11-28T11:11:39.501556+0000","last_unstale":"2023-11-28T11:11:39.504874+0000","last_undegraded":"2023-11-28T11:11:39.504874+0000","last_fullsized":"2023-11-28T11:11:39.504874+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:36:44.166153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493857+0000","last_change":"2023-11-28T11:11:39.491431+0000","last_active":"2023-11-28T11:11:39.493857+0000","last_peered":"2023-11-28T11:11:39.493857+0000","last_clean":"2023-11-28T11:11:39.493857+0000","last_became_active":"2023-11-28T11:11:39.490824+0000","last_became_peered":"2023-11-28T11:11:39.490824+0000","last_unstale":"2023-11-28T11:11:39.493857+0000","last_undegraded":"2023-11-28T11:11:39.493857+0000","last_fullsized":"2023-11-28T11:11:39.493857+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:15:18.814740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501951+0000","last_change":"2023-11-28T11:11:39.499779+0000","last_active":"2023-11-28T11:11:39.501951+0000","last_peered":"2023-11-28T11:11:39.501951+0000","last_clean":"2023-11-28T11:11:39.501951+0000","last_became_active":"2023-11-28T11:11:39.499517+0000","last_became_peered":"2023-11-28T11:11:39.499517+0000","last_unstale":"2023-11-28T11:11:39.501951+0000","last_undegraded":"2023-11-28T11:11:39.501951+0000","last_fullsized":"2023-11-28T11:11:39.501951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:34.374509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508044+0000","last_change":"2023-11-28T11:11:39.506713+0000","last_active":"2023-11-28T11:11:39.508044+0000","last_peered":"2023-11-28T11:11:39.508044+0000","last_clean":"2023-11-28T11:11:39.508044+0000","last_became_active":"2023-11-28T11:11:39.506446+0000","last_became_peered":"2023-11-28T11:11:39.506446+0000","last_unstale":"2023-11-28T11:11:39.508044+0000","last_undegraded":"2023-11-28T11:11:39.508044+0000","last_fullsized":"2023-11-28T11:11:39.508044+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:52.111544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508091+0000","last_change":"2023-11-28T11:11:39.504602+0000","last_active":"2023-11-28T11:11:39.508091+0000","last_peered":"2023-11-28T11:11:39.508091+0000","last_clean":"2023-11-28T11:11:39.508091+0000","last_became_active":"2023-11-28T11:11:39.504300+0000","last_became_peered":"2023-11-28T11:11:39.504300+0000","last_unstale":"2023-11-28T11:11:39.508091+0000","last_undegraded":"2023-11-28T11:11:39.508091+0000","last_fullsized":"2023-11-28T11:11:39.508091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:33:47.418563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505022+0000","last_change":"2023-11-28T11:11:39.503929+0000","last_active":"2023-11-28T11:11:39.505022+0000","last_peered":"2023-11-28T11:11:39.505022+0000","last_clean":"2023-11-28T11:11:39.505022+0000","last_became_active":"2023-11-28T11:11:39.499307+0000","last_became_peered":"2023-11-28T11:11:39.499307+0000","last_unstale":"2023-11-28T11:11:39.505022+0000","last_undegraded":"2023-11-28T11:11:39.505022+0000","last_fullsized":"2023-11-28T11:11:39.505022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:38.983787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504969+0000","last_change":"2023-11-28T11:11:39.500783+0000","last_active":"2023-11-28T11:11:39.504969+0000","last_peered":"2023-11-28T11:11:39.504969+0000","last_clean":"2023-11-28T11:11:39.504969+0000","last_became_active":"2023-11-28T11:11:39.500515+0000","last_became_peered":"2023-11-28T11:11:39.500515+0000","last_unstale":"2023-11-28T11:11:39.504969+0000","last_undegraded":"2023-11-28T11:11:39.504969+0000","last_fullsized":"2023-11-28T11:11:39.504969+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:14:39.780137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505208+0000","last_change":"2023-11-28T11:11:39.502761+0000","last_active":"2023-11-28T11:11:39.505208+0000","last_peered":"2023-11-28T11:11:39.505208+0000","last_clean":"2023-11-28T11:11:39.505208+0000","last_became_active":"2023-11-28T11:11:39.502479+0000","last_became_peered":"2023-11-28T11:11:39.502479+0000","last_unstale":"2023-11-28T11:11:39.505208+0000","last_undegraded":"2023-11-28T11:11:39.505208+0000","last_fullsized":"2023-11-28T11:11:39.505208+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:31:12.227121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504800+0000","last_change":"2023-11-28T11:11:39.501189+0000","last_active":"2023-11-28T11:11:39.504800+0000","last_peered":"2023-11-28T11:11:39.504800+0000","last_clean":"2023-11-28T11:11:39.504800+0000","last_became_active":"2023-11-28T11:11:39.500902+0000","last_became_peered":"2023-11-28T11:11:39.500902+0000","last_unstale":"2023-11-28T11:11:39.504800+0000","last_undegraded":"2023-11-28T11:11:39.504800+0000","last_fullsized":"2023-11-28T11:11:39.504800+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:37.649020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508207+0000","last_change":"2023-11-28T11:11:39.505014+0000","last_active":"2023-11-28T11:11:39.508207+0000","last_peered":"2023-11-28T11:11:39.508207+0000","last_clean":"2023-11-28T11:11:39.508207+0000","last_became_active":"2023-11-28T11:11:39.504422+0000","last_became_peered":"2023-11-28T11:11:39.504422+0000","last_unstale":"2023-11-28T11:11:39.508207+0000","last_undegraded":"2023-11-28T11:11:39.508207+0000","last_fullsized":"2023-11-28T11:11:39.508207+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:52.111544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504101+0000","last_change":"2023-11-28T11:11:39.494609+0000","last_active":"2023-11-28T11:11:39.504101+0000","last_peered":"2023-11-28T11:11:39.504101+0000","last_clean":"2023-11-28T11:11:39.504101+0000","last_became_active":"2023-11-28T11:11:39.494241+0000","last_became_peered":"2023-11-28T11:11:39.494241+0000","last_unstale":"2023-11-28T11:11:39.504101+0000","last_undegraded":"2023-11-28T11:11:39.504101+0000","last_fullsized":"2023-11-28T11:11:39.504101+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:31:12.227121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501936+0000","last_change":"2023-11-28T11:11:39.499511+0000","last_active":"2023-11-28T11:11:39.501936+0000","last_peered":"2023-11-28T11:11:39.501936+0000","last_clean":"2023-11-28T11:11:39.501936+0000","last_became_active":"2023-11-28T11:11:39.499234+0000","last_became_peered":"2023-11-28T11:11:39.499234+0000","last_unstale":"2023-11-28T11:11:39.501936+0000","last_undegraded":"2023-11-28T11:11:39.501936+0000","last_fullsized":"2023-11-28T11:11:39.501936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:45:04.333609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.502010+0000","last_change":"2023-11-28T11:11:39.500539+0000","last_active":"2023-11-28T11:11:39.502010+0000","last_peered":"2023-11-28T11:11:39.502010+0000","last_clean":"2023-11-28T11:11:39.502010+0000","last_became_active":"2023-11-28T11:11:39.500166+0000","last_became_peered":"2023-11-28T11:11:39.500166+0000","last_unstale":"2023-11-28T11:11:39.502010+0000","last_undegraded":"2023-11-28T11:11:39.502010+0000","last_fullsized":"2023-11-28T11:11:39.502010+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:03.005870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.502118+0000","last_change":"2023-11-28T11:11:39.500106+0000","last_active":"2023-11-28T11:11:39.502118+0000","last_peered":"2023-11-28T11:11:39.502118+0000","last_clean":"2023-11-28T11:11:39.502118+0000","last_became_active":"2023-11-28T11:11:39.499601+0000","last_became_peered":"2023-11-28T11:11:39.499601+0000","last_unstale":"2023-11-28T11:11:39.502118+0000","last_undegraded":"2023-11-28T11:11:39.502118+0000","last_fullsized":"2023-11-28T11:11:39.502118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:58:52.452924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500261+0000","last_change":"2023-11-28T11:11:39.497502+0000","last_active":"2023-11-28T11:11:39.500261+0000","last_peered":"2023-11-28T11:11:39.500261+0000","last_clean":"2023-11-28T11:11:39.500261+0000","last_became_active":"2023-11-28T11:11:39.497213+0000","last_became_peered":"2023-11-28T11:11:39.497213+0000","last_unstale":"2023-11-28T11:11:39.500261+0000","last_undegraded":"2023-11-28T11:11:39.500261+0000","last_fullsized":"2023-11-28T11:11:39.500261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:22:02.083282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493389+0000","last_change":"2023-11-28T11:11:39.490970+0000","last_active":"2023-11-28T11:11:39.493389+0000","last_peered":"2023-11-28T11:11:39.493389+0000","last_clean":"2023-11-28T11:11:39.493389+0000","last_became_active":"2023-11-28T11:11:39.490714+0000","last_became_peered":"2023-11-28T11:11:39.490714+0000","last_unstale":"2023-11-28T11:11:39.493389+0000","last_undegraded":"2023-11-28T11:11:39.493389+0000","last_fullsized":"2023-11-28T11:11:39.493389+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:31:56.919015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500406+0000","last_change":"2023-11-28T11:11:39.496618+0000","last_active":"2023-11-28T11:11:39.500406+0000","last_peered":"2023-11-28T11:11:39.500406+0000","last_clean":"2023-11-28T11:11:39.500406+0000","last_became_active":"2023-11-28T11:11:39.496149+0000","last_became_peered":"2023-11-28T11:11:39.496149+0000","last_unstale":"2023-11-28T11:11:39.500406+0000","last_undegraded":"2023-11-28T11:11:39.500406+0000","last_fullsized":"2023-11-28T11:11:39.500406+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:29.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.499975+0000","last_change":"2023-11-28T11:11:39.498748+0000","last_active":"2023-11-28T11:11:39.499975+0000","last_peered":"2023-11-28T11:11:39.499975+0000","last_clean":"2023-11-28T11:11:39.499975+0000","last_became_active":"2023-11-28T11:11:39.498475+0000","last_became_peered":"2023-11-28T11:11:39.498475+0000","last_unstale":"2023-11-28T11:11:39.499975+0000","last_undegraded":"2023-11-28T11:11:39.499975+0000","last_fullsized":"2023-11-28T11:11:39.499975+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:24.315068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500664+0000","last_change":"2023-11-28T11:11:39.499848+0000","last_active":"2023-11-28T11:11:39.500664+0000","last_peered":"2023-11-28T11:11:39.500664+0000","last_clean":"2023-11-28T11:11:39.500664+0000","last_became_active":"2023-11-28T11:11:39.499562+0000","last_became_peered":"2023-11-28T11:11:39.499562+0000","last_unstale":"2023-11-28T11:11:39.500664+0000","last_undegraded":"2023-11-28T11:11:39.500664+0000","last_fullsized":"2023-11-28T11:11:39.500664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:43.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508227+0000","last_change":"2023-11-28T11:11:39.505322+0000","last_active":"2023-11-28T11:11:39.508227+0000","last_peered":"2023-11-28T11:11:39.508227+0000","last_clean":"2023-11-28T11:11:39.508227+0000","last_became_active":"2023-11-28T11:11:39.503630+0000","last_became_peered":"2023-11-28T11:11:39.503630+0000","last_unstale":"2023-11-28T11:11:39.508227+0000","last_undegraded":"2023-11-28T11:11:39.508227+0000","last_fullsized":"2023-11-28T11:11:39.508227+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:32.091508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500465+0000","last_change":"2023-11-28T11:11:39.496866+0000","last_active":"2023-11-28T11:11:39.500465+0000","last_peered":"2023-11-28T11:11:39.500465+0000","last_clean":"2023-11-28T11:11:39.500465+0000","last_became_active":"2023-11-28T11:11:39.496225+0000","last_became_peered":"2023-11-28T11:11:39.496225+0000","last_unstale":"2023-11-28T11:11:39.500465+0000","last_undegraded":"2023-11-28T11:11:39.500465+0000","last_fullsized":"2023-11-28T11:11:39.500465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:32.091508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500606+0000","last_change":"2023-11-28T11:11:39.497319+0000","last_active":"2023-11-28T11:11:39.500606+0000","last_peered":"2023-11-28T11:11:39.500606+0000","last_clean":"2023-11-28T11:11:39.500606+0000","last_became_active":"2023-11-28T11:11:39.496661+0000","last_became_peered":"2023-11-28T11:11:39.496661+0000","last_unstale":"2023-11-28T11:11:39.500606+0000","last_undegraded":"2023-11-28T11:11:39.500606+0000","last_fullsized":"2023-11-28T11:11:39.500606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:03.005870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500343+0000","last_change":"2023-11-28T11:11:39.489075+0000","last_active":"2023-11-28T11:11:39.500343+0000","last_peered":"2023-11-28T11:11:39.500343+0000","last_clean":"2023-11-28T11:11:39.500343+0000","last_became_active":"2023-11-28T11:11:39.488806+0000","last_became_peered":"2023-11-28T11:11:39.488806+0000","last_unstale":"2023-11-28T11:11:39.500343+0000","last_undegraded":"2023-11-28T11:11:39.500343+0000","last_fullsized":"2023-11-28T11:11:39.500343+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:25.283518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.495554+0000","last_change":"2023-11-28T11:11:39.493985+0000","last_active":"2023-11-28T11:11:39.495554+0000","last_peered":"2023-11-28T11:11:39.495554+0000","last_clean":"2023-11-28T11:11:39.495554+0000","last_became_active":"2023-11-28T11:11:39.493737+0000","last_became_peered":"2023-11-28T11:11:39.493737+0000","last_unstale":"2023-11-28T11:11:39.495554+0000","last_undegraded":"2023-11-28T11:11:39.495554+0000","last_fullsized":"2023-11-28T11:11:39.495554+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:37.649020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508114+0000","last_change":"2023-11-28T11:11:39.504632+0000","last_active":"2023-11-28T11:11:39.508114+0000","last_peered":"2023-11-28T11:11:39.508114+0000","last_clean":"2023-11-28T11:11:39.508114+0000","last_became_active":"2023-11-28T11:11:39.504157+0000","last_became_peered":"2023-11-28T11:11:39.504157+0000","last_unstale":"2023-11-28T11:11:39.508114+0000","last_undegraded":"2023-11-28T11:11:39.508114+0000","last_fullsized":"2023-11-28T11:11:39.508114+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:51:00.730093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508022+0000","last_change":"2023-11-28T11:11:39.506627+0000","last_active":"2023-11-28T11:11:39.508022+0000","last_peered":"2023-11-28T11:11:39.508022+0000","last_clean":"2023-11-28T11:11:39.508022+0000","last_became_active":"2023-11-28T11:11:39.506340+0000","last_became_peered":"2023-11-28T11:11:39.506340+0000","last_unstale":"2023-11-28T11:11:39.508022+0000","last_undegraded":"2023-11-28T11:11:39.508022+0000","last_fullsized":"2023-11-28T11:11:39.508022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:38.983787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501288+0000","last_change":"2023-11-28T11:11:39.498988+0000","last_active":"2023-11-28T11:11:39.501288+0000","last_peered":"2023-11-28T11:11:39.501288+0000","last_clean":"2023-11-28T11:11:39.501288+0000","last_became_active":"2023-11-28T11:11:39.498674+0000","last_became_peered":"2023-11-28T11:11:39.498674+0000","last_unstale":"2023-11-28T11:11:39.501288+0000","last_undegraded":"2023-11-28T11:11:39.501288+0000","last_fullsized":"2023-11-28T11:11:39.501288+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:17:10.491522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493827+0000","last_change":"2023-11-28T11:11:39.491679+0000","last_active":"2023-11-28T11:11:39.493827+0000","last_peered":"2023-11-28T11:11:39.493827+0000","last_clean":"2023-11-28T11:11:39.493827+0000","last_became_active":"2023-11-28T11:11:39.491400+0000","last_became_peered":"2023-11-28T11:11:39.491400+0000","last_unstale":"2023-11-28T11:11:39.493827+0000","last_undegraded":"2023-11-28T11:11:39.493827+0000","last_fullsized":"2023-11-28T11:11:39.493827+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:34:16.695419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.497326+0000","last_change":"2023-11-28T11:11:39.494132+0000","last_active":"2023-11-28T11:11:39.497326+0000","last_peered":"2023-11-28T11:11:39.497326+0000","last_clean":"2023-11-28T11:11:39.497326+0000","last_became_active":"2023-11-28T11:11:39.493528+0000","last_became_peered":"2023-11-28T11:11:39.493528+0000","last_unstale":"2023-11-28T11:11:39.497326+0000","last_undegraded":"2023-11-28T11:11:39.497326+0000","last_fullsized":"2023-11-28T11:11:39.497326+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:15:53.941620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500329+0000","last_change":"2023-11-28T11:11:39.086070+0000","last_active":"2023-11-28T11:11:39.500329+0000","last_peered":"2023-11-28T11:11:39.500329+0000","last_clean":"2023-11-28T11:11:39.500329+0000","last_became_active":"2023-11-28T11:11:39.085772+0000","last_became_peered":"2023-11-28T11:11:39.085772+0000","last_unstale":"2023-11-28T11:11:39.500329+0000","last_undegraded":"2023-11-28T11:11:39.500329+0000","last_fullsized":"2023-11-28T11:11:39.500329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:30.443943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500364+0000","last_change":"2023-11-28T11:11:39.491786+0000","last_active":"2023-11-28T11:11:39.500364+0000","last_peered":"2023-11-28T11:11:39.500364+0000","last_clean":"2023-11-28T11:11:39.500364+0000","last_became_active":"2023-11-28T11:11:39.491453+0000","last_became_peered":"2023-11-28T11:11:39.491453+0000","last_unstale":"2023-11-28T11:11:39.500364+0000","last_undegraded":"2023-11-28T11:11:39.500364+0000","last_fullsized":"2023-11-28T11:11:39.500364+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:31.618924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.499124+0000","last_change":"2023-11-28T11:11:39.087829+0000","last_active":"2023-11-28T11:11:39.499124+0000","last_peered":"2023-11-28T11:11:39.499124+0000","last_clean":"2023-11-28T11:11:39.499124+0000","last_became_active":"2023-11-28T11:11:39.087505+0000","last_became_peered":"2023-11-28T11:11:39.087505+0000","last_unstale":"2023-11-28T11:11:39.499124+0000","last_undegraded":"2023-11-28T11:11:39.499124+0000","last_fullsized":"2023-11-28T11:11:39.499124+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:36.642794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493920+0000","last_change":"2023-11-28T11:11:39.488659+0000","last_active":"2023-11-28T11:11:39.493920+0000","last_peered":"2023-11-28T11:11:39.493920+0000","last_clean":"2023-11-28T11:11:39.493920+0000","last_became_active":"2023-11-28T11:11:39.487962+0000","last_became_peered":"2023-11-28T11:11:39.487962+0000","last_unstale":"2023-11-28T11:11:39.493920+0000","last_undegraded":"2023-11-28T11:11:39.493920+0000","last_fullsized":"2023-11-28T11:11:39.493920+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:43.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.497844+0000","last_change":"2023-11-28T11:11:39.088467+0000","last_active":"2023-11-28T11:11:39.497844+0000","last_peered":"2023-11-28T11:11:39.497844+0000","last_clean":"2023-11-28T11:11:39.497844+0000","last_became_active":"2023-11-28T11:11:39.087457+0000","last_became_peered":"2023-11-28T11:11:39.087457+0000","last_unstale":"2023-11-28T11:11:39.497844+0000","last_undegraded":"2023-11-28T11:11:39.497844+0000","last_fullsized":"2023-11-28T11:11:39.497844+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:37.977560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505735+0000","last_change":"2023-11-28T11:11:39.503835+0000","last_active":"2023-11-28T11:11:39.505735+0000","last_peered":"2023-11-28T11:11:39.505735+0000","last_clean":"2023-11-28T11:11:39.505735+0000","last_became_active":"2023-11-28T11:11:39.499167+0000","last_became_peered":"2023-11-28T11:11:39.499167+0000","last_unstale":"2023-11-28T11:11:39.505735+0000","last_undegraded":"2023-11-28T11:11:39.505735+0000","last_fullsized":"2023-11-28T11:11:39.505735+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:24.208957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.492990+0000","last_change":"2023-11-28T11:11:39.087837+0000","last_active":"2023-11-28T11:11:39.492990+0000","last_peered":"2023-11-28T11:11:39.492990+0000","last_clean":"2023-11-28T11:11:39.492990+0000","last_became_active":"2023-11-28T11:11:39.087166+0000","last_became_peered":"2023-11-28T11:11:39.087166+0000","last_unstale":"2023-11-28T11:11:39.492990+0000","last_undegraded":"2023-11-28T11:11:39.492990+0000","last_fullsized":"2023-11-28T11:11:39.492990+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:01.999644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.492867+0000","last_change":"2023-11-28T11:11:39.489538+0000","last_active":"2023-11-28T11:11:39.492867+0000","last_peered":"2023-11-28T11:11:39.492867+0000","last_clean":"2023-11-28T11:11:39.492867+0000","last_became_active":"2023-11-28T11:11:39.489273+0000","last_became_peered":"2023-11-28T11:11:39.489273+0000","last_unstale":"2023-11-28T11:11:39.492867+0000","last_undegraded":"2023-11-28T11:11:39.492867+0000","last_fullsized":"2023-11-28T11:11:39.492867+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:49.378558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.490011+0000","last_change":"2023-11-28T11:11:39.098100+0000","last_active":"2023-11-28T11:11:39.490011+0000","last_peered":"2023-11-28T11:11:39.490011+0000","last_clean":"2023-11-28T11:11:39.490011+0000","last_became_active":"2023-11-28T11:11:39.097793+0000","last_became_peered":"2023-11-28T11:11:39.097793+0000","last_unstale":"2023-11-28T11:11:39.490011+0000","last_undegraded":"2023-11-28T11:11:39.490011+0000","last_fullsized":"2023-11-28T11:11:39.490011+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:16.213440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.502490+0000","last_change":"2023-11-28T11:11:39.501037+0000","last_active":"2023-11-28T11:11:39.502490+0000","last_peered":"2023-11-28T11:11:39.502490+0000","last_clean":"2023-11-28T11:11:39.502490+0000","last_became_active":"2023-11-28T11:11:39.500791+0000","last_became_peered":"2023-11-28T11:11:39.500791+0000","last_unstale":"2023-11-28T11:11:39.502490+0000","last_undegraded":"2023-11-28T11:11:39.502490+0000","last_fullsized":"2023-11-28T11:11:39.502490+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:32.091508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493010+0000","last_change":"2023-11-28T11:11:39.098122+0000","last_active":"2023-11-28T11:11:39.493010+0000","last_peered":"2023-11-28T11:11:39.493010+0000","last_clean":"2023-11-28T11:11:39.493010+0000","last_became_active":"2023-11-28T11:11:39.097862+0000","last_became_peered":"2023-11-28T11:11:39.097862+0000","last_unstale":"2023-11-28T11:11:39.493010+0000","last_undegraded":"2023-11-28T11:11:39.493010+0000","last_fullsized":"2023-11-28T11:11:39.493010+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:36.642794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.494075+0000","last_change":"2023-11-28T11:11:39.489090+0000","last_active":"2023-11-28T11:11:39.494075+0000","last_peered":"2023-11-28T11:11:39.494075+0000","last_clean":"2023-11-28T11:11:39.494075+0000","last_became_active":"2023-11-28T11:11:39.488627+0000","last_became_peered":"2023-11-28T11:11:39.488627+0000","last_unstale":"2023-11-28T11:11:39.494075+0000","last_undegraded":"2023-11-28T11:11:39.494075+0000","last_fullsized":"2023-11-28T11:11:39.494075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:35.528514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.483331+0000","last_change":"2023-11-28T11:11:39.095000+0000","last_active":"2023-11-28T11:11:39.483331+0000","last_peered":"2023-11-28T11:11:39.483331+0000","last_clean":"2023-11-28T11:11:39.483331+0000","last_became_active":"2023-11-28T11:11:39.094733+0000","last_became_peered":"2023-11-28T11:11:39.094733+0000","last_unstale":"2023-11-28T11:11:39.483331+0000","last_undegraded":"2023-11-28T11:11:39.483331+0000","last_fullsized":"2023-11-28T11:11:39.483331+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:37.977560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.502439+0000","last_change":"2023-11-28T11:11:39.501483+0000","last_active":"2023-11-28T11:11:39.502439+0000","last_peered":"2023-11-28T11:11:39.502439+0000","last_clean":"2023-11-28T11:11:39.502439+0000","last_became_active":"2023-11-28T11:11:39.501230+0000","last_became_peered":"2023-11-28T11:11:39.501230+0000","last_unstale":"2023-11-28T11:11:39.502439+0000","last_undegraded":"2023-11-28T11:11:39.502439+0000","last_fullsized":"2023-11-28T11:11:39.502439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:34:16.695419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.482201+0000","last_change":"2023-11-28T11:11:39.090096+0000","last_active":"2023-11-28T11:11:39.482201+0000","last_peered":"2023-11-28T11:11:39.482201+0000","last_clean":"2023-11-28T11:11:39.482201+0000","last_became_active":"2023-11-28T11:11:39.089822+0000","last_became_peered":"2023-11-28T11:11:39.089822+0000","last_unstale":"2023-11-28T11:11:39.482201+0000","last_undegraded":"2023-11-28T11:11:39.482201+0000","last_fullsized":"2023-11-28T11:11:39.482201+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:08.899992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.491039+0000","last_change":"2023-11-28T11:11:39.487632+0000","last_active":"2023-11-28T11:11:39.491039+0000","last_peered":"2023-11-28T11:11:39.491039+0000","last_clean":"2023-11-28T11:11:39.491039+0000","last_became_active":"2023-11-28T11:11:39.487288+0000","last_became_peered":"2023-11-28T11:11:39.487288+0000","last_unstale":"2023-11-28T11:11:39.491039+0000","last_undegraded":"2023-11-28T11:11:39.491039+0000","last_fullsized":"2023-11-28T11:11:39.491039+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:31.618924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.492670+0000","last_change":"2023-11-28T11:11:39.092764+0000","last_active":"2023-11-28T11:11:39.492670+0000","last_peered":"2023-11-28T11:11:39.492670+0000","last_clean":"2023-11-28T11:11:39.492670+0000","last_became_active":"2023-11-28T11:11:39.092328+0000","last_became_peered":"2023-11-28T11:11:39.092328+0000","last_unstale":"2023-11-28T11:11:39.492670+0000","last_undegraded":"2023-11-28T11:11:39.492670+0000","last_fullsized":"2023-11-28T11:11:39.492670+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:15:12.697873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.496706+0000","last_change":"2023-11-28T11:11:39.495599+0000","last_active":"2023-11-28T11:11:39.496706+0000","last_peered":"2023-11-28T11:11:39.496706+0000","last_clean":"2023-11-28T11:11:39.496706+0000","last_became_active":"2023-11-28T11:11:39.495309+0000","last_became_peered":"2023-11-28T11:11:39.495309+0000","last_unstale":"2023-11-28T11:11:39.496706+0000","last_undegraded":"2023-11-28T11:11:39.496706+0000","last_fullsized":"2023-11-28T11:11:39.496706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:43.072857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.483267+0000","last_change":"2023-11-28T11:11:39.089854+0000","last_active":"2023-11-28T11:11:39.483267+0000","last_peered":"2023-11-28T11:11:39.483267+0000","last_clean":"2023-11-28T11:11:39.483267+0000","last_became_active":"2023-11-28T11:11:39.089478+0000","last_became_peered":"2023-11-28T11:11:39.089478+0000","last_unstale":"2023-11-28T11:11:39.483267+0000","last_undegraded":"2023-11-28T11:11:39.483267+0000","last_fullsized":"2023-11-28T11:11:39.483267+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:00:01.273198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500352+0000","last_change":"2023-11-28T11:11:39.497598+0000","last_active":"2023-11-28T11:11:39.500352+0000","last_peered":"2023-11-28T11:11:39.500352+0000","last_clean":"2023-11-28T11:11:39.500352+0000","last_became_active":"2023-11-28T11:11:39.497302+0000","last_became_peered":"2023-11-28T11:11:39.497302+0000","last_unstale":"2023-11-28T11:11:39.500352+0000","last_undegraded":"2023-11-28T11:11:39.500352+0000","last_fullsized":"2023-11-28T11:11:39.500352+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:42:33.252377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"65'3","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504345+0000","last_change":"2023-11-28T11:11:39.090006+0000","last_active":"2023-11-28T11:11:39.504345+0000","last_peered":"2023-11-28T11:11:39.504345+0000","last_clean":"2023-11-28T11:11:39.504345+0000","last_became_active":"2023-11-28T11:11:39.089440+0000","last_became_peered":"2023-11-28T11:11:39.089440+0000","last_unstale":"2023-11-28T11:11:39.504345+0000","last_undegraded":"2023-11-28T11:11:39.504345+0000","last_fullsized":"2023-11-28T11:11:39.504345+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:30.443943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500281+0000","last_change":"2023-11-28T11:11:39.490525+0000","last_active":"2023-11-28T11:11:39.500281+0000","last_peered":"2023-11-28T11:11:39.500281+0000","last_clean":"2023-11-28T11:11:39.500281+0000","last_became_active":"2023-11-28T11:11:39.490271+0000","last_became_peered":"2023-11-28T11:11:39.490271+0000","last_unstale":"2023-11-28T11:11:39.500281+0000","last_undegraded":"2023-11-28T11:11:39.500281+0000","last_fullsized":"2023-11-28T11:11:39.500281+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:32.091508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.510840+0000","last_change":"2023-11-28T11:11:39.089931+0000","last_active":"2023-11-28T11:11:39.510840+0000","last_peered":"2023-11-28T11:11:39.510840+0000","last_clean":"2023-11-28T11:11:39.510840+0000","last_became_active":"2023-11-28T11:11:39.089682+0000","last_became_peered":"2023-11-28T11:11:39.089682+0000","last_unstale":"2023-11-28T11:11:39.510840+0000","last_undegraded":"2023-11-28T11:11:39.510840+0000","last_fullsized":"2023-11-28T11:11:39.510840+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:31:51.909729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505019+0000","last_change":"2023-11-28T11:11:39.501298+0000","last_active":"2023-11-28T11:11:39.505019+0000","last_peered":"2023-11-28T11:11:39.505019+0000","last_clean":"2023-11-28T11:11:39.505019+0000","last_became_active":"2023-11-28T11:11:39.501019+0000","last_became_peered":"2023-11-28T11:11:39.501019+0000","last_unstale":"2023-11-28T11:11:39.505019+0000","last_undegraded":"2023-11-28T11:11:39.505019+0000","last_fullsized":"2023-11-28T11:11:39.505019+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:17.219666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.503811+0000","last_change":"2023-11-28T11:11:39.093429+0000","last_active":"2023-11-28T11:11:39.503811+0000","last_peered":"2023-11-28T11:11:39.503811+0000","last_clean":"2023-11-28T11:11:39.503811+0000","last_became_active":"2023-11-28T11:11:39.093161+0000","last_became_peered":"2023-11-28T11:11:39.093161+0000","last_unstale":"2023-11-28T11:11:39.503811+0000","last_undegraded":"2023-11-28T11:11:39.503811+0000","last_fullsized":"2023-11-28T11:11:39.503811+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:44.141702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500458+0000","last_change":"2023-11-28T11:11:39.496475+0000","last_active":"2023-11-28T11:11:39.500458+0000","last_peered":"2023-11-28T11:11:39.500458+0000","last_clean":"2023-11-28T11:11:39.500458+0000","last_became_active":"2023-11-28T11:11:39.496140+0000","last_became_peered":"2023-11-28T11:11:39.496140+0000","last_unstale":"2023-11-28T11:11:39.500458+0000","last_undegraded":"2023-11-28T11:11:39.500458+0000","last_fullsized":"2023-11-28T11:11:39.500458+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:24.208957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.492781+0000","last_change":"2023-11-28T11:11:39.091511+0000","last_active":"2023-11-28T11:11:39.492781+0000","last_peered":"2023-11-28T11:11:39.492781+0000","last_clean":"2023-11-28T11:11:39.492781+0000","last_became_active":"2023-11-28T11:11:39.091254+0000","last_became_peered":"2023-11-28T11:11:39.091254+0000","last_unstale":"2023-11-28T11:11:39.492781+0000","last_undegraded":"2023-11-28T11:11:39.492781+0000","last_fullsized":"2023-11-28T11:11:39.492781+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:36:43.159926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.495673+0000","last_change":"2023-11-28T11:11:39.490842+0000","last_active":"2023-11-28T11:11:39.495673+0000","last_peered":"2023-11-28T11:11:39.495673+0000","last_clean":"2023-11-28T11:11:39.495673+0000","last_became_active":"2023-11-28T11:11:39.490565+0000","last_became_peered":"2023-11-28T11:11:39.490565+0000","last_unstale":"2023-11-28T11:11:39.495673+0000","last_undegraded":"2023-11-28T11:11:39.495673+0000","last_fullsized":"2023-11-28T11:11:39.495673+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:16.316227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.482167+0000","last_change":"2023-11-28T11:11:39.091271+0000","last_active":"2023-11-28T11:11:39.482167+0000","last_peered":"2023-11-28T11:11:39.482167+0000","last_clean":"2023-11-28T11:11:39.482167+0000","last_became_active":"2023-11-28T11:11:39.090997+0000","last_became_peered":"2023-11-28T11:11:39.090997+0000","last_unstale":"2023-11-28T11:11:39.482167+0000","last_undegraded":"2023-11-28T11:11:39.482167+0000","last_fullsized":"2023-11-28T11:11:39.482167+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:31:51.909729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.488929+0000","last_change":"2023-11-28T11:11:39.487310+0000","last_active":"2023-11-28T11:11:39.488929+0000","last_peered":"2023-11-28T11:11:39.488929+0000","last_clean":"2023-11-28T11:11:39.488929+0000","last_became_active":"2023-11-28T11:11:39.486990+0000","last_became_peered":"2023-11-28T11:11:39.486990+0000","last_unstale":"2023-11-28T11:11:39.488929+0000","last_undegraded":"2023-11-28T11:11:39.488929+0000","last_fullsized":"2023-11-28T11:11:39.488929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:29.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508367+0000","last_change":"2023-11-28T11:11:39.092100+0000","last_active":"2023-11-28T11:11:39.508367+0000","last_peered":"2023-11-28T11:11:39.508367+0000","last_clean":"2023-11-28T11:11:39.508367+0000","last_became_active":"2023-11-28T11:11:39.091806+0000","last_became_peered":"2023-11-28T11:11:39.091806+0000","last_unstale":"2023-11-28T11:11:39.508367+0000","last_undegraded":"2023-11-28T11:11:39.508367+0000","last_fullsized":"2023-11-28T11:11:39.508367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:15.310001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501612+0000","last_change":"2023-11-28T11:11:39.501033+0000","last_active":"2023-11-28T11:11:39.501612+0000","last_peered":"2023-11-28T11:11:39.501612+0000","last_clean":"2023-11-28T11:11:39.501612+0000","last_became_active":"2023-11-28T11:11:39.500801+0000","last_became_peered":"2023-11-28T11:11:39.500801+0000","last_unstale":"2023-11-28T11:11:39.501612+0000","last_undegraded":"2023-11-28T11:11:39.501612+0000","last_fullsized":"2023-11-28T11:11:39.501612+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:31:56.919015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.506112+0000","last_change":"2023-11-28T11:11:39.091155+0000","last_active":"2023-11-28T11:11:39.506112+0000","last_peered":"2023-11-28T11:11:39.506112+0000","last_clean":"2023-11-28T11:11:39.506112+0000","last_became_active":"2023-11-28T11:11:39.090880+0000","last_became_peered":"2023-11-28T11:11:39.090880+0000","last_unstale":"2023-11-28T11:11:39.506112+0000","last_undegraded":"2023-11-28T11:11:39.506112+0000","last_fullsized":"2023-11-28T11:11:39.506112+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:29.212273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.489641+0000","last_change":"2023-11-28T11:11:39.486427+0000","last_active":"2023-11-28T11:11:39.489641+0000","last_peered":"2023-11-28T11:11:39.489641+0000","last_clean":"2023-11-28T11:11:39.489641+0000","last_became_active":"2023-11-28T11:11:39.486160+0000","last_became_peered":"2023-11-28T11:11:39.486160+0000","last_unstale":"2023-11-28T11:11:39.489641+0000","last_undegraded":"2023-11-28T11:11:39.489641+0000","last_fullsized":"2023-11-28T11:11:39.489641+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:05.933893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.488918+0000","last_change":"2023-11-28T11:11:39.088353+0000","last_active":"2023-11-28T11:11:39.488918+0000","last_peered":"2023-11-28T11:11:39.488918+0000","last_clean":"2023-11-28T11:11:39.488918+0000","last_became_active":"2023-11-28T11:11:39.088012+0000","last_became_peered":"2023-11-28T11:11:39.088012+0000","last_unstale":"2023-11-28T11:11:39.488918+0000","last_undegraded":"2023-11-28T11:11:39.488918+0000","last_fullsized":"2023-11-28T11:11:39.488918+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:34.522288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500585+0000","last_change":"2023-11-28T11:11:39.497236+0000","last_active":"2023-11-28T11:11:39.500585+0000","last_peered":"2023-11-28T11:11:39.500585+0000","last_clean":"2023-11-28T11:11:39.500585+0000","last_became_active":"2023-11-28T11:11:39.496318+0000","last_became_peered":"2023-11-28T11:11:39.496318+0000","last_unstale":"2023-11-28T11:11:39.500585+0000","last_undegraded":"2023-11-28T11:11:39.500585+0000","last_fullsized":"2023-11-28T11:11:39.500585+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:58:52.452924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.476809+0000","last_change":"2023-11-28T11:11:39.088745+0000","last_active":"2023-11-28T11:11:39.476809+0000","last_peered":"2023-11-28T11:11:39.476809+0000","last_clean":"2023-11-28T11:11:39.476809+0000","last_became_active":"2023-11-28T11:11:39.088208+0000","last_became_peered":"2023-11-28T11:11:39.088208+0000","last_unstale":"2023-11-28T11:11:39.476809+0000","last_undegraded":"2023-11-28T11:11:39.476809+0000","last_fullsized":"2023-11-28T11:11:39.476809+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:31:11.220895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.495681+0000","last_change":"2023-11-28T11:11:39.490386+0000","last_active":"2023-11-28T11:11:39.495681+0000","last_peered":"2023-11-28T11:11:39.495681+0000","last_clean":"2023-11-28T11:11:39.495681+0000","last_became_active":"2023-11-28T11:11:39.489906+0000","last_became_peered":"2023-11-28T11:11:39.489906+0000","last_unstale":"2023-11-28T11:11:39.495681+0000","last_undegraded":"2023-11-28T11:11:39.495681+0000","last_fullsized":"2023-11-28T11:11:39.495681+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:31.450169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.478472+0000","last_change":"2023-11-28T11:11:39.090009+0000","last_active":"2023-11-28T11:11:39.478472+0000","last_peered":"2023-11-28T11:11:39.478472+0000","last_clean":"2023-11-28T11:11:39.478472+0000","last_became_active":"2023-11-28T11:11:39.089728+0000","last_became_peered":"2023-11-28T11:11:39.089728+0000","last_unstale":"2023-11-28T11:11:39.478472+0000","last_undegraded":"2023-11-28T11:11:39.478472+0000","last_fullsized":"2023-11-28T11:11:39.478472+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:34.522288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.496625+0000","last_change":"2023-11-28T11:11:39.494017+0000","last_active":"2023-11-28T11:11:39.496625+0000","last_peered":"2023-11-28T11:11:39.496625+0000","last_clean":"2023-11-28T11:11:39.496625+0000","last_became_active":"2023-11-28T11:11:39.493429+0000","last_became_peered":"2023-11-28T11:11:39.493429+0000","last_unstale":"2023-11-28T11:11:39.496625+0000","last_undegraded":"2023-11-28T11:11:39.496625+0000","last_fullsized":"2023-11-28T11:11:39.496625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:33:40.404585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.482442+0000","last_change":"2023-11-28T11:11:39.091178+0000","last_active":"2023-11-28T11:11:39.482442+0000","last_peered":"2023-11-28T11:11:39.482442+0000","last_clean":"2023-11-28T11:11:39.482442+0000","last_became_active":"2023-11-28T11:11:39.090848+0000","last_became_peered":"2023-11-28T11:11:39.090848+0000","last_unstale":"2023-11-28T11:11:39.482442+0000","last_undegraded":"2023-11-28T11:11:39.482442+0000","last_fullsized":"2023-11-28T11:11:39.482442+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:40.182873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505012+0000","last_change":"2023-11-28T11:11:39.501398+0000","last_active":"2023-11-28T11:11:39.505012+0000","last_peered":"2023-11-28T11:11:39.505012+0000","last_clean":"2023-11-28T11:11:39.505012+0000","last_became_active":"2023-11-28T11:11:39.501175+0000","last_became_peered":"2023-11-28T11:11:39.501175+0000","last_unstale":"2023-11-28T11:11:39.505012+0000","last_undegraded":"2023-11-28T11:11:39.505012+0000","last_fullsized":"2023-11-28T11:11:39.505012+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:29.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.485164+0000","last_change":"2023-11-28T11:11:39.092818+0000","last_active":"2023-11-28T11:11:39.485164+0000","last_peered":"2023-11-28T11:11:39.485164+0000","last_clean":"2023-11-28T11:11:39.485164+0000","last_became_active":"2023-11-28T11:11:39.092535+0000","last_became_peered":"2023-11-28T11:11:39.092535+0000","last_unstale":"2023-11-28T11:11:39.485164+0000","last_undegraded":"2023-11-28T11:11:39.485164+0000","last_fullsized":"2023-11-28T11:11:39.485164+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:51.105318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501898+0000","last_change":"2023-11-28T11:11:39.500493+0000","last_active":"2023-11-28T11:11:39.501898+0000","last_peered":"2023-11-28T11:11:39.501898+0000","last_clean":"2023-11-28T11:11:39.501898+0000","last_became_active":"2023-11-28T11:11:39.500027+0000","last_became_peered":"2023-11-28T11:11:39.500027+0000","last_unstale":"2023-11-28T11:11:39.501898+0000","last_undegraded":"2023-11-28T11:11:39.501898+0000","last_fullsized":"2023-11-28T11:11:39.501898+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:52.111544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.483359+0000","last_change":"2023-11-28T11:11:39.094769+0000","last_active":"2023-11-28T11:11:39.483359+0000","last_peered":"2023-11-28T11:11:39.483359+0000","last_clean":"2023-11-28T11:11:39.483359+0000","last_became_active":"2023-11-28T11:11:39.094445+0000","last_became_peered":"2023-11-28T11:11:39.094445+0000","last_unstale":"2023-11-28T11:11:39.483359+0000","last_undegraded":"2023-11-28T11:11:39.483359+0000","last_fullsized":"2023-11-28T11:11:39.483359+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:31:11.220895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501315+0000","last_change":"2023-11-28T11:11:39.498899+0000","last_active":"2023-11-28T11:11:39.501315+0000","last_peered":"2023-11-28T11:11:39.501315+0000","last_clean":"2023-11-28T11:11:39.501315+0000","last_became_active":"2023-11-28T11:11:39.498632+0000","last_became_peered":"2023-11-28T11:11:39.498632+0000","last_unstale":"2023-11-28T11:11:39.501315+0000","last_undegraded":"2023-11-28T11:11:39.501315+0000","last_fullsized":"2023-11-28T11:11:39.501315+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:11:26.950640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.477899+0000","last_change":"2023-11-28T11:11:39.089488+0000","last_active":"2023-11-28T11:11:39.477899+0000","last_peered":"2023-11-28T11:11:39.477899+0000","last_clean":"2023-11-28T11:11:39.477899+0000","last_became_active":"2023-11-28T11:11:39.089108+0000","last_became_peered":"2023-11-28T11:11:39.089108+0000","last_unstale":"2023-11-28T11:11:39.477899+0000","last_undegraded":"2023-11-28T11:11:39.477899+0000","last_fullsized":"2023-11-28T11:11:39.477899+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:40.182873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508120+0000","last_change":"2023-11-28T11:11:39.504610+0000","last_active":"2023-11-28T11:11:39.508120+0000","last_peered":"2023-11-28T11:11:39.508120+0000","last_clean":"2023-11-28T11:11:39.508120+0000","last_became_active":"2023-11-28T11:11:39.504361+0000","last_became_peered":"2023-11-28T11:11:39.504361+0000","last_unstale":"2023-11-28T11:11:39.508120+0000","last_undegraded":"2023-11-28T11:11:39.508120+0000","last_fullsized":"2023-11-28T11:11:39.508120+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:33.166366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.496503+0000","last_change":"2023-11-28T11:11:39.091525+0000","last_active":"2023-11-28T11:11:39.496503+0000","last_peered":"2023-11-28T11:11:39.496503+0000","last_clean":"2023-11-28T11:11:39.496503+0000","last_became_active":"2023-11-28T11:11:39.090581+0000","last_became_peered":"2023-11-28T11:11:39.090581+0000","last_unstale":"2023-11-28T11:11:39.496503+0000","last_undegraded":"2023-11-28T11:11:39.496503+0000","last_fullsized":"2023-11-28T11:11:39.496503+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:30.443943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.079636+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:11:39.079636+0000","last_peered":"2023-11-28T11:11:39.079636+0000","last_clean":"2023-11-28T11:11:39.079636+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:11:39.079636+0000","last_undegraded":"2023-11-28T11:11:39.079636+0000","last_fullsized":"2023-11-28T11:11:39.079636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.490734+0000","last_change":"2023-11-28T11:11:39.488899+0000","last_active":"2023-11-28T11:11:39.490734+0000","last_peered":"2023-11-28T11:11:39.490734+0000","last_clean":"2023-11-28T11:11:39.490734+0000","last_became_active":"2023-11-28T11:11:39.488281+0000","last_became_peered":"2023-11-28T11:11:39.488281+0000","last_unstale":"2023-11-28T11:11:39.490734+0000","last_undegraded":"2023-11-28T11:11:39.490734+0000","last_fullsized":"2023-11-28T11:11:39.490734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:00:02.279424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.476422+0000","last_change":"2023-11-28T11:11:39.087733+0000","last_active":"2023-11-28T11:11:39.476422+0000","last_peered":"2023-11-28T11:11:39.476422+0000","last_clean":"2023-11-28T11:11:39.476422+0000","last_became_active":"2023-11-28T11:11:39.087330+0000","last_became_peered":"2023-11-28T11:11:39.087330+0000","last_unstale":"2023-11-28T11:11:39.476422+0000","last_undegraded":"2023-11-28T11:11:39.476422+0000","last_fullsized":"2023-11-28T11:11:39.476422+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:31.085282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.083143+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:11:39.083143+0000","last_peered":"2023-11-28T11:11:39.083143+0000","last_clean":"2023-11-28T11:11:39.083143+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:11:39.083143+0000","last_undegraded":"2023-11-28T11:11:39.083143+0000","last_fullsized":"2023-11-28T11:11:39.083143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500483+0000","last_change":"2023-11-28T11:11:39.497012+0000","last_active":"2023-11-28T11:11:39.500483+0000","last_peered":"2023-11-28T11:11:39.500483+0000","last_clean":"2023-11-28T11:11:39.500483+0000","last_became_active":"2023-11-28T11:11:39.496735+0000","last_became_peered":"2023-11-28T11:11:39.496735+0000","last_unstale":"2023-11-28T11:11:39.500483+0000","last_undegraded":"2023-11-28T11:11:39.500483+0000","last_fullsized":"2023-11-28T11:11:39.500483+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:31.618924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.492883+0000","last_change":"2023-11-28T11:11:39.091033+0000","last_active":"2023-11-28T11:11:39.492883+0000","last_peered":"2023-11-28T11:11:39.492883+0000","last_clean":"2023-11-28T11:11:39.492883+0000","last_became_active":"2023-11-28T11:11:39.090496+0000","last_became_peered":"2023-11-28T11:11:39.090496+0000","last_unstale":"2023-11-28T11:11:39.492883+0000","last_undegraded":"2023-11-28T11:11:39.492883+0000","last_fullsized":"2023-11-28T11:11:39.492883+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:38.064594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.084101+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:11:39.084101+0000","last_peered":"2023-11-28T11:11:39.084101+0000","last_clean":"2023-11-28T11:11:39.084101+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:11:39.084101+0000","last_undegraded":"2023-11-28T11:11:39.084101+0000","last_fullsized":"2023-11-28T11:11:39.084101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.496959+0000","last_change":"2023-11-28T11:11:39.493932+0000","last_active":"2023-11-28T11:11:39.496959+0000","last_peered":"2023-11-28T11:11:39.496959+0000","last_clean":"2023-11-28T11:11:39.496959+0000","last_became_active":"2023-11-28T11:11:39.493631+0000","last_became_peered":"2023-11-28T11:11:39.493631+0000","last_unstale":"2023-11-28T11:11:39.496959+0000","last_undegraded":"2023-11-28T11:11:39.496959+0000","last_fullsized":"2023-11-28T11:11:39.496959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:39.070820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.482556+0000","last_change":"2023-11-28T11:11:39.098164+0000","last_active":"2023-11-28T11:11:39.482556+0000","last_peered":"2023-11-28T11:11:39.482556+0000","last_clean":"2023-11-28T11:11:39.482556+0000","last_became_active":"2023-11-28T11:11:39.097719+0000","last_became_peered":"2023-11-28T11:11:39.097719+0000","last_unstale":"2023-11-28T11:11:39.482556+0000","last_undegraded":"2023-11-28T11:11:39.482556+0000","last_fullsized":"2023-11-28T11:11:39.482556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:28.091834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.082964+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:11:39.082964+0000","last_peered":"2023-11-28T11:11:39.082964+0000","last_clean":"2023-11-28T11:11:39.082964+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:11:39.082964+0000","last_undegraded":"2023-11-28T11:11:39.082964+0000","last_fullsized":"2023-11-28T11:11:39.082964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.078078+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:11:39.078078+0000","last_peered":"2023-11-28T11:11:39.078078+0000","last_clean":"2023-11-28T11:11:39.078078+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:11:39.078078+0000","last_undegraded":"2023-11-28T11:11:39.078078+0000","last_fullsized":"2023-11-28T11:11:39.078078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493808+0000","last_change":"2023-11-28T11:11:39.491331+0000","last_active":"2023-11-28T11:11:39.493808+0000","last_peered":"2023-11-28T11:11:39.493808+0000","last_clean":"2023-11-28T11:11:39.493808+0000","last_became_active":"2023-11-28T11:11:39.491007+0000","last_became_peered":"2023-11-28T11:11:39.491007+0000","last_unstale":"2023-11-28T11:11:39.493808+0000","last_undegraded":"2023-11-28T11:11:39.493808+0000","last_fullsized":"2023-11-28T11:11:39.493808+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:43.072857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.489904+0000","last_change":"2023-11-28T11:11:39.093252+0000","last_active":"2023-11-28T11:11:39.489904+0000","last_peered":"2023-11-28T11:11:39.489904+0000","last_clean":"2023-11-28T11:11:39.489904+0000","last_became_active":"2023-11-28T11:11:39.092985+0000","last_became_peered":"2023-11-28T11:11:39.092985+0000","last_unstale":"2023-11-28T11:11:39.489904+0000","last_undegraded":"2023-11-28T11:11:39.489904+0000","last_fullsized":"2023-11-28T11:11:39.489904+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:23.202731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.078095+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:11:39.078095+0000","last_peered":"2023-11-28T11:11:39.078095+0000","last_clean":"2023-11-28T11:11:39.078095+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:11:39.078095+0000","last_undegraded":"2023-11-28T11:11:39.078095+0000","last_fullsized":"2023-11-28T11:11:39.078095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.502051+0000","last_change":"2023-11-28T11:11:39.501345+0000","last_active":"2023-11-28T11:11:39.502051+0000","last_peered":"2023-11-28T11:11:39.502051+0000","last_clean":"2023-11-28T11:11:39.502051+0000","last_became_active":"2023-11-28T11:11:39.501059+0000","last_became_peered":"2023-11-28T11:11:39.501059+0000","last_unstale":"2023-11-28T11:11:39.502051+0000","last_undegraded":"2023-11-28T11:11:39.502051+0000","last_fullsized":"2023-11-28T11:11:39.502051+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:49:19.205431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504381+0000","last_change":"2023-11-28T11:11:39.092374+0000","last_active":"2023-11-28T11:11:39.504381+0000","last_peered":"2023-11-28T11:11:39.504381+0000","last_clean":"2023-11-28T11:11:39.504381+0000","last_became_active":"2023-11-28T11:11:39.092080+0000","last_became_peered":"2023-11-28T11:11:39.092080+0000","last_unstale":"2023-11-28T11:11:39.504381+0000","last_undegraded":"2023-11-28T11:11:39.504381+0000","last_fullsized":"2023-11-28T11:11:39.504381+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:44:11.019293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.078919+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:11:39.078919+0000","last_peered":"2023-11-28T11:11:39.078919+0000","last_clean":"2023-11-28T11:11:39.078919+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:11:39.078919+0000","last_undegraded":"2023-11-28T11:11:39.078919+0000","last_fullsized":"2023-11-28T11:11:39.078919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500195+0000","last_change":"2023-11-28T11:11:39.491813+0000","last_active":"2023-11-28T11:11:39.500195+0000","last_peered":"2023-11-28T11:11:39.500195+0000","last_clean":"2023-11-28T11:11:39.500195+0000","last_became_active":"2023-11-28T11:11:39.491501+0000","last_became_peered":"2023-11-28T11:11:39.491501+0000","last_unstale":"2023-11-28T11:11:39.500195+0000","last_undegraded":"2023-11-28T11:11:39.500195+0000","last_fullsized":"2023-11-28T11:11:39.500195+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:52.111544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505445+0000","last_change":"2023-11-28T11:11:39.090158+0000","last_active":"2023-11-28T11:11:39.505445+0000","last_peered":"2023-11-28T11:11:39.505445+0000","last_clean":"2023-11-28T11:11:39.505445+0000","last_became_active":"2023-11-28T11:11:39.089772+0000","last_became_peered":"2023-11-28T11:11:39.089772+0000","last_unstale":"2023-11-28T11:11:39.505445+0000","last_undegraded":"2023-11-28T11:11:39.505445+0000","last_fullsized":"2023-11-28T11:11:39.505445+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:34.522288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.081021+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:11:39.081021+0000","last_peered":"2023-11-28T11:11:39.081021+0000","last_clean":"2023-11-28T11:11:39.081021+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:11:39.081021+0000","last_undegraded":"2023-11-28T11:11:39.081021+0000","last_fullsized":"2023-11-28T11:11:39.081021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.495660+0000","last_change":"2023-11-28T11:11:39.490192+0000","last_active":"2023-11-28T11:11:39.495660+0000","last_peered":"2023-11-28T11:11:39.495660+0000","last_clean":"2023-11-28T11:11:39.495660+0000","last_became_active":"2023-11-28T11:11:39.489581+0000","last_became_peered":"2023-11-28T11:11:39.489581+0000","last_unstale":"2023-11-28T11:11:39.495660+0000","last_undegraded":"2023-11-28T11:11:39.495660+0000","last_fullsized":"2023-11-28T11:11:39.495660+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:30.218500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.483590+0000","last_change":"2023-11-28T11:11:39.097899+0000","last_active":"2023-11-28T11:11:39.483590+0000","last_peered":"2023-11-28T11:11:39.483590+0000","last_clean":"2023-11-28T11:11:39.483590+0000","last_became_active":"2023-11-28T11:11:39.097628+0000","last_became_peered":"2023-11-28T11:11:39.097628+0000","last_unstale":"2023-11-28T11:11:39.483590+0000","last_undegraded":"2023-11-28T11:11:39.483590+0000","last_fullsized":"2023-11-28T11:11:39.483590+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:01.999644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.084729+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:11:39.084729+0000","last_peered":"2023-11-28T11:11:39.084729+0000","last_clean":"2023-11-28T11:11:39.084729+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:11:39.084729+0000","last_undegraded":"2023-11-28T11:11:39.084729+0000","last_fullsized":"2023-11-28T11:11:39.084729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10672,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361168,"statfs":{"total":96636764160,"available":96625836032,"internally_reserved":0,"allocated":1351680,"data_stored":921339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.433,"5min":0.316,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.66400000000000003,"15min":0.70999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77900000000000003,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.66000000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.753,"15min":0.753},"last":0.629}]},{"osd":2,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.70299999999999996,"15min":0.754},"min":{"1min":0.49399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.753,"5min":5.532,"15min":5.532},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60999999999999999,"15min":0.624},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80000000000000004,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69799999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.47699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.52300000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.35599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40400000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82199999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77200000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.42399999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.441,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.505},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.995,"15min":0.995},"last":0.47799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9352,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362488,"statfs":{"total":96636764160,"available":96627187712,"internally_reserved":0,"allocated":786432,"data_stored":344753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52100000000000002,"15min":0.499},"min":{"1min":0.38300000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.495},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.437}]},{"osd":1,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.70199999999999996,"15min":0.76300000000000001},"min":{"1min":0.43099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77400000000000002,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52400000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.70299999999999996,"15min":0.75700000000000001},"min":{"1min":0.42299999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81000000000000005,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.67500000000000004,"15min":0.72099999999999997},"min":{"1min":0.42899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.70199999999999996,"15min":0.76300000000000001},"min":{"1min":0.44700000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.48099999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.35099999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77100000000000002,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.62}]},{"osd":5,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.36699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.71999999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.45300000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.40500000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.63},"min":{"1min":0.49399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79000000000000004,"5min":1.137,"15min":1.137},"last":0.60699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9324,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362516,"statfs":{"total":96636764160,"available":96627216384,"internally_reserved":0,"allocated":757760,"data_stored":330971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.27100000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50900000000000001,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35899999999999999},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52900000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.34599999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34000000000000002},"min":{"1min":0.249,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51300000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.372,"15min":0.36899999999999999},"min":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.224}]},{"osd":3,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40200000000000002},"min":{"1min":0.31,"5min":0.253,"15min":0.253},"max":{"1min":0.58199999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.31,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57599999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.307}]},{"osd":4,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.40999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.377},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.46600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90500000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.495}]},{"osd":6,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.41799999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.83099999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93000000000000005,"5min":0.999,"15min":0.999},"last":0.46200000000000002}]},{"osd":7,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.49199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.871,"5min":1.036,"15min":1.036},"last":0.437},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.627,"15min":0.625},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.40799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10684,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361156,"statfs":{"total":96636764160,"available":96625823744,"internally_reserved":0,"allocated":1363968,"data_stored":927959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.31900000000000001,"15min":0.309},"min":{"1min":0.27900000000000003,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.53600000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.26400000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56999999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.29899999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.40100000000000002,"15min":0.42899999999999999},"min":{"1min":0.23999999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52700000000000002,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.315},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42999999999999999,"15min":0.45100000000000001},"min":{"1min":0.29199999999999998,"5min":0.193,"15min":0.193},"max":{"1min":0.58299999999999996,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.26700000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.35699999999999998,"15min":0.34699999999999998},"min":{"1min":0.28599999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.38400000000000001,"15min":0.377},"min":{"1min":0.28399999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.372}]},{"osd":4,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.434,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.66200000000000003,"15min":0.69499999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.877,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.53900000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.41999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73899999999999999,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66200000000000003,"15min":0.69299999999999995},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83099999999999996,"5min":3.298,"15min":3.298},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.69499999999999995,"15min":0.73499999999999999},"min":{"1min":0.441,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89300000000000002,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.50600000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.52900000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":0.877,"15min":0.877},"last":0.5},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.44900000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86399999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9400,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362440,"statfs":{"total":96636764160,"available":96627138560,"internally_reserved":0,"allocated":770048,"data_stored":337591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.32000000000000001},"min":{"1min":0.222,"5min":0.19,"15min":0.19},"max":{"1min":0.48099999999999998,"5min":0.503,"15min":0.503},"last":0.31},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.372,"15min":0.35999999999999999},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53400000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.32200000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.35299999999999998,"15min":0.34000000000000002},"min":{"1min":0.27900000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34100000000000003},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48999999999999999,"5min":1.002,"15min":1.002},"last":0.29099999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.35299999999999998},"min":{"1min":0.26300000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.372},"min":{"1min":0.26800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.42799999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77400000000000002,"5min":0.875,"15min":0.875},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78700000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53900000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.442,"5min":0.435,"15min":0.435},"max":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.48499999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78700000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.67900000000000005}]},{"osd":6,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77500000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.47599999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.81799999999999995,"5min":1.05,"15min":1.05},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.44400000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78100000000000003,"5min":1.222,"15min":1.222},"last":0.69099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9720,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362120,"statfs":{"total":96636764160,"available":96626810880,"internally_reserved":0,"allocated":770048,"data_stored":337591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.34899999999999998,"15min":0.36399999999999999},"min":{"1min":0.23799999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.503,"5min":1.365,"15min":1.365},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.58099999999999996,"15min":0.69499999999999995},"min":{"1min":0.26400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51400000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.63700000000000001,"15min":0.77000000000000002},"min":{"1min":0.252,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52500000000000002,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.498},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38800000000000001,"15min":0.40600000000000003},"min":{"1min":0.29099999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.53100000000000003,"5min":1.448,"15min":1.448},"last":0.313}]},{"osd":2,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40699999999999997,"15min":0.42899999999999999},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.496,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.32600000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.50800000000000001,"5min":1.474,"15min":1.474},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.78200000000000003,"15min":0.877},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88500000000000001,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.85399999999999998,"15min":0.97399999999999998},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80900000000000005,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.84799999999999998,"15min":0.96599999999999997},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71099999999999997,"5min":12.994,"15min":12.994},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.46100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.86899999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.82799999999999996,"15min":0.93100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85399999999999998,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.88200000000000001,"15min":1.006},"min":{"1min":0.45600000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78600000000000003,"5min":12.932,"15min":12.932},"last":0.72899999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.623,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76900000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.83199999999999996,"15min":0.93600000000000005},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.72399999999999998,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.81499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9452,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362388,"statfs":{"total":96636764160,"available":96627085312,"internally_reserved":0,"allocated":757760,"data_stored":330971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.51000000000000001,"15min":0.49399999999999999},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.495},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.32000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.75,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.39000000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.47099999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68700000000000006,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40400000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.46300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.443}]},{"osd":3,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.47799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47399999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51600000000000001,"15min":0.52800000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.36399999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.46200000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85799999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.39400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9464,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362376,"statfs":{"total":96636764160,"available":96627073024,"internally_reserved":0,"allocated":770048,"data_stored":337591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":0.71599999999999997,"15min":0.621},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":11.763999999999999,"5min":11.763999999999999,"15min":11.763999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.593,"5min":0.76600000000000001,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":16.245000000000001,"5min":16.245000000000001,"15min":16.245000000000001},"last":0.37}]},{"osd":1,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.442,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.63100000000000001,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.3849999999999998,"5min":5.3849999999999998,"15min":5.3849999999999998},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.47099999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":1.032,"15min":1.032},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.39800000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.7290000000000001,"5min":2.282,"15min":2.282},"last":0.47199999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.401,"15min":1.401},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.46200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94999999999999996,"5min":1.478,"15min":1.478},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.39700000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70999999999999996,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.443}]},{"osd":6,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.65100000000000002,"15min":0.68600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.623,"15min":0.63500000000000001},"min":{"1min":0.45700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77100000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.49399999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.65900000000000003,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72299999999999998,"5min":2.444,"15min":2.444},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.75600000000000001,"15min":0.72999999999999998},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.44},"max":{"1min":5.8079999999999998,"5min":5.8079999999999998,"15min":5.8079999999999998},"last":0.54700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:11:43.559 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:11:43.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.712+0000 7f9054830700 1 Processor -- start 2023-11-28T11:11:43.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.712+0000 7f9054830700 1 -- start start 2023-11-28T11:11:43.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.713+0000 7f9054830700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f905006a270 0x7f9050071f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.713+0000 7f9054830700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f90500ae520 0x7f905006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.713+0000 7f9054830700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90500b43f0 0x7f90500b4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.713+0000 7f9054830700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90500af0c0 con 0x7f905006a270 2023-11-28T11:11:43.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.713+0000 7f9054830700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90500b0590 con 0x7f90500ae520 2023-11-28T11:11:43.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.713+0000 7f9054830700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9050159280 con 0x7f90500b43f0 2023-11-28T11:11:43.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.713+0000 7f904e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f905006a270 0x7f9050071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.713+0000 7f904e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f905006a270 0x7f9050071f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33114/0 (socket says 172.21.15.125:33114) 2023-11-28T11:11:43.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.713+0000 7f904e59c700 1 -- 172.21.15.125:0/342006532 learned_addr learned my addr 172.21.15.125:0/342006532 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:43.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.714+0000 7f904dd9b700 1 --2- 172.21.15.125:0/342006532 >> v2:172.21.15.167:3300/0 conn(0x7f90500ae520 0x7f905006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.714+0000 7f904ed9d700 1 --2- 172.21.15.125:0/342006532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90500b43f0 0x7f90500b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.714+0000 7f904e59c700 1 -- 172.21.15.125:0/342006532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90500b43f0 msgr2=0x7f90500b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:43.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.714+0000 7f904e59c700 1 --2- 172.21.15.125:0/342006532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90500b43f0 0x7f90500b4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.714+0000 7f904e59c700 1 -- 172.21.15.125:0/342006532 >> v2:172.21.15.167:3300/0 conn(0x7f90500ae520 msgr2=0x7f905006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:43.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.714+0000 7f904e59c700 1 --2- 172.21.15.125:0/342006532 >> v2:172.21.15.167:3300/0 conn(0x7f90500ae520 0x7f905006a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.714+0000 7f904e59c700 1 -- 172.21.15.125:0/342006532 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905006ab80 con 0x7f905006a270 2023-11-28T11:11:43.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.714+0000 7f904e59c700 1 --2- 172.21.15.125:0/342006532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f905006a270 0x7f9050071f70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f90500c9a00 tx=0x7f904400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea84cb5a3e7598b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:43.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.714+0000 7f904d59a700 1 -- 172.21.15.125:0/342006532 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904400dc20 con 0x7f905006a270 2023-11-28T11:11:43.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.714+0000 7f904d59a700 1 -- 172.21.15.125:0/342006532 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904400dd80 con 0x7f905006a270 2023-11-28T11:11:43.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.714+0000 7f904d59a700 1 -- 172.21.15.125:0/342006532 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044017660 con 0x7f905006a270 2023-11-28T11:11:43.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.715+0000 7f9054830700 1 -- 172.21.15.125:0/342006532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f905006a270 msgr2=0x7f9050071f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.715+0000 7f9054830700 1 --2- 172.21.15.125:0/342006532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f905006a270 0x7f9050071f70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f90500c9a00 tx=0x7f904400be70 comp rx=0 tx=0).stop 2023-11-28T11:11:43.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.715+0000 7f9054830700 1 -- 172.21.15.125:0/342006532 shutdown_connections 2023-11-28T11:11:43.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.715+0000 7f9054830700 1 --2- 172.21.15.125:0/342006532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90500b43f0 0x7f90500b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.715+0000 7f9054830700 1 --2- 172.21.15.125:0/342006532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f905006a270 0x7f9050071f70 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.715+0000 7f9054830700 1 --2- 172.21.15.125:0/342006532 >> v2:172.21.15.167:3300/0 conn(0x7f90500ae520 0x7f905006a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.715+0000 7f9054830700 1 -- 172.21.15.125:0/342006532 >> 172.21.15.125:0/342006532 conn(0x7f90500b2fc0 msgr2=0x7f9050071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:43.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.715+0000 7f9054830700 1 -- 172.21.15.125:0/342006532 shutdown_connections 2023-11-28T11:11:43.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.715+0000 7f9054830700 1 -- 172.21.15.125:0/342006532 wait complete. 2023-11-28T11:11:43.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.716+0000 7f9054830700 1 Processor -- start 2023-11-28T11:11:43.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.716+0000 7f9054830700 1 -- start start 2023-11-28T11:11:43.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.717+0000 7f9054830700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f905006a270 0x7f90501f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.717+0000 7f9054830700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90500ae520 0x7f90500c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.717+0000 7f9054830700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90500b43f0 0x7f90500c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.717+0000 7f9054830700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90500aced0 con 0x7f90500b43f0 2023-11-28T11:11:43.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.717+0000 7f9054830700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90500ca520 con 0x7f90500ae520 2023-11-28T11:11:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.717+0000 7f9054830700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90500ad390 con 0x7f905006a270 2023-11-28T11:11:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.717+0000 7f904ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90500b43f0 0x7f90500c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f904ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90500b43f0 0x7f90500c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33122/0 (socket says 172.21.15.125:33122) 2023-11-28T11:11:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f904ed9d700 1 -- 172.21.15.125:0/630190467 learned_addr learned my addr 172.21.15.125:0/630190467 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f904e59c700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f905006a270 0x7f90501f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f904dd9b700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90500ae520 0x7f90500c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f904ed9d700 1 -- 172.21.15.125:0/630190467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f905006a270 msgr2=0x7f90501f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f904ed9d700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f905006a270 0x7f90501f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f904ed9d700 1 -- 172.21.15.125:0/630190467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90500ae520 msgr2=0x7f90500c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f904ed9d700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90500ae520 0x7f90500c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f904ed9d700 1 -- 172.21.15.125:0/630190467 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904400b7f0 con 0x7f90500b43f0 2023-11-28T11:11:43.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f904ed9d700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90500b43f0 0x7f90500c6a60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9048007e60 tx=0x7f904800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:43.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f903effd700 1 -- 172.21.15.125:0/630190467 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904800ed80 con 0x7f90500b43f0 2023-11-28T11:11:43.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f903effd700 1 -- 172.21.15.125:0/630190467 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9048014420 con 0x7f90500b43f0 2023-11-28T11:11:43.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f903effd700 1 -- 172.21.15.125:0/630190467 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90480147d0 con 0x7f90500b43f0 2023-11-28T11:11:43.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f9054830700 1 -- 172.21.15.125:0/630190467 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9050072670 con 0x7f90500b43f0 2023-11-28T11:11:43.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.718+0000 7f9054830700 1 -- 172.21.15.125:0/630190467 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90500b0d10 con 0x7f90500b43f0 2023-11-28T11:11:43.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.719+0000 7f9054830700 1 -- 172.21.15.125:0/630190467 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90500afc60 con 0x7f90500b43f0 2023-11-28T11:11:43.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.719+0000 7f903effd700 1 -- 172.21.15.125:0/630190467 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9048012050 con 0x7f90500b43f0 2023-11-28T11:11:43.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.720+0000 7f903effd700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f90300682f0 0x7f903006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:43.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.720+0000 7f903effd700 1 -- 172.21.15.125:0/630190467 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9048086110 con 0x7f90500b43f0 2023-11-28T11:11:43.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.720+0000 7f904e59c700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f90300682f0 0x7f903006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:43.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.720+0000 7f904e59c700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f90300682f0 0x7f903006a7a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9044019040 tx=0x7f904400bf90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:43.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.724+0000 7f903effd700 1 -- 172.21.15.125:0/630190467 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9048052970 con 0x7f90500b43f0 2023-11-28T11:11:43.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.901+0000 7f9054830700 1 -- 172.21.15.125:0/630190467 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90500c2890 con 0x7f90300682f0 2023-11-28T11:11:43.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.909+0000 7f903effd700 1 -- 172.21.15.125:0/630190467 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311217 (secure 0 0 0) 0x7f90500c2890 con 0x7f90300682f0 2023-11-28T11:11:43.914 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:43.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 -- 172.21.15.125:0/630190467 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f90300682f0 msgr2=0x7f903006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f90300682f0 0x7f903006a7a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9044019040 tx=0x7f904400bf90 comp rx=0 tx=0).stop 2023-11-28T11:11:43.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 -- 172.21.15.125:0/630190467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90500b43f0 msgr2=0x7f90500c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:43.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90500b43f0 0x7f90500c6a60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9048007e60 tx=0x7f904800e3c0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 -- 172.21.15.125:0/630190467 shutdown_connections 2023-11-28T11:11:43.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90500b43f0 0x7f90500c6a60 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f90300682f0 0x7f903006a7a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f905006a270 0x7f90501f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 --2- 172.21.15.125:0/630190467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90500ae520 0x7f90500c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:43.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 -- 172.21.15.125:0/630190467 >> 172.21.15.125:0/630190467 conn(0x7f90500b2fc0 msgr2=0x7f905006d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:43.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 -- 172.21.15.125:0/630190467 shutdown_connections 2023-11-28T11:11:43.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:43.913+0000 7f9054830700 1 -- 172.21.15.125:0/630190467 wait complete. 2023-11-28T11:11:43.917 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:11:43.926 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2023-11-28T11:11:43.663125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":78068,"kb_used_data":7156,"kb_used_omap":0,"kb_used_meta":70848,"kb_avail":754896652,"statfs":{"total":773094113280,"available":773014171648,"internally_reserved":0,"allocated":7327744,"data_stored":3868766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":72548352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.590795"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500398+0000","last_change":"2023-11-28T11:11:39.498060+0000","last_active":"2023-11-28T11:11:39.500398+0000","last_peered":"2023-11-28T11:11:39.500398+0000","last_clean":"2023-11-28T11:11:39.500398+0000","last_became_active":"2023-11-28T11:11:39.497782+0000","last_became_peered":"2023-11-28T11:11:39.497782+0000","last_unstale":"2023-11-28T11:11:39.500398+0000","last_undegraded":"2023-11-28T11:11:39.500398+0000","last_fullsized":"2023-11-28T11:11:39.500398+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:17.219666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.484579+0000","last_change":"2023-11-28T11:11:39.480913+0000","last_active":"2023-11-28T11:11:39.484579+0000","last_peered":"2023-11-28T11:11:39.484579+0000","last_clean":"2023-11-28T11:11:39.484579+0000","last_became_active":"2023-11-28T11:11:39.480649+0000","last_became_peered":"2023-11-28T11:11:39.480649+0000","last_unstale":"2023-11-28T11:11:39.484579+0000","last_undegraded":"2023-11-28T11:11:39.484579+0000","last_fullsized":"2023-11-28T11:11:39.484579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:47:04.753595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504982+0000","last_change":"2023-11-28T11:11:39.498504+0000","last_active":"2023-11-28T11:11:39.504982+0000","last_peered":"2023-11-28T11:11:39.504982+0000","last_clean":"2023-11-28T11:11:39.504982+0000","last_became_active":"2023-11-28T11:11:39.498258+0000","last_became_peered":"2023-11-28T11:11:39.498258+0000","last_unstale":"2023-11-28T11:11:39.504982+0000","last_undegraded":"2023-11-28T11:11:39.504982+0000","last_fullsized":"2023-11-28T11:11:39.504982+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:37.649020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.507693+0000","last_change":"2023-11-28T11:11:39.502276+0000","last_active":"2023-11-28T11:11:39.507693+0000","last_peered":"2023-11-28T11:11:39.507693+0000","last_clean":"2023-11-28T11:11:39.507693+0000","last_became_active":"2023-11-28T11:11:39.499862+0000","last_became_peered":"2023-11-28T11:11:39.499862+0000","last_unstale":"2023-11-28T11:11:39.507693+0000","last_undegraded":"2023-11-28T11:11:39.507693+0000","last_fullsized":"2023-11-28T11:11:39.507693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:47:04.753595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504874+0000","last_change":"2023-11-28T11:11:39.501829+0000","last_active":"2023-11-28T11:11:39.504874+0000","last_peered":"2023-11-28T11:11:39.504874+0000","last_clean":"2023-11-28T11:11:39.504874+0000","last_became_active":"2023-11-28T11:11:39.501556+0000","last_became_peered":"2023-11-28T11:11:39.501556+0000","last_unstale":"2023-11-28T11:11:39.504874+0000","last_undegraded":"2023-11-28T11:11:39.504874+0000","last_fullsized":"2023-11-28T11:11:39.504874+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:36:44.166153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493857+0000","last_change":"2023-11-28T11:11:39.491431+0000","last_active":"2023-11-28T11:11:39.493857+0000","last_peered":"2023-11-28T11:11:39.493857+0000","last_clean":"2023-11-28T11:11:39.493857+0000","last_became_active":"2023-11-28T11:11:39.490824+0000","last_became_peered":"2023-11-28T11:11:39.490824+0000","last_unstale":"2023-11-28T11:11:39.493857+0000","last_undegraded":"2023-11-28T11:11:39.493857+0000","last_fullsized":"2023-11-28T11:11:39.493857+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:15:18.814740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501951+0000","last_change":"2023-11-28T11:11:39.499779+0000","last_active":"2023-11-28T11:11:39.501951+0000","last_peered":"2023-11-28T11:11:39.501951+0000","last_clean":"2023-11-28T11:11:39.501951+0000","last_became_active":"2023-11-28T11:11:39.499517+0000","last_became_peered":"2023-11-28T11:11:39.499517+0000","last_unstale":"2023-11-28T11:11:39.501951+0000","last_undegraded":"2023-11-28T11:11:39.501951+0000","last_fullsized":"2023-11-28T11:11:39.501951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:34.374509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508044+0000","last_change":"2023-11-28T11:11:39.506713+0000","last_active":"2023-11-28T11:11:39.508044+0000","last_peered":"2023-11-28T11:11:39.508044+0000","last_clean":"2023-11-28T11:11:39.508044+0000","last_became_active":"2023-11-28T11:11:39.506446+0000","last_became_peered":"2023-11-28T11:11:39.506446+0000","last_unstale":"2023-11-28T11:11:39.508044+0000","last_undegraded":"2023-11-28T11:11:39.508044+0000","last_fullsized":"2023-11-28T11:11:39.508044+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:52.111544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508091+0000","last_change":"2023-11-28T11:11:39.504602+0000","last_active":"2023-11-28T11:11:39.508091+0000","last_peered":"2023-11-28T11:11:39.508091+0000","last_clean":"2023-11-28T11:11:39.508091+0000","last_became_active":"2023-11-28T11:11:39.504300+0000","last_became_peered":"2023-11-28T11:11:39.504300+0000","last_unstale":"2023-11-28T11:11:39.508091+0000","last_undegraded":"2023-11-28T11:11:39.508091+0000","last_fullsized":"2023-11-28T11:11:39.508091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:33:47.418563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505022+0000","last_change":"2023-11-28T11:11:39.503929+0000","last_active":"2023-11-28T11:11:39.505022+0000","last_peered":"2023-11-28T11:11:39.505022+0000","last_clean":"2023-11-28T11:11:39.505022+0000","last_became_active":"2023-11-28T11:11:39.499307+0000","last_became_peered":"2023-11-28T11:11:39.499307+0000","last_unstale":"2023-11-28T11:11:39.505022+0000","last_undegraded":"2023-11-28T11:11:39.505022+0000","last_fullsized":"2023-11-28T11:11:39.505022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:38.983787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504969+0000","last_change":"2023-11-28T11:11:39.500783+0000","last_active":"2023-11-28T11:11:39.504969+0000","last_peered":"2023-11-28T11:11:39.504969+0000","last_clean":"2023-11-28T11:11:39.504969+0000","last_became_active":"2023-11-28T11:11:39.500515+0000","last_became_peered":"2023-11-28T11:11:39.500515+0000","last_unstale":"2023-11-28T11:11:39.504969+0000","last_undegraded":"2023-11-28T11:11:39.504969+0000","last_fullsized":"2023-11-28T11:11:39.504969+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:14:39.780137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505208+0000","last_change":"2023-11-28T11:11:39.502761+0000","last_active":"2023-11-28T11:11:39.505208+0000","last_peered":"2023-11-28T11:11:39.505208+0000","last_clean":"2023-11-28T11:11:39.505208+0000","last_became_active":"2023-11-28T11:11:39.502479+0000","last_became_peered":"2023-11-28T11:11:39.502479+0000","last_unstale":"2023-11-28T11:11:39.505208+0000","last_undegraded":"2023-11-28T11:11:39.505208+0000","last_fullsized":"2023-11-28T11:11:39.505208+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:31:12.227121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504800+0000","last_change":"2023-11-28T11:11:39.501189+0000","last_active":"2023-11-28T11:11:39.504800+0000","last_peered":"2023-11-28T11:11:39.504800+0000","last_clean":"2023-11-28T11:11:39.504800+0000","last_became_active":"2023-11-28T11:11:39.500902+0000","last_became_peered":"2023-11-28T11:11:39.500902+0000","last_unstale":"2023-11-28T11:11:39.504800+0000","last_undegraded":"2023-11-28T11:11:39.504800+0000","last_fullsized":"2023-11-28T11:11:39.504800+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:37.649020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508207+0000","last_change":"2023-11-28T11:11:39.505014+0000","last_active":"2023-11-28T11:11:39.508207+0000","last_peered":"2023-11-28T11:11:39.508207+0000","last_clean":"2023-11-28T11:11:39.508207+0000","last_became_active":"2023-11-28T11:11:39.504422+0000","last_became_peered":"2023-11-28T11:11:39.504422+0000","last_unstale":"2023-11-28T11:11:39.508207+0000","last_undegraded":"2023-11-28T11:11:39.508207+0000","last_fullsized":"2023-11-28T11:11:39.508207+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:52.111544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504101+0000","last_change":"2023-11-28T11:11:39.494609+0000","last_active":"2023-11-28T11:11:39.504101+0000","last_peered":"2023-11-28T11:11:39.504101+0000","last_clean":"2023-11-28T11:11:39.504101+0000","last_became_active":"2023-11-28T11:11:39.494241+0000","last_became_peered":"2023-11-28T11:11:39.494241+0000","last_unstale":"2023-11-28T11:11:39.504101+0000","last_undegraded":"2023-11-28T11:11:39.504101+0000","last_fullsized":"2023-11-28T11:11:39.504101+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:31:12.227121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501936+0000","last_change":"2023-11-28T11:11:39.499511+0000","last_active":"2023-11-28T11:11:39.501936+0000","last_peered":"2023-11-28T11:11:39.501936+0000","last_clean":"2023-11-28T11:11:39.501936+0000","last_became_active":"2023-11-28T11:11:39.499234+0000","last_became_peered":"2023-11-28T11:11:39.499234+0000","last_unstale":"2023-11-28T11:11:39.501936+0000","last_undegraded":"2023-11-28T11:11:39.501936+0000","last_fullsized":"2023-11-28T11:11:39.501936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:45:04.333609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.502010+0000","last_change":"2023-11-28T11:11:39.500539+0000","last_active":"2023-11-28T11:11:39.502010+0000","last_peered":"2023-11-28T11:11:39.502010+0000","last_clean":"2023-11-28T11:11:39.502010+0000","last_became_active":"2023-11-28T11:11:39.500166+0000","last_became_peered":"2023-11-28T11:11:39.500166+0000","last_unstale":"2023-11-28T11:11:39.502010+0000","last_undegraded":"2023-11-28T11:11:39.502010+0000","last_fullsized":"2023-11-28T11:11:39.502010+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:03.005870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.502118+0000","last_change":"2023-11-28T11:11:39.500106+0000","last_active":"2023-11-28T11:11:39.502118+0000","last_peered":"2023-11-28T11:11:39.502118+0000","last_clean":"2023-11-28T11:11:39.502118+0000","last_became_active":"2023-11-28T11:11:39.499601+0000","last_became_peered":"2023-11-28T11:11:39.499601+0000","last_unstale":"2023-11-28T11:11:39.502118+0000","last_undegraded":"2023-11-28T11:11:39.502118+0000","last_fullsized":"2023-11-28T11:11:39.502118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:58:52.452924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500261+0000","last_change":"2023-11-28T11:11:39.497502+0000","last_active":"2023-11-28T11:11:39.500261+0000","last_peered":"2023-11-28T11:11:39.500261+0000","last_clean":"2023-11-28T11:11:39.500261+0000","last_became_active":"2023-11-28T11:11:39.497213+0000","last_became_peered":"2023-11-28T11:11:39.497213+0000","last_unstale":"2023-11-28T11:11:39.500261+0000","last_undegraded":"2023-11-28T11:11:39.500261+0000","last_fullsized":"2023-11-28T11:11:39.500261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:22:02.083282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493389+0000","last_change":"2023-11-28T11:11:39.490970+0000","last_active":"2023-11-28T11:11:39.493389+0000","last_peered":"2023-11-28T11:11:39.493389+0000","last_clean":"2023-11-28T11:11:39.493389+0000","last_became_active":"2023-11-28T11:11:39.490714+0000","last_became_peered":"2023-11-28T11:11:39.490714+0000","last_unstale":"2023-11-28T11:11:39.493389+0000","last_undegraded":"2023-11-28T11:11:39.493389+0000","last_fullsized":"2023-11-28T11:11:39.493389+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:31:56.919015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500406+0000","last_change":"2023-11-28T11:11:39.496618+0000","last_active":"2023-11-28T11:11:39.500406+0000","last_peered":"2023-11-28T11:11:39.500406+0000","last_clean":"2023-11-28T11:11:39.500406+0000","last_became_active":"2023-11-28T11:11:39.496149+0000","last_became_peered":"2023-11-28T11:11:39.496149+0000","last_unstale":"2023-11-28T11:11:39.500406+0000","last_undegraded":"2023-11-28T11:11:39.500406+0000","last_fullsized":"2023-11-28T11:11:39.500406+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:29.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.499975+0000","last_change":"2023-11-28T11:11:39.498748+0000","last_active":"2023-11-28T11:11:39.499975+0000","last_peered":"2023-11-28T11:11:39.499975+0000","last_clean":"2023-11-28T11:11:39.499975+0000","last_became_active":"2023-11-28T11:11:39.498475+0000","last_became_peered":"2023-11-28T11:11:39.498475+0000","last_unstale":"2023-11-28T11:11:39.499975+0000","last_undegraded":"2023-11-28T11:11:39.499975+0000","last_fullsized":"2023-11-28T11:11:39.499975+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:24.315068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500664+0000","last_change":"2023-11-28T11:11:39.499848+0000","last_active":"2023-11-28T11:11:39.500664+0000","last_peered":"2023-11-28T11:11:39.500664+0000","last_clean":"2023-11-28T11:11:39.500664+0000","last_became_active":"2023-11-28T11:11:39.499562+0000","last_became_peered":"2023-11-28T11:11:39.499562+0000","last_unstale":"2023-11-28T11:11:39.500664+0000","last_undegraded":"2023-11-28T11:11:39.500664+0000","last_fullsized":"2023-11-28T11:11:39.500664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:43.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508227+0000","last_change":"2023-11-28T11:11:39.505322+0000","last_active":"2023-11-28T11:11:39.508227+0000","last_peered":"2023-11-28T11:11:39.508227+0000","last_clean":"2023-11-28T11:11:39.508227+0000","last_became_active":"2023-11-28T11:11:39.503630+0000","last_became_peered":"2023-11-28T11:11:39.503630+0000","last_unstale":"2023-11-28T11:11:39.508227+0000","last_undegraded":"2023-11-28T11:11:39.508227+0000","last_fullsized":"2023-11-28T11:11:39.508227+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:32.091508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500465+0000","last_change":"2023-11-28T11:11:39.496866+0000","last_active":"2023-11-28T11:11:39.500465+0000","last_peered":"2023-11-28T11:11:39.500465+0000","last_clean":"2023-11-28T11:11:39.500465+0000","last_became_active":"2023-11-28T11:11:39.496225+0000","last_became_peered":"2023-11-28T11:11:39.496225+0000","last_unstale":"2023-11-28T11:11:39.500465+0000","last_undegraded":"2023-11-28T11:11:39.500465+0000","last_fullsized":"2023-11-28T11:11:39.500465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:32.091508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500606+0000","last_change":"2023-11-28T11:11:39.497319+0000","last_active":"2023-11-28T11:11:39.500606+0000","last_peered":"2023-11-28T11:11:39.500606+0000","last_clean":"2023-11-28T11:11:39.500606+0000","last_became_active":"2023-11-28T11:11:39.496661+0000","last_became_peered":"2023-11-28T11:11:39.496661+0000","last_unstale":"2023-11-28T11:11:39.500606+0000","last_undegraded":"2023-11-28T11:11:39.500606+0000","last_fullsized":"2023-11-28T11:11:39.500606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:03.005870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500343+0000","last_change":"2023-11-28T11:11:39.489075+0000","last_active":"2023-11-28T11:11:39.500343+0000","last_peered":"2023-11-28T11:11:39.500343+0000","last_clean":"2023-11-28T11:11:39.500343+0000","last_became_active":"2023-11-28T11:11:39.488806+0000","last_became_peered":"2023-11-28T11:11:39.488806+0000","last_unstale":"2023-11-28T11:11:39.500343+0000","last_undegraded":"2023-11-28T11:11:39.500343+0000","last_fullsized":"2023-11-28T11:11:39.500343+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:25.283518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.495554+0000","last_change":"2023-11-28T11:11:39.493985+0000","last_active":"2023-11-28T11:11:39.495554+0000","last_peered":"2023-11-28T11:11:39.495554+0000","last_clean":"2023-11-28T11:11:39.495554+0000","last_became_active":"2023-11-28T11:11:39.493737+0000","last_became_peered":"2023-11-28T11:11:39.493737+0000","last_unstale":"2023-11-28T11:11:39.495554+0000","last_undegraded":"2023-11-28T11:11:39.495554+0000","last_fullsized":"2023-11-28T11:11:39.495554+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:37.649020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508114+0000","last_change":"2023-11-28T11:11:39.504632+0000","last_active":"2023-11-28T11:11:39.508114+0000","last_peered":"2023-11-28T11:11:39.508114+0000","last_clean":"2023-11-28T11:11:39.508114+0000","last_became_active":"2023-11-28T11:11:39.504157+0000","last_became_peered":"2023-11-28T11:11:39.504157+0000","last_unstale":"2023-11-28T11:11:39.508114+0000","last_undegraded":"2023-11-28T11:11:39.508114+0000","last_fullsized":"2023-11-28T11:11:39.508114+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:51:00.730093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508022+0000","last_change":"2023-11-28T11:11:39.506627+0000","last_active":"2023-11-28T11:11:39.508022+0000","last_peered":"2023-11-28T11:11:39.508022+0000","last_clean":"2023-11-28T11:11:39.508022+0000","last_became_active":"2023-11-28T11:11:39.506340+0000","last_became_peered":"2023-11-28T11:11:39.506340+0000","last_unstale":"2023-11-28T11:11:39.508022+0000","last_undegraded":"2023-11-28T11:11:39.508022+0000","last_fullsized":"2023-11-28T11:11:39.508022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:38.983787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501288+0000","last_change":"2023-11-28T11:11:39.498988+0000","last_active":"2023-11-28T11:11:39.501288+0000","last_peered":"2023-11-28T11:11:39.501288+0000","last_clean":"2023-11-28T11:11:39.501288+0000","last_became_active":"2023-11-28T11:11:39.498674+0000","last_became_peered":"2023-11-28T11:11:39.498674+0000","last_unstale":"2023-11-28T11:11:39.501288+0000","last_undegraded":"2023-11-28T11:11:39.501288+0000","last_fullsized":"2023-11-28T11:11:39.501288+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:17:10.491522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493827+0000","last_change":"2023-11-28T11:11:39.491679+0000","last_active":"2023-11-28T11:11:39.493827+0000","last_peered":"2023-11-28T11:11:39.493827+0000","last_clean":"2023-11-28T11:11:39.493827+0000","last_became_active":"2023-11-28T11:11:39.491400+0000","last_became_peered":"2023-11-28T11:11:39.491400+0000","last_unstale":"2023-11-28T11:11:39.493827+0000","last_undegraded":"2023-11-28T11:11:39.493827+0000","last_fullsized":"2023-11-28T11:11:39.493827+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:34:16.695419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.497326+0000","last_change":"2023-11-28T11:11:39.494132+0000","last_active":"2023-11-28T11:11:39.497326+0000","last_peered":"2023-11-28T11:11:39.497326+0000","last_clean":"2023-11-28T11:11:39.497326+0000","last_became_active":"2023-11-28T11:11:39.493528+0000","last_became_peered":"2023-11-28T11:11:39.493528+0000","last_unstale":"2023-11-28T11:11:39.497326+0000","last_undegraded":"2023-11-28T11:11:39.497326+0000","last_fullsized":"2023-11-28T11:11:39.497326+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:15:53.941620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500329+0000","last_change":"2023-11-28T11:11:39.086070+0000","last_active":"2023-11-28T11:11:39.500329+0000","last_peered":"2023-11-28T11:11:39.500329+0000","last_clean":"2023-11-28T11:11:39.500329+0000","last_became_active":"2023-11-28T11:11:39.085772+0000","last_became_peered":"2023-11-28T11:11:39.085772+0000","last_unstale":"2023-11-28T11:11:39.500329+0000","last_undegraded":"2023-11-28T11:11:39.500329+0000","last_fullsized":"2023-11-28T11:11:39.500329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:30.443943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500364+0000","last_change":"2023-11-28T11:11:39.491786+0000","last_active":"2023-11-28T11:11:39.500364+0000","last_peered":"2023-11-28T11:11:39.500364+0000","last_clean":"2023-11-28T11:11:39.500364+0000","last_became_active":"2023-11-28T11:11:39.491453+0000","last_became_peered":"2023-11-28T11:11:39.491453+0000","last_unstale":"2023-11-28T11:11:39.500364+0000","last_undegraded":"2023-11-28T11:11:39.500364+0000","last_fullsized":"2023-11-28T11:11:39.500364+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:31.618924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.499124+0000","last_change":"2023-11-28T11:11:39.087829+0000","last_active":"2023-11-28T11:11:39.499124+0000","last_peered":"2023-11-28T11:11:39.499124+0000","last_clean":"2023-11-28T11:11:39.499124+0000","last_became_active":"2023-11-28T11:11:39.087505+0000","last_became_peered":"2023-11-28T11:11:39.087505+0000","last_unstale":"2023-11-28T11:11:39.499124+0000","last_undegraded":"2023-11-28T11:11:39.499124+0000","last_fullsized":"2023-11-28T11:11:39.499124+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:36.642794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493920+0000","last_change":"2023-11-28T11:11:39.488659+0000","last_active":"2023-11-28T11:11:39.493920+0000","last_peered":"2023-11-28T11:11:39.493920+0000","last_clean":"2023-11-28T11:11:39.493920+0000","last_became_active":"2023-11-28T11:11:39.487962+0000","last_became_peered":"2023-11-28T11:11:39.487962+0000","last_unstale":"2023-11-28T11:11:39.493920+0000","last_undegraded":"2023-11-28T11:11:39.493920+0000","last_fullsized":"2023-11-28T11:11:39.493920+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:43.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.497844+0000","last_change":"2023-11-28T11:11:39.088467+0000","last_active":"2023-11-28T11:11:39.497844+0000","last_peered":"2023-11-28T11:11:39.497844+0000","last_clean":"2023-11-28T11:11:39.497844+0000","last_became_active":"2023-11-28T11:11:39.087457+0000","last_became_peered":"2023-11-28T11:11:39.087457+0000","last_unstale":"2023-11-28T11:11:39.497844+0000","last_undegraded":"2023-11-28T11:11:39.497844+0000","last_fullsized":"2023-11-28T11:11:39.497844+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:37.977560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505735+0000","last_change":"2023-11-28T11:11:39.503835+0000","last_active":"2023-11-28T11:11:39.505735+0000","last_peered":"2023-11-28T11:11:39.505735+0000","last_clean":"2023-11-28T11:11:39.505735+0000","last_became_active":"2023-11-28T11:11:39.499167+0000","last_became_peered":"2023-11-28T11:11:39.499167+0000","last_unstale":"2023-11-28T11:11:39.505735+0000","last_undegraded":"2023-11-28T11:11:39.505735+0000","last_fullsized":"2023-11-28T11:11:39.505735+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:24.208957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.492990+0000","last_change":"2023-11-28T11:11:39.087837+0000","last_active":"2023-11-28T11:11:39.492990+0000","last_peered":"2023-11-28T11:11:39.492990+0000","last_clean":"2023-11-28T11:11:39.492990+0000","last_became_active":"2023-11-28T11:11:39.087166+0000","last_became_peered":"2023-11-28T11:11:39.087166+0000","last_unstale":"2023-11-28T11:11:39.492990+0000","last_undegraded":"2023-11-28T11:11:39.492990+0000","last_fullsized":"2023-11-28T11:11:39.492990+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:01.999644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.492867+0000","last_change":"2023-11-28T11:11:39.489538+0000","last_active":"2023-11-28T11:11:39.492867+0000","last_peered":"2023-11-28T11:11:39.492867+0000","last_clean":"2023-11-28T11:11:39.492867+0000","last_became_active":"2023-11-28T11:11:39.489273+0000","last_became_peered":"2023-11-28T11:11:39.489273+0000","last_unstale":"2023-11-28T11:11:39.492867+0000","last_undegraded":"2023-11-28T11:11:39.492867+0000","last_fullsized":"2023-11-28T11:11:39.492867+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:49.378558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.490011+0000","last_change":"2023-11-28T11:11:39.098100+0000","last_active":"2023-11-28T11:11:39.490011+0000","last_peered":"2023-11-28T11:11:39.490011+0000","last_clean":"2023-11-28T11:11:39.490011+0000","last_became_active":"2023-11-28T11:11:39.097793+0000","last_became_peered":"2023-11-28T11:11:39.097793+0000","last_unstale":"2023-11-28T11:11:39.490011+0000","last_undegraded":"2023-11-28T11:11:39.490011+0000","last_fullsized":"2023-11-28T11:11:39.490011+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:16.213440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.502490+0000","last_change":"2023-11-28T11:11:39.501037+0000","last_active":"2023-11-28T11:11:39.502490+0000","last_peered":"2023-11-28T11:11:39.502490+0000","last_clean":"2023-11-28T11:11:39.502490+0000","last_became_active":"2023-11-28T11:11:39.500791+0000","last_became_peered":"2023-11-28T11:11:39.500791+0000","last_unstale":"2023-11-28T11:11:39.502490+0000","last_undegraded":"2023-11-28T11:11:39.502490+0000","last_fullsized":"2023-11-28T11:11:39.502490+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:32.091508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493010+0000","last_change":"2023-11-28T11:11:39.098122+0000","last_active":"2023-11-28T11:11:39.493010+0000","last_peered":"2023-11-28T11:11:39.493010+0000","last_clean":"2023-11-28T11:11:39.493010+0000","last_became_active":"2023-11-28T11:11:39.097862+0000","last_became_peered":"2023-11-28T11:11:39.097862+0000","last_unstale":"2023-11-28T11:11:39.493010+0000","last_undegraded":"2023-11-28T11:11:39.493010+0000","last_fullsized":"2023-11-28T11:11:39.493010+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:36.642794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.494075+0000","last_change":"2023-11-28T11:11:39.489090+0000","last_active":"2023-11-28T11:11:39.494075+0000","last_peered":"2023-11-28T11:11:39.494075+0000","last_clean":"2023-11-28T11:11:39.494075+0000","last_became_active":"2023-11-28T11:11:39.488627+0000","last_became_peered":"2023-11-28T11:11:39.488627+0000","last_unstale":"2023-11-28T11:11:39.494075+0000","last_undegraded":"2023-11-28T11:11:39.494075+0000","last_fullsized":"2023-11-28T11:11:39.494075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:35.528514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.483331+0000","last_change":"2023-11-28T11:11:39.095000+0000","last_active":"2023-11-28T11:11:39.483331+0000","last_peered":"2023-11-28T11:11:39.483331+0000","last_clean":"2023-11-28T11:11:39.483331+0000","last_became_active":"2023-11-28T11:11:39.094733+0000","last_became_peered":"2023-11-28T11:11:39.094733+0000","last_unstale":"2023-11-28T11:11:39.483331+0000","last_undegraded":"2023-11-28T11:11:39.483331+0000","last_fullsized":"2023-11-28T11:11:39.483331+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:37.977560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.502439+0000","last_change":"2023-11-28T11:11:39.501483+0000","last_active":"2023-11-28T11:11:39.502439+0000","last_peered":"2023-11-28T11:11:39.502439+0000","last_clean":"2023-11-28T11:11:39.502439+0000","last_became_active":"2023-11-28T11:11:39.501230+0000","last_became_peered":"2023-11-28T11:11:39.501230+0000","last_unstale":"2023-11-28T11:11:39.502439+0000","last_undegraded":"2023-11-28T11:11:39.502439+0000","last_fullsized":"2023-11-28T11:11:39.502439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:34:16.695419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.482201+0000","last_change":"2023-11-28T11:11:39.090096+0000","last_active":"2023-11-28T11:11:39.482201+0000","last_peered":"2023-11-28T11:11:39.482201+0000","last_clean":"2023-11-28T11:11:39.482201+0000","last_became_active":"2023-11-28T11:11:39.089822+0000","last_became_peered":"2023-11-28T11:11:39.089822+0000","last_unstale":"2023-11-28T11:11:39.482201+0000","last_undegraded":"2023-11-28T11:11:39.482201+0000","last_fullsized":"2023-11-28T11:11:39.482201+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:08.899992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.491039+0000","last_change":"2023-11-28T11:11:39.487632+0000","last_active":"2023-11-28T11:11:39.491039+0000","last_peered":"2023-11-28T11:11:39.491039+0000","last_clean":"2023-11-28T11:11:39.491039+0000","last_became_active":"2023-11-28T11:11:39.487288+0000","last_became_peered":"2023-11-28T11:11:39.487288+0000","last_unstale":"2023-11-28T11:11:39.491039+0000","last_undegraded":"2023-11-28T11:11:39.491039+0000","last_fullsized":"2023-11-28T11:11:39.491039+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:31.618924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.492670+0000","last_change":"2023-11-28T11:11:39.092764+0000","last_active":"2023-11-28T11:11:39.492670+0000","last_peered":"2023-11-28T11:11:39.492670+0000","last_clean":"2023-11-28T11:11:39.492670+0000","last_became_active":"2023-11-28T11:11:39.092328+0000","last_became_peered":"2023-11-28T11:11:39.092328+0000","last_unstale":"2023-11-28T11:11:39.492670+0000","last_undegraded":"2023-11-28T11:11:39.492670+0000","last_fullsized":"2023-11-28T11:11:39.492670+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:15:12.697873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.496706+0000","last_change":"2023-11-28T11:11:39.495599+0000","last_active":"2023-11-28T11:11:39.496706+0000","last_peered":"2023-11-28T11:11:39.496706+0000","last_clean":"2023-11-28T11:11:39.496706+0000","last_became_active":"2023-11-28T11:11:39.495309+0000","last_became_peered":"2023-11-28T11:11:39.495309+0000","last_unstale":"2023-11-28T11:11:39.496706+0000","last_undegraded":"2023-11-28T11:11:39.496706+0000","last_fullsized":"2023-11-28T11:11:39.496706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:43.072857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.483267+0000","last_change":"2023-11-28T11:11:39.089854+0000","last_active":"2023-11-28T11:11:39.483267+0000","last_peered":"2023-11-28T11:11:39.483267+0000","last_clean":"2023-11-28T11:11:39.483267+0000","last_became_active":"2023-11-28T11:11:39.089478+0000","last_became_peered":"2023-11-28T11:11:39.089478+0000","last_unstale":"2023-11-28T11:11:39.483267+0000","last_undegraded":"2023-11-28T11:11:39.483267+0000","last_fullsized":"2023-11-28T11:11:39.483267+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:00:01.273198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500352+0000","last_change":"2023-11-28T11:11:39.497598+0000","last_active":"2023-11-28T11:11:39.500352+0000","last_peered":"2023-11-28T11:11:39.500352+0000","last_clean":"2023-11-28T11:11:39.500352+0000","last_became_active":"2023-11-28T11:11:39.497302+0000","last_became_peered":"2023-11-28T11:11:39.497302+0000","last_unstale":"2023-11-28T11:11:39.500352+0000","last_undegraded":"2023-11-28T11:11:39.500352+0000","last_fullsized":"2023-11-28T11:11:39.500352+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:42:33.252377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"65'3","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504345+0000","last_change":"2023-11-28T11:11:39.090006+0000","last_active":"2023-11-28T11:11:39.504345+0000","last_peered":"2023-11-28T11:11:39.504345+0000","last_clean":"2023-11-28T11:11:39.504345+0000","last_became_active":"2023-11-28T11:11:39.089440+0000","last_became_peered":"2023-11-28T11:11:39.089440+0000","last_unstale":"2023-11-28T11:11:39.504345+0000","last_undegraded":"2023-11-28T11:11:39.504345+0000","last_fullsized":"2023-11-28T11:11:39.504345+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:30.443943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500281+0000","last_change":"2023-11-28T11:11:39.490525+0000","last_active":"2023-11-28T11:11:39.500281+0000","last_peered":"2023-11-28T11:11:39.500281+0000","last_clean":"2023-11-28T11:11:39.500281+0000","last_became_active":"2023-11-28T11:11:39.490271+0000","last_became_peered":"2023-11-28T11:11:39.490271+0000","last_unstale":"2023-11-28T11:11:39.500281+0000","last_undegraded":"2023-11-28T11:11:39.500281+0000","last_fullsized":"2023-11-28T11:11:39.500281+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:32.091508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.510840+0000","last_change":"2023-11-28T11:11:39.089931+0000","last_active":"2023-11-28T11:11:39.510840+0000","last_peered":"2023-11-28T11:11:39.510840+0000","last_clean":"2023-11-28T11:11:39.510840+0000","last_became_active":"2023-11-28T11:11:39.089682+0000","last_became_peered":"2023-11-28T11:11:39.089682+0000","last_unstale":"2023-11-28T11:11:39.510840+0000","last_undegraded":"2023-11-28T11:11:39.510840+0000","last_fullsized":"2023-11-28T11:11:39.510840+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:31:51.909729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505019+0000","last_change":"2023-11-28T11:11:39.501298+0000","last_active":"2023-11-28T11:11:39.505019+0000","last_peered":"2023-11-28T11:11:39.505019+0000","last_clean":"2023-11-28T11:11:39.505019+0000","last_became_active":"2023-11-28T11:11:39.501019+0000","last_became_peered":"2023-11-28T11:11:39.501019+0000","last_unstale":"2023-11-28T11:11:39.505019+0000","last_undegraded":"2023-11-28T11:11:39.505019+0000","last_fullsized":"2023-11-28T11:11:39.505019+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:17.219666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.503811+0000","last_change":"2023-11-28T11:11:39.093429+0000","last_active":"2023-11-28T11:11:39.503811+0000","last_peered":"2023-11-28T11:11:39.503811+0000","last_clean":"2023-11-28T11:11:39.503811+0000","last_became_active":"2023-11-28T11:11:39.093161+0000","last_became_peered":"2023-11-28T11:11:39.093161+0000","last_unstale":"2023-11-28T11:11:39.503811+0000","last_undegraded":"2023-11-28T11:11:39.503811+0000","last_fullsized":"2023-11-28T11:11:39.503811+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:44.141702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500458+0000","last_change":"2023-11-28T11:11:39.496475+0000","last_active":"2023-11-28T11:11:39.500458+0000","last_peered":"2023-11-28T11:11:39.500458+0000","last_clean":"2023-11-28T11:11:39.500458+0000","last_became_active":"2023-11-28T11:11:39.496140+0000","last_became_peered":"2023-11-28T11:11:39.496140+0000","last_unstale":"2023-11-28T11:11:39.500458+0000","last_undegraded":"2023-11-28T11:11:39.500458+0000","last_fullsized":"2023-11-28T11:11:39.500458+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:24.208957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.492781+0000","last_change":"2023-11-28T11:11:39.091511+0000","last_active":"2023-11-28T11:11:39.492781+0000","last_peered":"2023-11-28T11:11:39.492781+0000","last_clean":"2023-11-28T11:11:39.492781+0000","last_became_active":"2023-11-28T11:11:39.091254+0000","last_became_peered":"2023-11-28T11:11:39.091254+0000","last_unstale":"2023-11-28T11:11:39.492781+0000","last_undegraded":"2023-11-28T11:11:39.492781+0000","last_fullsized":"2023-11-28T11:11:39.492781+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:36:43.159926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.495673+0000","last_change":"2023-11-28T11:11:39.490842+0000","last_active":"2023-11-28T11:11:39.495673+0000","last_peered":"2023-11-28T11:11:39.495673+0000","last_clean":"2023-11-28T11:11:39.495673+0000","last_became_active":"2023-11-28T11:11:39.490565+0000","last_became_peered":"2023-11-28T11:11:39.490565+0000","last_unstale":"2023-11-28T11:11:39.495673+0000","last_undegraded":"2023-11-28T11:11:39.495673+0000","last_fullsized":"2023-11-28T11:11:39.495673+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:16.316227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.482167+0000","last_change":"2023-11-28T11:11:39.091271+0000","last_active":"2023-11-28T11:11:39.482167+0000","last_peered":"2023-11-28T11:11:39.482167+0000","last_clean":"2023-11-28T11:11:39.482167+0000","last_became_active":"2023-11-28T11:11:39.090997+0000","last_became_peered":"2023-11-28T11:11:39.090997+0000","last_unstale":"2023-11-28T11:11:39.482167+0000","last_undegraded":"2023-11-28T11:11:39.482167+0000","last_fullsized":"2023-11-28T11:11:39.482167+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:31:51.909729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.488929+0000","last_change":"2023-11-28T11:11:39.487310+0000","last_active":"2023-11-28T11:11:39.488929+0000","last_peered":"2023-11-28T11:11:39.488929+0000","last_clean":"2023-11-28T11:11:39.488929+0000","last_became_active":"2023-11-28T11:11:39.486990+0000","last_became_peered":"2023-11-28T11:11:39.486990+0000","last_unstale":"2023-11-28T11:11:39.488929+0000","last_undegraded":"2023-11-28T11:11:39.488929+0000","last_fullsized":"2023-11-28T11:11:39.488929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:29.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508367+0000","last_change":"2023-11-28T11:11:39.092100+0000","last_active":"2023-11-28T11:11:39.508367+0000","last_peered":"2023-11-28T11:11:39.508367+0000","last_clean":"2023-11-28T11:11:39.508367+0000","last_became_active":"2023-11-28T11:11:39.091806+0000","last_became_peered":"2023-11-28T11:11:39.091806+0000","last_unstale":"2023-11-28T11:11:39.508367+0000","last_undegraded":"2023-11-28T11:11:39.508367+0000","last_fullsized":"2023-11-28T11:11:39.508367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:15.310001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501612+0000","last_change":"2023-11-28T11:11:39.501033+0000","last_active":"2023-11-28T11:11:39.501612+0000","last_peered":"2023-11-28T11:11:39.501612+0000","last_clean":"2023-11-28T11:11:39.501612+0000","last_became_active":"2023-11-28T11:11:39.500801+0000","last_became_peered":"2023-11-28T11:11:39.500801+0000","last_unstale":"2023-11-28T11:11:39.501612+0000","last_undegraded":"2023-11-28T11:11:39.501612+0000","last_fullsized":"2023-11-28T11:11:39.501612+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:31:56.919015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.506112+0000","last_change":"2023-11-28T11:11:39.091155+0000","last_active":"2023-11-28T11:11:39.506112+0000","last_peered":"2023-11-28T11:11:39.506112+0000","last_clean":"2023-11-28T11:11:39.506112+0000","last_became_active":"2023-11-28T11:11:39.090880+0000","last_became_peered":"2023-11-28T11:11:39.090880+0000","last_unstale":"2023-11-28T11:11:39.506112+0000","last_undegraded":"2023-11-28T11:11:39.506112+0000","last_fullsized":"2023-11-28T11:11:39.506112+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:29.212273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.489641+0000","last_change":"2023-11-28T11:11:39.486427+0000","last_active":"2023-11-28T11:11:39.489641+0000","last_peered":"2023-11-28T11:11:39.489641+0000","last_clean":"2023-11-28T11:11:39.489641+0000","last_became_active":"2023-11-28T11:11:39.486160+0000","last_became_peered":"2023-11-28T11:11:39.486160+0000","last_unstale":"2023-11-28T11:11:39.489641+0000","last_undegraded":"2023-11-28T11:11:39.489641+0000","last_fullsized":"2023-11-28T11:11:39.489641+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:05.933893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.488918+0000","last_change":"2023-11-28T11:11:39.088353+0000","last_active":"2023-11-28T11:11:39.488918+0000","last_peered":"2023-11-28T11:11:39.488918+0000","last_clean":"2023-11-28T11:11:39.488918+0000","last_became_active":"2023-11-28T11:11:39.088012+0000","last_became_peered":"2023-11-28T11:11:39.088012+0000","last_unstale":"2023-11-28T11:11:39.488918+0000","last_undegraded":"2023-11-28T11:11:39.488918+0000","last_fullsized":"2023-11-28T11:11:39.488918+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:34.522288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500585+0000","last_change":"2023-11-28T11:11:39.497236+0000","last_active":"2023-11-28T11:11:39.500585+0000","last_peered":"2023-11-28T11:11:39.500585+0000","last_clean":"2023-11-28T11:11:39.500585+0000","last_became_active":"2023-11-28T11:11:39.496318+0000","last_became_peered":"2023-11-28T11:11:39.496318+0000","last_unstale":"2023-11-28T11:11:39.500585+0000","last_undegraded":"2023-11-28T11:11:39.500585+0000","last_fullsized":"2023-11-28T11:11:39.500585+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:58:52.452924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.476809+0000","last_change":"2023-11-28T11:11:39.088745+0000","last_active":"2023-11-28T11:11:39.476809+0000","last_peered":"2023-11-28T11:11:39.476809+0000","last_clean":"2023-11-28T11:11:39.476809+0000","last_became_active":"2023-11-28T11:11:39.088208+0000","last_became_peered":"2023-11-28T11:11:39.088208+0000","last_unstale":"2023-11-28T11:11:39.476809+0000","last_undegraded":"2023-11-28T11:11:39.476809+0000","last_fullsized":"2023-11-28T11:11:39.476809+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:31:11.220895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.495681+0000","last_change":"2023-11-28T11:11:39.490386+0000","last_active":"2023-11-28T11:11:39.495681+0000","last_peered":"2023-11-28T11:11:39.495681+0000","last_clean":"2023-11-28T11:11:39.495681+0000","last_became_active":"2023-11-28T11:11:39.489906+0000","last_became_peered":"2023-11-28T11:11:39.489906+0000","last_unstale":"2023-11-28T11:11:39.495681+0000","last_undegraded":"2023-11-28T11:11:39.495681+0000","last_fullsized":"2023-11-28T11:11:39.495681+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:31.450169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.478472+0000","last_change":"2023-11-28T11:11:39.090009+0000","last_active":"2023-11-28T11:11:39.478472+0000","last_peered":"2023-11-28T11:11:39.478472+0000","last_clean":"2023-11-28T11:11:39.478472+0000","last_became_active":"2023-11-28T11:11:39.089728+0000","last_became_peered":"2023-11-28T11:11:39.089728+0000","last_unstale":"2023-11-28T11:11:39.478472+0000","last_undegraded":"2023-11-28T11:11:39.478472+0000","last_fullsized":"2023-11-28T11:11:39.478472+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:34.522288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.496625+0000","last_change":"2023-11-28T11:11:39.494017+0000","last_active":"2023-11-28T11:11:39.496625+0000","last_peered":"2023-11-28T11:11:39.496625+0000","last_clean":"2023-11-28T11:11:39.496625+0000","last_became_active":"2023-11-28T11:11:39.493429+0000","last_became_peered":"2023-11-28T11:11:39.493429+0000","last_unstale":"2023-11-28T11:11:39.496625+0000","last_undegraded":"2023-11-28T11:11:39.496625+0000","last_fullsized":"2023-11-28T11:11:39.496625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:33:40.404585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.482442+0000","last_change":"2023-11-28T11:11:39.091178+0000","last_active":"2023-11-28T11:11:39.482442+0000","last_peered":"2023-11-28T11:11:39.482442+0000","last_clean":"2023-11-28T11:11:39.482442+0000","last_became_active":"2023-11-28T11:11:39.090848+0000","last_became_peered":"2023-11-28T11:11:39.090848+0000","last_unstale":"2023-11-28T11:11:39.482442+0000","last_undegraded":"2023-11-28T11:11:39.482442+0000","last_fullsized":"2023-11-28T11:11:39.482442+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:40.182873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505012+0000","last_change":"2023-11-28T11:11:39.501398+0000","last_active":"2023-11-28T11:11:39.505012+0000","last_peered":"2023-11-28T11:11:39.505012+0000","last_clean":"2023-11-28T11:11:39.505012+0000","last_became_active":"2023-11-28T11:11:39.501175+0000","last_became_peered":"2023-11-28T11:11:39.501175+0000","last_unstale":"2023-11-28T11:11:39.505012+0000","last_undegraded":"2023-11-28T11:11:39.505012+0000","last_fullsized":"2023-11-28T11:11:39.505012+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:29.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.485164+0000","last_change":"2023-11-28T11:11:39.092818+0000","last_active":"2023-11-28T11:11:39.485164+0000","last_peered":"2023-11-28T11:11:39.485164+0000","last_clean":"2023-11-28T11:11:39.485164+0000","last_became_active":"2023-11-28T11:11:39.092535+0000","last_became_peered":"2023-11-28T11:11:39.092535+0000","last_unstale":"2023-11-28T11:11:39.485164+0000","last_undegraded":"2023-11-28T11:11:39.485164+0000","last_fullsized":"2023-11-28T11:11:39.485164+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:51.105318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501898+0000","last_change":"2023-11-28T11:11:39.500493+0000","last_active":"2023-11-28T11:11:39.501898+0000","last_peered":"2023-11-28T11:11:39.501898+0000","last_clean":"2023-11-28T11:11:39.501898+0000","last_became_active":"2023-11-28T11:11:39.500027+0000","last_became_peered":"2023-11-28T11:11:39.500027+0000","last_unstale":"2023-11-28T11:11:39.501898+0000","last_undegraded":"2023-11-28T11:11:39.501898+0000","last_fullsized":"2023-11-28T11:11:39.501898+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:52.111544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.483359+0000","last_change":"2023-11-28T11:11:39.094769+0000","last_active":"2023-11-28T11:11:39.483359+0000","last_peered":"2023-11-28T11:11:39.483359+0000","last_clean":"2023-11-28T11:11:39.483359+0000","last_became_active":"2023-11-28T11:11:39.094445+0000","last_became_peered":"2023-11-28T11:11:39.094445+0000","last_unstale":"2023-11-28T11:11:39.483359+0000","last_undegraded":"2023-11-28T11:11:39.483359+0000","last_fullsized":"2023-11-28T11:11:39.483359+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:31:11.220895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.501315+0000","last_change":"2023-11-28T11:11:39.498899+0000","last_active":"2023-11-28T11:11:39.501315+0000","last_peered":"2023-11-28T11:11:39.501315+0000","last_clean":"2023-11-28T11:11:39.501315+0000","last_became_active":"2023-11-28T11:11:39.498632+0000","last_became_peered":"2023-11-28T11:11:39.498632+0000","last_unstale":"2023-11-28T11:11:39.501315+0000","last_undegraded":"2023-11-28T11:11:39.501315+0000","last_fullsized":"2023-11-28T11:11:39.501315+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:11:26.950640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.477899+0000","last_change":"2023-11-28T11:11:39.089488+0000","last_active":"2023-11-28T11:11:39.477899+0000","last_peered":"2023-11-28T11:11:39.477899+0000","last_clean":"2023-11-28T11:11:39.477899+0000","last_became_active":"2023-11-28T11:11:39.089108+0000","last_became_peered":"2023-11-28T11:11:39.089108+0000","last_unstale":"2023-11-28T11:11:39.477899+0000","last_undegraded":"2023-11-28T11:11:39.477899+0000","last_fullsized":"2023-11-28T11:11:39.477899+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:40.182873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.508120+0000","last_change":"2023-11-28T11:11:39.504610+0000","last_active":"2023-11-28T11:11:39.508120+0000","last_peered":"2023-11-28T11:11:39.508120+0000","last_clean":"2023-11-28T11:11:39.508120+0000","last_became_active":"2023-11-28T11:11:39.504361+0000","last_became_peered":"2023-11-28T11:11:39.504361+0000","last_unstale":"2023-11-28T11:11:39.508120+0000","last_undegraded":"2023-11-28T11:11:39.508120+0000","last_fullsized":"2023-11-28T11:11:39.508120+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:33.166366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.496503+0000","last_change":"2023-11-28T11:11:39.091525+0000","last_active":"2023-11-28T11:11:39.496503+0000","last_peered":"2023-11-28T11:11:39.496503+0000","last_clean":"2023-11-28T11:11:39.496503+0000","last_became_active":"2023-11-28T11:11:39.090581+0000","last_became_peered":"2023-11-28T11:11:39.090581+0000","last_unstale":"2023-11-28T11:11:39.496503+0000","last_undegraded":"2023-11-28T11:11:39.496503+0000","last_fullsized":"2023-11-28T11:11:39.496503+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:30.443943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.079636+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:11:39.079636+0000","last_peered":"2023-11-28T11:11:39.079636+0000","last_clean":"2023-11-28T11:11:39.079636+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:11:39.079636+0000","last_undegraded":"2023-11-28T11:11:39.079636+0000","last_fullsized":"2023-11-28T11:11:39.079636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.490734+0000","last_change":"2023-11-28T11:11:39.488899+0000","last_active":"2023-11-28T11:11:39.490734+0000","last_peered":"2023-11-28T11:11:39.490734+0000","last_clean":"2023-11-28T11:11:39.490734+0000","last_became_active":"2023-11-28T11:11:39.488281+0000","last_became_peered":"2023-11-28T11:11:39.488281+0000","last_unstale":"2023-11-28T11:11:39.490734+0000","last_undegraded":"2023-11-28T11:11:39.490734+0000","last_fullsized":"2023-11-28T11:11:39.490734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:00:02.279424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.476422+0000","last_change":"2023-11-28T11:11:39.087733+0000","last_active":"2023-11-28T11:11:39.476422+0000","last_peered":"2023-11-28T11:11:39.476422+0000","last_clean":"2023-11-28T11:11:39.476422+0000","last_became_active":"2023-11-28T11:11:39.087330+0000","last_became_peered":"2023-11-28T11:11:39.087330+0000","last_unstale":"2023-11-28T11:11:39.476422+0000","last_undegraded":"2023-11-28T11:11:39.476422+0000","last_fullsized":"2023-11-28T11:11:39.476422+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:31.085282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.083143+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:11:39.083143+0000","last_peered":"2023-11-28T11:11:39.083143+0000","last_clean":"2023-11-28T11:11:39.083143+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:11:39.083143+0000","last_undegraded":"2023-11-28T11:11:39.083143+0000","last_fullsized":"2023-11-28T11:11:39.083143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500483+0000","last_change":"2023-11-28T11:11:39.497012+0000","last_active":"2023-11-28T11:11:39.500483+0000","last_peered":"2023-11-28T11:11:39.500483+0000","last_clean":"2023-11-28T11:11:39.500483+0000","last_became_active":"2023-11-28T11:11:39.496735+0000","last_became_peered":"2023-11-28T11:11:39.496735+0000","last_unstale":"2023-11-28T11:11:39.500483+0000","last_undegraded":"2023-11-28T11:11:39.500483+0000","last_fullsized":"2023-11-28T11:11:39.500483+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:31.618924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.492883+0000","last_change":"2023-11-28T11:11:39.091033+0000","last_active":"2023-11-28T11:11:39.492883+0000","last_peered":"2023-11-28T11:11:39.492883+0000","last_clean":"2023-11-28T11:11:39.492883+0000","last_became_active":"2023-11-28T11:11:39.090496+0000","last_became_peered":"2023-11-28T11:11:39.090496+0000","last_unstale":"2023-11-28T11:11:39.492883+0000","last_undegraded":"2023-11-28T11:11:39.492883+0000","last_fullsized":"2023-11-28T11:11:39.492883+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:38.064594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.084101+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:11:39.084101+0000","last_peered":"2023-11-28T11:11:39.084101+0000","last_clean":"2023-11-28T11:11:39.084101+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:11:39.084101+0000","last_undegraded":"2023-11-28T11:11:39.084101+0000","last_fullsized":"2023-11-28T11:11:39.084101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.496959+0000","last_change":"2023-11-28T11:11:39.493932+0000","last_active":"2023-11-28T11:11:39.496959+0000","last_peered":"2023-11-28T11:11:39.496959+0000","last_clean":"2023-11-28T11:11:39.496959+0000","last_became_active":"2023-11-28T11:11:39.493631+0000","last_became_peered":"2023-11-28T11:11:39.493631+0000","last_unstale":"2023-11-28T11:11:39.496959+0000","last_undegraded":"2023-11-28T11:11:39.496959+0000","last_fullsized":"2023-11-28T11:11:39.496959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:39.070820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.482556+0000","last_change":"2023-11-28T11:11:39.098164+0000","last_active":"2023-11-28T11:11:39.482556+0000","last_peered":"2023-11-28T11:11:39.482556+0000","last_clean":"2023-11-28T11:11:39.482556+0000","last_became_active":"2023-11-28T11:11:39.097719+0000","last_became_peered":"2023-11-28T11:11:39.097719+0000","last_unstale":"2023-11-28T11:11:39.482556+0000","last_undegraded":"2023-11-28T11:11:39.482556+0000","last_fullsized":"2023-11-28T11:11:39.482556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:28.091834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.082964+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:11:39.082964+0000","last_peered":"2023-11-28T11:11:39.082964+0000","last_clean":"2023-11-28T11:11:39.082964+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:11:39.082964+0000","last_undegraded":"2023-11-28T11:11:39.082964+0000","last_fullsized":"2023-11-28T11:11:39.082964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.078078+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:11:39.078078+0000","last_peered":"2023-11-28T11:11:39.078078+0000","last_clean":"2023-11-28T11:11:39.078078+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:11:39.078078+0000","last_undegraded":"2023-11-28T11:11:39.078078+0000","last_fullsized":"2023-11-28T11:11:39.078078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.493808+0000","last_change":"2023-11-28T11:11:39.491331+0000","last_active":"2023-11-28T11:11:39.493808+0000","last_peered":"2023-11-28T11:11:39.493808+0000","last_clean":"2023-11-28T11:11:39.493808+0000","last_became_active":"2023-11-28T11:11:39.491007+0000","last_became_peered":"2023-11-28T11:11:39.491007+0000","last_unstale":"2023-11-28T11:11:39.493808+0000","last_undegraded":"2023-11-28T11:11:39.493808+0000","last_fullsized":"2023-11-28T11:11:39.493808+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:43.072857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.489904+0000","last_change":"2023-11-28T11:11:39.093252+0000","last_active":"2023-11-28T11:11:39.489904+0000","last_peered":"2023-11-28T11:11:39.489904+0000","last_clean":"2023-11-28T11:11:39.489904+0000","last_became_active":"2023-11-28T11:11:39.092985+0000","last_became_peered":"2023-11-28T11:11:39.092985+0000","last_unstale":"2023-11-28T11:11:39.489904+0000","last_undegraded":"2023-11-28T11:11:39.489904+0000","last_fullsized":"2023-11-28T11:11:39.489904+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:23.202731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.078095+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:11:39.078095+0000","last_peered":"2023-11-28T11:11:39.078095+0000","last_clean":"2023-11-28T11:11:39.078095+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:11:39.078095+0000","last_undegraded":"2023-11-28T11:11:39.078095+0000","last_fullsized":"2023-11-28T11:11:39.078095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.502051+0000","last_change":"2023-11-28T11:11:39.501345+0000","last_active":"2023-11-28T11:11:39.502051+0000","last_peered":"2023-11-28T11:11:39.502051+0000","last_clean":"2023-11-28T11:11:39.502051+0000","last_became_active":"2023-11-28T11:11:39.501059+0000","last_became_peered":"2023-11-28T11:11:39.501059+0000","last_unstale":"2023-11-28T11:11:39.502051+0000","last_undegraded":"2023-11-28T11:11:39.502051+0000","last_fullsized":"2023-11-28T11:11:39.502051+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:49:19.205431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.504381+0000","last_change":"2023-11-28T11:11:39.092374+0000","last_active":"2023-11-28T11:11:39.504381+0000","last_peered":"2023-11-28T11:11:39.504381+0000","last_clean":"2023-11-28T11:11:39.504381+0000","last_became_active":"2023-11-28T11:11:39.092080+0000","last_became_peered":"2023-11-28T11:11:39.092080+0000","last_unstale":"2023-11-28T11:11:39.504381+0000","last_undegraded":"2023-11-28T11:11:39.504381+0000","last_fullsized":"2023-11-28T11:11:39.504381+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:44:11.019293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.078919+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:11:39.078919+0000","last_peered":"2023-11-28T11:11:39.078919+0000","last_clean":"2023-11-28T11:11:39.078919+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:11:39.078919+0000","last_undegraded":"2023-11-28T11:11:39.078919+0000","last_fullsized":"2023-11-28T11:11:39.078919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.500195+0000","last_change":"2023-11-28T11:11:39.491813+0000","last_active":"2023-11-28T11:11:39.500195+0000","last_peered":"2023-11-28T11:11:39.500195+0000","last_clean":"2023-11-28T11:11:39.500195+0000","last_became_active":"2023-11-28T11:11:39.491501+0000","last_became_peered":"2023-11-28T11:11:39.491501+0000","last_unstale":"2023-11-28T11:11:39.500195+0000","last_undegraded":"2023-11-28T11:11:39.500195+0000","last_fullsized":"2023-11-28T11:11:39.500195+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:52.111544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.505445+0000","last_change":"2023-11-28T11:11:39.090158+0000","last_active":"2023-11-28T11:11:39.505445+0000","last_peered":"2023-11-28T11:11:39.505445+0000","last_clean":"2023-11-28T11:11:39.505445+0000","last_became_active":"2023-11-28T11:11:39.089772+0000","last_became_peered":"2023-11-28T11:11:39.089772+0000","last_unstale":"2023-11-28T11:11:39.505445+0000","last_undegraded":"2023-11-28T11:11:39.505445+0000","last_fullsized":"2023-11-28T11:11:39.505445+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:34.522288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.081021+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:11:39.081021+0000","last_peered":"2023-11-28T11:11:39.081021+0000","last_clean":"2023-11-28T11:11:39.081021+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:11:39.081021+0000","last_undegraded":"2023-11-28T11:11:39.081021+0000","last_fullsized":"2023-11-28T11:11:39.081021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.495660+0000","last_change":"2023-11-28T11:11:39.490192+0000","last_active":"2023-11-28T11:11:39.495660+0000","last_peered":"2023-11-28T11:11:39.495660+0000","last_clean":"2023-11-28T11:11:39.495660+0000","last_became_active":"2023-11-28T11:11:39.489581+0000","last_became_peered":"2023-11-28T11:11:39.489581+0000","last_unstale":"2023-11-28T11:11:39.495660+0000","last_undegraded":"2023-11-28T11:11:39.495660+0000","last_fullsized":"2023-11-28T11:11:39.495660+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:39.069798+0000","last_clean_scrub_stamp":"2023-11-28T11:11:39.069798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:30.218500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.483590+0000","last_change":"2023-11-28T11:11:39.097899+0000","last_active":"2023-11-28T11:11:39.483590+0000","last_peered":"2023-11-28T11:11:39.483590+0000","last_clean":"2023-11-28T11:11:39.483590+0000","last_became_active":"2023-11-28T11:11:39.097628+0000","last_became_peered":"2023-11-28T11:11:39.097628+0000","last_unstale":"2023-11-28T11:11:39.483590+0000","last_undegraded":"2023-11-28T11:11:39.483590+0000","last_fullsized":"2023-11-28T11:11:39.483590+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:11:38.063572+0000","last_clean_scrub_stamp":"2023-11-28T11:11:38.063572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:01.999644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T11:11:39.084729+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:11:39.084729+0000","last_peered":"2023-11-28T11:11:39.084729+0000","last_clean":"2023-11-28T11:11:39.084729+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:11:39.084729+0000","last_undegraded":"2023-11-28T11:11:39.084729+0000","last_fullsized":"2023-11-28T11:11:39.084729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10672,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361168,"statfs":{"total":96636764160,"available":96625836032,"internally_reserved":0,"allocated":1351680,"data_stored":921339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.433,"5min":0.316,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.66400000000000003,"15min":0.70999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77900000000000003,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.66000000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.753,"15min":0.753},"last":0.629}]},{"osd":2,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.70299999999999996,"15min":0.754},"min":{"1min":0.49399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.753,"5min":5.532,"15min":5.532},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60999999999999999,"15min":0.624},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80000000000000004,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69799999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.47699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.52300000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.35599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40400000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82199999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77200000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.42399999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.441,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.505},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.995,"15min":0.995},"last":0.47799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9352,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362488,"statfs":{"total":96636764160,"available":96627187712,"internally_reserved":0,"allocated":786432,"data_stored":344753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52100000000000002,"15min":0.499},"min":{"1min":0.38300000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.495},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.437}]},{"osd":1,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.70199999999999996,"15min":0.76300000000000001},"min":{"1min":0.43099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77400000000000002,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52400000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.70299999999999996,"15min":0.75700000000000001},"min":{"1min":0.42299999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81000000000000005,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.67500000000000004,"15min":0.72099999999999997},"min":{"1min":0.42899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.70199999999999996,"15min":0.76300000000000001},"min":{"1min":0.44700000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.48099999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.35099999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77100000000000002,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.62}]},{"osd":5,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.36699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.71999999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.45300000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.40500000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.63},"min":{"1min":0.49399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79000000000000004,"5min":1.137,"15min":1.137},"last":0.60699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9324,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362516,"statfs":{"total":96636764160,"available":96627216384,"internally_reserved":0,"allocated":757760,"data_stored":330971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.27100000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50900000000000001,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35899999999999999},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52900000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.34599999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34000000000000002},"min":{"1min":0.249,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51300000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.372,"15min":0.36899999999999999},"min":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.224}]},{"osd":3,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40200000000000002},"min":{"1min":0.31,"5min":0.253,"15min":0.253},"max":{"1min":0.58199999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.31,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57599999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.307}]},{"osd":4,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.40999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.377},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.46600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90500000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.495}]},{"osd":6,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.41799999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.83099999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93000000000000005,"5min":0.999,"15min":0.999},"last":0.46200000000000002}]},{"osd":7,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.49199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.871,"5min":1.036,"15min":1.036},"last":0.437},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.627,"15min":0.625},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.40799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10684,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361156,"statfs":{"total":96636764160,"available":96625823744,"internally_reserved":0,"allocated":1363968,"data_stored":927959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.31900000000000001,"15min":0.309},"min":{"1min":0.27900000000000003,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.53600000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.26400000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56999999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.29899999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.40100000000000002,"15min":0.42899999999999999},"min":{"1min":0.23999999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52700000000000002,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.315},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42999999999999999,"15min":0.45100000000000001},"min":{"1min":0.29199999999999998,"5min":0.193,"15min":0.193},"max":{"1min":0.58299999999999996,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.26700000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.35699999999999998,"15min":0.34699999999999998},"min":{"1min":0.28599999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.38400000000000001,"15min":0.377},"min":{"1min":0.28399999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.372}]},{"osd":4,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.434,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.66200000000000003,"15min":0.69499999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.877,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.53900000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.41999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73899999999999999,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66200000000000003,"15min":0.69299999999999995},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83099999999999996,"5min":3.298,"15min":3.298},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.69499999999999995,"15min":0.73499999999999999},"min":{"1min":0.441,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89300000000000002,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.50600000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.52900000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":0.877,"15min":0.877},"last":0.5},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.44900000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86399999999999999,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9400,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362440,"statfs":{"total":96636764160,"available":96627138560,"internally_reserved":0,"allocated":770048,"data_stored":337591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.32000000000000001},"min":{"1min":0.222,"5min":0.19,"15min":0.19},"max":{"1min":0.48099999999999998,"5min":0.503,"15min":0.503},"last":0.31},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.372,"15min":0.35999999999999999},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53400000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.32200000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.35299999999999998,"15min":0.34000000000000002},"min":{"1min":0.27900000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34100000000000003},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48999999999999999,"5min":1.002,"15min":1.002},"last":0.29099999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.35299999999999998},"min":{"1min":0.26300000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.372},"min":{"1min":0.26800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.42799999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77400000000000002,"5min":0.875,"15min":0.875},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78700000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53900000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.442,"5min":0.435,"15min":0.435},"max":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.48499999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78700000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.67900000000000005}]},{"osd":6,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77500000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.47599999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.81799999999999995,"5min":1.05,"15min":1.05},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.44400000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78100000000000003,"5min":1.222,"15min":1.222},"last":0.69099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9720,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362120,"statfs":{"total":96636764160,"available":96626810880,"internally_reserved":0,"allocated":770048,"data_stored":337591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.34899999999999998,"15min":0.36399999999999999},"min":{"1min":0.23799999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.503,"5min":1.365,"15min":1.365},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.58099999999999996,"15min":0.69499999999999995},"min":{"1min":0.26400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51400000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.63700000000000001,"15min":0.77000000000000002},"min":{"1min":0.252,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52500000000000002,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.498},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38800000000000001,"15min":0.40600000000000003},"min":{"1min":0.29099999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.53100000000000003,"5min":1.448,"15min":1.448},"last":0.313}]},{"osd":2,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40699999999999997,"15min":0.42899999999999999},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.496,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.32600000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.50800000000000001,"5min":1.474,"15min":1.474},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.78200000000000003,"15min":0.877},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88500000000000001,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.85399999999999998,"15min":0.97399999999999998},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80900000000000005,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.84799999999999998,"15min":0.96599999999999997},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71099999999999997,"5min":12.994,"15min":12.994},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.46100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.86899999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.82799999999999996,"15min":0.93100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85399999999999998,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.88200000000000001,"15min":1.006},"min":{"1min":0.45600000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78600000000000003,"5min":12.932,"15min":12.932},"last":0.72899999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.623,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76900000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.83199999999999996,"15min":0.93600000000000005},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.72399999999999998,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.81499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9452,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362388,"statfs":{"total":96636764160,"available":96627085312,"internally_reserved":0,"allocated":757760,"data_stored":330971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.51000000000000001,"15min":0.49399999999999999},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.495},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.32000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.75,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.39000000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.47099999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68700000000000006,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40400000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.46300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.443}]},{"osd":3,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.47799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47399999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51600000000000001,"15min":0.52800000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.36399999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.46200000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85799999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.39400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9464,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362376,"statfs":{"total":96636764160,"available":96627073024,"internally_reserved":0,"allocated":770048,"data_stored":337591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":0.71599999999999997,"15min":0.621},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":11.763999999999999,"5min":11.763999999999999,"15min":11.763999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.593,"5min":0.76600000000000001,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":16.245000000000001,"5min":16.245000000000001,"15min":16.245000000000001},"last":0.37}]},{"osd":1,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.442,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.63100000000000001,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.3849999999999998,"5min":5.3849999999999998,"15min":5.3849999999999998},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.47099999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":1.032,"15min":1.032},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.39800000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.7290000000000001,"5min":2.282,"15min":2.282},"last":0.47199999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.401,"15min":1.401},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.46200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94999999999999996,"5min":1.478,"15min":1.478},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.39700000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70999999999999996,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.443}]},{"osd":6,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.65100000000000002,"15min":0.68600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.623,"15min":0.63500000000000001},"min":{"1min":0.45700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77100000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.49399999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.65900000000000003,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72299999999999998,"5min":2.444,"15min":2.444},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.75600000000000001,"15min":0.72999999999999998},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.44},"max":{"1min":5.8079999999999998,"5min":5.8079999999999998,"15min":5.8079999999999998},"last":0.54700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:11:43.931 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:11:43.931 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T11:11:44.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.092+0000 7fdd27d6c700 1 Processor -- start 2023-11-28T11:11:44.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.093+0000 7fdd27d6c700 1 -- start start 2023-11-28T11:11:44.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.093+0000 7fdd27d6c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd200b2ee0 0x7fdd200d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.093+0000 7fdd27d6c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2015a9c0 con 0x7fdd2015a5f0 2023-11-28T11:11:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.093+0000 7fdd27d6c700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd200c7b80 con 0x7fdd200cc200 2023-11-28T11:11:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.093+0000 7fdd27d6c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd200cc990 con 0x7fdd200b2ee0 2023-11-28T11:11:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.094+0000 7fdd25307700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd200b2ee0 0x7fdd200d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.094+0000 7fdd25b08700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdd2015a5f0 0x7fdd200b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45484/0 (socket says 172.21.15.125:45484) 2023-11-28T11:11:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.094+0000 7fdd25b08700 1 -- 172.21.15.125:0/1614866072 learned_addr learned my addr 172.21.15.125:0/1614866072 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.094+0000 7fdd25307700 1 -- 172.21.15.125:0/1614866072 >> v1:172.21.15.167:6789/0 conn(0x7fdd200cc200 legacy=0x7fdd200ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.094+0000 7fdd25307700 1 -- 172.21.15.125:0/1614866072 >> v1:172.21.15.125:6789/0 conn(0x7fdd2015a5f0 legacy=0x7fdd200b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.094+0000 7fdd25307700 1 -- 172.21.15.125:0/1614866072 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd200ccc70 con 0x7fdd200b2ee0 2023-11-28T11:11:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.094+0000 7fdd24b06700 1 -- 172.21.15.125:0/1614866072 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859681319 0 0) 0x7fdd2015a9c0 con 0x7fdd2015a5f0 2023-11-28T11:11:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.094+0000 7fdd25307700 1 --2- 172.21.15.125:0/1614866072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd200b2ee0 0x7fdd200d0ad0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009840 tx=0x7fdd1c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935e23ee459bd126 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.094+0000 7fdd24b06700 1 -- 172.21.15.125:0/1614866072 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c004230 con 0x7fdd200b2ee0 2023-11-28T11:11:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.094+0000 7fdd24b06700 1 -- 172.21.15.125:0/1614866072 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c004390 con 0x7fdd200b2ee0 2023-11-28T11:11:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.094+0000 7fdd24b06700 1 -- 172.21.15.125:0/1614866072 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c0036a0 con 0x7fdd200b2ee0 2023-11-28T11:11:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.095+0000 7fdd27d6c700 1 -- 172.21.15.125:0/1614866072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd200b2ee0 msgr2=0x7fdd200d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.095+0000 7fdd27d6c700 1 --2- 172.21.15.125:0/1614866072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd200b2ee0 0x7fdd200d0ad0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009840 tx=0x7fdd1c009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.095+0000 7fdd27d6c700 1 -- 172.21.15.125:0/1614866072 shutdown_connections 2023-11-28T11:11:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.095+0000 7fdd27d6c700 1 --2- 172.21.15.125:0/1614866072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd200b2ee0 0x7fdd200d0ad0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.095+0000 7fdd27d6c700 1 -- 172.21.15.125:0/1614866072 >> 172.21.15.125:0/1614866072 conn(0x7fdd2006ea80 msgr2=0x7fdd2006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.095+0000 7fdd27d6c700 1 -- 172.21.15.125:0/1614866072 shutdown_connections 2023-11-28T11:11:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.095+0000 7fdd27d6c700 1 -- 172.21.15.125:0/1614866072 wait complete. 2023-11-28T11:11:44.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.096+0000 7fdd27d6c700 1 Processor -- start 2023-11-28T11:11:44.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.097+0000 7fdd27d6c700 1 -- start start 2023-11-28T11:11:44.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.097+0000 7fdd27d6c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd200b2ee0 0x7fdd2014a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.097+0000 7fdd27d6c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd200cc200 0x7fdd200c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.097+0000 7fdd27d6c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2015a5f0 0x7fdd201e4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.097+0000 7fdd27d6c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200c98d0 con 0x7fdd200cc200 2023-11-28T11:11:44.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.097+0000 7fdd27d6c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200c8df0 con 0x7fdd2015a5f0 2023-11-28T11:11:44.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd27d6c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200c8830 con 0x7fdd200b2ee0 2023-11-28T11:11:44.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd25307700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd200cc200 0x7fdd200c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd25307700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd200cc200 0x7fdd200c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33136/0 (socket says 172.21.15.125:33136) 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd25307700 1 -- 172.21.15.125:0/2414151912 learned_addr learned my addr 172.21.15.125:0/2414151912 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd25b08700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd200b2ee0 0x7fdd2014a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd26309700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2015a5f0 0x7fdd201e4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd25307700 1 -- 172.21.15.125:0/2414151912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd200b2ee0 msgr2=0x7fdd2014a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd25307700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd200b2ee0 0x7fdd2014a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd25307700 1 -- 172.21.15.125:0/2414151912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2015a5f0 msgr2=0x7fdd201e4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd25307700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2015a5f0 0x7fdd201e4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd25307700 1 -- 172.21.15.125:0/2414151912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0094a0 con 0x7fdd200cc200 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd25b08700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd200b2ee0 0x7fdd2014a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd26309700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2015a5f0 0x7fdd201e4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:44.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd25307700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd200cc200 0x7fdd200c7e00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c004000 tx=0x7fdd1c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:44.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd167fc700 1 -- 172.21.15.125:0/2414151912 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c011630 con 0x7fdd200cc200 2023-11-28T11:11:44.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd167fc700 1 -- 172.21.15.125:0/2414151912 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c011790 con 0x7fdd200cc200 2023-11-28T11:11:44.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd167fc700 1 -- 172.21.15.125:0/2414151912 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c011b40 con 0x7fdd200cc200 2023-11-28T11:11:44.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd27d6c700 1 -- 172.21.15.125:0/2414151912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd200cd230 con 0x7fdd200cc200 2023-11-28T11:11:44.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.098+0000 7fdd27d6c700 1 -- 172.21.15.125:0/2414151912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd200ccf50 con 0x7fdd200cc200 2023-11-28T11:11:44.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.099+0000 7fdd27d6c700 1 -- 172.21.15.125:0/2414151912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd200cd510 con 0x7fdd200cc200 2023-11-28T11:11:44.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.100+0000 7fdd167fc700 1 -- 172.21.15.125:0/2414151912 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdd1c017020 con 0x7fdd200cc200 2023-11-28T11:11:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.100+0000 7fdd167fc700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd040682f0 0x7fdd0406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.100+0000 7fdd167fc700 1 -- 172.21.15.125:0/2414151912 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd1c0874a0 con 0x7fdd200cc200 2023-11-28T11:11:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.100+0000 7fdd25b08700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd040682f0 0x7fdd0406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:44.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.100+0000 7fdd25b08700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd040682f0 0x7fdd0406a7a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdd10000f60 tx=0x7fdd10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:44.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.104+0000 7fdd167fc700 1 -- 172.21.15.125:0/2414151912 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdd1c053d00 con 0x7fdd200cc200 2023-11-28T11:11:44.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.361+0000 7fdd27d6c700 1 -- 172.21.15.125:0/2414151912 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fdd200743f0 con 0x7fdd200cc200 2023-11-28T11:11:44.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.364+0000 7fdd167fc700 1 -- 172.21.15.125:0/2414151912 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdd1c057320 con 0x7fdd200cc200 2023-11-28T11:11:44.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.366+0000 7fdd27d6c700 1 -- 172.21.15.125:0/2414151912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd040682f0 msgr2=0x7fdd0406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:44.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.366+0000 7fdd27d6c700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd040682f0 0x7fdd0406a7a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdd10000f60 tx=0x7fdd10009040 comp rx=0 tx=0).stop 2023-11-28T11:11:44.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.366+0000 7fdd27d6c700 1 -- 172.21.15.125:0/2414151912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd200cc200 msgr2=0x7fdd200c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:44.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.366+0000 7fdd27d6c700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd200cc200 0x7fdd200c7e00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c004000 tx=0x7fdd1c0047c0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.366+0000 7fdd27d6c700 1 -- 172.21.15.125:0/2414151912 shutdown_connections 2023-11-28T11:11:44.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.366+0000 7fdd27d6c700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd2015a5f0 0x7fdd201e4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.366+0000 7fdd27d6c700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fdd040682f0 0x7fdd0406a7a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.366+0000 7fdd27d6c700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd200b2ee0 0x7fdd2014a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.366+0000 7fdd27d6c700 1 --2- 172.21.15.125:0/2414151912 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd200cc200 0x7fdd200c7e00 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.366+0000 7fdd27d6c700 1 -- 172.21.15.125:0/2414151912 >> 172.21.15.125:0/2414151912 conn(0x7fdd2006ea80 msgr2=0x7fdd20155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:44.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.367+0000 7fdd27d6c700 1 -- 172.21.15.125:0/2414151912 shutdown_connections 2023-11-28T11:11:44.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.367+0000 7fdd27d6c700 1 -- 172.21.15.125:0/2414151912 wait complete. 2023-11-28T11:11:44.369 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-11-28T11:11:44.379 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:11:44.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.498+0000 7f6a86040700 1 Processor -- start 2023-11-28T11:11:44.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.498+0000 7f6a86040700 1 -- start start 2023-11-28T11:11:44.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.498+0000 7f6a86040700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a800b4660 0x7f6a80071f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a86040700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a800cff90 0x7f6a8006b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a86040700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6a800b4a30 0x7f6a800b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a86040700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a800cfb00 con 0x7f6a800cff90 2023-11-28T11:11:44.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a86040700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8015aa20 con 0x7f6a800b4a30 2023-11-28T11:11:44.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a86040700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800cf4d0 con 0x7f6a800b4660 2023-11-28T11:11:44.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a800cff90 0x7f6a8006b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:44.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a800cff90 0x7f6a8006b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33142/0 (socket says 172.21.15.125:33142) 2023-11-28T11:11:44.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7effd700 1 -- 172.21.15.125:0/882099277 learned_addr learned my addr 172.21.15.125:0/882099277 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:44.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7effd700 1 -- 172.21.15.125:0/882099277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a800b4660 msgr2=0x7f6a80071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:44.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7effd700 1 --2- 172.21.15.125:0/882099277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a800b4660 0x7f6a80071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7effd700 1 -- 172.21.15.125:0/882099277 >> v2:172.21.15.167:3300/0 conn(0x7f6a800b4a30 msgr2=0x7f6a800b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:44.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7effd700 1 --2- 172.21.15.125:0/882099277 >> v2:172.21.15.167:3300/0 conn(0x7f6a800b4a30 0x7f6a800b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7effd700 1 -- 172.21.15.125:0/882099277 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80072550 con 0x7f6a800cff90 2023-11-28T11:11:44.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7effd700 1 --2- 172.21.15.125:0/882099277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a800cff90 0x7f6a8006b590 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6a8006f560 tx=0x7f6a74009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dd4a1a6ce66a19 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:44.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7e7fc700 1 -- 172.21.15.125:0/882099277 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7400b870 con 0x7f6a800cff90 2023-11-28T11:11:44.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7e7fc700 1 -- 172.21.15.125:0/882099277 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7400b9d0 con 0x7f6a800cff90 2023-11-28T11:11:44.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.499+0000 7f6a7e7fc700 1 -- 172.21.15.125:0/882099277 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7400bd60 con 0x7f6a800cff90 2023-11-28T11:11:44.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.500+0000 7f6a86040700 1 -- 172.21.15.125:0/882099277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a800cff90 msgr2=0x7f6a8006b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:44.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.500+0000 7f6a86040700 1 --2- 172.21.15.125:0/882099277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a800cff90 0x7f6a8006b590 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6a8006f560 tx=0x7f6a74009bd0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.500+0000 7f6a86040700 1 -- 172.21.15.125:0/882099277 shutdown_connections 2023-11-28T11:11:44.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.500+0000 7f6a86040700 1 --2- 172.21.15.125:0/882099277 >> v2:172.21.15.167:3300/0 conn(0x7f6a800b4a30 0x7f6a800b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.500+0000 7f6a86040700 1 --2- 172.21.15.125:0/882099277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a800b4660 0x7f6a80071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.500+0000 7f6a86040700 1 --2- 172.21.15.125:0/882099277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a800cff90 0x7f6a8006b590 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.500+0000 7f6a86040700 1 -- 172.21.15.125:0/882099277 >> 172.21.15.125:0/882099277 conn(0x7f6a800b2fc0 msgr2=0x7f6a80071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:44.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.500+0000 7f6a86040700 1 -- 172.21.15.125:0/882099277 shutdown_connections 2023-11-28T11:11:44.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.500+0000 7f6a86040700 1 -- 172.21.15.125:0/882099277 wait complete. 2023-11-28T11:11:44.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.501+0000 7f6a86040700 1 Processor -- start 2023-11-28T11:11:44.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.501+0000 7f6a86040700 1 -- start start 2023-11-28T11:11:44.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a86040700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a800b4660 0x7f6a800c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a86040700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a800b4a30 0x7f6a800c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a86040700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a800cff90 0x7f6a80155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a86040700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800c8d30 con 0x7f6a800cff90 2023-11-28T11:11:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a86040700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800c8a00 con 0x7f6a800b4660 2023-11-28T11:11:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a86040700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800c5990 con 0x7f6a800b4a30 2023-11-28T11:11:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a7ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a800cff90 0x7f6a80155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a7ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a800cff90 0x7f6a80155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33150/0 (socket says 172.21.15.125:33150) 2023-11-28T11:11:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a7f7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a800b4660 0x7f6a800c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a7ffff700 1 -- 172.21.15.125:0/4068150544 learned_addr learned my addr 172.21.15.125:0/4068150544 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a7effd700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a800b4a30 0x7f6a800c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a7ffff700 1 -- 172.21.15.125:0/4068150544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a800b4a30 msgr2=0x7f6a800c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a7ffff700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a800b4a30 0x7f6a800c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a7ffff700 1 -- 172.21.15.125:0/4068150544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a800b4660 msgr2=0x7f6a800c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:44.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a7ffff700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a800b4660 0x7f6a800c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.502+0000 7f6a7ffff700 1 -- 172.21.15.125:0/4068150544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a74009550 con 0x7f6a800cff90 2023-11-28T11:11:44.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.503+0000 7f6a7ffff700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a800cff90 0x7f6a80155d80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800b970 tx=0x7f6a7800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:44.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.503+0000 7f6a67fff700 1 -- 172.21.15.125:0/4068150544 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7800d860 con 0x7f6a800cff90 2023-11-28T11:11:44.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.503+0000 7f6a67fff700 1 -- 172.21.15.125:0/4068150544 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7800d9e0 con 0x7f6a800cff90 2023-11-28T11:11:44.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.503+0000 7f6a86040700 1 -- 172.21.15.125:0/4068150544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8006bad0 con 0x7f6a800cff90 2023-11-28T11:11:44.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.503+0000 7f6a67fff700 1 -- 172.21.15.125:0/4068150544 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7800dd90 con 0x7f6a800cff90 2023-11-28T11:11:44.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.503+0000 7f6a86040700 1 -- 172.21.15.125:0/4068150544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a800cf790 con 0x7f6a800cff90 2023-11-28T11:11:44.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.504+0000 7f6a86040700 1 -- 172.21.15.125:0/4068150544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a800ac1e0 con 0x7f6a800cff90 2023-11-28T11:11:44.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.504+0000 7f6a67fff700 1 -- 172.21.15.125:0/4068150544 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6a7800e430 con 0x7f6a800cff90 2023-11-28T11:11:44.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.505+0000 7f6a67fff700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6a6c0682f0 0x7f6a6c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:44.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.505+0000 7f6a67fff700 1 -- 172.21.15.125:0/4068150544 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a78006e40 con 0x7f6a800cff90 2023-11-28T11:11:44.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.505+0000 7f6a7f7fe700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6a6c0682f0 0x7f6a6c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:44.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.505+0000 7f6a7f7fe700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6a6c0682f0 0x7f6a6c06a7a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6a80096340 tx=0x7f6a70009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:44.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.509+0000 7f6a67fff700 1 -- 172.21.15.125:0/4068150544 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6a780527b0 con 0x7f6a800cff90 2023-11-28T11:11:44.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.734+0000 7f6a86040700 1 -- 172.21.15.125:0/4068150544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a800743f0 con 0x7f6a800cff90 2023-11-28T11:11:44.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.734+0000 7f6a67fff700 1 -- 172.21.15.125:0/4068150544 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4661 (secure 0 0 0) 0x7f6a78055dd0 con 0x7f6a800cff90 2023-11-28T11:11:44.735 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:44.735 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5710,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3518974696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3518974696},{"type":"v1","addr":"172.21.15.167:6834","nonce":3518974696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/2475008501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2475008501},{"type":"v1","addr":"172.21.15.125:6836","nonce":2475008501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2392518832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":2392518832},{"type":"v1","addr":"172.21.15.125:6837","nonce":2392518832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:11:39.473096+0000","modified":"2023-11-28T11:11:42.492030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/1701437437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1701437437},{"type":"v1","addr":"172.21.15.167:6835","nonce":1701437437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:11:44.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.736+0000 7f6a86040700 1 -- 172.21.15.125:0/4068150544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6a6c0682f0 msgr2=0x7f6a6c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.736+0000 7f6a86040700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6a6c0682f0 0x7f6a6c06a7a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6a80096340 tx=0x7f6a70009190 comp rx=0 tx=0).stop 2023-11-28T11:11:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.736+0000 7f6a86040700 1 -- 172.21.15.125:0/4068150544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a800cff90 msgr2=0x7f6a80155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.736+0000 7f6a86040700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a800cff90 0x7f6a80155d80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800b970 tx=0x7f6a7800bc80 comp rx=0 tx=0).stop 2023-11-28T11:11:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.736+0000 7f6a86040700 1 -- 172.21.15.125:0/4068150544 shutdown_connections 2023-11-28T11:11:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.736+0000 7f6a86040700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a800cff90 0x7f6a80155d80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.736+0000 7f6a86040700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a800b4660 0x7f6a800c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.736+0000 7f6a86040700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6a6c0682f0 0x7f6a6c06a7a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.736+0000 7f6a86040700 1 --2- 172.21.15.125:0/4068150544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a800b4a30 0x7f6a800c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.736+0000 7f6a86040700 1 -- 172.21.15.125:0/4068150544 >> 172.21.15.125:0/4068150544 conn(0x7f6a800b2fc0 msgr2=0x7f6a800cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.737+0000 7f6a86040700 1 -- 172.21.15.125:0/4068150544 shutdown_connections 2023-11-28T11:11:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:44.737+0000 7f6a86040700 1 -- 172.21.15.125:0/4068150544 wait complete. 2023-11-28T11:11:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 31 2023-11-28T11:11:45.068 INFO:tasks.ceph.mds.b.smithi167.stderr:2023-11-28T11:11:45.067+0000 7fe14c8e1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:11:45.152 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:11:39.473096+0000', 'modified': '2023-11-28T11:11:42.492030+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6276': {'gid': 6276, 'name': 'b', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6835/1701437437', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6833', 'nonce': 1701437437}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 1701437437}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:11:45.152 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:11:45.152 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-28T11:11:45.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.273+0000 7fa78f981700 1 Processor -- start 2023-11-28T11:11:45.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.274+0000 7fa78f981700 1 -- start start 2023-11-28T11:11:45.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.274+0000 7fa78f981700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa788071890 0x7fa7880ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.274+0000 7fa78f981700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78815cc10 con 0x7fa78806a980 2023-11-28T11:11:45.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.274+0000 7fa78f981700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78806c9b0 con 0x7fa7880cf710 2023-11-28T11:11:45.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.274+0000 7fa78f981700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78806cc90 con 0x7fa788071890 2023-11-28T11:11:45.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.275+0000 7fa78df1e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa788071890 0x7fa7880ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.275+0000 7fa78cf1c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa78806a980 0x7fa788160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45510/0 (socket says 172.21.15.125:45510) 2023-11-28T11:11:45.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.275+0000 7fa78cf1c700 1 -- 172.21.15.125:0/966687415 learned_addr learned my addr 172.21.15.125:0/966687415 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:45.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.275+0000 7fa78df1e700 1 -- 172.21.15.125:0/966687415 >> v1:172.21.15.167:6789/0 conn(0x7fa7880cf710 legacy=0x7fa78806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:45.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.275+0000 7fa78df1e700 1 -- 172.21.15.125:0/966687415 >> v1:172.21.15.125:6789/0 conn(0x7fa78806a980 legacy=0x7fa788160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.275+0000 7fa77ffff700 1 -- 172.21.15.125:0/966687415 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978027157 0 0) 0x7fa78815cc10 con 0x7fa78806a980 2023-11-28T11:11:45.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.275+0000 7fa78df1e700 1 -- 172.21.15.125:0/966687415 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78806cf70 con 0x7fa788071890 2023-11-28T11:11:45.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.275+0000 7fa78df1e700 1 --2- 172.21.15.125:0/966687415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa788071890 0x7fa7880ce740 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa780009d90 tx=0x7fa78000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06e000689d2bbaa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:45.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.275+0000 7fa77ffff700 1 -- 172.21.15.125:0/966687415 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78000e070 con 0x7fa788071890 2023-11-28T11:11:45.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.275+0000 7fa77ffff700 1 -- 172.21.15.125:0/966687415 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78000bb90 con 0x7fa788071890 2023-11-28T11:11:45.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.275+0000 7fa77ffff700 1 -- 172.21.15.125:0/966687415 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780003a20 con 0x7fa788071890 2023-11-28T11:11:45.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.276+0000 7fa78f981700 1 -- 172.21.15.125:0/966687415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa788071890 msgr2=0x7fa7880ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.276+0000 7fa78f981700 1 --2- 172.21.15.125:0/966687415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa788071890 0x7fa7880ce740 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa780009d90 tx=0x7fa78000b330 comp rx=0 tx=0).stop 2023-11-28T11:11:45.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.276+0000 7fa78f981700 1 -- 172.21.15.125:0/966687415 shutdown_connections 2023-11-28T11:11:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.276+0000 7fa78f981700 1 --2- 172.21.15.125:0/966687415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa788071890 0x7fa7880ce740 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.276+0000 7fa78f981700 1 -- 172.21.15.125:0/966687415 >> 172.21.15.125:0/966687415 conn(0x7fa78806c010 msgr2=0x7fa7880cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.276+0000 7fa78f981700 1 -- 172.21.15.125:0/966687415 shutdown_connections 2023-11-28T11:11:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.276+0000 7fa78f981700 1 -- 172.21.15.125:0/966687415 wait complete. 2023-11-28T11:11:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.277+0000 7fa78f981700 1 Processor -- start 2023-11-28T11:11:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.277+0000 7fa78f981700 1 -- start start 2023-11-28T11:11:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78f981700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa78806a980 0x7fa7881f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78f981700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa788071890 0x7fa78815de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78f981700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7880cf710 0x7fa7880c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78f981700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881f63e0 con 0x7fa7880cf710 2023-11-28T11:11:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78f981700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78815e350 con 0x7fa788071890 2023-11-28T11:11:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78f981700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78815e620 con 0x7fa78806a980 2023-11-28T11:11:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78df1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7880cf710 0x7fa7880c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78df1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7880cf710 0x7fa7880c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33164/0 (socket says 172.21.15.125:33164) 2023-11-28T11:11:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78df1e700 1 -- 172.21.15.125:0/1921852236 learned_addr learned my addr 172.21.15.125:0/1921852236 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78cf1c700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa788071890 0x7fa78815de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78df1e700 1 -- 172.21.15.125:0/1921852236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa78806a980 msgr2=0x7fa7881f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78df1e700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa78806a980 0x7fa7881f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78df1e700 1 -- 172.21.15.125:0/1921852236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa788071890 msgr2=0x7fa78815de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78df1e700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa788071890 0x7fa78815de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78df1e700 1 -- 172.21.15.125:0/1921852236 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa780009a70 con 0x7fa7880cf710 2023-11-28T11:11:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78df1e700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7880cf710 0x7fa7880c6f10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa788067450 tx=0x7fa780004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:45.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa77dffb700 1 -- 172.21.15.125:0/1921852236 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780012630 con 0x7fa7880cf710 2023-11-28T11:11:45.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa77dffb700 1 -- 172.21.15.125:0/1921852236 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780012790 con 0x7fa7880cf710 2023-11-28T11:11:45.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa78f981700 1 -- 172.21.15.125:0/1921852236 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78806d530 con 0x7fa7880cf710 2023-11-28T11:11:45.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.278+0000 7fa77dffb700 1 -- 172.21.15.125:0/1921852236 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780012b40 con 0x7fa7880cf710 2023-11-28T11:11:45.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.279+0000 7fa78f981700 1 -- 172.21.15.125:0/1921852236 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78806d250 con 0x7fa7880cf710 2023-11-28T11:11:45.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.280+0000 7fa77dffb700 1 -- 172.21.15.125:0/1921852236 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa78002c070 con 0x7fa7880cf710 2023-11-28T11:11:45.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.280+0000 7fa77dffb700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa76c0682f0 0x7fa76c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.280+0000 7fa77dffb700 1 -- 172.21.15.125:0/1921852236 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa780087ea0 con 0x7fa7880cf710 2023-11-28T11:11:45.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.281+0000 7fa78d71d700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa76c0682f0 0x7fa76c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.281+0000 7fa78d71d700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa76c0682f0 0x7fa76c06a7a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa7780096d0 tx=0x7fa778006c30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:45.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.282+0000 7fa79bb0ab80 1 Processor -- start 2023-11-28T11:11:45.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.282+0000 7fa79bb0ab80 1 -- start start 2023-11-28T11:11:45.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.283+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2a810 0x55efdad00a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.283+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad28130 0x55efdad2abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.283+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2b120 0x55efdad46770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.283+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdabeabc0 con 0x55efdad2a810 2023-11-28T11:11:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.283+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdac59350 con 0x55efdad2b120 2023-11-28T11:11:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.283+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55efdac52880 con 0x55efdad28130 2023-11-28T11:11:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.283+0000 7fa78d71d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2a810 0x55efdad00a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.283+0000 7fa78d71d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2a810 0x55efdad00a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33168/0 (socket says 172.21.15.125:33168) 2023-11-28T11:11:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.283+0000 7fa78d71d700 1 -- 172.21.15.125:0/346262406 learned_addr learned my addr 172.21.15.125:0/346262406 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.283+0000 7fa78d71d700 1 -- 172.21.15.125:0/346262406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad28130 msgr2=0x55efdad2abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.283+0000 7fa78d71d700 1 --2- 172.21.15.125:0/346262406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad28130 0x55efdad2abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa78d71d700 1 -- 172.21.15.125:0/346262406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2b120 msgr2=0x55efdad46770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa78df1e700 1 --2- 172.21.15.125:0/346262406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2b120 0x55efdad46770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa78d71d700 1 --2- 172.21.15.125:0/346262406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2b120 0x55efdad46770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa78d71d700 1 -- 172.21.15.125:0/346262406 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efdaad45e0 con 0x55efdad2a810 2023-11-28T11:11:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa78d71d700 1 --2- 172.21.15.125:0/346262406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2a810 0x55efdad00a20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa778013920 tx=0x7fa77800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b105e9393210583f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa772ffd700 1 -- 172.21.15.125:0/346262406 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780128a0 con 0x55efdad2a810 2023-11-28T11:11:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa772ffd700 1 -- 172.21.15.125:0/346262406 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa778019040 con 0x55efdad2a810 2023-11-28T11:11:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa772ffd700 1 -- 172.21.15.125:0/346262406 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778012c60 con 0x55efdad2a810 2023-11-28T11:11:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/346262406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2a810 msgr2=0x55efdad00a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/346262406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2a810 0x55efdad00a20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa778013920 tx=0x7fa77800e000 comp rx=0 tx=0).stop 2023-11-28T11:11:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/346262406 shutdown_connections 2023-11-28T11:11:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/346262406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2b120 0x55efdad46770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/346262406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2a810 0x55efdad00a20 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.284+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/346262406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad28130 0x55efdad2abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.285+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/346262406 >> 172.21.15.125:0/346262406 conn(0x55efdacfdd60 msgr2=0x55efdacfe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.285+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/346262406 shutdown_connections 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.285+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/346262406 wait complete. 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.285+0000 7fa79bb0ab80 1 -- start start 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.285+0000 7fa79bb0ab80 1 Processor -- start 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad28130 0x55efdad1d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad2a810 0x55efdad191d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2b120 0x55efdad19860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdaad68d0 con 0x55efdad28130 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdad2cec0 con 0x55efdad2b120 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55efdad1c8c0 con 0x55efdad2a810 2023-11-28T11:11:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa79bb0ab80 10 client.0 _ll_register_callbacks cb 0x55efdaaf8240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:11:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa78d71d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad28130 0x55efdad1d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa78d71d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad28130 0x55efdad1d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33176/0 (socket says 172.21.15.125:33176) 2023-11-28T11:11:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa78d71d700 1 -- 172.21.15.125:0/678659545 learned_addr learned my addr 172.21.15.125:0/678659545 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa78df1e700 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2b120 0x55efdad19860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa78cf1c700 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad2a810 0x55efdad191d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa78d71d700 1 -- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad2a810 msgr2=0x55efdad191d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa78d71d700 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad2a810 0x55efdad191d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa78d71d700 1 -- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2b120 msgr2=0x55efdad19860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa78d71d700 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2b120 0x55efdad19860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa78d71d700 1 -- 172.21.15.125:0/678659545 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7780135a0 con 0x55efdad28130 2023-11-28T11:11:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.286+0000 7fa78cf1c700 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad2a810 0x55efdad191d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa78d71d700 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad28130 0x55efdad1d660 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x55efdacfc0d0 tx=0x7fa7780047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6cef84540f7248 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa767fff700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:11:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa767fff700 1 -- 172.21.15.125:0/678659545 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778027820 con 0x55efdad28130 2023-11-28T11:11:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa767fff700 1 -- 172.21.15.125:0/678659545 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa778027980 con 0x55efdad28130 2023-11-28T11:11:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/678659545 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efdac20140 con 0x55efdad28130 2023-11-28T11:11:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa767fff700 1 -- 172.21.15.125:0/678659545 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa778027b80 con 0x55efdad28130 2023-11-28T11:11:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa79bb0ab80 10 client.6420 fetch_fsmap learned FSMap version 31 2023-11-28T11:11:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/678659545 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55efdaa80d90 con 0x55efdad28130 2023-11-28T11:11:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa767fff700 1 -- 172.21.15.125:0/678659545 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55efdac20140 con 0x55efdad28130 2023-11-28T11:11:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa767fff700 1 -- 172.21.15.125:0/678659545 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fa778027ce0 con 0x55efdad28130 2023-11-28T11:11:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa79bb0ab80 10 client.6420 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:11:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa79bb0ab80 10 client.6420 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T11:11:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa79bb0ab80 20 client.6420 populate_metadata read hostname 'smithi125' 2023-11-28T11:11:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55efdad2c2f0 0x55efdad2c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa79bb0ab80 4 client.6420 mds_command: new command op to 6276 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:11:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/678659545 --> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55efdaad6f10 con 0x55efdad2c2f0 2023-11-28T11:11:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.287+0000 7fa78cf1c700 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55efdad2c2f0 0x55efdad2c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.288+0000 7fa767fff700 10 client.6420 ms_handle_connect on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.288+0000 7fa78cf1c700 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55efdad2c2f0 0x55efdad2c6c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9a2228ba08f72ab server_cookie=73c2ed76b5de4863 in_seq=0 out_seq=0 2023-11-28T11:11:45.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.288+0000 7fa767fff700 1 -- 172.21.15.125:0/678659545 <== mds.0 v2:172.21.15.167:6833/1701437437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55efdaad6f10 con 0x55efdad2c2f0 2023-11-28T11:11:45.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.288+0000 7fa767fff700 10 client.6420 handle_command_reply: tid=0 2023-11-28T11:11:45.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.288+0000 7fa79bb0ab80 1 client.6420 shutdown 2023-11-28T11:11:45.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/678659545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad28130 msgr2=0x55efdad1d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad28130 0x55efdad1d660 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x55efdacfc0d0 tx=0x7fa7780047b0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/678659545 shutdown_connections 2023-11-28T11:11:45.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2b120 0x55efdad19860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55efdad2c2f0 0x55efdad2c6c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad28130 0x55efdad1d660 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa767fff700 0 client.6420 ms_handle_reset on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/678659545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad2a810 0x55efdad191d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/678659545 >> 172.21.15.125:0/678659545 conn(0x55efdacfdd60 msgr2=0x55efdacff230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/678659545 shutdown_connections 2023-11-28T11:11:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/678659545 wait complete. 2023-11-28T11:11:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.289+0000 7fa79bb0ab80 20 client.6420 trim_cache size 0 max 16384 2023-11-28T11:11:45.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.306+0000 7fa79bb0ab80 1 Processor -- start 2023-11-28T11:11:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.306+0000 7fa79bb0ab80 1 -- start start 2023-11-28T11:11:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad28130 0x55efdad27bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad2a810 0x55efdad19210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad2c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdacf9fb0 con 0x55efdad2b120 2023-11-28T11:11:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdad67860 con 0x55efdad28130 2023-11-28T11:11:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55efdad22280 con 0x55efdad2a810 2023-11-28T11:11:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa78df1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad2c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa78df1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad2c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33186/0 (socket says 172.21.15.125:33186) 2023-11-28T11:11:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa78df1e700 1 -- 172.21.15.125:0/2920603011 learned_addr learned my addr 172.21.15.125:0/2920603011 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa78df1e700 1 -- 172.21.15.125:0/2920603011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad2a810 msgr2=0x55efdad19210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa78df1e700 1 --2- 172.21.15.125:0/2920603011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad2a810 0x55efdad19210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa78df1e700 1 -- 172.21.15.125:0/2920603011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad28130 msgr2=0x55efdad27bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa78df1e700 1 --2- 172.21.15.125:0/2920603011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad28130 0x55efdad27bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa78df1e700 1 -- 172.21.15.125:0/2920603011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efdac19140 con 0x55efdad2b120 2023-11-28T11:11:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa78df1e700 1 --2- 172.21.15.125:0/2920603011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad2c6c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa78000b730 tx=0x7fa780060450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c2c23a73b06c62 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa7737fe700 1 -- 172.21.15.125:0/2920603011 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780054ad0 con 0x55efdad2b120 2023-11-28T11:11:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa7737fe700 1 -- 172.21.15.125:0/2920603011 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780054c30 con 0x55efdad2b120 2023-11-28T11:11:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.307+0000 7fa7737fe700 1 -- 172.21.15.125:0/2920603011 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780057ab0 con 0x55efdad2b120 2023-11-28T11:11:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.308+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/2920603011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 msgr2=0x55efdad2c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.308+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/2920603011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad2c6c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa78000b730 tx=0x7fa780060450 comp rx=0 tx=0).stop 2023-11-28T11:11:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.308+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/2920603011 shutdown_connections 2023-11-28T11:11:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.308+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/2920603011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad2c6c0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.308+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/2920603011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad28130 0x55efdad27bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.308+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/2920603011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad2a810 0x55efdad19210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.308+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/2920603011 >> 172.21.15.125:0/2920603011 conn(0x55efdacfdd60 msgr2=0x55efdad01960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.308+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/2920603011 shutdown_connections 2023-11-28T11:11:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.308+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/2920603011 wait complete. 2023-11-28T11:11:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.308+0000 7fa79bb0ab80 1 -- start start 2023-11-28T11:11:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.308+0000 7fa79bb0ab80 1 Processor -- start 2023-11-28T11:11:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.309+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad28130 0x55efdad29080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.309+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2a810 0x55efdacff230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.309+0000 7fa79bb0ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad20e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.309+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdacfff50 con 0x55efdad2b120 2023-11-28T11:11:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.309+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdad27560 con 0x55efdad2a810 2023-11-28T11:11:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.309+0000 7fa79bb0ab80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55efdad18a70 con 0x55efdad28130 2023-11-28T11:11:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.309+0000 7fa79bb0ab80 10 client.0 _ll_register_callbacks cb 0x55efdaaf8240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:11:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.309+0000 7fa78df1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad20e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa78df1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad20e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33192/0 (socket says 172.21.15.125:33192) 2023-11-28T11:11:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa78df1e700 1 -- 172.21.15.125:0/3857652321 learned_addr learned my addr 172.21.15.125:0/3857652321 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa78df1e700 1 -- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad28130 msgr2=0x55efdad29080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa78d71d700 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad28130 0x55efdad29080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa78cf1c700 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2a810 0x55efdacff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa78df1e700 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad28130 0x55efdad29080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa78df1e700 1 -- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2a810 msgr2=0x55efdacff230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:45.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa78df1e700 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2a810 0x55efdacff230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa78df1e700 1 -- 172.21.15.125:0/3857652321 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78806d250 con 0x55efdad2b120 2023-11-28T11:11:45.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa78df1e700 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad20e10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa780083040 tx=0x7fa780009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb3c0e0a5ac59fe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:45.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa767fff700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:11:45.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa767fff700 1 -- 172.21.15.125:0/3857652321 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78006bb00 con 0x55efdad2b120 2023-11-28T11:11:45.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/3857652321 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efdac10160 con 0x55efdad2b120 2023-11-28T11:11:45.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa767fff700 1 -- 172.21.15.125:0/3857652321 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa78006bc60 con 0x55efdad2b120 2023-11-28T11:11:45.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa767fff700 1 -- 172.21.15.125:0/3857652321 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa78006be20 con 0x55efdad2b120 2023-11-28T11:11:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa79bb0ab80 10 client.6426 fetch_fsmap learned FSMap version 31 2023-11-28T11:11:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/3857652321 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55efdaaa7200 con 0x55efdad2b120 2023-11-28T11:11:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa767fff700 1 -- 172.21.15.125:0/3857652321 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55efdac10160 con 0x55efdad2b120 2023-11-28T11:11:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa767fff700 1 -- 172.21.15.125:0/3857652321 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fa7800541b0 con 0x55efdad2b120 2023-11-28T11:11:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa79bb0ab80 10 client.6426 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:11:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa79bb0ab80 10 client.6426 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T11:11:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa79bb0ab80 20 client.6426 populate_metadata read hostname 'smithi125' 2023-11-28T11:11:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55efdad213f0 0x55efdad217c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa79bb0ab80 4 client.6426 mds_command: new command op to 6276 tid=0[{"prefix": "status"}] 2023-11-28T11:11:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.310+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/3857652321 --> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55efdabfa170 con 0x55efdad213f0 2023-11-28T11:11:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa78d71d700 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55efdad213f0 0x55efdad217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa767fff700 10 client.6426 ms_handle_connect on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa78d71d700 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55efdad213f0 0x55efdad217c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c585893bedd6ba71 server_cookie=411bbd1883c97bf7 in_seq=0 out_seq=0 2023-11-28T11:11:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa767fff700 1 -- 172.21.15.125:0/3857652321 <== mds.0 v2:172.21.15.167:6833/1701437437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55efdabfa170 con 0x55efdad213f0 2023-11-28T11:11:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa767fff700 10 client.6426 handle_command_reply: tid=0 2023-11-28T11:11:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa79bb0ab80 1 client.6426 shutdown 2023-11-28T11:11:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/3857652321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 msgr2=0x55efdad20e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad20e10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa780083040 tx=0x7fa780009580 comp rx=0 tx=0).stop 2023-11-28T11:11:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/3857652321 shutdown_connections 2023-11-28T11:11:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55efdad213f0 0x55efdad217c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55efdad2b120 0x55efdad20e10 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa767fff700 0 client.6426 ms_handle_reset on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55efdad28130 0x55efdad29080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa79bb0ab80 1 --2- 172.21.15.125:0/3857652321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55efdad2a810 0x55efdacff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.311+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/3857652321 >> 172.21.15.125:0/3857652321 conn(0x55efdacfdd60 msgr2=0x55efdad2dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:45.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/3857652321 shutdown_connections 2023-11-28T11:11:45.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa79bb0ab80 1 -- 172.21.15.125:0/3857652321 wait complete. 2023-11-28T11:11:45.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa79bb0ab80 20 client.6426 trim_cache size 0 max 16384 2023-11-28T11:11:45.326 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:11:45.326 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea", 2023-11-28T11:11:45.327 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-11-28T11:11:45.327 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 6276, 2023-11-28T11:11:45.327 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-11-28T11:11:45.327 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-11-28T11:11:45.327 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-11-28T11:11:45.327 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 5.8368666999999999, 2023-11-28T11:11:45.327 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 31, 2023-11-28T11:11:45.327 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 66, 2023-11-28T11:11:45.327 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 66, 2023-11-28T11:11:45.328 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 11.124295235 2023-11-28T11:11:45.328 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:11:45.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 -- 172.21.15.125:0/1921852236 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa76c0682f0 msgr2=0x7fa76c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa76c0682f0 0x7fa76c06a7a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa7780096d0 tx=0x7fa778006c30 comp rx=0 tx=0).stop 2023-11-28T11:11:45.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 -- 172.21.15.125:0/1921852236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7880cf710 msgr2=0x7fa7880c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7880cf710 0x7fa7880c6f10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa788067450 tx=0x7fa780004ad0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 -- 172.21.15.125:0/1921852236 shutdown_connections 2023-11-28T11:11:45.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7880cf710 0x7fa7880c6f10 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa76c0682f0 0x7fa76c06a7a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa78806a980 0x7fa7881f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 --2- 172.21.15.125:0/1921852236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa788071890 0x7fa78815de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 -- 172.21.15.125:0/1921852236 >> 172.21.15.125:0/1921852236 conn(0x7fa78806c010 msgr2=0x7fa78815beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:45.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 -- 172.21.15.125:0/1921852236 shutdown_connections 2023-11-28T11:11:45.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.312+0000 7fa78f981700 1 -- 172.21.15.125:0/1921852236 wait complete. 2023-11-28T11:11:45.331 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:11:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.449+0000 7f64caba8700 1 Processor -- start 2023-11-28T11:11:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.449+0000 7f64caba8700 1 -- start start 2023-11-28T11:11:45.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.450+0000 7f64caba8700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64c406e400 0x7f64c40b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.450+0000 7f64caba8700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c4160e70 0x7f64c415c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.450+0000 7f64caba8700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c406e900 con 0x7f64c40d0c60 2023-11-28T11:11:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.450+0000 7f64caba8700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c4160390 con 0x7f64c406e400 2023-11-28T11:11:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.450+0000 7f64caba8700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c4160670 con 0x7f64c4160e70 2023-11-28T11:11:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c3fff700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64c406e400 0x7f64c40b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c9145700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c4160e70 0x7f64c415c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c8944700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f64c40d0c60 0x7f64c40d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:48354/0 (socket says 172.21.15.125:48354) 2023-11-28T11:11:45.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c8944700 1 -- 172.21.15.125:0/1773684272 learned_addr learned my addr 172.21.15.125:0/1773684272 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:45.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c3fff700 1 -- 172.21.15.125:0/1773684272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c4160e70 msgr2=0x7f64c415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:45.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c3fff700 1 --2- 172.21.15.125:0/1773684272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c4160e70 0x7f64c415c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c3fff700 1 -- 172.21.15.125:0/1773684272 >> v1:172.21.15.167:6789/0 conn(0x7f64c40d0c60 legacy=0x7f64c40d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c3fff700 1 -- 172.21.15.125:0/1773684272 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c4160950 con 0x7f64c406e400 2023-11-28T11:11:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c9145700 1 --2- 172.21.15.125:0/1773684272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c4160e70 0x7f64c415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:11:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c3fff700 1 --2- 172.21.15.125:0/1773684272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c406e400 0x7f64c40b5be0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009840 tx=0x7f64b0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60ef994d20b662ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c37fe700 1 -- 172.21.15.125:0/1773684272 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0011830 con 0x7f64c406e400 2023-11-28T11:11:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c37fe700 1 -- 172.21.15.125:0/1773684272 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b0011990 con 0x7f64c406e400 2023-11-28T11:11:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.451+0000 7f64c37fe700 1 -- 172.21.15.125:0/1773684272 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0011d20 con 0x7f64c406e400 2023-11-28T11:11:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.452+0000 7f64caba8700 1 -- 172.21.15.125:0/1773684272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c406e400 msgr2=0x7f64c40b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.452+0000 7f64caba8700 1 --2- 172.21.15.125:0/1773684272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c406e400 0x7f64c40b5be0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009840 tx=0x7f64b0009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.452+0000 7f64caba8700 1 -- 172.21.15.125:0/1773684272 shutdown_connections 2023-11-28T11:11:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.452+0000 7f64caba8700 1 --2- 172.21.15.125:0/1773684272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c4160e70 0x7f64c415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.452+0000 7f64caba8700 1 --2- 172.21.15.125:0/1773684272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c406e400 0x7f64c40b5be0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.452+0000 7f64caba8700 1 -- 172.21.15.125:0/1773684272 >> 172.21.15.125:0/1773684272 conn(0x7f64c406a270 msgr2=0x7f64c406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.452+0000 7f64caba8700 1 -- 172.21.15.125:0/1773684272 shutdown_connections 2023-11-28T11:11:45.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.452+0000 7f64caba8700 1 -- 172.21.15.125:0/1773684272 wait complete. 2023-11-28T11:11:45.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.453+0000 7f64caba8700 1 Processor -- start 2023-11-28T11:11:45.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.453+0000 7f64caba8700 1 -- start start 2023-11-28T11:11:45.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64caba8700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c406e400 0x7f64c4147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64caba8700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c40d0c60 0x7f64c4155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64caba8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c4160e70 0x7f64c4155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64caba8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40b18e0 con 0x7f64c4160e70 2023-11-28T11:11:45.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64caba8700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40b08d0 con 0x7f64c40d0c60 2023-11-28T11:11:45.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64caba8700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40b1450 con 0x7f64c406e400 2023-11-28T11:11:45.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c9145700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c4160e70 0x7f64c4155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c9145700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c4160e70 0x7f64c4155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33206/0 (socket says 172.21.15.125:33206) 2023-11-28T11:11:45.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c9145700 1 -- 172.21.15.125:0/83314512 learned_addr learned my addr 172.21.15.125:0/83314512 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:45.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c8944700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c406e400 0x7f64c4147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c3fff700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c40d0c60 0x7f64c4155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c9145700 1 -- 172.21.15.125:0/83314512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c406e400 msgr2=0x7f64c4147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c9145700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c406e400 0x7f64c4147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c9145700 1 -- 172.21.15.125:0/83314512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c40d0c60 msgr2=0x7f64c4155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c9145700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c40d0c60 0x7f64c4155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c9145700 1 -- 172.21.15.125:0/83314512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc009a70 con 0x7f64c4160e70 2023-11-28T11:11:45.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c8944700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c406e400 0x7f64c4147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:45.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.454+0000 7f64c3fff700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c40d0c60 0x7f64c4155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:11:45.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.455+0000 7f64c9145700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c4160e70 0x7f64c4155b70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009e10 tx=0x7f64bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:45.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.455+0000 7f64c17fa700 1 -- 172.21.15.125:0/83314512 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc009cb0 con 0x7f64c4160e70 2023-11-28T11:11:45.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.455+0000 7f64c17fa700 1 -- 172.21.15.125:0/83314512 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc00f040 con 0x7f64c4160e70 2023-11-28T11:11:45.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.455+0000 7f64caba8700 1 -- 172.21.15.125:0/83314512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b00094a0 con 0x7f64c4160e70 2023-11-28T11:11:45.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.455+0000 7f64c17fa700 1 -- 172.21.15.125:0/83314512 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc014480 con 0x7f64c4160e70 2023-11-28T11:11:45.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.455+0000 7f64caba8700 1 -- 172.21.15.125:0/83314512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c415ceb0 con 0x7f64c4160e70 2023-11-28T11:11:45.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.456+0000 7f64caba8700 1 -- 172.21.15.125:0/83314512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c40d0740 con 0x7f64c4160e70 2023-11-28T11:11:45.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.456+0000 7f64c17fa700 1 -- 172.21.15.125:0/83314512 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f64bc0145e0 con 0x7f64c4160e70 2023-11-28T11:11:45.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.457+0000 7f64c17fa700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64a80682f0 0x7f64a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:45.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.457+0000 7f64c17fa700 1 -- 172.21.15.125:0/83314512 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64bc086ac0 con 0x7f64c4160e70 2023-11-28T11:11:45.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.457+0000 7f64c8944700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64a80682f0 0x7f64a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:45.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.457+0000 7f64c8944700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64a80682f0 0x7f64a806a7a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f64b8000f60 tx=0x7f64b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:45.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.461+0000 7f64c17fa700 1 -- 172.21.15.125:0/83314512 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f64bc053320 con 0x7f64c4160e70 2023-11-28T11:11:45.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.688+0000 7f64caba8700 1 -- 172.21.15.125:0/83314512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64c415d040 con 0x7f64c4160e70 2023-11-28T11:11:45.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.688+0000 7f64c17fa700 1 -- 172.21.15.125:0/83314512 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f64bc018070 con 0x7f64c4160e70 2023-11-28T11:11:45.689 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:11:45.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 -- 172.21.15.125:0/83314512 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64a80682f0 msgr2=0x7f64a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64a80682f0 0x7f64a806a7a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f64b8000f60 tx=0x7f64b8009040 comp rx=0 tx=0).stop 2023-11-28T11:11:45.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 -- 172.21.15.125:0/83314512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c4160e70 msgr2=0x7f64c4155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:45.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c4160e70 0x7f64c4155b70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009e10 tx=0x7f64bc00c3a0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 -- 172.21.15.125:0/83314512 shutdown_connections 2023-11-28T11:11:45.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c4160e70 0x7f64c4155b70 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f64a80682f0 0x7f64a806a7a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64c406e400 0x7f64c4147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 --2- 172.21.15.125:0/83314512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c40d0c60 0x7f64c4155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:45.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 -- 172.21.15.125:0/83314512 >> 172.21.15.125:0/83314512 conn(0x7f64c406a270 msgr2=0x7f64c41527c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:45.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 -- 172.21.15.125:0/83314512 shutdown_connections 2023-11-28T11:11:45.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:45.690+0000 7f64caba8700 1 -- 172.21.15.125:0/83314512 wait complete. 2023-11-28T11:11:45.703 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:11:45.703 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:11:45.703 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-11-28T11:11:45.703 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:11:45.703 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:11:45.703 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:11:45.703 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T11:11:45.703 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:11:45.703 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:11:45.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:45.704 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-11-28T11:11:45.722 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:11:45.722 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:11:45.722 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:11:45.722 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:11:45.722 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-11-28T11:11:45.722 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:11:45.722 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:11:45.722 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:11:45.722 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:11:45.723 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:11:45.723 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T11:11:45.723 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:11:45.723 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:11:45.723 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:11:45.723 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-28T11:11:45.723 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42165sec preferred_lft 42165sec 2023-11-28T11:11:45.723 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::af9c:3934:f827:ab8e/64 scope link noprefixroute 2023-11-28T11:11:45.723 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:11:45.724 INFO:teuthology.orchestra.run.smithi125.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:11:45.724 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 1e:0c:6e:81:a9:77 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:11:45.724 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:11:45.724 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:11:45.724 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::2847:a7ff:fe7f:fad9/64 scope link 2023-11-28T11:11:45.724 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:11:45.724 INFO:teuthology.orchestra.run.smithi125.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:11:45.724 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 8a:65:01:86:2c:a8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:11:45.724 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::8865:1ff:fe86:2ca8/64 scope link 2023-11-28T11:11:45.725 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:11:45.725 INFO:teuthology.orchestra.run.smithi125.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:11:45.725 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 1e:0c:6e:81:a9:77 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:11:45.725 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::1c0c:6eff:fe81:a977/64 scope link 2023-11-28T11:11:45.725 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:11:45.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:45.726 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:11:45.787 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-11-28T11:11:45.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:45.788 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-11-28T11:11:45.847 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-11-28T11:11:45.847 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:11:45.848 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T11:11:45.848 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T11:11:45.848 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:11:45.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:45.848 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-28T11:11:45.848 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-28T11:11:45.848 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T11:11:45.848 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T11:11:45.849 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T11:11:45.849 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-28T11:11:45.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:45.952 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-11-28T11:11:45.968 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T11:11:45.968 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:11:45.968 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:11:45.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:45.969 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-11-28T11:11:46.035 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T11:11:46.035 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:11:46.035 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:11:46.092 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:11:46.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:11:46.093 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:11:46.149 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-11-28T11:11:46.216 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:11:46.216 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:11:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:11:46.283 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:11:46.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:46.283 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-28T11:11:46.340 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:11:46.340 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T11:11:46.383 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-11-28T11:11:46.409 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:11:46.409 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:11:46.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2023-11-28T11:11:46.468+0000 7f234ee055c0 -1 init, newargv = 0x56494a0a8ef0 newargc=15 2023-11-28T11:11:46.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[127318]: starting ceph client 2023-11-28T11:11:46.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[127318]: starting fuse 2023-11-28T11:11:46.478 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:11:46.479 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:11:46.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:46.480 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-28T11:11:46.537 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-11-28T11:11:46.538 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-11-28T11:11:46.538 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:11:46.538 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-11-28T11:11:46.538 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-11-28T11:11:46.538 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:11:46.538 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-11-28T11:11:46.538 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:11:46.538 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-11-28T11:11:46.538 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T11:11:46.538 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-11-28T11:11:46.539 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T11:11:46.539 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:11:46.539 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-11-28T11:11:46.539 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-11-28T11:11:46.539 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-11-28T11:11:46.539 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-11-28T11:11:46.539 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:11:46.539 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-11-28T11:11:46.539 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:11:46.539 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:11:46.539 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:11:46.540 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-11-28T11:11:46.540 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-11-28T11:11:46.540 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-11-28T11:11:46.540 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:11:46.540 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:11:46.540 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.0")) 2023-11-28T11:11:46.540 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:11:46.659 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.127318.asok 2023-11-28T11:11:46.843 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.127318.asok 2023-11-28T11:11:46.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:46.843 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.127318.asok status 2023-11-28T11:11:46.999 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:11:46.999 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-11-28T11:11:46.999 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:11:46.999 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:11:46.999 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2023-11-28T11:11:46.999 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-11-28T11:11:46.999 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T11:11:46.999 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "127318", 2023-11-28T11:11:47.000 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-11-28T11:11:47.000 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:47.000 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-11-28T11:11:47.000 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-11-28T11:11:47.000 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 6432, 2023-11-28T11:11:47.000 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-11-28T11:11:47.000 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-11-28T11:11:47.000 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-11-28T11:11:47.000 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 6432 2023-11-28T11:11:47.001 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:47.001 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-28T11:11:47.001 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-28T11:11:47.001 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:11:47.001 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3785223954 2023-11-28T11:11:47.001 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:47.001 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:47.001 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-28T11:11:47.001 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-28T11:11:47.002 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:11:47.002 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3785223954 2023-11-28T11:11:47.002 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:47.002 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.6432 192.168.0.1:0/3785223954", 2023-11-28T11:11:47.002 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/3785223954", 2023-11-28T11:11:47.002 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-11-28T11:11:47.002 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 31, 2023-11-28T11:11:47.002 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 66, 2023-11-28T11:11:47.002 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:11:47.003 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-11-28T11:11:47.003 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-11-28T11:11:47.003 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:11:47.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:47.009 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-11-28T11:11:47.009 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T11:11:47.026 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-11-28T11:11:47.027 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T11:11:47.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:47.028 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:11:47.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:47.095 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2023-11-28T11:11:47.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:11:47.159 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2023-11-28T11:11:47.221 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:11:47.221 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-28T11:11:47.221 DEBUG:teuthology.orchestra.run.smithi125:> import stat 2023-11-28T11:11:47.221 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-28T11:11:47.221 DEBUG:teuthology.orchestra.run.smithi125:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2023-11-28T11:11:47.221 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-28T11:11:47.327 INFO:teuthology.orchestra.run.smithi125.stdout:1099511627777 2023-11-28T11:11:47.516 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:11:47.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.676+0000 7efc4b298700 1 Processor -- start 2023-11-28T11:11:47.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.676+0000 7efc4b298700 1 -- start start 2023-11-28T11:11:47.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc4b298700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efc440ce040 0x7efc4415d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:47.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc4b298700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc44142db0 0x7efc4413ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:47.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc4b298700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4413fc90 con 0x7efc440b1770 2023-11-28T11:11:47.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc4b298700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4413f6d0 con 0x7efc440ce040 2023-11-28T11:11:47.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc4b298700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4413f9b0 con 0x7efc44142db0 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc49034700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efc440ce040 0x7efc4415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc48833700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc44142db0 0x7efc4413ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc49835700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7efc440b1770 0x7efc4413cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:48384/0 (socket says 172.21.15.125:48384) 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc48833700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc44142db0 0x7efc4413ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:56462/0 (socket says 172.21.15.125:56462) 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc49034700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efc440ce040 0x7efc4415d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:58184/0 (socket says 172.21.15.125:58184) 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc49835700 1 -- 172.21.15.125:0/1231085597 learned_addr learned my addr 172.21.15.125:0/1231085597 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc49034700 1 -- 172.21.15.125:0/1231085597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc44142db0 msgr2=0x7efc4413ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc49034700 1 --2- 172.21.15.125:0/1231085597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc44142db0 0x7efc4413ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc49034700 1 -- 172.21.15.125:0/1231085597 >> v1:172.21.15.167:6789/0 conn(0x7efc440b1770 legacy=0x7efc4413cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc49034700 1 -- 172.21.15.125:0/1231085597 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4415d100 con 0x7efc440ce040 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc3bfff700 1 -- 172.21.15.125:0/1231085597 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462338789 0 0) 0x7efc4413fc90 con 0x7efc440b1770 2023-11-28T11:11:47.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.677+0000 7efc48833700 1 --2- 172.21.15.125:0/1231085597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc44142db0 0x7efc4413ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:11:47.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc49034700 1 --2- 172.21.15.125:0/1231085597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc440ce040 0x7efc4415d900 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efc40009840 tx=0x7efc40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eea367b0996bca1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:47.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc3bfff700 1 -- 172.21.15.125:0/1231085597 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40011830 con 0x7efc440ce040 2023-11-28T11:11:47.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc3bfff700 1 -- 172.21.15.125:0/1231085597 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc40011990 con 0x7efc440ce040 2023-11-28T11:11:47.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc3bfff700 1 -- 172.21.15.125:0/1231085597 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40011d20 con 0x7efc440ce040 2023-11-28T11:11:47.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc4b298700 1 -- 172.21.15.125:0/1231085597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc440ce040 msgr2=0x7efc4415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:47.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc4b298700 1 --2- 172.21.15.125:0/1231085597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc440ce040 0x7efc4415d900 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efc40009840 tx=0x7efc40009b50 comp rx=0 tx=0).stop 2023-11-28T11:11:47.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc4b298700 1 -- 172.21.15.125:0/1231085597 shutdown_connections 2023-11-28T11:11:47.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc4b298700 1 --2- 172.21.15.125:0/1231085597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc440ce040 0x7efc4415d900 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:47.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc4b298700 1 --2- 172.21.15.125:0/1231085597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc44142db0 0x7efc4413ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:47.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc4b298700 1 -- 172.21.15.125:0/1231085597 >> 172.21.15.125:0/1231085597 conn(0x7efc4406c010 msgr2=0x7efc440cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:47.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc4b298700 1 -- 172.21.15.125:0/1231085597 shutdown_connections 2023-11-28T11:11:47.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.678+0000 7efc4b298700 1 -- 172.21.15.125:0/1231085597 wait complete. 2023-11-28T11:11:47.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.680+0000 7efc4b298700 1 Processor -- start 2023-11-28T11:11:47.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.680+0000 7efc4b298700 1 -- start start 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc4b298700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc440b1770 0x7efc4406ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc4b298700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc440ce040 0x7efc440c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc4b298700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc44142db0 0x7efc440cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc4b298700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440b3d40 con 0x7efc440b1770 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc4b298700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440b3f50 con 0x7efc44142db0 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc4b298700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc440b4230 con 0x7efc440ce040 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc49034700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc440b1770 0x7efc4406ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc49034700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc440b1770 0x7efc4406ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33228/0 (socket says 172.21.15.125:33228) 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc49034700 1 -- 172.21.15.125:0/3564048016 learned_addr learned my addr 172.21.15.125:0/3564048016 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc48833700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc440ce040 0x7efc440c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc49835700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc44142db0 0x7efc440cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:47.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc49034700 1 -- 172.21.15.125:0/3564048016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc440ce040 msgr2=0x7efc440c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc49034700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc440ce040 0x7efc440c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc49034700 1 -- 172.21.15.125:0/3564048016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc44142db0 msgr2=0x7efc440cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc49034700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc44142db0 0x7efc440cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc49034700 1 -- 172.21.15.125:0/3564048016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc340094a0 con 0x7efc440b1770 2023-11-28T11:11:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.681+0000 7efc49034700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc440b1770 0x7efc4406ac50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efc40009fd0 tx=0x7efc40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.682+0000 7efc39ffb700 1 -- 172.21.15.125:0/3564048016 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40004550 con 0x7efc440b1770 2023-11-28T11:11:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.682+0000 7efc39ffb700 1 -- 172.21.15.125:0/3564048016 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4001f070 con 0x7efc440b1770 2023-11-28T11:11:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.682+0000 7efc4b298700 1 -- 172.21.15.125:0/3564048016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc400094a0 con 0x7efc440b1770 2023-11-28T11:11:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.682+0000 7efc39ffb700 1 -- 172.21.15.125:0/3564048016 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400038e0 con 0x7efc440b1770 2023-11-28T11:11:47.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.682+0000 7efc4b298700 1 -- 172.21.15.125:0/3564048016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc440ce410 con 0x7efc440b1770 2023-11-28T11:11:47.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.683+0000 7efc4b298700 1 -- 172.21.15.125:0/3564048016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4415d3e0 con 0x7efc440b1770 2023-11-28T11:11:47.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.683+0000 7efc39ffb700 1 -- 172.21.15.125:0/3564048016 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efc4000f050 con 0x7efc440b1770 2023-11-28T11:11:47.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.683+0000 7efc39ffb700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc280682f0 0x7efc2806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:47.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.684+0000 7efc39ffb700 1 -- 172.21.15.125:0/3564048016 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc40021070 con 0x7efc440b1770 2023-11-28T11:11:47.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.684+0000 7efc48833700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc280682f0 0x7efc2806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:47.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.684+0000 7efc48833700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc280682f0 0x7efc2806a7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efc4415a4d0 tx=0x7efc34009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:47.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.688+0000 7efc39ffb700 1 -- 172.21.15.125:0/3564048016 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7efc40053d20 con 0x7efc440b1770 2023-11-28T11:11:47.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.913+0000 7efc4b298700 1 -- 172.21.15.125:0/3564048016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc440ce5a0 con 0x7efc440b1770 2023-11-28T11:11:47.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.914+0000 7efc39ffb700 1 -- 172.21.15.125:0/3564048016 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4661 (secure 0 0 0) 0x7efc40057340 con 0x7efc440b1770 2023-11-28T11:11:47.915 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:47.915 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5710,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3518974696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3518974696},{"type":"v1","addr":"172.21.15.167:6834","nonce":3518974696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/2475008501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2475008501},{"type":"v1","addr":"172.21.15.125:6836","nonce":2475008501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2392518832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":2392518832},{"type":"v1","addr":"172.21.15.125:6837","nonce":2392518832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:11:39.473096+0000","modified":"2023-11-28T11:11:42.492030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/1701437437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1701437437},{"type":"v1","addr":"172.21.15.167:6835","nonce":1701437437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:11:47.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 -- 172.21.15.125:0/3564048016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc280682f0 msgr2=0x7efc2806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:47.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc280682f0 0x7efc2806a7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efc4415a4d0 tx=0x7efc34009210 comp rx=0 tx=0).stop 2023-11-28T11:11:47.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 -- 172.21.15.125:0/3564048016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc440b1770 msgr2=0x7efc4406ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:47.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc440b1770 0x7efc4406ac50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efc40009fd0 tx=0x7efc40004750 comp rx=0 tx=0).stop 2023-11-28T11:11:47.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 -- 172.21.15.125:0/3564048016 shutdown_connections 2023-11-28T11:11:47.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc44142db0 0x7efc440cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:47.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc440b1770 0x7efc4406ac50 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:47.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7efc280682f0 0x7efc2806a7a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:47.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 --2- 172.21.15.125:0/3564048016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc440ce040 0x7efc440c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:47.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 -- 172.21.15.125:0/3564048016 >> 172.21.15.125:0/3564048016 conn(0x7efc4406c010 msgr2=0x7efc44153200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:47.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 -- 172.21.15.125:0/3564048016 shutdown_connections 2023-11-28T11:11:47.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:47.916+0000 7efc4b298700 1 -- 172.21.15.125:0/3564048016 wait complete. 2023-11-28T11:11:47.918 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 31 2023-11-28T11:11:47.928 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2023-11-28T11:11:48.091 INFO:teuthology.orchestra.run.smithi167.stdout:{"message":"","return_code":0} 2023-11-28T11:11:48.091 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:11:48.091 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T11:11:48.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.135+0000 7f63a7c37080 1 Processor -- start 2023-11-28T11:11:48.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.135+0000 7f63a7c37080 1 -- start start 2023-11-28T11:11:48.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.135+0000 7f63a7c37080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c634ca6190 0x55c634d7c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.135+0000 7f63a7c37080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd1c80 0x55c634ca2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.135+0000 7f63a7c37080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c634cd2a20 0x55c634cd0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.135+0000 7f63a7c37080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c634bdefe0 con 0x55c634cd1c80 2023-11-28T11:11:48.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.135+0000 7f63a7c37080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c634d7f990 con 0x55c634cd2a20 2023-11-28T11:11:48.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.135+0000 7f63a7c37080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c634ca30b0 con 0x55c634ca6190 2023-11-28T11:11:48.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.135+0000 7f639d539700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd1c80 0x55c634ca2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.135+0000 7f639d539700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd1c80 0x55c634ca2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33244/0 (socket says 172.21.15.125:33244) 2023-11-28T11:11:48.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.135+0000 7f639d539700 1 -- 172.21.15.125:0/1979845405 learned_addr learned my addr 172.21.15.125:0/1979845405 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f639dd3a700 1 --2- 172.21.15.125:0/1979845405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c634ca6190 0x55c634d7c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f639e53b700 1 --2- 172.21.15.125:0/1979845405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c634cd2a20 0x55c634cd0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f639d539700 1 -- 172.21.15.125:0/1979845405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c634ca6190 msgr2=0x55c634d7c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f639d539700 1 --2- 172.21.15.125:0/1979845405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c634ca6190 0x55c634d7c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f639d539700 1 -- 172.21.15.125:0/1979845405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c634cd2a20 msgr2=0x55c634cd0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f639d539700 1 --2- 172.21.15.125:0/1979845405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c634cd2a20 0x55c634cd0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f639d539700 1 -- 172.21.15.125:0/1979845405 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6394005d20 con 0x55c634cd1c80 2023-11-28T11:11:48.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f639d539700 1 --2- 172.21.15.125:0/1979845405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd1c80 0x55c634ca2490 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f639000b2e0 tx=0x7f639000b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a6e2d3405395a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f638ffff700 1 -- 172.21.15.125:0/1979845405 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390014070 con 0x55c634cd1c80 2023-11-28T11:11:48.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f638ffff700 1 -- 172.21.15.125:0/1979845405 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639000f3f0 con 0x55c634cd1c80 2023-11-28T11:11:48.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f638ffff700 1 -- 172.21.15.125:0/1979845405 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639000f760 con 0x55c634cd1c80 2023-11-28T11:11:48.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f63a7c37080 1 -- 172.21.15.125:0/1979845405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd1c80 msgr2=0x55c634ca2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f63a7c37080 1 --2- 172.21.15.125:0/1979845405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd1c80 0x55c634ca2490 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f639000b2e0 tx=0x7f639000b5f0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f63a7c37080 1 -- 172.21.15.125:0/1979845405 shutdown_connections 2023-11-28T11:11:48.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f63a7c37080 1 --2- 172.21.15.125:0/1979845405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c634cd2a20 0x55c634cd0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f63a7c37080 1 --2- 172.21.15.125:0/1979845405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c634ca6190 0x55c634d7c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f63a7c37080 1 --2- 172.21.15.125:0/1979845405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd1c80 0x55c634ca2490 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.136+0000 7f63a7c37080 1 -- 172.21.15.125:0/1979845405 >> 172.21.15.125:0/1979845405 conn(0x55c634ca3ba0 msgr2=0x55c634c8eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.137+0000 7f63a7c37080 1 -- 172.21.15.125:0/1979845405 shutdown_connections 2023-11-28T11:11:48.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.137+0000 7f63a7c37080 1 -- 172.21.15.125:0/1979845405 wait complete. 2023-11-28T11:11:48.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.137+0000 7f63a7c37080 1 Processor -- start 2023-11-28T11:11:48.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.137+0000 7f63a7c37080 1 -- start start 2023-11-28T11:11:48.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.138+0000 7f63a7c37080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c634ca6190 0x55c634d7df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.138+0000 7f63a7c37080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c634cd1c80 0x55c634ca2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.138+0000 7f63a7c37080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd2a20 0x55c634e12c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.138+0000 7f63a7c37080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c634ce6f30 con 0x55c634cd2a20 2023-11-28T11:11:48.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.138+0000 7f63a7c37080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c634ce6950 con 0x55c634ca6190 2023-11-28T11:11:48.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.138+0000 7f63a7c37080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c634ce6c10 con 0x55c634cd1c80 2023-11-28T11:11:48.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.138+0000 7f639dd3a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c634ca6190 0x55c634d7df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.138+0000 7f639e53b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd2a20 0x55c634e12c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.138+0000 7f639dd3a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c634ca6190 0x55c634d7df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:58210/0 (socket says 172.21.15.125:58210) 2023-11-28T11:11:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.138+0000 7f639dd3a700 1 -- 172.21.15.125:0/4025597875 learned_addr learned my addr 172.21.15.125:0/4025597875 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f639d539700 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c634cd1c80 0x55c634ca2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f639e53b700 1 -- 172.21.15.125:0/4025597875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c634cd1c80 msgr2=0x55c634ca2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f639e53b700 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c634cd1c80 0x55c634ca2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f639e53b700 1 -- 172.21.15.125:0/4025597875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c634ca6190 msgr2=0x55c634d7df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f639e53b700 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c634ca6190 0x55c634d7df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f639e53b700 1 -- 172.21.15.125:0/4025597875 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390001c10 con 0x55c634cd2a20 2023-11-28T11:11:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f639e53b700 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd2a20 0x55c634e12c10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6398012000 tx=0x7f6398003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f638effd700 1 -- 172.21.15.125:0/4025597875 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398024660 con 0x55c634cd2a20 2023-11-28T11:11:48.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f638effd700 1 -- 172.21.15.125:0/4025597875 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6398009070 con 0x55c634cd2a20 2023-11-28T11:11:48.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f638effd700 1 -- 172.21.15.125:0/4025597875 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63980249e0 con 0x55c634cd2a20 2023-11-28T11:11:48.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f63a7c37080 1 -- 172.21.15.125:0/4025597875 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c634bea830 con 0x55c634cd2a20 2023-11-28T11:11:48.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.139+0000 7f63a7c37080 1 -- 172.21.15.125:0/4025597875 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639800a100 con 0x55c634cd2a20 2023-11-28T11:11:48.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.140+0000 7f638effd700 1 -- 172.21.15.125:0/4025597875 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f639800e050 con 0x55c634cd2a20 2023-11-28T11:11:48.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.141+0000 7f638effd700 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6380066c10 0x7f63800690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.141+0000 7f638effd700 1 -- 172.21.15.125:0/4025597875 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6398085f30 con 0x55c634cd2a20 2023-11-28T11:11:48.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.141+0000 7f639dd3a700 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6380066c10 0x7f63800690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.141+0000 7f63a7c37080 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x55c634ca2bd0 0x55c634e1e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.141+0000 7f63a7c37080 1 -- 172.21.15.125:0/4025597875 --> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c634cd0c10 con 0x55c634ca2bd0 2023-11-28T11:11:48.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.141+0000 7f639dd3a700 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6380066c10 0x7f63800690c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6394005400 tx=0x7f639400c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.141+0000 7f639d539700 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x55c634ca2bd0 0x55c634e1e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.141+0000 7f639d539700 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x55c634ca2bd0 0x55c634e1e260 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f639d539700 1 -- 172.21.15.125:0/4025597875 <== osd.6 v2:172.21.15.167:6808/103805 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7f6390016070 con 0x55c634ca2bd0 2023-11-28T11:11:48.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f63a7c37080 1 -- 172.21.15.125:0/4025597875 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x55c634ca2bd0 msgr2=0x55c634e1e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f63a7c37080 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x55c634ca2bd0 0x55c634e1e260 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f63a7c37080 1 -- 172.21.15.125:0/4025597875 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6380066c10 msgr2=0x7f63800690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f63a7c37080 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6380066c10 0x7f63800690c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6394005400 tx=0x7f639400c040 comp rx=0 tx=0).stop 2023-11-28T11:11:48.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f63a7c37080 1 -- 172.21.15.125:0/4025597875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd2a20 msgr2=0x55c634e12c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f63a7c37080 1 --2- 172.21.15.125:0/4025597875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c634cd2a20 0x55c634e12c10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6398012000 tx=0x7f6398003330 comp rx=0 tx=0).stop 2023-11-28T11:11:48.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f639e53b700 1 -- 172.21.15.125:0/4025597875 reap_dead start 2023-11-28T11:11:48.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f63a7c37080 1 -- 172.21.15.125:0/4025597875 shutdown_connections 2023-11-28T11:11:48.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f63a7c37080 1 -- 172.21.15.125:0/4025597875 >> 172.21.15.125:0/4025597875 conn(0x55c634ca3ba0 msgr2=0x55c634ce5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f63a7c37080 1 -- 172.21.15.125:0/4025597875 shutdown_connections 2023-11-28T11:11:48.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.142+0000 7f63a7c37080 1 -- 172.21.15.125:0/4025597875 wait complete. 2023-11-28T11:11:48.150 INFO:teuthology.orchestra.run.smithi125.stdout:Xfiledir_test 2023-11-28T11:11:48.150 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:48.150 DEBUG:teuthology.orchestra.run.smithi125:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T11:11:48.205 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:11:48.206 INFO:teuthology.orchestra.run.smithi125.stdout: "ino": 1099511627777, 2023-11-28T11:11:48.206 INFO:teuthology.orchestra.run.smithi125.stdout: "ancestors": [ 2023-11-28T11:11:48.206 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:48.206 INFO:teuthology.orchestra.run.smithi125.stdout: "dirino": 1099511627776, 2023-11-28T11:11:48.206 INFO:teuthology.orchestra.run.smithi125.stdout: "dname": "file", 2023-11-28T11:11:48.206 INFO:teuthology.orchestra.run.smithi125.stdout: "version": 2 2023-11-28T11:11:48.206 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-28T11:11:48.206 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:11:48.206 INFO:teuthology.orchestra.run.smithi125.stdout: "dirino": 1, 2023-11-28T11:11:48.206 INFO:teuthology.orchestra.run.smithi125.stdout: "dname": "dir_test", 2023-11-28T11:11:48.207 INFO:teuthology.orchestra.run.smithi125.stdout: "version": 4 2023-11-28T11:11:48.207 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:48.207 INFO:teuthology.orchestra.run.smithi125.stdout: ], 2023-11-28T11:11:48.207 INFO:teuthology.orchestra.run.smithi125.stdout: "pool": 10, 2023-11-28T11:11:48.207 INFO:teuthology.orchestra.run.smithi125.stdout: "old_pools": [] 2023-11-28T11:11:48.207 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:11:48.207 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:11:48.210 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2023-11-28T11:11:48.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.294+0000 7fe5c7dd4080 1 Processor -- start 2023-11-28T11:11:48.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.294+0000 7fe5c7dd4080 1 -- start start 2023-11-28T11:11:48.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5c7dd4080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abb034b0 0x5619abaebb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5c7dd4080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5619abb03e80 0x5619abbdf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5c7dd4080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5619abbd57a0 0x5619abb00000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5c7dd4080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619aba3bfe0 con 0x5619abb034b0 2023-11-28T11:11:48.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5c7dd4080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619abb4bb10 con 0x5619abb03e80 2023-11-28T11:11:48.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5c7dd4080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5619abbe1680 con 0x5619abbd57a0 2023-11-28T11:11:48.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5bded7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abb034b0 0x5619abaebb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5bded7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abb034b0 0x5619abaebb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33264/0 (socket says 172.21.15.125:33264) 2023-11-28T11:11:48.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5bded7700 1 -- 172.21.15.125:0/2978993442 learned_addr learned my addr 172.21.15.125:0/2978993442 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5be6d8700 1 --2- 172.21.15.125:0/2978993442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5619abbd57a0 0x5619abb00000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5bd6d6700 1 --2- 172.21.15.125:0/2978993442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5619abb03e80 0x5619abbdf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5bded7700 1 -- 172.21.15.125:0/2978993442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5619abbd57a0 msgr2=0x5619abb00000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5bded7700 1 --2- 172.21.15.125:0/2978993442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5619abbd57a0 0x5619abb00000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5bded7700 1 -- 172.21.15.125:0/2978993442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5619abb03e80 msgr2=0x5619abbdf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5bded7700 1 --2- 172.21.15.125:0/2978993442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5619abb03e80 0x5619abbdf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5bded7700 1 -- 172.21.15.125:0/2978993442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b800a100 con 0x5619abb034b0 2023-11-28T11:11:48.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5bded7700 1 --2- 172.21.15.125:0/2978993442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abb034b0 0x5619abaebb40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400b270 tx=0x7fe5b400b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e70f00fb77f0c82 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.295+0000 7fe5affff700 1 -- 172.21.15.125:0/2978993442 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4014070 con 0x5619abb034b0 2023-11-28T11:11:48.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.296+0000 7fe5affff700 1 -- 172.21.15.125:0/2978993442 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b400be50 con 0x5619abb034b0 2023-11-28T11:11:48.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.296+0000 7fe5affff700 1 -- 172.21.15.125:0/2978993442 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400f5f0 con 0x5619abb034b0 2023-11-28T11:11:48.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.296+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/2978993442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abb034b0 msgr2=0x5619abaebb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.296+0000 7fe5c7dd4080 1 --2- 172.21.15.125:0/2978993442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abb034b0 0x5619abaebb40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400b270 tx=0x7fe5b400b580 comp rx=0 tx=0).stop 2023-11-28T11:11:48.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.296+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/2978993442 shutdown_connections 2023-11-28T11:11:48.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.296+0000 7fe5c7dd4080 1 --2- 172.21.15.125:0/2978993442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5619abbd57a0 0x5619abb00000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.296+0000 7fe5c7dd4080 1 --2- 172.21.15.125:0/2978993442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abb034b0 0x5619abaebb40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.296+0000 7fe5c7dd4080 1 --2- 172.21.15.125:0/2978993442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5619abb03e80 0x5619abbdf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.296+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/2978993442 >> 172.21.15.125:0/2978993442 conn(0x5619abb2db00 msgr2=0x5619abb48040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.296+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/2978993442 shutdown_connections 2023-11-28T11:11:48.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.296+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/2978993442 wait complete. 2023-11-28T11:11:48.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5c7dd4080 1 Processor -- start 2023-11-28T11:11:48.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5c7dd4080 1 -- start start 2023-11-28T11:11:48.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5c7dd4080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5619abb034b0 0x5619abbc39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5c7dd4080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5619abb03e80 0x5619abbde4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5c7dd4080 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abbd57a0 0x5619abbde9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5c7dd4080 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619abb2b5e0 con 0x5619abbd57a0 2023-11-28T11:11:48.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5c7dd4080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619abb2ee00 con 0x5619abb03e80 2023-11-28T11:11:48.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5c7dd4080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5619abbc3f00 con 0x5619abb034b0 2023-11-28T11:11:48.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5be6d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abbd57a0 0x5619abbde9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5bd6d6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5619abb03e80 0x5619abbde4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5be6d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abbd57a0 0x5619abbde9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33274/0 (socket says 172.21.15.125:33274) 2023-11-28T11:11:48.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.297+0000 7fe5be6d8700 1 -- 172.21.15.125:0/55123977 learned_addr learned my addr 172.21.15.125:0/55123977 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5bded7700 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5619abb034b0 0x5619abbc39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5be6d8700 1 -- 172.21.15.125:0/55123977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5619abb034b0 msgr2=0x5619abbc39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5be6d8700 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5619abb034b0 0x5619abbc39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5be6d8700 1 -- 172.21.15.125:0/55123977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5619abb03e80 msgr2=0x5619abbde4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5be6d8700 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5619abb03e80 0x5619abbde4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5be6d8700 1 -- 172.21.15.125:0/55123977 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b4001b40 con 0x5619abbd57a0 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5be6d8700 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abbd57a0 0x5619abbde9e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8003000 tx=0x7fe5b8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5aeffd700 1 -- 172.21.15.125:0/55123977 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b801b850 con 0x5619abbd57a0 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5aeffd700 1 -- 172.21.15.125:0/55123977 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b8009050 con 0x5619abbd57a0 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5aeffd700 1 -- 172.21.15.125:0/55123977 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b801bbd0 con 0x5619abbd57a0 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/55123977 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619aba54120 con 0x5619abbd57a0 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.298+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/55123977 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619aba47830 con 0x5619abbd57a0 2023-11-28T11:11:48.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.299+0000 7fe5aeffd700 1 -- 172.21.15.125:0/55123977 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe5b802a020 con 0x5619abbd57a0 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.300+0000 7fe5aeffd700 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe5a0066c10 0x7fe5a00690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.300+0000 7fe5aeffd700 1 -- 172.21.15.125:0/55123977 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe5b8086370 con 0x5619abbd57a0 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.300+0000 7fe5bded7700 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe5a0066c10 0x7fe5a00690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.300+0000 7fe5c7dd4080 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x5619abb2e470 0x5619abc7c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.300+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/55123977 --> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x5619abb302a0 con 0x5619abb2e470 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.300+0000 7fe5bded7700 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe5a0066c10 0x7fe5a00690c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x5619abb4b1e0 tx=0x7fe5b4011040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.300+0000 7fe5bd6d6700 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x5619abb2e470 0x5619abc7c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.300+0000 7fe5bd6d6700 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x5619abb2e470 0x5619abc7c0a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5bd6d6700 1 -- 172.21.15.125:0/55123977 <== osd.6 v2:172.21.15.167:6808/103805 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v66'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe5b0012040 con 0x5619abb2e470 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/55123977 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x5619abb2e470 msgr2=0x5619abc7c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5c7dd4080 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x5619abb2e470 0x5619abc7c0a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/55123977 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe5a0066c10 msgr2=0x7fe5a00690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5c7dd4080 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe5a0066c10 0x7fe5a00690c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x5619abb4b1e0 tx=0x7fe5b4011040 comp rx=0 tx=0).stop 2023-11-28T11:11:48.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/55123977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abbd57a0 msgr2=0x5619abbde9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5c7dd4080 1 --2- 172.21.15.125:0/55123977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5619abbd57a0 0x5619abbde9e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8003000 tx=0x7fe5b8003330 comp rx=0 tx=0).stop 2023-11-28T11:11:48.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5be6d8700 1 -- 172.21.15.125:0/55123977 reap_dead start 2023-11-28T11:11:48.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/55123977 shutdown_connections 2023-11-28T11:11:48.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/55123977 >> 172.21.15.125:0/55123977 conn(0x5619abb2db00 msgr2=0x5619abbdf970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/55123977 shutdown_connections 2023-11-28T11:11:48.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.302+0000 7fe5c7dd4080 1 -- 172.21.15.125:0/55123977 wait complete. 2023-11-28T11:11:48.310 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2023-11-28T11:11:48.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.433+0000 7f53e8629700 1 Processor -- start 2023-11-28T11:11:48.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.434+0000 7f53e8629700 1 -- start start 2023-11-28T11:11:48.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.434+0000 7f53e8629700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e00d0cb0 0x7f53e00d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.434+0000 7f53e8629700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53e015c8f0 0x7f53e006b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e8629700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f53e00ccef0 0x7f53e006b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e8629700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e00d15c0 con 0x7f53e015c8f0 2023-11-28T11:11:48.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e8629700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e00cbe50 con 0x7f53e00ccef0 2023-11-28T11:11:48.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e8629700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00cc130 con 0x7f53e00d0cb0 2023-11-28T11:11:48.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e5bc4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53e015c8f0 0x7f53e006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e5bc4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53e015c8f0 0x7f53e006b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33280/0 (socket says 172.21.15.125:33280) 2023-11-28T11:11:48.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e5bc4700 1 -- 172.21.15.125:0/2353944640 learned_addr learned my addr 172.21.15.125:0/2353944640 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e63c5700 1 --2- 172.21.15.125:0/2353944640 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e00d0cb0 0x7f53e00d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e6bc6700 1 --2- 172.21.15.125:0/2353944640 >> v2:172.21.15.167:3300/0 conn(0x7f53e00ccef0 0x7f53e006b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e5bc4700 1 -- 172.21.15.125:0/2353944640 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e00d0cb0 msgr2=0x7f53e00d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/2353944640 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e00d0cb0 0x7f53e00d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e5bc4700 1 -- 172.21.15.125:0/2353944640 >> v2:172.21.15.167:3300/0 conn(0x7f53e00ccef0 msgr2=0x7f53e006b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/2353944640 >> v2:172.21.15.167:3300/0 conn(0x7f53e00ccef0 0x7f53e006b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e5bc4700 1 -- 172.21.15.125:0/2353944640 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e00cc410 con 0x7f53e015c8f0 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/2353944640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53e015c8f0 0x7f53e006b380 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f53e009a210 tx=0x7f53dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91d0b3f5f2a9085 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e53c3700 1 -- 172.21.15.125:0/2353944640 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc011830 con 0x7f53e015c8f0 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e53c3700 1 -- 172.21.15.125:0/2353944640 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc011990 con 0x7f53e015c8f0 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.435+0000 7f53e53c3700 1 -- 172.21.15.125:0/2353944640 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc011d20 con 0x7f53e015c8f0 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.436+0000 7f53e8629700 1 -- 172.21.15.125:0/2353944640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53e015c8f0 msgr2=0x7f53e006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.436+0000 7f53e8629700 1 --2- 172.21.15.125:0/2353944640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53e015c8f0 0x7f53e006b380 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f53e009a210 tx=0x7f53dc009bd0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.436+0000 7f53e8629700 1 -- 172.21.15.125:0/2353944640 shutdown_connections 2023-11-28T11:11:48.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.436+0000 7f53e8629700 1 --2- 172.21.15.125:0/2353944640 >> v2:172.21.15.167:3300/0 conn(0x7f53e00ccef0 0x7f53e006b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.436+0000 7f53e8629700 1 --2- 172.21.15.125:0/2353944640 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e00d0cb0 0x7f53e00d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.436+0000 7f53e8629700 1 --2- 172.21.15.125:0/2353944640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53e015c8f0 0x7f53e006b380 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.436+0000 7f53e8629700 1 -- 172.21.15.125:0/2353944640 >> 172.21.15.125:0/2353944640 conn(0x7f53e006ab90 msgr2=0x7f53e0099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.436+0000 7f53e8629700 1 -- 172.21.15.125:0/2353944640 shutdown_connections 2023-11-28T11:11:48.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.436+0000 7f53e8629700 1 -- 172.21.15.125:0/2353944640 wait complete. 2023-11-28T11:11:48.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.437+0000 7f53e8629700 1 Processor -- start 2023-11-28T11:11:48.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.437+0000 7f53e8629700 1 -- start start 2023-11-28T11:11:48.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e8629700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53e00ccef0 0x7f53e00b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e8629700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e00d0cb0 0x7f53e0147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e8629700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e015c8f0 0x7f53e01482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e8629700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00b5bf0 con 0x7f53e00ccef0 2023-11-28T11:11:48.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e8629700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00b4610 con 0x7f53e015c8f0 2023-11-28T11:11:48.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e8629700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00b48f0 con 0x7f53e00d0cb0 2023-11-28T11:11:48.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e63c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53e00ccef0 0x7f53e00b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e63c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53e00ccef0 0x7f53e00b56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33286/0 (socket says 172.21.15.125:33286) 2023-11-28T11:11:48.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e63c5700 1 -- 172.21.15.125:0/1198289419 learned_addr learned my addr 172.21.15.125:0/1198289419 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e00d0cb0 0x7f53e0147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e6bc6700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e015c8f0 0x7f53e01482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e63c5700 1 -- 172.21.15.125:0/1198289419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e00d0cb0 msgr2=0x7f53e0147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e63c5700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e00d0cb0 0x7f53e0147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e63c5700 1 -- 172.21.15.125:0/1198289419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e015c8f0 msgr2=0x7f53e01482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e63c5700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e015c8f0 0x7f53e01482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e63c5700 1 -- 172.21.15.125:0/1198289419 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc009550 con 0x7f53e00ccef0 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.438+0000 7f53e63c5700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53e00ccef0 0x7f53e00b56b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f53d000e900 tx=0x7f53d000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.439+0000 7f53d6ffd700 1 -- 172.21.15.125:0/1198289419 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0013680 con 0x7f53e00ccef0 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.439+0000 7f53d6ffd700 1 -- 172.21.15.125:0/1198289419 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d00137e0 con 0x7f53e00ccef0 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.439+0000 7f53e8629700 1 -- 172.21.15.125:0/1198289419 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e00cc9d0 con 0x7f53e00ccef0 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.439+0000 7f53d6ffd700 1 -- 172.21.15.125:0/1198289419 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0013b50 con 0x7f53e00ccef0 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.439+0000 7f53e8629700 1 -- 172.21.15.125:0/1198289419 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e00cc6f0 con 0x7f53e00ccef0 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.440+0000 7f53d6ffd700 1 -- 172.21.15.125:0/1198289419 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f53d0023070 con 0x7f53e00ccef0 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.441+0000 7f53d6ffd700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 0x7f53c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.441+0000 7f53d6ffd700 1 -- 172.21.15.125:0/1198289419 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53d0085e90 con 0x7f53e00ccef0 2023-11-28T11:11:48.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.441+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 0x7f53c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.441+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 0x7f53c406a7a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f53e015ccc0 tx=0x7f53dc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.443+0000 7f53f47b2b80 1 Processor -- start 2023-11-28T11:11:48.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.443+0000 7f53f47b2b80 1 -- start start 2023-11-28T11:11:48.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7358c0 0x55740a70bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7331e0 0x55740a735c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7361d0 0x55740a751820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740a5f5c70 con 0x55740a7361d0 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740a664400 con 0x55740a7358c0 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55740a65d930 con 0x55740a7331e0 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53e6bc6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7361d0 0x55740a751820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53e6bc6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7361d0 0x55740a751820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33298/0 (socket says 172.21.15.125:33298) 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53e6bc6700 1 -- 172.21.15.125:0/2175924499 learned_addr learned my addr 172.21.15.125:0/2175924499 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/2175924499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7331e0 0x55740a735c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53e63c5700 1 --2- 172.21.15.125:0/2175924499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7358c0 0x55740a70bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53e6bc6700 1 -- 172.21.15.125:0/2175924499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7331e0 msgr2=0x55740a735c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53e6bc6700 1 --2- 172.21.15.125:0/2175924499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7331e0 0x55740a735c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53e6bc6700 1 -- 172.21.15.125:0/2175924499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7358c0 msgr2=0x55740a70bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53e6bc6700 1 --2- 172.21.15.125:0/2175924499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7358c0 0x55740a70bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53e6bc6700 1 -- 172.21.15.125:0/2175924499 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55740a4df690 con 0x55740a7361d0 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53e6bc6700 1 --2- 172.21.15.125:0/2175924499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7361d0 0x55740a751820 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f53d80113f0 tx=0x7f53d8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0b5792691aba0c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53c3fff700 1 -- 172.21.15.125:0/2175924499 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d800e040 con 0x55740a7361d0 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.444+0000 7f53c3fff700 1 -- 172.21.15.125:0/2175924499 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d800f040 con 0x55740a7361d0 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.445+0000 7f53c3fff700 1 -- 172.21.15.125:0/2175924499 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8003e80 con 0x55740a7361d0 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.445+0000 7f53f47b2b80 1 -- 172.21.15.125:0/2175924499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7361d0 msgr2=0x55740a751820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.445+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/2175924499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7361d0 0x55740a751820 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f53d80113f0 tx=0x7f53d8009750 comp rx=0 tx=0).stop 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.445+0000 7f53f47b2b80 1 -- 172.21.15.125:0/2175924499 shutdown_connections 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.445+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/2175924499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7361d0 0x55740a751820 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.445+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/2175924499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7358c0 0x55740a70bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.445+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/2175924499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7331e0 0x55740a735c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.445+0000 7f53f47b2b80 1 -- 172.21.15.125:0/2175924499 >> 172.21.15.125:0/2175924499 conn(0x55740a708e10 msgr2=0x55740a7097a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.445+0000 7f53f47b2b80 1 -- 172.21.15.125:0/2175924499 shutdown_connections 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.445+0000 7f53f47b2b80 1 -- 172.21.15.125:0/2175924499 wait complete. 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.446+0000 7f53f47b2b80 1 -- start start 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.446+0000 7f53f47b2b80 1 Processor -- start 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a72c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7358c0 0x55740a72c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7361d0 0x55740a732c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740a4e1980 con 0x55740a7331e0 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740a754f40 con 0x55740a7361d0 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55740a737e70 con 0x55740a7358c0 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53f47b2b80 10 client.0 _ll_register_callbacks cb 0x55740a5032f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53e63c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a72c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53e63c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a72c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33300/0 (socket says 172.21.15.125:33300) 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53e63c5700 1 -- 172.21.15.125:0/3924102698 learned_addr learned my addr 172.21.15.125:0/3924102698 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7358c0 0x55740a72c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53e6bc6700 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7361d0 0x55740a732c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53e63c5700 1 -- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7358c0 msgr2=0x55740a72c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53e63c5700 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7358c0 0x55740a72c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53e63c5700 1 -- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7361d0 msgr2=0x55740a732c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53e63c5700 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7361d0 0x55740a732c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53e63c5700 1 -- 172.21.15.125:0/3924102698 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d8009e10 con 0x55740a7331e0 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53e63c5700 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a72c870 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f53d00561a0 tx=0x7f53d005e3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f8cb50dff9aa0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53c17fa700 1 -- 172.21.15.125:0/3924102698 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d00522b0 con 0x55740a7331e0 2023-11-28T11:11:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53c17fa700 1 -- 172.21.15.125:0/3924102698 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53d0052410 con 0x55740a7331e0 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.447+0000 7f53f47b2b80 1 -- 172.21.15.125:0/3924102698 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55740a62b1f0 con 0x55740a7331e0 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53c17fa700 1 -- 172.21.15.125:0/3924102698 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53d005e150 con 0x55740a7331e0 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53f47b2b80 10 client.6465 fetch_fsmap learned FSMap version 31 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53f47b2b80 1 -- 172.21.15.125:0/3924102698 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55740a48be40 con 0x55740a7331e0 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53c17fa700 1 -- 172.21.15.125:0/3924102698 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55740a62b1f0 con 0x55740a7331e0 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53c17fa700 1 -- 172.21.15.125:0/3924102698 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f53d00693f0 con 0x55740a7331e0 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53f47b2b80 10 client.6465 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53f47b2b80 10 client.6465 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53f47b2b80 20 client.6465 populate_metadata read hostname 'smithi125' 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55740a7386e0 0x55740a738ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53f47b2b80 4 client.6465 mds_command: new command op to 6276 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53f47b2b80 1 -- 172.21.15.125:0/3924102698 --> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55740a4e1fc0 con 0x55740a7386e0 2023-11-28T11:11:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55740a7386e0 0x55740a738ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53c17fa700 10 client.6465 ms_handle_connect on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.448+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55740a7386e0 0x55740a738ab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adaf8b1d88f10e60 server_cookie=221e8b96fe4344f2 in_seq=0 out_seq=0 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53c17fa700 1 -- 172.21.15.125:0/3924102698 <== mds.0 v2:172.21.15.167:6833/1701437437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55740a4e1fc0 con 0x55740a7386e0 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53c17fa700 10 client.6465 handle_command_reply: tid=0 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 1 client.6465 shutdown 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 1 -- 172.21.15.125:0/3924102698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 msgr2=0x55740a72c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a72c870 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f53d00561a0 tx=0x7f53d005e3d0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 1 -- 172.21.15.125:0/3924102698 shutdown_connections 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7361d0 0x55740a732c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55740a7386e0 0x55740a738ab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a72c870 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/3924102698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7358c0 0x55740a72c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53c17fa700 0 client.6465 ms_handle_reset on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:48.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 1 -- 172.21.15.125:0/3924102698 >> 172.21.15.125:0/3924102698 conn(0x55740a708e10 msgr2=0x55740a70ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 1 -- 172.21.15.125:0/3924102698 shutdown_connections 2023-11-28T11:11:48.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 1 -- 172.21.15.125:0/3924102698 wait complete. 2023-11-28T11:11:48.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.449+0000 7f53f47b2b80 20 client.6465 trim_cache size 0 max 16384 2023-11-28T11:11:48.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.466+0000 7f53f47b2b80 1 Processor -- start 2023-11-28T11:11:48.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.466+0000 7f53f47b2b80 1 -- start start 2023-11-28T11:11:48.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.466+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7331e0 0x55740a7562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.466+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7358c0 0x55740a738ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.466+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7361d0 0x55740a72c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.466+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740a702340 con 0x55740a7358c0 2023-11-28T11:11:48.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.466+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740a756900 con 0x55740a7331e0 2023-11-28T11:11:48.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.466+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55740a732940 con 0x55740a7361d0 2023-11-28T11:11:48.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e5bc4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7358c0 0x55740a738ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e5bc4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7358c0 0x55740a738ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33310/0 (socket says 172.21.15.125:33310) 2023-11-28T11:11:48.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e5bc4700 1 -- 172.21.15.125:0/867253953 learned_addr learned my addr 172.21.15.125:0/867253953 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e6bc6700 1 --2- 172.21.15.125:0/867253953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7361d0 0x55740a72c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e63c5700 1 --2- 172.21.15.125:0/867253953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7331e0 0x55740a7562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e5bc4700 1 -- 172.21.15.125:0/867253953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7361d0 msgr2=0x55740a72c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/867253953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7361d0 0x55740a72c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e5bc4700 1 -- 172.21.15.125:0/867253953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7331e0 msgr2=0x55740a7562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/867253953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7331e0 0x55740a7562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e5bc4700 1 -- 172.21.15.125:0/867253953 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55740a707f00 con 0x55740a7358c0 2023-11-28T11:11:48.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e6bc6700 1 --2- 172.21.15.125:0/867253953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7361d0 0x55740a72c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:48.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e63c5700 1 --2- 172.21.15.125:0/867253953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7331e0 0x55740a7562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:11:48.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/867253953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7358c0 0x55740a738ab0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f53dc013000 tx=0x7f53dc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406fecb2667aca25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53d4ff9700 1 -- 172.21.15.125:0/867253953 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc02e040 con 0x55740a7358c0 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53d4ff9700 1 -- 172.21.15.125:0/867253953 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc034420 con 0x55740a7358c0 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.467+0000 7f53d4ff9700 1 -- 172.21.15.125:0/867253953 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc020070 con 0x55740a7358c0 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.468+0000 7f53f47b2b80 1 -- 172.21.15.125:0/867253953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7358c0 msgr2=0x55740a738ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.468+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/867253953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7358c0 0x55740a738ab0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f53dc013000 tx=0x7f53dc010000 comp rx=0 tx=0).stop 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.468+0000 7f53f47b2b80 1 -- 172.21.15.125:0/867253953 shutdown_connections 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.468+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/867253953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7361d0 0x55740a72c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.468+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/867253953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7331e0 0x55740a7562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.468+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/867253953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7358c0 0x55740a738ab0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.468+0000 7f53f47b2b80 1 -- 172.21.15.125:0/867253953 >> 172.21.15.125:0/867253953 conn(0x55740a708e10 msgr2=0x55740a70a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.468+0000 7f53f47b2b80 1 -- 172.21.15.125:0/867253953 shutdown_connections 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.468+0000 7f53f47b2b80 1 -- 172.21.15.125:0/867253953 wait complete. 2023-11-28T11:11:48.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.468+0000 7f53f47b2b80 1 -- start start 2023-11-28T11:11:48.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.468+0000 7f53f47b2b80 1 Processor -- start 2023-11-28T11:11:48.472 INFO:tasks.ceph.mds.b.smithi167.stderr:2023-11-28T11:11:48.471+0000 7fe1490da700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6432=0-4194304@1} caps={6432=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6432 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x555f201f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T11:11:48.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a705140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7358c0 0x55740a756070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53f47b2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7361d0 0x55740a797b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740a746320 con 0x55740a7331e0 2023-11-28T11:11:48.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740a7565b0 con 0x55740a7361d0 2023-11-28T11:11:48.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53f47b2b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55740a798930 con 0x55740a7358c0 2023-11-28T11:11:48.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53f47b2b80 10 client.0 _ll_register_callbacks cb 0x55740a5032f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:11:48.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53e63c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a705140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53e63c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a705140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33314/0 (socket says 172.21.15.125:33314) 2023-11-28T11:11:48.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53e63c5700 1 -- 172.21.15.125:0/150904890 learned_addr learned my addr 172.21.15.125:0/150904890 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7358c0 0x55740a756070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.469+0000 7f53e6bc6700 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7361d0 0x55740a797b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53e63c5700 1 -- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7358c0 msgr2=0x55740a756070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53e63c5700 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7358c0 0x55740a756070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53e63c5700 1 -- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7361d0 msgr2=0x55740a797b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53e63c5700 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7361d0 0x55740a797b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53e63c5700 1 -- 172.21.15.125:0/150904890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e00cc410 con 0x55740a7331e0 2023-11-28T11:11:48.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53e63c5700 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a705140 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f53d005de20 tx=0x7f53d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d239a0e0420012d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:11:48.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53c17fa700 1 -- 172.21.15.125:0/150904890 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d005e150 con 0x55740a7331e0 2023-11-28T11:11:48.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53c17fa700 1 -- 172.21.15.125:0/150904890 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53d00520b0 con 0x55740a7331e0 2023-11-28T11:11:48.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53f47b2b80 1 -- 172.21.15.125:0/150904890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55740a61b210 con 0x55740a7331e0 2023-11-28T11:11:48.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53c17fa700 1 -- 172.21.15.125:0/150904890 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53d0052270 con 0x55740a7331e0 2023-11-28T11:11:48.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53f47b2b80 10 client.6471 fetch_fsmap learned FSMap version 31 2023-11-28T11:11:48.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53f47b2b80 1 -- 172.21.15.125:0/150904890 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55740a474cc0 con 0x55740a7331e0 2023-11-28T11:11:48.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53c17fa700 1 -- 172.21.15.125:0/150904890 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55740a61b210 con 0x55740a7331e0 2023-11-28T11:11:48.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53c17fa700 1 -- 172.21.15.125:0/150904890 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f53d0076070 con 0x55740a7331e0 2023-11-28T11:11:48.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53f47b2b80 10 client.6471 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:11:48.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53f47b2b80 10 client.6471 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-11-28T11:11:48.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53f47b2b80 20 client.6471 populate_metadata read hostname 'smithi125' 2023-11-28T11:11:48.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55740a7acdc0 0x55740a798060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53f47b2b80 4 client.6471 mds_command: new command op to 6276 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2023-11-28T11:11:48.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53f47b2b80 1 -- 172.21.15.125:0/150904890 --> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x55740a605220 con 0x55740a7acdc0 2023-11-28T11:11:48.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.470+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55740a7acdc0 0x55740a798060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.471+0000 7f53c17fa700 10 client.6471 ms_handle_connect on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:48.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.471+0000 7f53e5bc4700 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55740a7acdc0 0x55740a798060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f21aee2fc3c8144 server_cookie=46c7020dcb94cf99 in_seq=0 out_seq=0 2023-11-28T11:11:48.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.471+0000 7f53c17fa700 1 -- 172.21.15.125:0/150904890 <== mds.0 v2:172.21.15.167:6833/1701437437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55740a605220 con 0x55740a7acdc0 2023-11-28T11:11:48.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.471+0000 7f53c17fa700 10 client.6471 handle_command_reply: tid=0 2023-11-28T11:11:48.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.471+0000 7f53f47b2b80 1 client.6471 shutdown 2023-11-28T11:11:48.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.471+0000 7f53f47b2b80 1 -- 172.21.15.125:0/150904890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 msgr2=0x55740a705140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.471+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a705140 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f53d005de20 tx=0x7f53d0000bc0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53f47b2b80 1 -- 172.21.15.125:0/150904890 shutdown_connections 2023-11-28T11:11:48.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55740a7361d0 0x55740a797b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55740a7acdc0 0x55740a798060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55740a7331e0 0x55740a705140 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53c17fa700 0 client.6471 ms_handle_reset on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:48.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53f47b2b80 1 --2- 172.21.15.125:0/150904890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55740a7358c0 0x55740a756070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53f47b2b80 1 -- 172.21.15.125:0/150904890 >> 172.21.15.125:0/150904890 conn(0x55740a708e10 msgr2=0x55740a7095b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53f47b2b80 1 -- 172.21.15.125:0/150904890 shutdown_connections 2023-11-28T11:11:48.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53f47b2b80 1 -- 172.21.15.125:0/150904890 wait complete. 2023-11-28T11:11:48.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53f47b2b80 20 client.6471 trim_cache size 0 max 16384 2023-11-28T11:11:48.480 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:11:48.481 INFO:teuthology.orchestra.run.smithi125.stdout: "return_code": 0, 2023-11-28T11:11:48.481 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_tag": "3bfe9b3c-74c6-42eb-91e7-d5f675af60fb", 2023-11-28T11:11:48.481 INFO:teuthology.orchestra.run.smithi125.stdout: "mode": "asynchronous" 2023-11-28T11:11:48.481 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:11:48.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 -- 172.21.15.125:0/1198289419 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 msgr2=0x7f53c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 0x7f53c406a7a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f53e015ccc0 tx=0x7f53dc008030 comp rx=0 tx=0).stop 2023-11-28T11:11:48.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 -- 172.21.15.125:0/1198289419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53e00ccef0 msgr2=0x7f53e00b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53e00ccef0 0x7f53e00b56b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f53d000e900 tx=0x7f53d000ec10 comp rx=0 tx=0).stop 2023-11-28T11:11:48.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 -- 172.21.15.125:0/1198289419 shutdown_connections 2023-11-28T11:11:48.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e015c8f0 0x7f53e01482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53e00ccef0 0x7f53e00b56b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f53c40682f0 0x7f53c406a7a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 --2- 172.21.15.125:0/1198289419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e00d0cb0 0x7f53e0147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 -- 172.21.15.125:0/1198289419 >> 172.21.15.125:0/1198289419 conn(0x7f53e006ab90 msgr2=0x7f53e00cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 -- 172.21.15.125:0/1198289419 shutdown_connections 2023-11-28T11:11:48.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.472+0000 7f53e8629700 1 -- 172.21.15.125:0/1198289419 wait complete. 2023-11-28T11:11:48.485 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-28T11:11:48.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.605+0000 7f6ecb51c700 1 Processor -- start 2023-11-28T11:11:48.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.605+0000 7f6ecb51c700 1 -- start start 2023-11-28T11:11:48.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ecb51c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ec406a270 0x7f6ec406a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ecb51c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec406abd0 con 0x7f6ec40718e0 2023-11-28T11:11:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ecb51c700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec4160a50 con 0x7f6ec415c810 2023-11-28T11:11:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ecb51c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec415cbe0 con 0x7f6ec406a270 2023-11-28T11:11:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ec8ab7700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6ec40718e0 0x7f6ec406c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45680/0 (socket says 172.21.15.125:45680) 2023-11-28T11:11:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ec8ab7700 1 -- 172.21.15.125:0/2165713712 learned_addr learned my addr 172.21.15.125:0/2165713712 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:11:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/2165713712 >> v2:172.21.15.125:3300/0 conn(0x7f6ec406a270 0x7f6ec406a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/2165713712 >> v1:172.21.15.167:6789/0 conn(0x7f6ec415c810 legacy=0x7f6ec4160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/2165713712 >> v1:172.21.15.125:6789/0 conn(0x7f6ec40718e0 legacy=0x7f6ec406c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/2165713712 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4160d30 con 0x7f6ec406a270 2023-11-28T11:11:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ebbfff700 1 -- 172.21.15.125:0/2165713712 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588629678 0 0) 0x7f6ec406abd0 con 0x7f6ec40718e0 2023-11-28T11:11:48.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/2165713712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec406a270 0x7f6ec406a690 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009dc0 tx=0x7f6ebc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88df4a57d3989bbb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.606+0000 7f6ebbfff700 1 -- 172.21.15.125:0/2165713712 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc00e070 con 0x7f6ec406a270 2023-11-28T11:11:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.607+0000 7f6ebbfff700 1 -- 172.21.15.125:0/2165713712 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc00bb90 con 0x7f6ec406a270 2023-11-28T11:11:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.607+0000 7f6ebbfff700 1 -- 172.21.15.125:0/2165713712 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc012430 con 0x7f6ec406a270 2023-11-28T11:11:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.607+0000 7f6ecb51c700 1 -- 172.21.15.125:0/2165713712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec406a270 msgr2=0x7f6ec406a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.607+0000 7f6ecb51c700 1 --2- 172.21.15.125:0/2165713712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec406a270 0x7f6ec406a690 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009dc0 tx=0x7f6ebc00b330 comp rx=0 tx=0).stop 2023-11-28T11:11:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.607+0000 7f6ecb51c700 1 -- 172.21.15.125:0/2165713712 shutdown_connections 2023-11-28T11:11:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.607+0000 7f6ecb51c700 1 --2- 172.21.15.125:0/2165713712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec406a270 0x7f6ec406a690 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.607+0000 7f6ecb51c700 1 -- 172.21.15.125:0/2165713712 >> 172.21.15.125:0/2165713712 conn(0x7f6ec406c010 msgr2=0x7f6ec40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.607+0000 7f6ecb51c700 1 -- 172.21.15.125:0/2165713712 shutdown_connections 2023-11-28T11:11:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.607+0000 7f6ecb51c700 1 -- 172.21.15.125:0/2165713712 wait complete. 2023-11-28T11:11:48.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.608+0000 7f6ecb51c700 1 Processor -- start 2023-11-28T11:11:48.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.608+0000 7f6ecb51c700 1 -- start start 2023-11-28T11:11:48.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ecb51c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ec406a270 0x7f6ec41561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ecb51c700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ec40718e0 0x7f6ec415d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ecb51c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec415c810 0x7f6ec4157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ecb51c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec41f2670 con 0x7f6ec415c810 2023-11-28T11:11:48.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ecb51c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec41566f0 con 0x7f6ec406a270 2023-11-28T11:11:48.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ecb51c700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec415ec00 con 0x7f6ec40718e0 2023-11-28T11:11:48.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ec9ab9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec415c810 0x7f6ec4157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ec9ab9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec415c810 0x7f6ec4157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33332/0 (socket says 172.21.15.125:33332) 2023-11-28T11:11:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/1726322531 learned_addr learned my addr 172.21.15.125:0/1726322531 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ec8ab7700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ec40718e0 0x7f6ec415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ec406a270 0x7f6ec41561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/1726322531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ec40718e0 msgr2=0x7f6ec415d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ec40718e0 0x7f6ec415d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/1726322531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ec406a270 msgr2=0x7f6ec41561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ec406a270 0x7f6ec41561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.609+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/1726322531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc009a70 con 0x7f6ec415c810 2023-11-28T11:11:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.610+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec415c810 0x7f6ec4157360 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc014040 tx=0x7f6ebc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.610+0000 7f6eb9ffb700 1 -- 172.21.15.125:0/1726322531 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc01b8e0 con 0x7f6ec415c810 2023-11-28T11:11:48.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.610+0000 7f6eb9ffb700 1 -- 172.21.15.125:0/1726322531 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc020070 con 0x7f6ec415c810 2023-11-28T11:11:48.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.610+0000 7f6ecb51c700 1 -- 172.21.15.125:0/1726322531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec40ceb20 con 0x7f6ec415c810 2023-11-28T11:11:48.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.610+0000 7f6eb9ffb700 1 -- 172.21.15.125:0/1726322531 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc01bc80 con 0x7f6ec415c810 2023-11-28T11:11:48.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.610+0000 7f6ecb51c700 1 -- 172.21.15.125:0/1726322531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec4161010 con 0x7f6ec415c810 2023-11-28T11:11:48.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.611+0000 7f6eb9ffb700 1 -- 172.21.15.125:0/1726322531 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6ebc026400 con 0x7f6ec415c810 2023-11-28T11:11:48.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.612+0000 7f6eb9ffb700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ea80682f0 0x7f6ea806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.612+0000 7f6eb9ffb700 1 -- 172.21.15.125:0/1726322531 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ebc087e60 con 0x7f6ec415c810 2023-11-28T11:11:48.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.612+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ea80682f0 0x7f6ea806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.612+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ea80682f0 0x7f6ea806a7a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4000f60 tx=0x7f6eb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.614+0000 7f6ed76a5b80 1 Processor -- start 2023-11-28T11:11:48.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.614+0000 7f6ed76a5b80 1 -- start start 2023-11-28T11:11:48.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.614+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1da96a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.614+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dac0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.614+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac1170 0x562b1dadc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.614+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1d980c10 con 0x562b1dac0860 2023-11-28T11:11:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.614+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1d9ef3a0 con 0x562b1dac1170 2023-11-28T11:11:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.614+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b1d9e88d0 con 0x562b1dabe180 2023-11-28T11:11:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6ec92b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1da96a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6ec92b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1da96a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33336/0 (socket says 172.21.15.125:33336) 2023-11-28T11:11:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6ec92b8700 1 -- 172.21.15.125:0/949789107 learned_addr learned my addr 172.21.15.125:0/949789107 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/949789107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac1170 0x562b1dadc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6ec8ab7700 1 --2- 172.21.15.125:0/949789107 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dac0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6ec92b8700 1 -- 172.21.15.125:0/949789107 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 msgr2=0x562b1dac0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/949789107 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dac0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6ec92b8700 1 -- 172.21.15.125:0/949789107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac1170 msgr2=0x562b1dadc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/949789107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac1170 0x562b1dadc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6ec92b8700 1 -- 172.21.15.125:0/949789107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b1d86a630 con 0x562b1dac0860 2023-11-28T11:11:48.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/949789107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1da96a70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4005390 tx=0x7f6eb4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de2f29be5c1ae0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6eaeffd700 1 -- 172.21.15.125:0/949789107 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb401c070 con 0x562b1dac0860 2023-11-28T11:11:48.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6eaeffd700 1 -- 172.21.15.125:0/949789107 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb4003d40 con 0x562b1dac0860 2023-11-28T11:11:48.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.615+0000 7f6eaeffd700 1 -- 172.21.15.125:0/949789107 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4021610 con 0x562b1dac0860 2023-11-28T11:11:48.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.616+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/949789107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 msgr2=0x562b1da96a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.616+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/949789107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1da96a70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4005390 tx=0x7f6eb4010000 comp rx=0 tx=0).stop 2023-11-28T11:11:48.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.616+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/949789107 shutdown_connections 2023-11-28T11:11:48.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.616+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/949789107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac1170 0x562b1dadc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.616+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/949789107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1da96a70 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.616+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/949789107 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dac0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.616+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/949789107 >> 172.21.15.125:0/949789107 conn(0x562b1da93db0 msgr2=0x562b1da94740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.616+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/949789107 shutdown_connections 2023-11-28T11:11:48.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.616+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/949789107 wait complete. 2023-11-28T11:11:48.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.616+0000 7f6ed76a5b80 1 -- start start 2023-11-28T11:11:48.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.616+0000 7f6ed76a5b80 1 Processor -- start 2023-11-28T11:11:48.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.617+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dad3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.617+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac0860 0x562b1dad3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.617+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1dab2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.617+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1d86c920 con 0x562b1dac1170 2023-11-28T11:11:48.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.617+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1dab17b0 con 0x562b1dac0860 2023-11-28T11:11:48.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.617+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b1dabeb00 con 0x562b1dabe180 2023-11-28T11:11:48.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.617+0000 7f6ed76a5b80 10 client.0 _ll_register_callbacks cb 0x562b1d88e290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.617+0000 7f6ec9ab9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1dab2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.617+0000 7f6ec9ab9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1dab2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33346/0 (socket says 172.21.15.125:33346) 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.617+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/1505079485 learned_addr learned my addr 172.21.15.125:0/1505079485 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dad3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ec8ab7700 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac0860 0x562b1dad3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 msgr2=0x562b1dad3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dad3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac0860 msgr2=0x562b1dad3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac0860 0x562b1dad3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/1505079485 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec4160a50 con 0x562b1dac1170 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1dab2fe0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009f80 tx=0x7f6ebc054ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bcff5dbd510154 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ea3fff700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:11:48.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ea3fff700 1 -- 172.21.15.125:0/1505079485 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc05c0d0 con 0x562b1dac1170 2023-11-28T11:11:48.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ea3fff700 1 -- 172.21.15.125:0/1505079485 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ebc054110 con 0x562b1dac1170 2023-11-28T11:11:48.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/1505079485 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b1d9b6190 con 0x562b1dac1170 2023-11-28T11:11:48.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ea3fff700 1 -- 172.21.15.125:0/1505079485 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ebc086250 con 0x562b1dac1170 2023-11-28T11:11:48.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ed76a5b80 10 client.6486 fetch_fsmap learned FSMap version 31 2023-11-28T11:11:48.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/1505079485 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x562b1d816de0 con 0x562b1dac1170 2023-11-28T11:11:48.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ea3fff700 1 -- 172.21.15.125:0/1505079485 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b1d9b6190 con 0x562b1dac1170 2023-11-28T11:11:48.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ea3fff700 1 -- 172.21.15.125:0/1505079485 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f6ebc0542d0 con 0x562b1dac1170 2023-11-28T11:11:48.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ed76a5b80 10 client.6486 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:11:48.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ed76a5b80 10 client.6486 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-11-28T11:11:48.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ed76a5b80 20 client.6486 populate_metadata read hostname 'smithi125' 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x562b1dac4760 0x562b1dab0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ed76a5b80 4 client.6486 mds_command: new command op to 6276 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.618+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/1505079485 --> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b1d86cf60 con 0x562b1dac4760 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.619+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x562b1dac4760 0x562b1dab0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.619+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x562b1dac4760 0x562b1dab0f80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79af0c58bfece1ca server_cookie=f2a27ac047cbc82a in_seq=0 out_seq=0 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.619+0000 7f6ea3fff700 10 client.6486 ms_handle_connect on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.619+0000 7f6ea3fff700 1 -- 172.21.15.125:0/1505079485 <== mds.0 v2:172.21.15.167:6833/1701437437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x562b1d86cf60 con 0x562b1dac4760 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.619+0000 7f6ea3fff700 10 client.6486 handle_command_reply: tid=0 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.619+0000 7f6ed76a5b80 1 client.6486 shutdown 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/1505079485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 msgr2=0x562b1dab2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1dab2fe0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009f80 tx=0x7f6ebc054ab0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/1505079485 shutdown_connections 2023-11-28T11:11:48.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x562b1dac4760 0x562b1dab0f80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1dab2fe0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ea3fff700 0 client.6486 ms_handle_reset on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:48.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dad3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/1505079485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac0860 0x562b1dad3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/1505079485 >> 172.21.15.125:0/1505079485 conn(0x562b1da93db0 msgr2=0x562b1da969e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/1505079485 shutdown_connections 2023-11-28T11:11:48.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/1505079485 wait complete. 2023-11-28T11:11:48.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.620+0000 7f6ed76a5b80 20 client.6486 trim_cache size 0 max 16384 2023-11-28T11:11:48.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.636+0000 7f6ed76a5b80 1 Processor -- start 2023-11-28T11:11:48.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.636+0000 7f6ed76a5b80 1 -- start start 2023-11-28T11:11:48.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dab6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac0860 0x562b1daae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1daae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1dab2550 con 0x562b1dac1170 2023-11-28T11:11:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1dac03f0 con 0x562b1dac0860 2023-11-28T11:11:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b1dafd990 con 0x562b1dabe180 2023-11-28T11:11:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ec9ab9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1daae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ec9ab9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1daae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33354/0 (socket says 172.21.15.125:33354) 2023-11-28T11:11:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/3466221507 learned_addr learned my addr 172.21.15.125:0/3466221507 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/3466221507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dab6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/3466221507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 msgr2=0x562b1dab6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/3466221507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dab6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/3466221507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac0860 msgr2=0x562b1daae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ec8ab7700 1 --2- 172.21.15.125:0/3466221507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac0860 0x562b1daae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/3466221507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac0860 0x562b1daae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ec9ab9700 1 -- 172.21.15.125:0/3466221507 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b1d9af190 con 0x562b1dac1170 2023-11-28T11:11:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.637+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/3466221507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1daae830 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc06be10 tx=0x7f6ebc028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c94057281a6c54 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6eaf7fe700 1 -- 172.21.15.125:0/3466221507 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc086250 con 0x562b1dac1170 2023-11-28T11:11:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6eaf7fe700 1 -- 172.21.15.125:0/3466221507 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc06be90 con 0x562b1dac1170 2023-11-28T11:11:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6eaf7fe700 1 -- 172.21.15.125:0/3466221507 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc054310 con 0x562b1dac1170 2023-11-28T11:11:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/3466221507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 msgr2=0x562b1daae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/3466221507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1daae830 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc06be10 tx=0x7f6ebc028000 comp rx=0 tx=0).stop 2023-11-28T11:11:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/3466221507 shutdown_connections 2023-11-28T11:11:48.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/3466221507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac1170 0x562b1daae830 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/3466221507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dab6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/3466221507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac0860 0x562b1daae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/3466221507 >> 172.21.15.125:0/3466221507 conn(0x562b1da93db0 msgr2=0x562b1da97a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/3466221507 shutdown_connections 2023-11-28T11:11:48.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.638+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/3466221507 wait complete. 2023-11-28T11:11:48.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.639+0000 7f6ed76a5b80 1 -- start start 2023-11-28T11:11:48.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.639+0000 7f6ed76a5b80 1 Processor -- start 2023-11-28T11:11:48.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dac4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1db3fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ed76a5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac1170 0x562b1dab6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1dab78e0 con 0x562b1dac0860 2023-11-28T11:11:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1db40390 con 0x562b1dac1170 2023-11-28T11:11:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ed76a5b80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b1daaeb80 con 0x562b1dabe180 2023-11-28T11:11:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ed76a5b80 10 client.0 _ll_register_callbacks cb 0x562b1d88e290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:11:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ec8ab7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1db3fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ec8ab7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1db3fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33358/0 (socket says 172.21.15.125:33358) 2023-11-28T11:11:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ec8ab7700 1 -- 172.21.15.125:0/707107653 learned_addr learned my addr 172.21.15.125:0/707107653 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:11:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dac4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ec9ab9700 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac1170 0x562b1dab6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ec8ab7700 1 -- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 msgr2=0x562b1dac4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ec8ab7700 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dac4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ec8ab7700 1 -- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac1170 msgr2=0x562b1dab6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:11:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ec8ab7700 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac1170 0x562b1dab6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ec8ab7700 1 -- 172.21.15.125:0/707107653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b1d816de0 con 0x562b1dac0860 2023-11-28T11:11:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ec8ab7700 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1db3fe50 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0000f60 tx=0x7f6ec0007630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0476259dbf8ebf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:11:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ea3fff700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:11:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ea3fff700 1 -- 172.21.15.125:0/707107653 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0001900 con 0x562b1dac0860 2023-11-28T11:11:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ea3fff700 1 -- 172.21.15.125:0/707107653 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ec0001a60 con 0x562b1dac0860 2023-11-28T11:11:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/707107653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b1d9a61b0 con 0x562b1dac0860 2023-11-28T11:11:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ea3fff700 1 -- 172.21.15.125:0/707107653 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ec0001c20 con 0x562b1dac0860 2023-11-28T11:11:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.640+0000 7f6ed76a5b80 10 client.6492 fetch_fsmap learned FSMap version 31 2023-11-28T11:11:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/707107653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x562b1d83d250 con 0x562b1dac0860 2023-11-28T11:11:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ea3fff700 1 -- 172.21.15.125:0/707107653 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b1d9a61b0 con 0x562b1dac0860 2023-11-28T11:11:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ea3fff700 1 -- 172.21.15.125:0/707107653 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f6ec0020410 con 0x562b1dac0860 2023-11-28T11:11:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ed76a5b80 10 client.6492 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:11:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ed76a5b80 10 client.6492 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-11-28T11:11:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ed76a5b80 20 client.6492 populate_metadata read hostname 'smithi125' 2023-11-28T11:11:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x562b1dac3b10 0x562b1dab7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:11:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ed76a5b80 4 client.6492 mds_command: new command op to 6276 tid=0[{"prefix": "scrub status"}] 2023-11-28T11:11:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/707107653 --> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562b1d9901c0 con 0x562b1dac3b10 2023-11-28T11:11:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x562b1dac3b10 0x562b1dab7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:11:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ea3fff700 10 client.6492 ms_handle_connect on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ec92b8700 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x562b1dac3b10 0x562b1dab7020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4811615eb9dad156 server_cookie=911721d84703f274 in_seq=0 out_seq=0 2023-11-28T11:11:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ea3fff700 1 -- 172.21.15.125:0/707107653 <== mds.0 v2:172.21.15.167:6833/1701437437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x562b1d9901c0 con 0x562b1dac3b10 2023-11-28T11:11:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ea3fff700 10 client.6492 handle_command_reply: tid=0 2023-11-28T11:11:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.641+0000 7f6ed76a5b80 1 client.6492 shutdown 2023-11-28T11:11:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/707107653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 msgr2=0x562b1db3fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1db3fe50 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0000f60 tx=0x7f6ec0007630 comp rx=0 tx=0).stop 2023-11-28T11:11:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/707107653 shutdown_connections 2023-11-28T11:11:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1dac1170 0x562b1dab6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562b1dabe180 0x562b1dac4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x562b1dac3b10 0x562b1dab7020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ed76a5b80 1 --2- 172.21.15.125:0/707107653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b1dac0860 0x562b1db3fe50 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ea3fff700 0 client.6492 ms_handle_reset on v2:172.21.15.167:6833/1701437437 2023-11-28T11:11:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/707107653 >> 172.21.15.125:0/707107653 conn(0x562b1da93db0 msgr2=0x562b1da97a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/707107653 shutdown_connections 2023-11-28T11:11:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ed76a5b80 1 -- 172.21.15.125:0/707107653 wait complete. 2023-11-28T11:11:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ed76a5b80 20 client.6492 trim_cache size 0 max 16384 2023-11-28T11:11:48.651 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:11:48.651 INFO:teuthology.orchestra.run.smithi125.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-28T11:11:48.651 INFO:teuthology.orchestra.run.smithi125.stdout: "scrubs": { 2023-11-28T11:11:48.651 INFO:teuthology.orchestra.run.smithi125.stdout: "3bfe9b3c-74c6-42eb-91e7-d5f675af60fb": { 2023-11-28T11:11:48.651 INFO:teuthology.orchestra.run.smithi125.stdout: "path": "/", 2023-11-28T11:11:48.651 INFO:teuthology.orchestra.run.smithi125.stdout: "tag": "3bfe9b3c-74c6-42eb-91e7-d5f675af60fb", 2023-11-28T11:11:48.651 INFO:teuthology.orchestra.run.smithi125.stdout: "options": "recursive" 2023-11-28T11:11:48.651 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:48.652 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:11:48.652 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:11:48.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 -- 172.21.15.125:0/1726322531 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ea80682f0 msgr2=0x7f6ea806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ea80682f0 0x7f6ea806a7a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4000f60 tx=0x7f6eb4009040 comp rx=0 tx=0).stop 2023-11-28T11:11:48.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 -- 172.21.15.125:0/1726322531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec415c810 msgr2=0x7f6ec4157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:11:48.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec415c810 0x7f6ec4157360 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc014040 tx=0x7f6ebc004ad0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 -- 172.21.15.125:0/1726322531 shutdown_connections 2023-11-28T11:11:48.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec415c810 0x7f6ec4157360 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ec406a270 0x7f6ec41561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6ea80682f0 0x7f6ea806a7a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 --2- 172.21.15.125:0/1726322531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ec40718e0 0x7f6ec415d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:11:48.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 -- 172.21.15.125:0/1726322531 >> 172.21.15.125:0/1726322531 conn(0x7f6ec406c010 msgr2=0x7f6ec40adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:11:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 -- 172.21.15.125:0/1726322531 shutdown_connections 2023-11-28T11:11:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:11:48.642+0000 7f6ecb51c700 1 -- 172.21.15.125:0/1726322531 wait complete. 2023-11-28T11:11:48.654 INFO:tasks.cephfs.filesystem:scrub status for tag:3bfe9b3c-74c6-42eb-91e7-d5f675af60fb - {'path': '/', 'tag': '3bfe9b3c-74c6-42eb-91e7-d5f675af60fb', 'options': 'recursive'} 2023-11-28T11:11:51.944 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-11-28T11:11:51.943+0000 7f87cb91a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-11-28T11:12:03.211 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:12:03.214 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:12:18.656 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-28T11:12:18.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.789+0000 7f70ebe34700 1 Processor -- start 2023-11-28T11:12:18.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.789+0000 7f70ebe34700 1 -- start start 2023-11-28T11:12:18.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.790+0000 7f70ebe34700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e41599b0 0x7f70e415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.790+0000 7f70ebe34700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f70e40af0a0 0x7f70e415a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.790+0000 7f70ebe34700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e4159ec0 con 0x7f70e40b1650 2023-11-28T11:12:18.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.790+0000 7f70ebe34700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e415d8a0 con 0x7f70e40af0a0 2023-11-28T11:12:18.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.790+0000 7f70ebe34700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e415db80 con 0x7f70e41599b0 2023-11-28T11:12:18.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.790+0000 7f70ea3d1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f70e40af0a0 0x7f70e415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.790+0000 7f70ea3d1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f70e40af0a0 0x7f70e415a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33368/0 (socket says 172.21.15.125:33368) 2023-11-28T11:12:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.790+0000 7f70ea3d1700 1 -- 172.21.15.125:0/1292658141 learned_addr learned my addr 172.21.15.125:0/1292658141 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.791+0000 7f70e93cf700 1 --2- 172.21.15.125:0/1292658141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e41599b0 0x7f70e415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.791+0000 7f70ea3d1700 1 -- 172.21.15.125:0/1292658141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e41599b0 msgr2=0x7f70e415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.791+0000 7f70ea3d1700 1 --2- 172.21.15.125:0/1292658141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e41599b0 0x7f70e415d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.791+0000 7f70ea3d1700 1 -- 172.21.15.125:0/1292658141 >> v1:172.21.15.167:6789/0 conn(0x7f70e40b1650 legacy=0x7f70e40b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.791+0000 7f70ea3d1700 1 -- 172.21.15.125:0/1292658141 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e415de60 con 0x7f70e40af0a0 2023-11-28T11:12:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.791+0000 7f70ea3d1700 1 --2- 172.21.15.125:0/1292658141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70e40af0a0 0x7f70e415a350 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009e50 tx=0x7f70dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7b761e3f25425a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.791+0000 7f70e8bce700 1 -- 172.21.15.125:0/1292658141 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00e070 con 0x7f70e40af0a0 2023-11-28T11:12:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.791+0000 7f70e8bce700 1 -- 172.21.15.125:0/1292658141 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc00b9c0 con 0x7f70e40af0a0 2023-11-28T11:12:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.791+0000 7f70e8bce700 1 -- 172.21.15.125:0/1292658141 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00bd70 con 0x7f70e40af0a0 2023-11-28T11:12:18.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.791+0000 7f70ebe34700 1 -- 172.21.15.125:0/1292658141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70e40af0a0 msgr2=0x7f70e415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.791+0000 7f70ebe34700 1 --2- 172.21.15.125:0/1292658141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70e40af0a0 0x7f70e415a350 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009e50 tx=0x7f70dc00b330 comp rx=0 tx=0).stop 2023-11-28T11:12:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.792+0000 7f70ebe34700 1 -- 172.21.15.125:0/1292658141 shutdown_connections 2023-11-28T11:12:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.792+0000 7f70ebe34700 1 --2- 172.21.15.125:0/1292658141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70e40af0a0 0x7f70e415a350 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.792+0000 7f70ebe34700 1 --2- 172.21.15.125:0/1292658141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e41599b0 0x7f70e415d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.792+0000 7f70ebe34700 1 -- 172.21.15.125:0/1292658141 >> 172.21.15.125:0/1292658141 conn(0x7f70e406c010 msgr2=0x7f70e40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.792+0000 7f70ebe34700 1 -- 172.21.15.125:0/1292658141 shutdown_connections 2023-11-28T11:12:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.792+0000 7f70ebe34700 1 -- 172.21.15.125:0/1292658141 wait complete. 2023-11-28T11:12:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.793+0000 7f70ebe34700 1 Processor -- start 2023-11-28T11:12:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.793+0000 7f70ebe34700 1 -- start start 2023-11-28T11:12:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.793+0000 7f70ebe34700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e40af0a0 0x7f70e40c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.793+0000 7f70ebe34700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70e40b1650 0x7f70e40b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.793+0000 7f70ebe34700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e40b3ea0 0x7f70e40c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.793+0000 7f70ebe34700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40c4f60 con 0x7f70e40b1650 2023-11-28T11:12:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.793+0000 7f70ebe34700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40b2ba0 con 0x7f70e40b3ea0 2023-11-28T11:12:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.793+0000 7f70ebe34700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40b2e80 con 0x7f70e40af0a0 2023-11-28T11:12:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70e93cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70e40b1650 0x7f70e40b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70e93cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70e40b1650 0x7f70e40b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33372/0 (socket says 172.21.15.125:33372) 2023-11-28T11:12:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70e93cf700 1 -- 172.21.15.125:0/730812485 learned_addr learned my addr 172.21.15.125:0/730812485 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e40af0a0 0x7f70e40c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70ea3d1700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e40b3ea0 0x7f70e40c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70e93cf700 1 -- 172.21.15.125:0/730812485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e40af0a0 msgr2=0x7f70e40c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70e93cf700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e40af0a0 0x7f70e40c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70e93cf700 1 -- 172.21.15.125:0/730812485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e40b3ea0 msgr2=0x7f70e40c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70e93cf700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e40b3ea0 0x7f70e40c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70e93cf700 1 -- 172.21.15.125:0/730812485 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc009b30 con 0x7f70e40b1650 2023-11-28T11:12:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70e93cf700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70e40b1650 0x7f70e40b3960 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f70d400e7e0 tx=0x7f70d400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70da7fc700 1 -- 172.21.15.125:0/730812485 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d400c070 con 0x7f70e40b1650 2023-11-28T11:12:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70da7fc700 1 -- 172.21.15.125:0/730812485 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4013610 con 0x7f70e40b1650 2023-11-28T11:12:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70ebe34700 1 -- 172.21.15.125:0/730812485 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e415a890 con 0x7f70e40b1650 2023-11-28T11:12:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70da7fc700 1 -- 172.21.15.125:0/730812485 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4013980 con 0x7f70e40b1650 2023-11-28T11:12:18.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.794+0000 7f70ebe34700 1 -- 172.21.15.125:0/730812485 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e415d590 con 0x7f70e40b1650 2023-11-28T11:12:18.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.796+0000 7f70da7fc700 1 -- 172.21.15.125:0/730812485 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f70d4023070 con 0x7f70e40b1650 2023-11-28T11:12:18.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.796+0000 7f70da7fc700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f70c80682f0 0x7f70c806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.796+0000 7f70da7fc700 1 -- 172.21.15.125:0/730812485 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70d40859b0 con 0x7f70e40b1650 2023-11-28T11:12:18.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.796+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f70c80682f0 0x7f70c806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.796+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f70c80682f0 0x7f70c806a7a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f70e40b4710 tx=0x7f70e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:18.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.798+0000 7f70f7fbdb80 1 Processor -- start 2023-11-28T11:12:18.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.798+0000 7f70f7fbdb80 1 -- start start 2023-11-28T11:12:18.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac7aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3aca4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca5170 0x55ac3acc07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac3ab64c10 con 0x55ac3aca4860 2023-11-28T11:12:18.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac3abd33a0 con 0x55ac3aca2180 2023-11-28T11:12:18.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac3abcc8d0 con 0x55ac3aca5170 2023-11-28T11:12:18.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70e9bd0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac7aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70e9bd0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac7aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33380/0 (socket says 172.21.15.125:33380) 2023-11-28T11:12:18.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70e9bd0700 1 -- 172.21.15.125:0/3742912418 learned_addr learned my addr 172.21.15.125:0/3742912418 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:18.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70e93cf700 1 --2- 172.21.15.125:0/3742912418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3aca4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70ea3d1700 1 --2- 172.21.15.125:0/3742912418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca5170 0x55ac3acc07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70e9bd0700 1 -- 172.21.15.125:0/3742912418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca5170 msgr2=0x55ac3acc07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:18.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/3742912418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca5170 0x55ac3acc07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70e9bd0700 1 -- 172.21.15.125:0/3742912418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 msgr2=0x55ac3aca4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:18.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/3742912418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3aca4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70e9bd0700 1 -- 172.21.15.125:0/3742912418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac3aa4e630 con 0x55ac3aca4860 2023-11-28T11:12:18.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.799+0000 7f70e93cf700 1 --2- 172.21.15.125:0/3742912418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3aca4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:18.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/3742912418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac7aa70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f70e000f6c0 tx=0x7f70e0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01e1cd3f177e530 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:18.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70c77fe700 1 -- 172.21.15.125:0/3742912418 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e000fe40 con 0x55ac3aca4860 2023-11-28T11:12:18.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70c77fe700 1 -- 172.21.15.125:0/3742912418 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e0014450 con 0x55ac3aca4860 2023-11-28T11:12:18.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70c77fe700 1 -- 172.21.15.125:0/3742912418 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e00147c0 con 0x55ac3aca4860 2023-11-28T11:12:18.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/3742912418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 msgr2=0x55ac3ac7aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/3742912418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac7aa70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f70e000f6c0 tx=0x7f70e0012000 comp rx=0 tx=0).stop 2023-11-28T11:12:18.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/3742912418 shutdown_connections 2023-11-28T11:12:18.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/3742912418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca5170 0x55ac3acc07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/3742912418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac7aa70 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/3742912418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3aca4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/3742912418 >> 172.21.15.125:0/3742912418 conn(0x55ac3ac77db0 msgr2=0x55ac3ac78740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:18.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/3742912418 shutdown_connections 2023-11-28T11:12:18.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.800+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/3742912418 wait complete. 2023-11-28T11:12:18.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.801+0000 7f70f7fbdb80 1 -- start start 2023-11-28T11:12:18.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.801+0000 7f70f7fbdb80 1 Processor -- start 2023-11-28T11:12:18.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3aca8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac94880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca5170 0x55ac3aca36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac3aa50920 con 0x55ac3aca4860 2023-11-28T11:12:18.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac3ac94dc0 con 0x55ac3aca2180 2023-11-28T11:12:18.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac3aca77b0 con 0x55ac3aca5170 2023-11-28T11:12:18.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70f7fbdb80 10 client.0 _ll_register_callbacks cb 0x55ac3aa72290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:12:18.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70e93cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac94880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70e93cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac94880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33386/0 (socket says 172.21.15.125:33386) 2023-11-28T11:12:18.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70e93cf700 1 -- 172.21.15.125:0/84761696 learned_addr learned my addr 172.21.15.125:0/84761696 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:18.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3aca8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70ea3d1700 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca5170 0x55ac3aca36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70e93cf700 1 -- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca5170 msgr2=0x55ac3aca36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:18.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70e93cf700 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca5170 0x55ac3aca36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70e93cf700 1 -- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 msgr2=0x55ac3aca8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:18.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70e93cf700 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3aca8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70e93cf700 1 -- 172.21.15.125:0/84761696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e4159ec0 con 0x55ac3aca4860 2023-11-28T11:12:18.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3aca8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:18.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70e93cf700 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac94880 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f70d40542c0 tx=0x7f70d405dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477f62e8da70e0a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:18.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.802+0000 7f70c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:12:18.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70c4ff9700 1 -- 172.21.15.125:0/84761696 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4023e90 con 0x55ac3aca4860 2023-11-28T11:12:18.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70c4ff9700 1 -- 172.21.15.125:0/84761696 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70d4013ae0 con 0x55ac3aca4860 2023-11-28T11:12:18.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/84761696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac3ab9a190 con 0x55ac3aca4860 2023-11-28T11:12:18.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70c4ff9700 1 -- 172.21.15.125:0/84761696 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70d4013ca0 con 0x55ac3aca4860 2023-11-28T11:12:18.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70f7fbdb80 10 client.6504 fetch_fsmap learned FSMap version 32 2023-11-28T11:12:18.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/84761696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55ac3a9fade0 con 0x55ac3aca4860 2023-11-28T11:12:18.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70c4ff9700 1 -- 172.21.15.125:0/84761696 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ac3ab9a190 con 0x55ac3aca4860 2023-11-28T11:12:18.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70c4ff9700 1 -- 172.21.15.125:0/84761696 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f70d4051c40 con 0x55ac3aca4860 2023-11-28T11:12:18.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70f7fbdb80 10 client.6504 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:12:18.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70f7fbdb80 10 client.6504 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-11-28T11:12:18.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70f7fbdb80 20 client.6504 populate_metadata read hostname 'smithi125' 2023-11-28T11:12:18.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55ac3ac94f30 0x55ac3ac97cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70f7fbdb80 4 client.6504 mds_command: new command op to 6276 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:12:18.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/84761696 --> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac3aa50f60 con 0x55ac3ac94f30 2023-11-28T11:12:18.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.803+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55ac3ac94f30 0x55ac3ac97cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.804+0000 7f70c4ff9700 10 client.6504 ms_handle_connect on v2:172.21.15.167:6833/1701437437 2023-11-28T11:12:18.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.804+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55ac3ac94f30 0x55ac3ac97cb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4d5ad9c1d9ed05e server_cookie=ef5c1a8b5238d67c in_seq=0 out_seq=0 2023-11-28T11:12:18.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.804+0000 7f70c4ff9700 1 -- 172.21.15.125:0/84761696 <== mds.0 v2:172.21.15.167:6833/1701437437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55ac3aa50f60 con 0x55ac3ac94f30 2023-11-28T11:12:18.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.804+0000 7f70c4ff9700 10 client.6504 handle_command_reply: tid=0 2023-11-28T11:12:18.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.804+0000 7f70f7fbdb80 1 client.6504 shutdown 2023-11-28T11:12:18.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.804+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/84761696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 msgr2=0x55ac3ac94880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.804+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac94880 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f70d40542c0 tx=0x7f70d405dd30 comp rx=0 tx=0).stop 2023-11-28T11:12:18.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.804+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/84761696 shutdown_connections 2023-11-28T11:12:18.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.804+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca5170 0x55ac3aca36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.804+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3aca8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.805+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55ac3ac94f30 0x55ac3ac97cb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.805+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/84761696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ac94880 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.805+0000 7f70c4ff9700 0 client.6504 ms_handle_reset on v2:172.21.15.167:6833/1701437437 2023-11-28T11:12:18.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.805+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/84761696 >> 172.21.15.125:0/84761696 conn(0x55ac3ac77db0 msgr2=0x55ac3ac73f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:18.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.805+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/84761696 shutdown_connections 2023-11-28T11:12:18.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.805+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/84761696 wait complete. 2023-11-28T11:12:18.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.805+0000 7f70f7fbdb80 20 client.6504 trim_cache size 0 max 16384 2023-11-28T11:12:18.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.821+0000 7f70f7fbdb80 1 Processor -- start 2023-11-28T11:12:18.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.821+0000 7f70f7fbdb80 1 -- start start 2023-11-28T11:12:18.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3ac92780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca4860 0x55ac3aca6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca5170 0x55ac3aca6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac3aca6ed0 con 0x55ac3aca5170 2023-11-28T11:12:18.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac3aca7300 con 0x55ac3aca2180 2023-11-28T11:12:18.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac3acb9030 con 0x55ac3aca4860 2023-11-28T11:12:18.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70ea3d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca5170 0x55ac3aca6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70ea3d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca5170 0x55ac3aca6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33396/0 (socket says 172.21.15.125:33396) 2023-11-28T11:12:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70ea3d1700 1 -- 172.21.15.125:0/224770286 learned_addr learned my addr 172.21.15.125:0/224770286 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70e93cf700 1 --2- 172.21.15.125:0/224770286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca4860 0x55ac3aca6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/224770286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3ac92780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70ea3d1700 1 -- 172.21.15.125:0/224770286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca4860 msgr2=0x55ac3aca6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70ea3d1700 1 --2- 172.21.15.125:0/224770286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca4860 0x55ac3aca6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70ea3d1700 1 -- 172.21.15.125:0/224770286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 msgr2=0x55ac3ac92780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:18.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70ea3d1700 1 --2- 172.21.15.125:0/224770286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3ac92780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70ea3d1700 1 -- 172.21.15.125:0/224770286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac3ab93190 con 0x55ac3aca5170 2023-11-28T11:12:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/224770286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3ac92780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70ea3d1700 1 --2- 172.21.15.125:0/224770286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca5170 0x55ac3aca6990 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00b730 tx=0x7f70dc009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4f0e3dc3254d9e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70c7fff700 1 -- 172.21.15.125:0/224770286 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc003c20 con 0x55ac3aca5170 2023-11-28T11:12:18.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.822+0000 7f70c7fff700 1 -- 172.21.15.125:0/224770286 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc003d80 con 0x55ac3aca5170 2023-11-28T11:12:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.823+0000 7f70c7fff700 1 -- 172.21.15.125:0/224770286 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc004240 con 0x55ac3aca5170 2023-11-28T11:12:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.823+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/224770286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca5170 msgr2=0x55ac3aca6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.823+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/224770286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca5170 0x55ac3aca6990 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00b730 tx=0x7f70dc009000 comp rx=0 tx=0).stop 2023-11-28T11:12:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.823+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/224770286 shutdown_connections 2023-11-28T11:12:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.823+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/224770286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca5170 0x55ac3aca6990 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.823+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/224770286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca2180 0x55ac3ac92780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.823+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/224770286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca4860 0x55ac3aca6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.823+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/224770286 >> 172.21.15.125:0/224770286 conn(0x55ac3ac77db0 msgr2=0x55ac3ac96140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.823+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/224770286 shutdown_connections 2023-11-28T11:12:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.823+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/224770286 wait complete. 2023-11-28T11:12:18.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.824+0000 7f70f7fbdb80 1 -- start start 2023-11-28T11:12:18.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.824+0000 7f70f7fbdb80 1 Processor -- start 2023-11-28T11:12:18.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca2180 0x55ac3ac73eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ad27680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70f7fbdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca5170 0x55ac3ac79c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac3ad27bc0 con 0x55ac3aca4860 2023-11-28T11:12:18.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac3acc2d90 con 0x55ac3aca5170 2023-11-28T11:12:18.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70f7fbdb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac3acc2320 con 0x55ac3aca2180 2023-11-28T11:12:18.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70f7fbdb80 10 client.0 _ll_register_callbacks cb 0x55ac3aa72290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:12:18.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70e93cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ad27680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70e93cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ad27680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33400/0 (socket says 172.21.15.125:33400) 2023-11-28T11:12:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70e93cf700 1 -- 172.21.15.125:0/855963561 learned_addr learned my addr 172.21.15.125:0/855963561 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca2180 0x55ac3ac73eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70e93cf700 1 -- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca2180 msgr2=0x55ac3ac73eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70e93cf700 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca2180 0x55ac3ac73eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70e93cf700 1 -- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca5170 msgr2=0x55ac3ac79c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70ea3d1700 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca5170 0x55ac3ac79c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70e93cf700 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca5170 0x55ac3ac79c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70e93cf700 1 -- 172.21.15.125:0/855963561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e415de60 con 0x55ac3aca4860 2023-11-28T11:12:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70e93cf700 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ad27680 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f70d405df20 tx=0x7f70d401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94705a3666a65b0f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:12:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70c4ff9700 1 -- 172.21.15.125:0/855963561 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d405f070 con 0x55ac3aca4860 2023-11-28T11:12:18.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70c4ff9700 1 -- 172.21.15.125:0/855963561 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70d4051c40 con 0x55ac3aca4860 2023-11-28T11:12:18.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/855963561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac3ab8a1b0 con 0x55ac3aca4860 2023-11-28T11:12:18.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70c4ff9700 1 -- 172.21.15.125:0/855963561 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70d4069100 con 0x55ac3aca4860 2023-11-28T11:12:18.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70f7fbdb80 10 client.6510 fetch_fsmap learned FSMap version 32 2023-11-28T11:12:18.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/855963561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55ac3aa21250 con 0x55ac3aca4860 2023-11-28T11:12:18.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.825+0000 7f70c4ff9700 1 -- 172.21.15.125:0/855963561 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ac3ab8a1b0 con 0x55ac3aca4860 2023-11-28T11:12:18.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70c4ff9700 1 -- 172.21.15.125:0/855963561 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f70d4013ae0 con 0x55ac3aca4860 2023-11-28T11:12:18.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70f7fbdb80 10 client.6510 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:12:18.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70f7fbdb80 10 client.6510 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-11-28T11:12:18.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70f7fbdb80 20 client.6510 populate_metadata read hostname 'smithi125' 2023-11-28T11:12:18.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55ac3acc25f0 0x55ac3ac7a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70f7fbdb80 4 client.6510 mds_command: new command op to 6276 tid=0[{"prefix": "scrub status"}] 2023-11-28T11:12:18.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/855963561 --> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ac3ab741c0 con 0x55ac3acc25f0 2023-11-28T11:12:18.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55ac3acc25f0 0x55ac3ac7a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70c4ff9700 10 client.6510 ms_handle_connect on v2:172.21.15.167:6833/1701437437 2023-11-28T11:12:18.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70e9bd0700 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55ac3acc25f0 0x55ac3ac7a140 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13ac63c6e6e4441 server_cookie=596f7dbbe792eeae in_seq=0 out_seq=0 2023-11-28T11:12:18.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70c4ff9700 1 -- 172.21.15.125:0/855963561 <== mds.0 v2:172.21.15.167:6833/1701437437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ac3ab741c0 con 0x55ac3acc25f0 2023-11-28T11:12:18.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70c4ff9700 10 client.6510 handle_command_reply: tid=0 2023-11-28T11:12:18.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70f7fbdb80 1 client.6510 shutdown 2023-11-28T11:12:18.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.826+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/855963561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 msgr2=0x55ac3ad27680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ad27680 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f70d405df20 tx=0x7f70d401d000 comp rx=0 tx=0).stop 2023-11-28T11:12:18.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/855963561 shutdown_connections 2023-11-28T11:12:18.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac3aca5170 0x55ac3ac79c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac3aca2180 0x55ac3ac73eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x55ac3acc25f0 0x55ac3ac7a140 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70f7fbdb80 1 --2- 172.21.15.125:0/855963561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ac3aca4860 0x55ac3ad27680 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70c4ff9700 0 client.6510 ms_handle_reset on v2:172.21.15.167:6833/1701437437 2023-11-28T11:12:18.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/855963561 >> 172.21.15.125:0/855963561 conn(0x55ac3ac77db0 msgr2=0x55ac3aca63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:18.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/855963561 shutdown_connections 2023-11-28T11:12:18.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70f7fbdb80 1 -- 172.21.15.125:0/855963561 wait complete. 2023-11-28T11:12:18.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70f7fbdb80 20 client.6510 trim_cache size 0 max 16384 2023-11-28T11:12:18.849 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:12:18.849 INFO:teuthology.orchestra.run.smithi125.stdout: "status": "no active scrubs running", 2023-11-28T11:12:18.849 INFO:teuthology.orchestra.run.smithi125.stdout: "scrubs": {} 2023-11-28T11:12:18.849 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:12:18.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 -- 172.21.15.125:0/730812485 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f70c80682f0 msgr2=0x7f70c806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f70c80682f0 0x7f70c806a7a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f70e40b4710 tx=0x7f70e0009040 comp rx=0 tx=0).stop 2023-11-28T11:12:18.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 -- 172.21.15.125:0/730812485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70e40b1650 msgr2=0x7f70e40b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70e40b1650 0x7f70e40b3960 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f70d400e7e0 tx=0x7f70d400eaf0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 -- 172.21.15.125:0/730812485 shutdown_connections 2023-11-28T11:12:18.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e40b3ea0 0x7f70e40c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f70c80682f0 0x7f70c806a7a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e40af0a0 0x7f70e40c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 --2- 172.21.15.125:0/730812485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70e40b1650 0x7f70e40b3960 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 -- 172.21.15.125:0/730812485 >> 172.21.15.125:0/730812485 conn(0x7f70e406c010 msgr2=0x7f70e4070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:18.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 -- 172.21.15.125:0/730812485 shutdown_connections 2023-11-28T11:12:18.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.827+0000 7f70ebe34700 1 -- 172.21.15.125:0/730812485 wait complete. 2023-11-28T11:12:18.852 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-28T11:12:18.852 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:12:18.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.970+0000 7f0143d2d700 1 Processor -- start 2023-11-28T11:12:18.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.971+0000 7f0143d2d700 1 -- start start 2023-11-28T11:12:18.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f0143d2d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f013c06e400 0x7f013c06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f0143d2d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f013c15e010 0x7f013c0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f0143d2d700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c15af30 con 0x7f013c0d15f0 2023-11-28T11:12:18.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f0143d2d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013c15a9d0 con 0x7f013c15e010 2023-11-28T11:12:18.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f0143d2d700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013c1584e0 con 0x7f013c06e400 2023-11-28T11:12:18.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f01422ca700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f013c15e010 0x7f013c0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f01422ca700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f013c15e010 0x7f013c0ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33410/0 (socket says 172.21.15.125:33410) 2023-11-28T11:12:18.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f01422ca700 1 -- 172.21.15.125:0/471922257 learned_addr learned my addr 172.21.15.125:0/471922257 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:18.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f0141ac9700 1 --2- 172.21.15.125:0/471922257 >> v2:172.21.15.167:3300/0 conn(0x7f013c06e400 0x7f013c06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f01422ca700 1 -- 172.21.15.125:0/471922257 >> v2:172.21.15.167:3300/0 conn(0x7f013c06e400 msgr2=0x7f013c06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:18.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f01422ca700 1 --2- 172.21.15.125:0/471922257 >> v2:172.21.15.167:3300/0 conn(0x7f013c06e400 0x7f013c06e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f01422ca700 1 -- 172.21.15.125:0/471922257 >> v1:172.21.15.167:6789/0 conn(0x7f013c0d15f0 legacy=0x7f013c15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:18.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f01422ca700 1 -- 172.21.15.125:0/471922257 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c15ef40 con 0x7f013c15e010 2023-11-28T11:12:18.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f0141ac9700 1 --2- 172.21.15.125:0/471922257 >> v2:172.21.15.167:3300/0 conn(0x7f013c06e400 0x7f013c06e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:18.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f01422ca700 1 --2- 172.21.15.125:0/471922257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f013c15e010 0x7f013c0ce970 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f013c0cd900 tx=0x7f013400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac49fd39aa06edd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:18.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f0140ac7700 1 -- 172.21.15.125:0/471922257 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400e070 con 0x7f013c15e010 2023-11-28T11:12:18.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f0140ac7700 1 -- 172.21.15.125:0/471922257 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134003a20 con 0x7f013c15e010 2023-11-28T11:12:18.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.972+0000 7f0140ac7700 1 -- 172.21.15.125:0/471922257 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134003dd0 con 0x7f013c15e010 2023-11-28T11:12:18.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.973+0000 7f0143d2d700 1 -- 172.21.15.125:0/471922257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f013c15e010 msgr2=0x7f013c0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.973+0000 7f0143d2d700 1 --2- 172.21.15.125:0/471922257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f013c15e010 0x7f013c0ce970 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f013c0cd900 tx=0x7f013400b330 comp rx=0 tx=0).stop 2023-11-28T11:12:18.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.973+0000 7f0143d2d700 1 -- 172.21.15.125:0/471922257 shutdown_connections 2023-11-28T11:12:18.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.973+0000 7f0143d2d700 1 --2- 172.21.15.125:0/471922257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f013c15e010 0x7f013c0ce970 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.973+0000 7f0143d2d700 1 --2- 172.21.15.125:0/471922257 >> v2:172.21.15.167:3300/0 conn(0x7f013c06e400 0x7f013c06e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.973+0000 7f0143d2d700 1 -- 172.21.15.125:0/471922257 >> 172.21.15.125:0/471922257 conn(0x7f013c06a270 msgr2=0x7f013c06a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:18.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.973+0000 7f0143d2d700 1 -- 172.21.15.125:0/471922257 shutdown_connections 2023-11-28T11:12:18.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.973+0000 7f0143d2d700 1 -- 172.21.15.125:0/471922257 wait complete. 2023-11-28T11:12:18.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.974+0000 7f0143d2d700 1 Processor -- start 2023-11-28T11:12:18.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.974+0000 7f0143d2d700 1 -- start start 2023-11-28T11:12:18.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f0143d2d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013c06e400 0x7f013c14ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f0143d2d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f013c0d15f0 0x7f013c0b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f0143d2d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f013c15e010 0x7f013c0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f0143d2d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0cf720 con 0x7f013c0d15f0 2023-11-28T11:12:18.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f0143d2d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0ceb10 con 0x7f013c06e400 2023-11-28T11:12:18.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f0143d2d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0cedf0 con 0x7f013c15e010 2023-11-28T11:12:18.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f01412c8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f013c0d15f0 0x7f013c0b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f01412c8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f013c0d15f0 0x7f013c0b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33414/0 (socket says 172.21.15.125:33414) 2023-11-28T11:12:18.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f01412c8700 1 -- 172.21.15.125:0/490964345 learned_addr learned my addr 172.21.15.125:0/490964345 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:18.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f0141ac9700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013c06e400 0x7f013c14ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f01422ca700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f013c15e010 0x7f013c0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f01412c8700 1 -- 172.21.15.125:0/490964345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f013c15e010 msgr2=0x7f013c0b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f01412c8700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f013c15e010 0x7f013c0b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f01412c8700 1 -- 172.21.15.125:0/490964345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013c06e400 msgr2=0x7f013c14ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:18.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f01412c8700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013c06e400 0x7f013c14ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:18.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f01412c8700 1 -- 172.21.15.125:0/490964345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0134009b30 con 0x7f013c0d15f0 2023-11-28T11:12:18.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.975+0000 7f0141ac9700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013c06e400 0x7f013c14ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:18.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.976+0000 7f01412c8700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f013c0d15f0 0x7f013c0b44c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f012c00c4a0 tx=0x7f012c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:18.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.976+0000 7f01327fc700 1 -- 172.21.15.125:0/490964345 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c011790 con 0x7f013c0d15f0 2023-11-28T11:12:18.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.976+0000 7f01327fc700 1 -- 172.21.15.125:0/490964345 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c0118f0 con 0x7f013c0d15f0 2023-11-28T11:12:18.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.976+0000 7f0143d2d700 1 -- 172.21.15.125:0/490964345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013c15e980 con 0x7f013c0d15f0 2023-11-28T11:12:18.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.976+0000 7f01327fc700 1 -- 172.21.15.125:0/490964345 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c011ca0 con 0x7f013c0d15f0 2023-11-28T11:12:18.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.976+0000 7f0143d2d700 1 -- 172.21.15.125:0/490964345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013c06ed10 con 0x7f013c0d15f0 2023-11-28T11:12:18.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.977+0000 7f0143d2d700 1 -- 172.21.15.125:0/490964345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013c15ec60 con 0x7f013c0d15f0 2023-11-28T11:12:18.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.977+0000 7f01327fc700 1 -- 172.21.15.125:0/490964345 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f012c010050 con 0x7f013c0d15f0 2023-11-28T11:12:18.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.977+0000 7f01327fc700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f01200682f0 0x7f012006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:18.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.978+0000 7f01327fc700 1 -- 172.21.15.125:0/490964345 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f012c085a30 con 0x7f013c0d15f0 2023-11-28T11:12:18.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.978+0000 7f0141ac9700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f01200682f0 0x7f012006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:18.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.978+0000 7f0141ac9700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f01200682f0 0x7f012006a7a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0138006fd0 tx=0x7f0138008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:18.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:18.982+0000 7f01327fc700 1 -- 172.21.15.125:0/490964345 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f012c052200 con 0x7f013c0d15f0 2023-11-28T11:12:19.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.208+0000 7f0143d2d700 1 -- 172.21.15.125:0/490964345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f013c0743f0 con 0x7f013c0d15f0 2023-11-28T11:12:19.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.209+0000 7f01327fc700 1 -- 172.21.15.125:0/490964345 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4661 (secure 0 0 0) 0x7f012c055820 con 0x7f013c0d15f0 2023-11-28T11:12:19.210 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:19.211 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5710,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3518974696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3518974696},{"type":"v1","addr":"172.21.15.167:6834","nonce":3518974696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/2475008501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2475008501},{"type":"v1","addr":"172.21.15.125:6836","nonce":2475008501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2392518832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":2392518832},{"type":"v1","addr":"172.21.15.125:6837","nonce":2392518832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:11:39.473096+0000","modified":"2023-11-28T11:11:51.944585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":6,"addr":"172.21.15.167:6835/1701437437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1701437437},{"type":"v1","addr":"172.21.15.167:6835","nonce":1701437437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:12:19.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 -- 172.21.15.125:0/490964345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f01200682f0 msgr2=0x7f012006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f01200682f0 0x7f012006a7a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0138006fd0 tx=0x7f0138008040 comp rx=0 tx=0).stop 2023-11-28T11:12:19.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 -- 172.21.15.125:0/490964345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f013c0d15f0 msgr2=0x7f013c0b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f013c0d15f0 0x7f013c0b44c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f012c00c4a0 tx=0x7f012c00c860 comp rx=0 tx=0).stop 2023-11-28T11:12:19.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 -- 172.21.15.125:0/490964345 shutdown_connections 2023-11-28T11:12:19.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f01200682f0 0x7f012006a7a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f013c15e010 0x7f013c0b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013c06e400 0x7f013c14ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 --2- 172.21.15.125:0/490964345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f013c0d15f0 0x7f013c0b44c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 -- 172.21.15.125:0/490964345 >> 172.21.15.125:0/490964345 conn(0x7f013c06a270 msgr2=0x7f013c159960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:19.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 -- 172.21.15.125:0/490964345 shutdown_connections 2023-11-28T11:12:19.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.211+0000 7f0143d2d700 1 -- 172.21.15.125:0/490964345 wait complete. 2023-11-28T11:12:19.215 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 32 2023-11-28T11:12:19.225 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b damage ls --format=json-pretty 2023-11-28T11:12:19.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.345+0000 7fd358192700 1 Processor -- start 2023-11-28T11:12:19.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.345+0000 7fd358192700 1 -- start start 2023-11-28T11:12:19.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd358192700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3500b2ee0 0x7fd3500d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd358192700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3500cc200 0x7fd3500ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd358192700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35015a9c0 con 0x7fd35015a5f0 2023-11-28T11:12:19.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd358192700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3500c7b80 con 0x7fd3500cc200 2023-11-28T11:12:19.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd358192700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500cc990 con 0x7fd3500b2ee0 2023-11-28T11:12:19.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd35672f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3500cc200 0x7fd3500ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd355f2e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd35015a5f0 0x7fd3500b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45776/0 (socket says 172.21.15.125:45776) 2023-11-28T11:12:19.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd355f2e700 1 -- 172.21.15.125:0/2645441193 learned_addr learned my addr 172.21.15.125:0/2645441193 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:19.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd35672f700 1 -- 172.21.15.125:0/2645441193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3500b2ee0 msgr2=0x7fd3500d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:19.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd35672f700 1 --2- 172.21.15.125:0/2645441193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3500b2ee0 0x7fd3500d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd35672f700 1 -- 172.21.15.125:0/2645441193 >> v1:172.21.15.125:6789/0 conn(0x7fd35015a5f0 legacy=0x7fd3500b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd354f2c700 1 -- 172.21.15.125:0/2645441193 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968682305 0 0) 0x7fd35015a9c0 con 0x7fd35015a5f0 2023-11-28T11:12:19.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd35672f700 1 -- 172.21.15.125:0/2645441193 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3500ccc70 con 0x7fd3500cc200 2023-11-28T11:12:19.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd35672f700 1 --2- 172.21.15.125:0/2645441193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3500cc200 0x7fd3500ced30 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd348009d90 tx=0x7fd34800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5af2447c43d682 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:19.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd354f2c700 1 -- 172.21.15.125:0/2645441193 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34800e070 con 0x7fd3500cc200 2023-11-28T11:12:19.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd354f2c700 1 -- 172.21.15.125:0/2645441193 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34800bbd0 con 0x7fd3500cc200 2023-11-28T11:12:19.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.346+0000 7fd354f2c700 1 -- 172.21.15.125:0/2645441193 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348012430 con 0x7fd3500cc200 2023-11-28T11:12:19.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.347+0000 7fd358192700 1 -- 172.21.15.125:0/2645441193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3500cc200 msgr2=0x7fd3500ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.347+0000 7fd358192700 1 --2- 172.21.15.125:0/2645441193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3500cc200 0x7fd3500ced30 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd348009d90 tx=0x7fd34800b330 comp rx=0 tx=0).stop 2023-11-28T11:12:19.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.347+0000 7fd358192700 1 -- 172.21.15.125:0/2645441193 shutdown_connections 2023-11-28T11:12:19.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.347+0000 7fd358192700 1 --2- 172.21.15.125:0/2645441193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3500cc200 0x7fd3500ced30 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.347+0000 7fd358192700 1 --2- 172.21.15.125:0/2645441193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3500b2ee0 0x7fd3500d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.347+0000 7fd358192700 1 -- 172.21.15.125:0/2645441193 >> 172.21.15.125:0/2645441193 conn(0x7fd35006ea80 msgr2=0x7fd35006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:19.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.347+0000 7fd358192700 1 -- 172.21.15.125:0/2645441193 shutdown_connections 2023-11-28T11:12:19.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.347+0000 7fd358192700 1 -- 172.21.15.125:0/2645441193 wait complete. 2023-11-28T11:12:19.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.348+0000 7fd358192700 1 Processor -- start 2023-11-28T11:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.348+0000 7fd358192700 1 -- start start 2023-11-28T11:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd358192700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3500b2ee0 0x7fd3501f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd358192700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3500cc200 0x7fd3501ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd358192700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35015a5f0 0x7fd3500c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd358192700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500c8da0 con 0x7fd35015a5f0 2023-11-28T11:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd358192700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3501f3ac0 con 0x7fd3500cc200 2023-11-28T11:12:19.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd358192700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500c87e0 con 0x7fd3500b2ee0 2023-11-28T11:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd35672f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35015a5f0 0x7fd3500c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd35672f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35015a5f0 0x7fd3500c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33430/0 (socket says 172.21.15.125:33430) 2023-11-28T11:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd35672f700 1 -- 172.21.15.125:0/2012209537 learned_addr learned my addr 172.21.15.125:0/2012209537 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd355f2e700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3500b2ee0 0x7fd3501f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd35572d700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3500cc200 0x7fd3501ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd35672f700 1 -- 172.21.15.125:0/2012209537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3500b2ee0 msgr2=0x7fd3501f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd35672f700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3500b2ee0 0x7fd3501f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd35672f700 1 -- 172.21.15.125:0/2012209537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3500cc200 msgr2=0x7fd3501ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd35672f700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3500cc200 0x7fd3501ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.349+0000 7fd35672f700 1 -- 172.21.15.125:0/2012209537 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348009a70 con 0x7fd35015a5f0 2023-11-28T11:12:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.350+0000 7fd35672f700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35015a5f0 0x7fd3500c7e00 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd35006d5f0 tx=0x7fd348004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.350+0000 7fd3467fc700 1 -- 172.21.15.125:0/2012209537 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348012430 con 0x7fd35015a5f0 2023-11-28T11:12:19.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.350+0000 7fd3467fc700 1 -- 172.21.15.125:0/2012209537 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348020070 con 0x7fd35015a5f0 2023-11-28T11:12:19.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.350+0000 7fd358192700 1 -- 172.21.15.125:0/2012209537 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3500cd230 con 0x7fd35015a5f0 2023-11-28T11:12:19.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.350+0000 7fd3467fc700 1 -- 172.21.15.125:0/2012209537 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348004280 con 0x7fd35015a5f0 2023-11-28T11:12:19.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.350+0000 7fd358192700 1 -- 172.21.15.125:0/2012209537 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3500ccf50 con 0x7fd35015a5f0 2023-11-28T11:12:19.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.351+0000 7fd3467fc700 1 -- 172.21.15.125:0/2012209537 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd3480043e0 con 0x7fd35015a5f0 2023-11-28T11:12:19.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.352+0000 7fd3467fc700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3340682f0 0x7fd33406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.352+0000 7fd3467fc700 1 -- 172.21.15.125:0/2012209537 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd348022070 con 0x7fd35015a5f0 2023-11-28T11:12:19.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.352+0000 7fd355f2e700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3340682f0 0x7fd33406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.352+0000 7fd355f2e700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3340682f0 0x7fd33406a7a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd34c000f60 tx=0x7fd34c007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:19.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.354+0000 7fd36431bb80 1 Processor -- start 2023-11-28T11:12:19.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.354+0000 7fd36431bb80 1 -- start start 2023-11-28T11:12:19.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df492c8b0 0x560df492cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4901260 0x560df492d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df49261f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd36431bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df47ecc60 con 0x560df4925d80 2023-11-28T11:12:19.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd36431bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df485b3f0 con 0x560df4901260 2023-11-28T11:12:19.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd36431bb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560df4854920 con 0x560df492c8b0 2023-11-28T11:12:19.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd35672f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df49261f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd35672f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df49261f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33438/0 (socket says 172.21.15.125:33438) 2023-11-28T11:12:19.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd35672f700 1 -- 172.21.15.125:0/610768611 learned_addr learned my addr 172.21.15.125:0/610768611 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:19.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd35672f700 1 -- 172.21.15.125:0/610768611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df492c8b0 msgr2=0x560df492cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:19.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd35672f700 1 --2- 172.21.15.125:0/610768611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df492c8b0 0x560df492cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd35672f700 1 -- 172.21.15.125:0/610768611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4901260 msgr2=0x560df492d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:19.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd35672f700 1 --2- 172.21.15.125:0/610768611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4901260 0x560df492d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd35672f700 1 -- 172.21.15.125:0/610768611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560df46d6680 con 0x560df4925d80 2023-11-28T11:12:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd35672f700 1 --2- 172.21.15.125:0/610768611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df49261f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd348086930 tx=0x7fd348026460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78407064bc25efca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd3337fe700 1 -- 172.21.15.125:0/610768611 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348057e80 con 0x560df4925d80 2023-11-28T11:12:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd3337fe700 1 -- 172.21.15.125:0/610768611 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348056990 con 0x560df4925d80 2023-11-28T11:12:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.355+0000 7fd3337fe700 1 -- 172.21.15.125:0/610768611 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34805e2b0 con 0x560df4925d80 2023-11-28T11:12:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.356+0000 7fd36431bb80 1 -- 172.21.15.125:0/610768611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 msgr2=0x560df49261f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.356+0000 7fd36431bb80 1 --2- 172.21.15.125:0/610768611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df49261f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd348086930 tx=0x7fd348026460 comp rx=0 tx=0).stop 2023-11-28T11:12:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.356+0000 7fd36431bb80 1 -- 172.21.15.125:0/610768611 shutdown_connections 2023-11-28T11:12:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.356+0000 7fd36431bb80 1 --2- 172.21.15.125:0/610768611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df49261f0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.356+0000 7fd36431bb80 1 --2- 172.21.15.125:0/610768611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df492c8b0 0x560df492cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.356+0000 7fd36431bb80 1 --2- 172.21.15.125:0/610768611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4901260 0x560df492d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.356+0000 7fd36431bb80 1 -- 172.21.15.125:0/610768611 >> 172.21.15.125:0/610768611 conn(0x560df48ffe00 msgr2=0x560df4900790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:19.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.356+0000 7fd36431bb80 1 -- 172.21.15.125:0/610768611 shutdown_connections 2023-11-28T11:12:19.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.356+0000 7fd36431bb80 1 -- 172.21.15.125:0/610768611 wait complete. 2023-11-28T11:12:19.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.356+0000 7fd36431bb80 1 -- start start 2023-11-28T11:12:19.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.357+0000 7fd36431bb80 1 Processor -- start 2023-11-28T11:12:19.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.357+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4901260 0x560df4953bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.357+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4925d80 0x560df494abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.357+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df492c8b0 0x560df494b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.357+0000 7fd36431bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df46d8970 con 0x560df4901260 2023-11-28T11:12:19.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.357+0000 7fd36431bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df492e5d0 con 0x560df4925d80 2023-11-28T11:12:19.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.357+0000 7fd36431bb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560df49295c0 con 0x560df492c8b0 2023-11-28T11:12:19.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd36431bb80 10 client.0 _ll_register_callbacks cb 0x560df46fa2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:12:19.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd355f2e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4901260 0x560df4953bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd355f2e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4901260 0x560df4953bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33440/0 (socket says 172.21.15.125:33440) 2023-11-28T11:12:19.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd355f2e700 1 -- 172.21.15.125:0/3318323300 learned_addr learned my addr 172.21.15.125:0/3318323300 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd35572d700 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4925d80 0x560df494abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd35672f700 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df492c8b0 0x560df494b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd355f2e700 1 -- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df492c8b0 msgr2=0x560df494b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd355f2e700 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df492c8b0 0x560df494b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd355f2e700 1 -- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4925d80 msgr2=0x560df494abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:19.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd355f2e700 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4925d80 0x560df494abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd355f2e700 1 -- 172.21.15.125:0/3318323300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3500ccf50 con 0x560df4901260 2023-11-28T11:12:19.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd35572d700 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4925d80 0x560df494abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:19.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd35672f700 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df492c8b0 0x560df494b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:19.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd355f2e700 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4901260 0x560df4953bc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd34c015b80 tx=0x7fd34c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85388c8e7271ef4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:19.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd330ff9700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:12:19.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd330ff9700 1 -- 172.21.15.125:0/3318323300 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0016c0 con 0x560df4901260 2023-11-28T11:12:19.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd330ff9700 1 -- 172.21.15.125:0/3318323300 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd34c023c30 con 0x560df4901260 2023-11-28T11:12:19.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd36431bb80 1 -- 172.21.15.125:0/3318323300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560df48221e0 con 0x560df4901260 2023-11-28T11:12:19.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd330ff9700 1 -- 172.21.15.125:0/3318323300 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd34c023df0 con 0x560df4901260 2023-11-28T11:12:19.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd36431bb80 10 client.6531 fetch_fsmap learned FSMap version 32 2023-11-28T11:12:19.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd36431bb80 1 -- 172.21.15.125:0/3318323300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x560df4682e30 con 0x560df4901260 2023-11-28T11:12:19.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.358+0000 7fd330ff9700 1 -- 172.21.15.125:0/3318323300 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560df48221e0 con 0x560df4901260 2023-11-28T11:12:19.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.359+0000 7fd330ff9700 1 -- 172.21.15.125:0/3318323300 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd34c001820 con 0x560df4901260 2023-11-28T11:12:19.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.359+0000 7fd36431bb80 10 client.6531 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:12:19.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.359+0000 7fd36431bb80 10 client.6531 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T11:12:19.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.359+0000 7fd36431bb80 20 client.6531 populate_metadata read hostname 'smithi125' 2023-11-28T11:12:19.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.359+0000 7fd36431bb80 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x560df4940f70 0x560df49520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.359+0000 7fd36431bb80 4 client.6531 mds_command: new command op to 6276 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:12:19.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.359+0000 7fd36431bb80 1 -- 172.21.15.125:0/3318323300 --> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560df46d8fb0 con 0x560df4940f70 2023-11-28T11:12:19.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.359+0000 7fd35572d700 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x560df4940f70 0x560df49520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.359+0000 7fd330ff9700 10 client.6531 ms_handle_connect on v2:172.21.15.167:6833/1701437437 2023-11-28T11:12:19.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.359+0000 7fd35572d700 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x560df4940f70 0x560df49520e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c84b948892de26e6 server_cookie=1684a42ee25bdb56 in_seq=0 out_seq=0 2023-11-28T11:12:19.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd330ff9700 1 -- 172.21.15.125:0/3318323300 <== mds.0 v2:172.21.15.167:6833/1701437437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x560df46d8fb0 con 0x560df4940f70 2023-11-28T11:12:19.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd330ff9700 10 client.6531 handle_command_reply: tid=0 2023-11-28T11:12:19.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 1 client.6531 shutdown 2023-11-28T11:12:19.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 1 -- 172.21.15.125:0/3318323300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4901260 msgr2=0x560df4953bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4901260 0x560df4953bc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd34c015b80 tx=0x7fd34c001080 comp rx=0 tx=0).stop 2023-11-28T11:12:19.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 1 -- 172.21.15.125:0/3318323300 shutdown_connections 2023-11-28T11:12:19.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df492c8b0 0x560df494b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x560df4940f70 0x560df49520e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4901260 0x560df4953bc0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 1 --2- 172.21.15.125:0/3318323300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4925d80 0x560df494abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd330ff9700 0 client.6531 ms_handle_reset on v2:172.21.15.167:6833/1701437437 2023-11-28T11:12:19.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 1 -- 172.21.15.125:0/3318323300 >> 172.21.15.125:0/3318323300 conn(0x560df48ffe00 msgr2=0x560df48fbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:19.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 1 -- 172.21.15.125:0/3318323300 shutdown_connections 2023-11-28T11:12:19.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 1 -- 172.21.15.125:0/3318323300 wait complete. 2023-11-28T11:12:19.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.360+0000 7fd36431bb80 20 client.6531 trim_cache size 0 max 16384 2023-11-28T11:12:19.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.373+0000 7fd36431bb80 1 Processor -- start 2023-11-28T11:12:19.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.373+0000 7fd36431bb80 1 -- start start 2023-11-28T11:12:19.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.373+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df4901260 0x560df496dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df492cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df492c8b0 0x560df492d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd36431bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df48fee10 con 0x560df4925d80 2023-11-28T11:12:19.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd36431bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df48fda70 con 0x560df492c8b0 2023-11-28T11:12:19.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd36431bb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560df49303f0 con 0x560df4901260 2023-11-28T11:12:19.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd35572d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df492cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd35572d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df492cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33450/0 (socket says 172.21.15.125:33450) 2023-11-28T11:12:19.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd35572d700 1 -- 172.21.15.125:0/1953578922 learned_addr learned my addr 172.21.15.125:0/1953578922 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:19.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd35572d700 1 -- 172.21.15.125:0/1953578922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df4901260 msgr2=0x560df496dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:19.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd35572d700 1 --2- 172.21.15.125:0/1953578922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df4901260 0x560df496dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd35572d700 1 -- 172.21.15.125:0/1953578922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df492c8b0 msgr2=0x560df492d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:19.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd35572d700 1 --2- 172.21.15.125:0/1953578922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df492c8b0 0x560df492d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd35572d700 1 -- 172.21.15.125:0/1953578922 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560df481b1e0 con 0x560df4925d80 2023-11-28T11:12:19.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd35572d700 1 --2- 172.21.15.125:0/1953578922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df492cc80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd3500b32d0 tx=0x7fd340017c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b8cfe877d3e3f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:19.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd333fff700 1 -- 172.21.15.125:0/1953578922 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340009ba0 con 0x560df4925d80 2023-11-28T11:12:19.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd333fff700 1 -- 172.21.15.125:0/1953578922 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd340009d00 con 0x560df4925d80 2023-11-28T11:12:19.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.374+0000 7fd333fff700 1 -- 172.21.15.125:0/1953578922 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340017280 con 0x560df4925d80 2023-11-28T11:12:19.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.375+0000 7fd36431bb80 1 -- 172.21.15.125:0/1953578922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 msgr2=0x560df492cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.375+0000 7fd36431bb80 1 --2- 172.21.15.125:0/1953578922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df492cc80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd3500b32d0 tx=0x7fd340017c30 comp rx=0 tx=0).stop 2023-11-28T11:12:19.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.375+0000 7fd36431bb80 1 -- 172.21.15.125:0/1953578922 shutdown_connections 2023-11-28T11:12:19.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.375+0000 7fd36431bb80 1 --2- 172.21.15.125:0/1953578922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df492c8b0 0x560df492d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.375+0000 7fd36431bb80 1 --2- 172.21.15.125:0/1953578922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df4901260 0x560df496dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.375+0000 7fd36431bb80 1 --2- 172.21.15.125:0/1953578922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df4925d80 0x560df492cc80 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.375+0000 7fd36431bb80 1 -- 172.21.15.125:0/1953578922 >> 172.21.15.125:0/1953578922 conn(0x560df48ffe00 msgr2=0x560df49539d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.375+0000 7fd36431bb80 1 -- 172.21.15.125:0/1953578922 shutdown_connections 2023-11-28T11:12:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.375+0000 7fd36431bb80 1 -- 172.21.15.125:0/1953578922 wait complete. 2023-11-28T11:12:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.375+0000 7fd36431bb80 1 -- start start 2023-11-28T11:12:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.375+0000 7fd36431bb80 1 Processor -- start 2023-11-28T11:12:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.376+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df4901260 0x560df48fb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.376+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4925d80 0x560df48fba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.376+0000 7fd36431bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df492c8b0 0x560df493d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.376+0000 7fd36431bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df493f230 con 0x560df492c8b0 2023-11-28T11:12:19.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.376+0000 7fd36431bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df4964af0 con 0x560df4925d80 2023-11-28T11:12:19.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.376+0000 7fd36431bb80 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560df496de10 con 0x560df4901260 2023-11-28T11:12:19.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.376+0000 7fd36431bb80 10 client.0 _ll_register_callbacks cb 0x560df46fa2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:12:19.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.376+0000 7fd35672f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df492c8b0 0x560df493d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.376+0000 7fd35672f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df492c8b0 0x560df493d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33458/0 (socket says 172.21.15.125:33458) 2023-11-28T11:12:19.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.376+0000 7fd35672f700 1 -- 172.21.15.125:0/4132897324 learned_addr learned my addr 172.21.15.125:0/4132897324 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:19.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd355f2e700 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df4901260 0x560df48fb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd35572d700 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4925d80 0x560df48fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd35672f700 1 -- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df4901260 msgr2=0x560df48fb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:19.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd35672f700 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df4901260 0x560df48fb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd35672f700 1 -- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4925d80 msgr2=0x560df48fba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:19.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd35672f700 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4925d80 0x560df48fba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd35672f700 1 -- 172.21.15.125:0/4132897324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34000e040 con 0x560df492c8b0 2023-11-28T11:12:19.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd35672f700 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df492c8b0 0x560df493d440 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd348058490 tx=0x7fd348009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d17cfcaf8608a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:19.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd330ff9700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-11-28T11:12:19.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd330ff9700 1 -- 172.21.15.125:0/4132897324 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348056990 con 0x560df492c8b0 2023-11-28T11:12:19.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd330ff9700 1 -- 172.21.15.125:0/4132897324 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd348086300 con 0x560df492c8b0 2023-11-28T11:12:19.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd36431bb80 1 -- 172.21.15.125:0/4132897324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560df4812200 con 0x560df492c8b0 2023-11-28T11:12:19.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd330ff9700 1 -- 172.21.15.125:0/4132897324 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3480864c0 con 0x560df492c8b0 2023-11-28T11:12:19.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd36431bb80 10 client.6537 fetch_fsmap learned FSMap version 32 2023-11-28T11:12:19.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd36431bb80 1 -- 172.21.15.125:0/4132897324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x560df46a92a0 con 0x560df492c8b0 2023-11-28T11:12:19.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd330ff9700 1 -- 172.21.15.125:0/4132897324 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560df4812200 con 0x560df492c8b0 2023-11-28T11:12:19.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd330ff9700 1 -- 172.21.15.125:0/4132897324 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd348059b20 con 0x560df492c8b0 2023-11-28T11:12:19.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd36431bb80 10 client.6537 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:12:19.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd36431bb80 10 client.6537 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T11:12:19.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd36431bb80 20 client.6537 populate_metadata read hostname 'smithi125' 2023-11-28T11:12:19.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd36431bb80 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x560df492e710 0x560df493d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd36431bb80 4 client.6537 mds_command: new command op to 6276 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-28T11:12:19.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd36431bb80 1 -- 172.21.15.125:0/4132897324 --> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x560df47fc210 con 0x560df492e710 2023-11-28T11:12:19.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.377+0000 7fd355f2e700 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x560df492e710 0x560df493d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd330ff9700 10 client.6537 ms_handle_connect on v2:172.21.15.167:6833/1701437437 2023-11-28T11:12:19.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd355f2e700 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x560df492e710 0x560df493d980 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b873e3151eb66f1c server_cookie=17d00ae6d7b7b5da in_seq=0 out_seq=0 2023-11-28T11:12:19.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd330ff9700 1 -- 172.21.15.125:0/4132897324 <== mds.0 v2:172.21.15.167:6833/1701437437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+140 (crc 0 0 0) 0x560df47fc210 con 0x560df492e710 2023-11-28T11:12:19.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd330ff9700 10 client.6537 handle_command_reply: tid=0 2023-11-28T11:12:19.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 1 client.6537 shutdown 2023-11-28T11:12:19.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 1 -- 172.21.15.125:0/4132897324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df492c8b0 msgr2=0x560df493d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df492c8b0 0x560df493d440 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd348058490 tx=0x7fd348009ee0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 1 -- 172.21.15.125:0/4132897324 shutdown_connections 2023-11-28T11:12:19.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:6833/1701437437,v1:172.21.15.167:6835/1701437437] conn(0x560df492e710 0x560df493d980 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560df492c8b0 0x560df493d440 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd330ff9700 0 client.6537 ms_handle_reset on v2:172.21.15.167:6833/1701437437 2023-11-28T11:12:19.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560df4901260 0x560df48fb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 1 --2- 172.21.15.125:0/4132897324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560df4925d80 0x560df48fba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 1 -- 172.21.15.125:0/4132897324 >> 172.21.15.125:0/4132897324 conn(0x560df48ffe00 msgr2=0x560df4902760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:19.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 1 -- 172.21.15.125:0/4132897324 shutdown_connections 2023-11-28T11:12:19.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 1 -- 172.21.15.125:0/4132897324 wait complete. 2023-11-28T11:12:19.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.378+0000 7fd36431bb80 20 client.6537 trim_cache size 0 max 16384 2023-11-28T11:12:19.402 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:19.402 INFO:teuthology.orchestra.run.smithi125.stdout:[ 2023-11-28T11:12:19.402 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-11-28T11:12:19.402 INFO:teuthology.orchestra.run.smithi125.stdout: "damage_type": "backtrace", 2023-11-28T11:12:19.403 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 778723429, 2023-11-28T11:12:19.403 INFO:teuthology.orchestra.run.smithi125.stdout: "ino": 1099511627777, 2023-11-28T11:12:19.403 INFO:teuthology.orchestra.run.smithi125.stdout: "path": "/dir_test/file" 2023-11-28T11:12:19.403 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-28T11:12:19.403 INFO:teuthology.orchestra.run.smithi125.stdout:] 2023-11-28T11:12:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 -- 172.21.15.125:0/2012209537 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3340682f0 msgr2=0x7fd33406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3340682f0 0x7fd33406a7a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd34c000f60 tx=0x7fd34c007be0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 -- 172.21.15.125:0/2012209537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35015a5f0 msgr2=0x7fd3500c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35015a5f0 0x7fd3500c7e00 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd35006d5f0 tx=0x7fd348004ad0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 -- 172.21.15.125:0/2012209537 shutdown_connections 2023-11-28T11:12:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd35015a5f0 0x7fd3500c7e00 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd3340682f0 0x7fd33406a7a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3500b2ee0 0x7fd3501f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 --2- 172.21.15.125:0/2012209537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3500cc200 0x7fd3501ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 -- 172.21.15.125:0/2012209537 >> 172.21.15.125:0/2012209537 conn(0x7fd35006ea80 msgr2=0x7fd3500b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:19.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 -- 172.21.15.125:0/2012209537 shutdown_connections 2023-11-28T11:12:19.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.379+0000 7fd358192700 1 -- 172.21.15.125:0/2012209537 wait complete. 2023-11-28T11:12:19.406 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:12:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.525+0000 7f97941af700 1 Processor -- start 2023-11-28T11:12:19.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.526+0000 7f97941af700 1 -- start start 2023-11-28T11:12:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.526+0000 7f97941af700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f978c06e400 0x7f978c0b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.526+0000 7f97941af700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f978c160e70 0x7f978c15c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.526+0000 7f97941af700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978c06e900 con 0x7f978c0d0c60 2023-11-28T11:12:19.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.526+0000 7f97941af700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978c160390 con 0x7f978c06e400 2023-11-28T11:12:19.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.526+0000 7f97941af700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978c160670 con 0x7f978c160e70 2023-11-28T11:12:19.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f979174a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f978c06e400 0x7f978c0b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f9791f4b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f978c0d0c60 0x7f978c0d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45818/0 (socket says 172.21.15.125:45818) 2023-11-28T11:12:19.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f9791f4b700 1 -- 172.21.15.125:0/679596069 learned_addr learned my addr 172.21.15.125:0/679596069 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:19.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f979274c700 1 --2- 172.21.15.125:0/679596069 >> v2:172.21.15.167:3300/0 conn(0x7f978c160e70 0x7f978c15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f979174a700 1 -- 172.21.15.125:0/679596069 >> v2:172.21.15.167:3300/0 conn(0x7f978c160e70 msgr2=0x7f978c15c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:19.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f979174a700 1 --2- 172.21.15.125:0/679596069 >> v2:172.21.15.167:3300/0 conn(0x7f978c160e70 0x7f978c15c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f979174a700 1 -- 172.21.15.125:0/679596069 >> v1:172.21.15.125:6789/0 conn(0x7f978c0d0c60 legacy=0x7f978c0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f979174a700 1 -- 172.21.15.125:0/679596069 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c160950 con 0x7f978c06e400 2023-11-28T11:12:19.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f979174a700 1 --2- 172.21.15.125:0/679596069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c06e400 0x7f978c0b5be0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f978c068250 tx=0x7f9788009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7079017a6f71de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:19.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f9790f49700 1 -- 172.21.15.125:0/679596069 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788004230 con 0x7f978c06e400 2023-11-28T11:12:19.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f9790f49700 1 -- 172.21.15.125:0/679596069 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788004390 con 0x7f978c06e400 2023-11-28T11:12:19.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.527+0000 7f9790f49700 1 -- 172.21.15.125:0/679596069 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880036a0 con 0x7f978c06e400 2023-11-28T11:12:19.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.528+0000 7f97941af700 1 -- 172.21.15.125:0/679596069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c06e400 msgr2=0x7f978c0b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.528+0000 7f97941af700 1 --2- 172.21.15.125:0/679596069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c06e400 0x7f978c0b5be0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f978c068250 tx=0x7f9788009b20 comp rx=0 tx=0).stop 2023-11-28T11:12:19.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.528+0000 7f97941af700 1 -- 172.21.15.125:0/679596069 shutdown_connections 2023-11-28T11:12:19.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.528+0000 7f97941af700 1 --2- 172.21.15.125:0/679596069 >> v2:172.21.15.167:3300/0 conn(0x7f978c160e70 0x7f978c15c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.528+0000 7f97941af700 1 --2- 172.21.15.125:0/679596069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c06e400 0x7f978c0b5be0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.528+0000 7f97941af700 1 -- 172.21.15.125:0/679596069 >> 172.21.15.125:0/679596069 conn(0x7f978c06a270 msgr2=0x7f978c06a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:19.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.528+0000 7f97941af700 1 -- 172.21.15.125:0/679596069 shutdown_connections 2023-11-28T11:12:19.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.528+0000 7f97941af700 1 -- 172.21.15.125:0/679596069 wait complete. 2023-11-28T11:12:19.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.529+0000 7f97941af700 1 Processor -- start 2023-11-28T11:12:19.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.529+0000 7f97941af700 1 -- start start 2023-11-28T11:12:19.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f97941af700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f978c06e400 0x7f978c0cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f97941af700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c0d0c60 0x7f978c0b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f97941af700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f978c160e70 0x7f978c1f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f97941af700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0b37e0 con 0x7f978c0d0c60 2023-11-28T11:12:19.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f97941af700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0cc7a0 con 0x7f978c160e70 2023-11-28T11:12:19.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f97941af700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0cca80 con 0x7f978c06e400 2023-11-28T11:12:19.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f979174a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c0d0c60 0x7f978c0b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f979174a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c0d0c60 0x7f978c0b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33470/0 (socket says 172.21.15.125:33470) 2023-11-28T11:12:19.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f979174a700 1 -- 172.21.15.125:0/2363839464 learned_addr learned my addr 172.21.15.125:0/2363839464 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:19.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f9791f4b700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f978c06e400 0x7f978c0cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f979274c700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f978c160e70 0x7f978c1f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f979174a700 1 -- 172.21.15.125:0/2363839464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f978c06e400 msgr2=0x7f978c0cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f979174a700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f978c06e400 0x7f978c0cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f979174a700 1 -- 172.21.15.125:0/2363839464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f978c160e70 msgr2=0x7f978c1f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f979174a700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f978c160e70 0x7f978c1f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f979174a700 1 -- 172.21.15.125:0/2363839464 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97880094a0 con 0x7f978c0d0c60 2023-11-28T11:12:19.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f979274c700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f978c160e70 0x7f978c1f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:19.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f979174a700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c0d0c60 0x7f978c0b32a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f97880090b0 tx=0x7f9788004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:19.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f97827fc700 1 -- 172.21.15.125:0/2363839464 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788003e40 con 0x7f978c0d0c60 2023-11-28T11:12:19.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f97827fc700 1 -- 172.21.15.125:0/2363839464 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978801f070 con 0x7f978c0d0c60 2023-11-28T11:12:19.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f97941af700 1 -- 172.21.15.125:0/2363839464 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c15ceb0 con 0x7f978c0d0c60 2023-11-28T11:12:19.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f97827fc700 1 -- 172.21.15.125:0/2363839464 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788011870 con 0x7f978c0d0c60 2023-11-28T11:12:19.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.530+0000 7f97941af700 1 -- 172.21.15.125:0/2363839464 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978c0d0740 con 0x7f978c0d0c60 2023-11-28T11:12:19.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.531+0000 7f97941af700 1 -- 172.21.15.125:0/2363839464 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978c15d040 con 0x7f978c0d0c60 2023-11-28T11:12:19.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.532+0000 7f97827fc700 1 -- 172.21.15.125:0/2363839464 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9788017020 con 0x7f978c0d0c60 2023-11-28T11:12:19.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.532+0000 7f97827fc700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97700682f0 0x7f977006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:19.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.532+0000 7f97827fc700 1 -- 172.21.15.125:0/2363839464 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9788021070 con 0x7f978c0d0c60 2023-11-28T11:12:19.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.532+0000 7f9791f4b700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97700682f0 0x7f977006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:19.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.532+0000 7f9791f4b700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97700682f0 0x7f977006a7a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f977c000f60 tx=0x7f977c004a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:19.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.536+0000 7f97827fc700 1 -- 172.21.15.125:0/2363839464 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9788053f60 con 0x7f978c0d0c60 2023-11-28T11:12:19.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.762+0000 7f97941af700 1 -- 172.21.15.125:0/2363839464 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f978c0743f0 con 0x7f978c0d0c60 2023-11-28T11:12:19.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.762+0000 7f97827fc700 1 -- 172.21.15.125:0/2363839464 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f9788057580 con 0x7f978c0d0c60 2023-11-28T11:12:19.765 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:19.765 INFO:teuthology.orchestra.run.smithi125.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:12:19.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 -- 172.21.15.125:0/2363839464 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97700682f0 msgr2=0x7f977006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97700682f0 0x7f977006a7a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f977c000f60 tx=0x7f977c004a50 comp rx=0 tx=0).stop 2023-11-28T11:12:19.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 -- 172.21.15.125:0/2363839464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c0d0c60 msgr2=0x7f978c0b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:19.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c0d0c60 0x7f978c0b32a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f97880090b0 tx=0x7f9788004750 comp rx=0 tx=0).stop 2023-11-28T11:12:19.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 -- 172.21.15.125:0/2363839464 shutdown_connections 2023-11-28T11:12:19.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f978c160e70 0x7f978c1f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97700682f0 0x7f977006a7a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f978c06e400 0x7f978c0cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 --2- 172.21.15.125:0/2363839464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c0d0c60 0x7f978c0b32a0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:19.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 -- 172.21.15.125:0/2363839464 >> 172.21.15.125:0/2363839464 conn(0x7f978c06a270 msgr2=0x7f978c1586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:19.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 -- 172.21.15.125:0/2363839464 shutdown_connections 2023-11-28T11:12:19.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:19.764+0000 7f97941af700 1 -- 172.21.15.125:0/2363839464 wait complete. 2023-11-28T11:12:19.778 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=20 retry_count=0)... 2023-11-28T11:12:24.779 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:12:24.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.910+0000 7fd999f74700 1 Processor -- start 2023-11-28T11:12:24.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.910+0000 7fd999f74700 1 -- start start 2023-11-28T11:12:24.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.911+0000 7fd999f74700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 0x7fd99413ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:24.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.911+0000 7fd999f74700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd9940b1770 0x7fd9940b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.911+0000 7fd999f74700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99415e010 con 0x7fd9940ce040 2023-11-28T11:12:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.911+0000 7fd999f74700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9940b2130 con 0x7fd9940b1770 2023-11-28T11:12:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.911+0000 7fd999f74700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99413fc90 con 0x7fd994142db0 2023-11-28T11:12:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.911+0000 7fd993fff700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd9940b1770 0x7fd9940b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.911+0000 7fd992ffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 0x7fd99413ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd992ffd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 0x7fd99413ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:56718/0 (socket says 172.21.15.125:56718) 2023-11-28T11:12:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd992ffd700 1 -- 172.21.15.125:0/1016741316 learned_addr learned my addr 172.21.15.125:0/1016741316 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd9937fe700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd9940ce040 0x7fd99415d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:48634/0 (socket says 172.21.15.125:48634) 2023-11-28T11:12:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd992ffd700 1 -- 172.21.15.125:0/1016741316 >> v2:172.21.15.167:3300/0 conn(0x7fd9940b1770 msgr2=0x7fd9940b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd992ffd700 1 --2- 172.21.15.125:0/1016741316 >> v2:172.21.15.167:3300/0 conn(0x7fd9940b1770 0x7fd9940b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:24.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd992ffd700 1 -- 172.21.15.125:0/1016741316 >> v1:172.21.15.167:6789/0 conn(0x7fd9940ce040 legacy=0x7fd99415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd992ffd700 1 -- 172.21.15.125:0/1016741316 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99413f6d0 con 0x7fd994142db0 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd993fff700 1 --2- 172.21.15.125:0/1016741316 >> v2:172.21.15.167:3300/0 conn(0x7fd9940b1770 0x7fd9940b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd992ffd700 1 --2- 172.21.15.125:0/1016741316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 0x7fd99413ed70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd98400bb90 tx=0x7fd98400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c87a291a76719b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd9927fc700 1 -- 172.21.15.125:0/1016741316 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400dd30 con 0x7fd994142db0 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd9927fc700 1 -- 172.21.15.125:0/1016741316 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98400de90 con 0x7fd994142db0 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.912+0000 7fd9927fc700 1 -- 172.21.15.125:0/1016741316 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984010690 con 0x7fd994142db0 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.913+0000 7fd999f74700 1 -- 172.21.15.125:0/1016741316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 msgr2=0x7fd99413ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.913+0000 7fd999f74700 1 --2- 172.21.15.125:0/1016741316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 0x7fd99413ed70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd98400bb90 tx=0x7fd98400bea0 comp rx=0 tx=0).stop 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.913+0000 7fd999f74700 1 -- 172.21.15.125:0/1016741316 shutdown_connections 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.913+0000 7fd999f74700 1 --2- 172.21.15.125:0/1016741316 >> v2:172.21.15.167:3300/0 conn(0x7fd9940b1770 0x7fd9940b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.913+0000 7fd999f74700 1 --2- 172.21.15.125:0/1016741316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 0x7fd99413ed70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:24.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.913+0000 7fd999f74700 1 -- 172.21.15.125:0/1016741316 >> 172.21.15.125:0/1016741316 conn(0x7fd99406c010 msgr2=0x7fd9940cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.913+0000 7fd999f74700 1 -- 172.21.15.125:0/1016741316 shutdown_connections 2023-11-28T11:12:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.913+0000 7fd999f74700 1 -- 172.21.15.125:0/1016741316 wait complete. 2023-11-28T11:12:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.914+0000 7fd999f74700 1 Processor -- start 2023-11-28T11:12:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.914+0000 7fd999f74700 1 -- start start 2023-11-28T11:12:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.915+0000 7fd999f74700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9940b1770 0x7fd9940c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.915+0000 7fd999f74700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9940ce040 0x7fd9940c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.915+0000 7fd999f74700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 0x7fd9940c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.915+0000 7fd999f74700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940c6200 con 0x7fd9940b1770 2023-11-28T11:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.915+0000 7fd999f74700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940c7300 con 0x7fd9940ce040 2023-11-28T11:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.915+0000 7fd999f74700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940c7530 con 0x7fd994142db0 2023-11-28T11:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.915+0000 7fd9937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9940b1770 0x7fd9940c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.915+0000 7fd9937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9940b1770 0x7fd9940c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33482/0 (socket says 172.21.15.125:33482) 2023-11-28T11:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.915+0000 7fd9937fe700 1 -- 172.21.15.125:0/1808853200 learned_addr learned my addr 172.21.15.125:0/1808853200 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.915+0000 7fd993fff700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 0x7fd9940c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.915+0000 7fd992ffd700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9940ce040 0x7fd9940c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.916+0000 7fd9937fe700 1 -- 172.21.15.125:0/1808853200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 msgr2=0x7fd9940c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.916+0000 7fd9937fe700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 0x7fd9940c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.916+0000 7fd9937fe700 1 -- 172.21.15.125:0/1808853200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9940ce040 msgr2=0x7fd9940c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.916+0000 7fd9937fe700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9940ce040 0x7fd9940c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.916+0000 7fd9937fe700 1 -- 172.21.15.125:0/1808853200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c009a70 con 0x7fd9940b1770 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.916+0000 7fd9937fe700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9940b1770 0x7fd9940c58c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c490 tx=0x7fd97c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.916+0000 7fd98bfff700 1 -- 172.21.15.125:0/1808853200 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c005cb0 con 0x7fd9940b1770 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.916+0000 7fd98bfff700 1 -- 172.21.15.125:0/1808853200 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c005e10 con 0x7fd9940b1770 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.916+0000 7fd999f74700 1 -- 172.21.15.125:0/1808853200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98400b7f0 con 0x7fd9940b1770 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.916+0000 7fd98bfff700 1 -- 172.21.15.125:0/1808853200 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0072d0 con 0x7fd9940b1770 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.916+0000 7fd999f74700 1 -- 172.21.15.125:0/1808853200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99415d100 con 0x7fd9940b1770 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.917+0000 7fd999f74700 1 -- 172.21.15.125:0/1808853200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99413f9b0 con 0x7fd9940b1770 2023-11-28T11:12:24.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.918+0000 7fd98bfff700 1 -- 172.21.15.125:0/1808853200 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd97c019030 con 0x7fd9940b1770 2023-11-28T11:12:24.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.918+0000 7fd98bfff700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9740682f0 0x7fd97406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:24.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.919+0000 7fd98bfff700 1 -- 172.21.15.125:0/1808853200 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd97c0853f0 con 0x7fd9940b1770 2023-11-28T11:12:24.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.919+0000 7fd992ffd700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9740682f0 0x7fd97406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:24.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.919+0000 7fd992ffd700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9740682f0 0x7fd97406a7a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd98400bee0 tx=0x7fd984013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:24.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:24.922+0000 7fd98bfff700 1 -- 172.21.15.125:0/1808853200 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd97c051b80 con 0x7fd9940b1770 2023-11-28T11:12:25.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.146+0000 7fd999f74700 1 -- 172.21.15.125:0/1808853200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd99415d3e0 con 0x7fd9940b1770 2023-11-28T11:12:25.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.146+0000 7fd98bfff700 1 -- 172.21.15.125:0/1808853200 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fd97c0551a0 con 0x7fd9940b1770 2023-11-28T11:12:25.148 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:25.148 INFO:teuthology.orchestra.run.smithi125.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:12:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.148+0000 7fd999f74700 1 -- 172.21.15.125:0/1808853200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9740682f0 msgr2=0x7fd97406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.148+0000 7fd999f74700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9740682f0 0x7fd97406a7a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd98400bee0 tx=0x7fd984013000 comp rx=0 tx=0).stop 2023-11-28T11:12:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.148+0000 7fd999f74700 1 -- 172.21.15.125:0/1808853200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9940b1770 msgr2=0x7fd9940c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.148+0000 7fd999f74700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9940b1770 0x7fd9940c58c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c490 tx=0x7fd97c00c850 comp rx=0 tx=0).stop 2023-11-28T11:12:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.148+0000 7fd999f74700 1 -- 172.21.15.125:0/1808853200 shutdown_connections 2023-11-28T11:12:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.148+0000 7fd999f74700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd9740682f0 0x7fd97406a7a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.148+0000 7fd999f74700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd994142db0 0x7fd9940c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.148+0000 7fd999f74700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd9940b1770 0x7fd9940c58c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.148+0000 7fd999f74700 1 --2- 172.21.15.125:0/1808853200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9940ce040 0x7fd9940c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.148+0000 7fd999f74700 1 -- 172.21.15.125:0/1808853200 >> 172.21.15.125:0/1808853200 conn(0x7fd99406c010 msgr2=0x7fd99406ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.149+0000 7fd999f74700 1 -- 172.21.15.125:0/1808853200 shutdown_connections 2023-11-28T11:12:25.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:25.149+0000 7fd999f74700 1 -- 172.21.15.125:0/1808853200 wait complete. 2023-11-28T11:12:25.162 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=20 retry_count=0)... 2023-11-28T11:12:30.163 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:12:30.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.297+0000 7f7c68b48700 1 Processor -- start 2023-11-28T11:12:30.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.297+0000 7f7c68b48700 1 -- start start 2023-11-28T11:12:30.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c68b48700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c6415c640 0x7f7c6406a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:30.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c68b48700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c6406a7b0 0x7f7c6406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:30.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c68b48700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406e110 0x7f7c640b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:30.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c68b48700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c64070bf0 con 0x7f7c6415c640 2023-11-28T11:12:30.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c68b48700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6406ac00 con 0x7f7c6406a7b0 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c68b48700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6406c880 con 0x7f7c6406e110 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c6259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c6415c640 0x7f7c6406a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c6259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c6415c640 0x7f7c6406a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33490/0 (socket says 172.21.15.125:33490) 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c6259c700 1 -- 172.21.15.125:0/639807494 learned_addr learned my addr 172.21.15.125:0/639807494 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c62d9d700 1 --2- 172.21.15.125:0/639807494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406e110 0x7f7c640b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c61d9b700 1 --2- 172.21.15.125:0/639807494 >> v2:172.21.15.167:3300/0 conn(0x7f7c6406a7b0 0x7f7c6406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c6259c700 1 -- 172.21.15.125:0/639807494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406e110 msgr2=0x7f7c640b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c6259c700 1 --2- 172.21.15.125:0/639807494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406e110 0x7f7c640b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c6259c700 1 -- 172.21.15.125:0/639807494 >> v2:172.21.15.167:3300/0 conn(0x7f7c6406a7b0 msgr2=0x7f7c6406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c6259c700 1 --2- 172.21.15.125:0/639807494 >> v2:172.21.15.167:3300/0 conn(0x7f7c6406a7b0 0x7f7c6406dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c6259c700 1 -- 172.21.15.125:0/639807494 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6406cad0 con 0x7f7c6415c640 2023-11-28T11:12:30.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c61d9b700 1 --2- 172.21.15.125:0/639807494 >> v2:172.21.15.167:3300/0 conn(0x7f7c6406a7b0 0x7f7c6406dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:30.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.298+0000 7f7c62d9d700 1 --2- 172.21.15.125:0/639807494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406e110 0x7f7c640b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:30.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c6259c700 1 --2- 172.21.15.125:0/639807494 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6415c640 0x7f7c6406a270 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7c640cd400 tx=0x7f7c54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ce9607e6814182 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:30.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c6159a700 1 -- 172.21.15.125:0/639807494 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5400b870 con 0x7f7c6415c640 2023-11-28T11:12:30.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c6159a700 1 -- 172.21.15.125:0/639807494 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5400b9d0 con 0x7f7c6415c640 2023-11-28T11:12:30.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c6159a700 1 -- 172.21.15.125:0/639807494 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5400bd60 con 0x7f7c6415c640 2023-11-28T11:12:30.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c68b48700 1 -- 172.21.15.125:0/639807494 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6415c640 msgr2=0x7f7c6406a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:30.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c68b48700 1 --2- 172.21.15.125:0/639807494 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6415c640 0x7f7c6406a270 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7c640cd400 tx=0x7f7c54009bd0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c68b48700 1 -- 172.21.15.125:0/639807494 shutdown_connections 2023-11-28T11:12:30.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c68b48700 1 --2- 172.21.15.125:0/639807494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406e110 0x7f7c640b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c68b48700 1 --2- 172.21.15.125:0/639807494 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6415c640 0x7f7c6406a270 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c68b48700 1 --2- 172.21.15.125:0/639807494 >> v2:172.21.15.167:3300/0 conn(0x7f7c6406a7b0 0x7f7c6406dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c68b48700 1 -- 172.21.15.125:0/639807494 >> 172.21.15.125:0/639807494 conn(0x7f7c6406bfd0 msgr2=0x7f7c640cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:30.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c68b48700 1 -- 172.21.15.125:0/639807494 shutdown_connections 2023-11-28T11:12:30.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.299+0000 7f7c68b48700 1 -- 172.21.15.125:0/639807494 wait complete. 2023-11-28T11:12:30.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.301+0000 7f7c68b48700 1 Processor -- start 2023-11-28T11:12:30.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.301+0000 7f7c68b48700 1 -- start start 2023-11-28T11:12:30.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.301+0000 7f7c68b48700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406a7b0 0x7f7c640b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:30.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.301+0000 7f7c68b48700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6406e110 0x7f7c64152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:30.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.301+0000 7f7c68b48700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c6415c640 0x7f7c640b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:30.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.301+0000 7f7c68b48700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64152640 con 0x7f7c6406e110 2023-11-28T11:12:30.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.301+0000 7f7c68b48700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640c8380 con 0x7f7c6415c640 2023-11-28T11:12:30.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.301+0000 7f7c68b48700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640b0a70 con 0x7f7c6406a7b0 2023-11-28T11:12:30.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c61d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6406e110 0x7f7c64152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:30.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c61d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6406e110 0x7f7c64152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33498/0 (socket says 172.21.15.125:33498) 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c61d9b700 1 -- 172.21.15.125:0/1769091877 learned_addr learned my addr 172.21.15.125:0/1769091877 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c62d9d700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c6415c640 0x7f7c640b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c6259c700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406a7b0 0x7f7c640b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c61d9b700 1 -- 172.21.15.125:0/1769091877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406a7b0 msgr2=0x7f7c640b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c61d9b700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406a7b0 0x7f7c640b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c61d9b700 1 -- 172.21.15.125:0/1769091877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c6415c640 msgr2=0x7f7c640b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c61d9b700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c6415c640 0x7f7c640b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c61d9b700 1 -- 172.21.15.125:0/1769091877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c54009550 con 0x7f7c6406e110 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c62d9d700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c6415c640 0x7f7c640b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c6259c700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406a7b0 0x7f7c640b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c61d9b700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6406e110 0x7f7c64152100 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800e840 tx=0x7f7c5800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:30.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c52ffd700 1 -- 172.21.15.125:0/1769091877 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58013610 con 0x7f7c6406e110 2023-11-28T11:12:30.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c52ffd700 1 -- 172.21.15.125:0/1769091877 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58013770 con 0x7f7c6406e110 2023-11-28T11:12:30.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c68b48700 1 -- 172.21.15.125:0/1769091877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6406d090 con 0x7f7c6406e110 2023-11-28T11:12:30.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c52ffd700 1 -- 172.21.15.125:0/1769091877 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58013b20 con 0x7f7c6406e110 2023-11-28T11:12:30.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.302+0000 7f7c68b48700 1 -- 172.21.15.125:0/1769091877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6406cdb0 con 0x7f7c6406e110 2023-11-28T11:12:30.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.303+0000 7f7c68b48700 1 -- 172.21.15.125:0/1769091877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6406d370 con 0x7f7c6406e110 2023-11-28T11:12:30.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.304+0000 7f7c52ffd700 1 -- 172.21.15.125:0/1769091877 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7c58023070 con 0x7f7c6406e110 2023-11-28T11:12:30.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.304+0000 7f7c52ffd700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c440682f0 0x7f7c4406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:30.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.304+0000 7f7c52ffd700 1 -- 172.21.15.125:0/1769091877 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f7c58085950 con 0x7f7c6406e110 2023-11-28T11:12:30.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.304+0000 7f7c6259c700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c440682f0 0x7f7c4406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:30.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.304+0000 7f7c6259c700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c440682f0 0x7f7c4406a7a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7c54014040 tx=0x7f7c54008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:30.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.308+0000 7f7c52ffd700 1 -- 172.21.15.125:0/1769091877 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7c58052120 con 0x7f7c6406e110 2023-11-28T11:12:30.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.532+0000 7f7c68b48700 1 -- 172.21.15.125:0/1769091877 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7c640b5b50 con 0x7f7c6406e110 2023-11-28T11:12:30.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.532+0000 7f7c52ffd700 1 -- 172.21.15.125:0/1769091877 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f7c58055740 con 0x7f7c6406e110 2023-11-28T11:12:30.533 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:30.533 INFO:teuthology.orchestra.run.smithi125.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:12:30.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 -- 172.21.15.125:0/1769091877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c440682f0 msgr2=0x7f7c4406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:30.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c440682f0 0x7f7c4406a7a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7c54014040 tx=0x7f7c54008030 comp rx=0 tx=0).stop 2023-11-28T11:12:30.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 -- 172.21.15.125:0/1769091877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6406e110 msgr2=0x7f7c64152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:30.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6406e110 0x7f7c64152100 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800e840 tx=0x7f7c5800ec00 comp rx=0 tx=0).stop 2023-11-28T11:12:30.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 -- 172.21.15.125:0/1769091877 shutdown_connections 2023-11-28T11:12:30.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c6415c640 0x7f7c640b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7c440682f0 0x7f7c4406a7a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c6406a7b0 0x7f7c640b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 --2- 172.21.15.125:0/1769091877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6406e110 0x7f7c64152100 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:30.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 -- 172.21.15.125:0/1769091877 >> 172.21.15.125:0/1769091877 conn(0x7f7c6406bfd0 msgr2=0x7f7c640cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:30.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 -- 172.21.15.125:0/1769091877 shutdown_connections 2023-11-28T11:12:30.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:30.534+0000 7f7c68b48700 1 -- 172.21.15.125:0/1769091877 wait complete. 2023-11-28T11:12:30.547 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=20 retry_count=0)... 2023-11-28T11:12:33.391 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:12:33.394 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:12:35.548 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:12:35.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.679+0000 7f359e043700 1 Processor -- start 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.679+0000 7f359e043700 1 -- start start 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.680+0000 7f359e043700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f359806a270 0x7f359806a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.680+0000 7f359e043700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f359815cc80 0x7f359806de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.680+0000 7f359e043700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359806ab80 con 0x7f359806e3a0 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.680+0000 7f359e043700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35980b2490 con 0x7f359806a270 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.680+0000 7f359e043700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35980b1810 con 0x7f359815cc80 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.680+0000 7f3597fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f359806e3a0 0x7f359806ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45864/0 (socket says 172.21.15.125:45864) 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.680+0000 7f3597fff700 1 -- 172.21.15.125:0/935448790 learned_addr learned my addr 172.21.15.125:0/935448790 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.680+0000 7f35977fe700 1 --2- 172.21.15.125:0/935448790 >> v2:172.21.15.167:3300/0 conn(0x7f359806a270 0x7f359806a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.680+0000 7f3596ffd700 1 --2- 172.21.15.125:0/935448790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f359815cc80 0x7f359806de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.680+0000 7f35967fc700 1 -- 172.21.15.125:0/935448790 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609641298 0 0) 0x7f359806ab80 con 0x7f359806e3a0 2023-11-28T11:12:35.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.680+0000 7f35967fc700 1 -- 172.21.15.125:0/935448790 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35800035b0 con 0x7f359806e3a0 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.681+0000 7f35977fe700 1 -- 172.21.15.125:0/935448790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f359815cc80 msgr2=0x7f359806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.681+0000 7f35977fe700 1 --2- 172.21.15.125:0/935448790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f359815cc80 0x7f359806de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.681+0000 7f35967fc700 1 -- 172.21.15.125:0/935448790 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2465936055 0 0) 0x7f35800035b0 con 0x7f359806e3a0 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.681+0000 7f35977fe700 1 -- 172.21.15.125:0/935448790 >> v1:172.21.15.125:6789/0 conn(0x7f359806e3a0 legacy=0x7f359806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.681+0000 7f35977fe700 1 -- 172.21.15.125:0/935448790 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35980b1af0 con 0x7f359806a270 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.681+0000 7f3596ffd700 1 --2- 172.21.15.125:0/935448790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f359815cc80 0x7f359806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.681+0000 7f35977fe700 1 --2- 172.21.15.125:0/935448790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f359806a270 0x7f359806a640 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f358c009840 tx=0x7f358c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2448d17f4041343a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.681+0000 7f35967fc700 1 -- 172.21.15.125:0/935448790 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35900019f0 con 0x7f359806a270 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.681+0000 7f35967fc700 1 -- 172.21.15.125:0/935448790 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c004030 con 0x7f359806a270 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.681+0000 7f35967fc700 1 -- 172.21.15.125:0/935448790 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0043c0 con 0x7f359806a270 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.682+0000 7f359e043700 1 -- 172.21.15.125:0/935448790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f359806a270 msgr2=0x7f359806a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.682+0000 7f359e043700 1 --2- 172.21.15.125:0/935448790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f359806a270 0x7f359806a640 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f358c009840 tx=0x7f358c009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:35.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.682+0000 7f359e043700 1 -- 172.21.15.125:0/935448790 shutdown_connections 2023-11-28T11:12:35.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.682+0000 7f359e043700 1 --2- 172.21.15.125:0/935448790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f359806a270 0x7f359806a640 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:35.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.682+0000 7f359e043700 1 --2- 172.21.15.125:0/935448790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f359815cc80 0x7f359806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:35.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.682+0000 7f359e043700 1 -- 172.21.15.125:0/935448790 >> 172.21.15.125:0/935448790 conn(0x7f359806c010 msgr2=0x7f35980cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:35.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.682+0000 7f359e043700 1 -- 172.21.15.125:0/935448790 shutdown_connections 2023-11-28T11:12:35.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.682+0000 7f359e043700 1 -- 172.21.15.125:0/935448790 wait complete. 2023-11-28T11:12:35.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.683+0000 7f359e043700 1 Processor -- start 2023-11-28T11:12:35.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.683+0000 7f359e043700 1 -- start start 2023-11-28T11:12:35.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f359e043700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f359806a270 0x7f35981531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:35.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f359e043700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f359806e3a0 0x7f359815a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:35.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f359e043700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f359815cc80 0x7f359815ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:35.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f359e043700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35980c9660 con 0x7f359815cc80 2023-11-28T11:12:35.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f359e043700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35980b39b0 con 0x7f359806e3a0 2023-11-28T11:12:35.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f359e043700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35980b3080 con 0x7f359806a270 2023-11-28T11:12:35.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f3597fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f359815cc80 0x7f359815ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:35.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f3597fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f359815cc80 0x7f359815ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33514/0 (socket says 172.21.15.125:33514) 2023-11-28T11:12:35.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f3597fff700 1 -- 172.21.15.125:0/3884477421 learned_addr learned my addr 172.21.15.125:0/3884477421 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f3596ffd700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f359806e3a0 0x7f359815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f35977fe700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f359806a270 0x7f35981531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f3597fff700 1 -- 172.21.15.125:0/3884477421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f359806a270 msgr2=0x7f35981531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f3597fff700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f359806a270 0x7f35981531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f3597fff700 1 -- 172.21.15.125:0/3884477421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f359806e3a0 msgr2=0x7f359815a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f3597fff700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f359806e3a0 0x7f359815a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f3597fff700 1 -- 172.21.15.125:0/3884477421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35880094a0 con 0x7f359815cc80 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f3597fff700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f359815cc80 0x7f359815ad70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f359000cc00 tx=0x7f359000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f357ffff700 1 -- 172.21.15.125:0/3884477421 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359000ab80 con 0x7f359815cc80 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f357ffff700 1 -- 172.21.15.125:0/3884477421 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359000ad00 con 0x7f359815cc80 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.684+0000 7f359e043700 1 -- 172.21.15.125:0/3884477421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c0094a0 con 0x7f359815cc80 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.685+0000 7f357ffff700 1 -- 172.21.15.125:0/3884477421 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590007310 con 0x7f359815cc80 2023-11-28T11:12:35.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.685+0000 7f359e043700 1 -- 172.21.15.125:0/3884477421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35980b20b0 con 0x7f359815cc80 2023-11-28T11:12:35.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.685+0000 7f359e043700 1 -- 172.21.15.125:0/3884477421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35980b1dd0 con 0x7f359815cc80 2023-11-28T11:12:35.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.686+0000 7f357ffff700 1 -- 172.21.15.125:0/3884477421 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f359001a030 con 0x7f359815cc80 2023-11-28T11:12:35.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.686+0000 7f357ffff700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35840682f0 0x7f358406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:35.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.686+0000 7f35977fe700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35840682f0 0x7f358406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:35.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.686+0000 7f357ffff700 1 -- 172.21.15.125:0/3884477421 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f3590085b80 con 0x7f359815cc80 2023-11-28T11:12:35.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.687+0000 7f35977fe700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35840682f0 0x7f358406a7a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f358c00a010 tx=0x7f358c013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:35.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.691+0000 7f357ffff700 1 -- 172.21.15.125:0/3884477421 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3590052260 con 0x7f359815cc80 2023-11-28T11:12:35.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.913+0000 7f359e043700 1 -- 172.21.15.125:0/3884477421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f359806e7e0 con 0x7f359815cc80 2023-11-28T11:12:35.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.913+0000 7f357ffff700 1 -- 172.21.15.125:0/3884477421 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f35900180c0 con 0x7f359815cc80 2023-11-28T11:12:35.914 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:35.914 INFO:teuthology.orchestra.run.smithi125.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:12:35.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 -- 172.21.15.125:0/3884477421 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35840682f0 msgr2=0x7f358406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:35.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35840682f0 0x7f358406a7a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f358c00a010 tx=0x7f358c013040 comp rx=0 tx=0).stop 2023-11-28T11:12:35.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 -- 172.21.15.125:0/3884477421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f359815cc80 msgr2=0x7f359815ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:35.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f359815cc80 0x7f359815ad70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f359000cc00 tx=0x7f359000a060 comp rx=0 tx=0).stop 2023-11-28T11:12:35.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 -- 172.21.15.125:0/3884477421 shutdown_connections 2023-11-28T11:12:35.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f359815cc80 0x7f359815ad70 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:35.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f35840682f0 0x7f358406a7a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:35.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f359806a270 0x7f35981531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:35.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 --2- 172.21.15.125:0/3884477421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f359806e3a0 0x7f359815a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:35.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 -- 172.21.15.125:0/3884477421 >> 172.21.15.125:0/3884477421 conn(0x7f359806c010 msgr2=0x7f35980b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:35.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 -- 172.21.15.125:0/3884477421 shutdown_connections 2023-11-28T11:12:35.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:35.915+0000 7f359e043700 1 -- 172.21.15.125:0/3884477421 wait complete. 2023-11-28T11:12:35.927 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=20 retry_count=0)... 2023-11-28T11:12:40.929 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:12:41.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.064+0000 7fcc37ce5700 1 Processor -- start 2023-11-28T11:12:41.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.064+0000 7fcc37ce5700 1 -- start start 2023-11-28T11:12:41.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.065+0000 7fcc37ce5700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc3015cc80 0x7fcc3006de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.065+0000 7fcc37ce5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc300b1810 con 0x7fcc3006e3a0 2023-11-28T11:12:41.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.065+0000 7fcc37ce5700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc300b1af0 con 0x7fcc3006a270 2023-11-28T11:12:41.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.065+0000 7fcc37ce5700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc300b2490 con 0x7fcc3015cc80 2023-11-28T11:12:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc36282700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcc3006e3a0 0x7fcc30070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45878/0 (socket says 172.21.15.125:45878) 2023-11-28T11:12:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc36282700 1 -- 172.21.15.125:0/151710542 learned_addr learned my addr 172.21.15.125:0/151710542 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc35280700 1 --2- 172.21.15.125:0/151710542 >> v2:172.21.15.167:3300/0 conn(0x7fcc3015cc80 0x7fcc3006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc34a7f700 1 -- 172.21.15.125:0/151710542 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6264625 0 0) 0x7fcc300b1810 con 0x7fcc3006e3a0 2023-11-28T11:12:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc34a7f700 1 -- 172.21.15.125:0/151710542 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc1c0035b0 con 0x7fcc3006e3a0 2023-11-28T11:12:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc35280700 1 -- 172.21.15.125:0/151710542 >> v1:172.21.15.167:6789/0 conn(0x7fcc3006a270 legacy=0x7fcc3006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc34a7f700 1 -- 172.21.15.125:0/151710542 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548247358 0 0) 0x7fcc1c0035b0 con 0x7fcc3006e3a0 2023-11-28T11:12:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc35280700 1 -- 172.21.15.125:0/151710542 >> v1:172.21.15.125:6789/0 conn(0x7fcc3006e3a0 legacy=0x7fcc30070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc35280700 1 -- 172.21.15.125:0/151710542 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc300b1dd0 con 0x7fcc3015cc80 2023-11-28T11:12:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc35280700 1 --2- 172.21.15.125:0/151710542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc3015cc80 0x7fcc3006de60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009840 tx=0x7fcc2c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3974b61d54ee7b43 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc34a7f700 1 -- 172.21.15.125:0/151710542 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280019f0 con 0x7fcc3015cc80 2023-11-28T11:12:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc34a7f700 1 -- 172.21.15.125:0/151710542 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c004030 con 0x7fcc3015cc80 2023-11-28T11:12:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.066+0000 7fcc34a7f700 1 -- 172.21.15.125:0/151710542 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0043c0 con 0x7fcc3015cc80 2023-11-28T11:12:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.067+0000 7fcc37ce5700 1 -- 172.21.15.125:0/151710542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc3015cc80 msgr2=0x7fcc3006de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.067+0000 7fcc37ce5700 1 --2- 172.21.15.125:0/151710542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc3015cc80 0x7fcc3006de60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009840 tx=0x7fcc2c009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.067+0000 7fcc37ce5700 1 -- 172.21.15.125:0/151710542 shutdown_connections 2023-11-28T11:12:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.067+0000 7fcc37ce5700 1 --2- 172.21.15.125:0/151710542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc3015cc80 0x7fcc3006de60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.067+0000 7fcc37ce5700 1 -- 172.21.15.125:0/151710542 >> 172.21.15.125:0/151710542 conn(0x7fcc3006c010 msgr2=0x7fcc300cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.067+0000 7fcc37ce5700 1 -- 172.21.15.125:0/151710542 shutdown_connections 2023-11-28T11:12:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.067+0000 7fcc37ce5700 1 -- 172.21.15.125:0/151710542 wait complete. 2023-11-28T11:12:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.069+0000 7fcc37ce5700 1 Processor -- start 2023-11-28T11:12:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.069+0000 7fcc37ce5700 1 -- start start 2023-11-28T11:12:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc37ce5700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc3006a270 0x7fcc3015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc37ce5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc3006e3a0 0x7fcc3015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc37ce5700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc3015cc80 0x7fcc300ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc37ce5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3015ae60 con 0x7fcc3006e3a0 2023-11-28T11:12:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc37ce5700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3015bce0 con 0x7fcc3006a270 2023-11-28T11:12:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc37ce5700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3015a830 con 0x7fcc3015cc80 2023-11-28T11:12:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc35280700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc3006e3a0 0x7fcc3015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc35280700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc3006e3a0 0x7fcc3015c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33526/0 (socket says 172.21.15.125:33526) 2023-11-28T11:12:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc35280700 1 -- 172.21.15.125:0/3080911447 learned_addr learned my addr 172.21.15.125:0/3080911447 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc35a81700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc3006a270 0x7fcc3015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc36282700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc3015cc80 0x7fcc300ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc35280700 1 -- 172.21.15.125:0/3080911447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc3015cc80 msgr2=0x7fcc300ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc35280700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc3015cc80 0x7fcc300ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc35280700 1 -- 172.21.15.125:0/3080911447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc3006a270 msgr2=0x7fcc3015b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc35280700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc3006a270 0x7fcc3015b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc35280700 1 -- 172.21.15.125:0/3080911447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c0094a0 con 0x7fcc3006e3a0 2023-11-28T11:12:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc35a81700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc3006a270 0x7fcc3015b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc35280700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc3006e3a0 0x7fcc3015c670 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009ea0 tx=0x7fcc2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc267fc700 1 -- 172.21.15.125:0/3080911447 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c010790 con 0x7fcc3006e3a0 2023-11-28T11:12:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc267fc700 1 -- 172.21.15.125:0/3080911447 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c010910 con 0x7fcc3006e3a0 2023-11-28T11:12:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc37ce5700 1 -- 172.21.15.125:0/3080911447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3006e7c0 con 0x7fcc3006e3a0 2023-11-28T11:12:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc267fc700 1 -- 172.21.15.125:0/3080911447 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c010cc0 con 0x7fcc3006e3a0 2023-11-28T11:12:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.070+0000 7fcc37ce5700 1 -- 172.21.15.125:0/3080911447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc300b20b0 con 0x7fcc3006e3a0 2023-11-28T11:12:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.071+0000 7fcc37ce5700 1 -- 172.21.15.125:0/3080911447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3006e950 con 0x7fcc3006e3a0 2023-11-28T11:12:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.073+0000 7fcc267fc700 1 -- 172.21.15.125:0/3080911447 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcc2c00f050 con 0x7fcc3006e3a0 2023-11-28T11:12:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.073+0000 7fcc267fc700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcc140682f0 0x7fcc1406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.073+0000 7fcc267fc700 1 -- 172.21.15.125:0/3080911447 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fcc2c087250 con 0x7fcc3006e3a0 2023-11-28T11:12:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.073+0000 7fcc35a81700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcc140682f0 0x7fcc1406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.073+0000 7fcc35a81700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcc140682f0 0x7fcc1406a7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcc20000f60 tx=0x7fcc20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.077+0000 7fcc267fc700 1 -- 172.21.15.125:0/3080911447 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fcc2c053ac0 con 0x7fcc3006e3a0 2023-11-28T11:12:41.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.300+0000 7fcc37ce5700 1 -- 172.21.15.125:0/3080911447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcc3015afa0 con 0x7fcc3006e3a0 2023-11-28T11:12:41.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.301+0000 7fcc267fc700 1 -- 172.21.15.125:0/3080911447 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fcc3015afa0 con 0x7fcc3006e3a0 2023-11-28T11:12:41.301 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:41.302 INFO:teuthology.orchestra.run.smithi125.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:12:41.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.302+0000 7fcc37ce5700 1 -- 172.21.15.125:0/3080911447 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcc140682f0 msgr2=0x7fcc1406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.302+0000 7fcc37ce5700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcc140682f0 0x7fcc1406a7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcc20000f60 tx=0x7fcc20009040 comp rx=0 tx=0).stop 2023-11-28T11:12:41.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.302+0000 7fcc37ce5700 1 -- 172.21.15.125:0/3080911447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc3006e3a0 msgr2=0x7fcc3015c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.302+0000 7fcc37ce5700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc3006e3a0 0x7fcc3015c670 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009ea0 tx=0x7fcc2c004750 comp rx=0 tx=0).stop 2023-11-28T11:12:41.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.302+0000 7fcc37ce5700 1 -- 172.21.15.125:0/3080911447 shutdown_connections 2023-11-28T11:12:41.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.302+0000 7fcc37ce5700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fcc140682f0 0x7fcc1406a7a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.302+0000 7fcc37ce5700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc3015cc80 0x7fcc300ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.302+0000 7fcc37ce5700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc3006a270 0x7fcc3015b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.302+0000 7fcc37ce5700 1 --2- 172.21.15.125:0/3080911447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc3006e3a0 0x7fcc3015c670 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.302+0000 7fcc37ce5700 1 -- 172.21.15.125:0/3080911447 >> 172.21.15.125:0/3080911447 conn(0x7fcc3006c010 msgr2=0x7fcc3006d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:41.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.303+0000 7fcc37ce5700 1 -- 172.21.15.125:0/3080911447 shutdown_connections 2023-11-28T11:12:41.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.303+0000 7fcc37ce5700 1 -- 172.21.15.125:0/3080911447 wait complete. 2023-11-28T11:12:41.315 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:12:41.315 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:12:41.352 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:12:41.397 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:12:41.397 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:12:41.398 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:12:41.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:12:41.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.574+0000 7f6376e13700 1 Processor -- start 2023-11-28T11:12:41.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.574+0000 7f6376e13700 1 -- start start 2023-11-28T11:12:41.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.575+0000 7f6376e13700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f63700b1770 0x7f63700b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.575+0000 7f6376e13700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637015e010 con 0x7f63700ce040 2023-11-28T11:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.575+0000 7f6376e13700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637013fc90 con 0x7f6370142db0 2023-11-28T11:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.575+0000 7f6376e13700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637013f480 con 0x7f63700b1770 2023-11-28T11:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.575+0000 7f6374baf700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f63700ce040 0x7f637015d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45888/0 (socket says 172.21.15.125:45888) 2023-11-28T11:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.575+0000 7f6374baf700 1 -- 172.21.15.125:0/2759132719 learned_addr learned my addr 172.21.15.125:0/2759132719 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f63753b0700 1 --2- 172.21.15.125:0/2759132719 >> v2:172.21.15.167:3300/0 conn(0x7f63700b1770 0x7f63700b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111063243 0 0) 0x7f6364001110 con 0x7f63700ce040 2023-11-28T11:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63600035b0 con 0x7f63700ce040 2023-11-28T11:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4006137264 0 0) 0x7f63600035b0 con 0x7f63700ce040 2023-11-28T11:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 >> v2:172.21.15.167:3300/0 conn(0x7f63700b1770 msgr2=0x7f63700b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:41.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 --2- 172.21.15.125:0/2759132719 >> v2:172.21.15.167:3300/0 conn(0x7f63700b1770 0x7f63700b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 >> v1:172.21.15.167:6789/0 conn(0x7f6370142db0 legacy=0x7f637013ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700b20d0 con 0x7f63700ce040 2023-11-28T11:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f6364001800 con 0x7f63700ce040 2023-11-28T11:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 >> v1:172.21.15.125:6789/0 conn(0x7f63700ce040 legacy=0x7f637015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 --2- 172.21.15.125:0/2759132719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6360003a00 0x7f6360003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 --2- 172.21.15.125:0/2759132719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 0x7f6360004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 --2- 172.21.15.125:0/2759132719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6360005200 0x7f636000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637013f480 con 0x7f6360004850 2023-11-28T11:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636000c080 con 0x7f6360005200 2023-11-28T11:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636000c240 con 0x7f6360003a00 2023-11-28T11:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636ffff700 1 --2- 172.21.15.125:0/2759132719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 0x7f6360004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f63753b0700 1 --2- 172.21.15.125:0/2759132719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6360005200 0x7f636000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f6374baf700 1 --2- 172.21.15.125:0/2759132719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6360003a00 0x7f6360003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636ffff700 1 -- 172.21.15.125:0/2759132719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6360003a00 msgr2=0x7f6360003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636ffff700 1 --2- 172.21.15.125:0/2759132719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6360003a00 0x7f6360003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636ffff700 1 -- 172.21.15.125:0/2759132719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6360005200 msgr2=0x7f636000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636ffff700 1 --2- 172.21.15.125:0/2759132719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6360005200 0x7f636000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636ffff700 1 -- 172.21.15.125:0/2759132719 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63600035b0 con 0x7f6360004850 2023-11-28T11:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f63753b0700 1 -- 172.21.15.125:0/2759132719 reap_dead start 2023-11-28T11:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.576+0000 7f636ffff700 1 --2- 172.21.15.125:0/2759132719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 0x7f6360004cc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f635c0017c0 tx=0x7f6360005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca587fbac6f4bb74 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.577+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0052d0 con 0x7f6360004850 2023-11-28T11:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.577+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c005450 con 0x7f6360004850 2023-11-28T11:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.577+0000 7f636f7fe700 1 -- 172.21.15.125:0/2759132719 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0038c0 con 0x7f6360004850 2023-11-28T11:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.577+0000 7f6376e13700 1 -- 172.21.15.125:0/2759132719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 msgr2=0x7f6360004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.577+0000 7f6376e13700 1 --2- 172.21.15.125:0/2759132719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 0x7f6360004cc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f635c0017c0 tx=0x7f6360005880 comp rx=0 tx=0).stop 2023-11-28T11:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.577+0000 7f6376e13700 1 -- 172.21.15.125:0/2759132719 shutdown_connections 2023-11-28T11:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.577+0000 7f6376e13700 1 --2- 172.21.15.125:0/2759132719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 0x7f6360004cc0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.577+0000 7f6376e13700 1 -- 172.21.15.125:0/2759132719 >> 172.21.15.125:0/2759132719 conn(0x7f637006c010 msgr2=0x7f63700cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.577+0000 7f6376e13700 1 -- 172.21.15.125:0/2759132719 shutdown_connections 2023-11-28T11:12:41.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.577+0000 7f6376e13700 1 -- 172.21.15.125:0/2759132719 wait complete. 2023-11-28T11:12:41.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.579+0000 7f6376e13700 1 Processor -- start 2023-11-28T11:12:41.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.579+0000 7f6376e13700 1 -- start start 2023-11-28T11:12:41.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6376e13700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 0x7f63700c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6376e13700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f637015c3d0 0x7f637013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6376e13700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63700b49c0 0x7f63700b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6376e13700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63700c8830 con 0x7f6360004850 2023-11-28T11:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6376e13700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63700b5380 con 0x7f63700b49c0 2023-11-28T11:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6376e13700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63700c9370 con 0x7f637015c3d0 2023-11-28T11:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6374baf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 0x7f63700c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6374baf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 0x7f63700c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33544/0 (socket says 172.21.15.125:33544) 2023-11-28T11:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6374baf700 1 -- 172.21.15.125:0/3977219411 learned_addr learned my addr 172.21.15.125:0/3977219411 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f63753b0700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63700b49c0 0x7f63700b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f636ffff700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f637015c3d0 0x7f637013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6374baf700 1 -- 172.21.15.125:0/3977219411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f637015c3d0 msgr2=0x7f637013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6374baf700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f637015c3d0 0x7f637013ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6374baf700 1 -- 172.21.15.125:0/3977219411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63700b49c0 msgr2=0x7f63700b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6374baf700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63700b49c0 0x7f63700b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6374baf700 1 -- 172.21.15.125:0/3977219411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637013f9b0 con 0x7f6360004850 2023-11-28T11:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f63753b0700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63700b49c0 0x7f63700b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.580+0000 7f6374baf700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 0x7f63700c9860 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f636400e780 tx=0x7f636400eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.581+0000 7f636d7fa700 1 -- 172.21.15.125:0/3977219411 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364012920 con 0x7f6360004850 2023-11-28T11:12:41.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.581+0000 7f636d7fa700 1 -- 172.21.15.125:0/3977219411 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6364012a80 con 0x7f6360004850 2023-11-28T11:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.581+0000 7f6376e13700 1 -- 172.21.15.125:0/3977219411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637013f6d0 con 0x7f6360004850 2023-11-28T11:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.581+0000 7f636d7fa700 1 -- 172.21.15.125:0/3977219411 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364012e30 con 0x7f6360004850 2023-11-28T11:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.581+0000 7f6376e13700 1 -- 172.21.15.125:0/3977219411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637015d100 con 0x7f6360004850 2023-11-28T11:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.582+0000 7f6376e13700 1 -- 172.21.15.125:0/3977219411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63700743f0 con 0x7f6360004850 2023-11-28T11:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.582+0000 7f636d7fa700 1 -- 172.21.15.125:0/3977219411 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6364011440 con 0x7f6360004850 2023-11-28T11:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.582+0000 7f636d7fa700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6354068320 0x7f635406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.583+0000 7f636ffff700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6354068320 0x7f635406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.583+0000 7f636d7fa700 1 -- 172.21.15.125:0/3977219411 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f6364087b80 con 0x7f6360004850 2023-11-28T11:12:41.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.583+0000 7f636ffff700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6354068320 0x7f635406a7d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f635c000c00 tx=0x7f635c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:41.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.587+0000 7f636d7fa700 1 -- 172.21.15.125:0/3977219411 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6364054270 con 0x7f6360004850 2023-11-28T11:12:41.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.769+0000 7f6376e13700 1 -- 172.21.15.125:0/3977219411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f637015e010 con 0x7f6360004850 2023-11-28T11:12:41.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.770+0000 7f636d7fa700 1 -- 172.21.15.125:0/3977219411 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f637015e010 con 0x7f6360004850 2023-11-28T11:12:41.771 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:41.772 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":68,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:12:20.977445+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:11:37.512888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T11:11:38.435309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.31","mappings":[{"from":7,"to":3}]},{"pgid":"10.35","mappings":[{"from":4,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:12:41.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 -- 172.21.15.125:0/3977219411 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6354068320 msgr2=0x7f635406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6354068320 0x7f635406a7d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f635c000c00 tx=0x7f635c009030 comp rx=0 tx=0).stop 2023-11-28T11:12:41.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 -- 172.21.15.125:0/3977219411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 msgr2=0x7f63700c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 0x7f63700c9860 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f636400e780 tx=0x7f636400eb40 comp rx=0 tx=0).stop 2023-11-28T11:12:41.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 -- 172.21.15.125:0/3977219411 shutdown_connections 2023-11-28T11:12:41.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63700b49c0 0x7f63700b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6360004850 0x7f63700c9860 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f6354068320 0x7f635406a7d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 --2- 172.21.15.125:0/3977219411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f637015c3d0 0x7f637013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 -- 172.21.15.125:0/3977219411 >> 172.21.15.125:0/3977219411 conn(0x7f637006c010 msgr2=0x7f63700cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:41.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 -- 172.21.15.125:0/3977219411 shutdown_connections 2023-11-28T11:12:41.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.773+0000 7f6376e13700 1 -- 172.21.15.125:0/3977219411 wait complete. 2023-11-28T11:12:41.786 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:11:37.512888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:11:38.435309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:12:41.786 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:12:41.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.908+0000 7f0baf9af700 1 Processor -- start 2023-11-28T11:12:41.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.908+0000 7f0baf9af700 1 -- start start 2023-11-28T11:12:41.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.909+0000 7f0baf9af700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba815c810 0x7f0ba8160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.909+0000 7f0baf9af700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0ba80718e0 0x7f0ba806c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.909+0000 7f0baf9af700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba81607a0 con 0x7f0ba806cdc0 2023-11-28T11:12:41.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.909+0000 7f0baf9af700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba815cbe0 con 0x7f0ba80718e0 2023-11-28T11:12:41.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.909+0000 7f0baf9af700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba8160a50 con 0x7f0ba815c810 2023-11-28T11:12:41.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.909+0000 7f0badf4c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0ba806cdc0 0x7f0ba806a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45912/0 (socket says 172.21.15.125:45912) 2023-11-28T11:12:41.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.909+0000 7f0badf4c700 1 -- 172.21.15.125:0/282001656 learned_addr learned my addr 172.21.15.125:0/282001656 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:41.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.909+0000 7f0bad74b700 1 --2- 172.21.15.125:0/282001656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba815c810 0x7f0ba8160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.909+0000 7f0bacf4a700 1 --2- 172.21.15.125:0/282001656 >> v2:172.21.15.167:3300/0 conn(0x7f0ba80718e0 0x7f0ba806c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.909+0000 7f0b9ffff700 1 -- 172.21.15.125:0/282001656 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817506264 0 0) 0x7f0ba81607a0 con 0x7f0ba806cdc0 2023-11-28T11:12:41.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.909+0000 7f0b9ffff700 1 -- 172.21.15.125:0/282001656 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b940035b0 con 0x7f0ba806cdc0 2023-11-28T11:12:41.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.910+0000 7f0bacf4a700 1 -- 172.21.15.125:0/282001656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba815c810 msgr2=0x7f0ba8160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:41.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.910+0000 7f0bacf4a700 1 --2- 172.21.15.125:0/282001656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba815c810 0x7f0ba8160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.910+0000 7f0b9ffff700 1 -- 172.21.15.125:0/282001656 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3739874859 0 0) 0x7f0b940035b0 con 0x7f0ba806cdc0 2023-11-28T11:12:41.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.910+0000 7f0bacf4a700 1 -- 172.21.15.125:0/282001656 >> v1:172.21.15.125:6789/0 conn(0x7f0ba806cdc0 legacy=0x7f0ba806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.910+0000 7f0bacf4a700 1 -- 172.21.15.125:0/282001656 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba8160d30 con 0x7f0ba80718e0 2023-11-28T11:12:41.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.910+0000 7f0bacf4a700 1 --2- 172.21.15.125:0/282001656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba80718e0 0x7f0ba806c880 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009840 tx=0x7f0ba4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=763b23eaf07b6473 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:41.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.910+0000 7f0b9ffff700 1 -- 172.21.15.125:0/282001656 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00019f0 con 0x7f0ba80718e0 2023-11-28T11:12:41.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.910+0000 7f0b9ffff700 1 -- 172.21.15.125:0/282001656 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba4004030 con 0x7f0ba80718e0 2023-11-28T11:12:41.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.910+0000 7f0b9ffff700 1 -- 172.21.15.125:0/282001656 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba40043a0 con 0x7f0ba80718e0 2023-11-28T11:12:41.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.910+0000 7f0baf9af700 1 -- 172.21.15.125:0/282001656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba80718e0 msgr2=0x7f0ba806c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.910+0000 7f0baf9af700 1 --2- 172.21.15.125:0/282001656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba80718e0 0x7f0ba806c880 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009840 tx=0x7f0ba4009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:41.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.911+0000 7f0baf9af700 1 -- 172.21.15.125:0/282001656 shutdown_connections 2023-11-28T11:12:41.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.911+0000 7f0baf9af700 1 --2- 172.21.15.125:0/282001656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba815c810 0x7f0ba8160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.911+0000 7f0baf9af700 1 --2- 172.21.15.125:0/282001656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba80718e0 0x7f0ba806c880 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.911+0000 7f0baf9af700 1 -- 172.21.15.125:0/282001656 >> 172.21.15.125:0/282001656 conn(0x7f0ba806c010 msgr2=0x7f0ba80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.911+0000 7f0baf9af700 1 -- 172.21.15.125:0/282001656 shutdown_connections 2023-11-28T11:12:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.911+0000 7f0baf9af700 1 -- 172.21.15.125:0/282001656 wait complete. 2023-11-28T11:12:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.912+0000 7f0baf9af700 1 Processor -- start 2023-11-28T11:12:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.912+0000 7f0baf9af700 1 -- start start 2023-11-28T11:12:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.912+0000 7f0baf9af700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba806cdc0 0x7f0ba81f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.912+0000 7f0baf9af700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba80718e0 0x7f0ba81f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.912+0000 7f0baf9af700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba815c810 0x7f0ba81f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.912+0000 7f0baf9af700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80c6330 con 0x7f0ba815c810 2023-11-28T11:12:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.912+0000 7f0baf9af700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba81f6630 con 0x7f0ba80718e0 2023-11-28T11:12:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.912+0000 7f0baf9af700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba81f6100 con 0x7f0ba806cdc0 2023-11-28T11:12:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0badf4c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba815c810 0x7f0ba81f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0badf4c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba815c810 0x7f0ba81f5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33562/0 (socket says 172.21.15.125:33562) 2023-11-28T11:12:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0badf4c700 1 -- 172.21.15.125:0/684067479 learned_addr learned my addr 172.21.15.125:0/684067479 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0bacf4a700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba80718e0 0x7f0ba81f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0bad74b700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba806cdc0 0x7f0ba81f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0badf4c700 1 -- 172.21.15.125:0/684067479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba806cdc0 msgr2=0x7f0ba81f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0badf4c700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba806cdc0 0x7f0ba81f1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0badf4c700 1 -- 172.21.15.125:0/684067479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba80718e0 msgr2=0x7f0ba81f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:41.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0badf4c700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba80718e0 0x7f0ba81f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:41.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0badf4c700 1 -- 172.21.15.125:0/684067479 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40094a0 con 0x7f0ba815c810 2023-11-28T11:12:41.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0bacf4a700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba80718e0 0x7f0ba81f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:41.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0badf4c700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba815c810 0x7f0ba81f5bc0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000cc20 tx=0x7f0ba000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:41.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0b9dffb700 1 -- 172.21.15.125:0/684067479 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba000abe0 con 0x7f0ba815c810 2023-11-28T11:12:41.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0b9dffb700 1 -- 172.21.15.125:0/684067479 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba000ad60 con 0x7f0ba815c810 2023-11-28T11:12:41.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0baf9af700 1 -- 172.21.15.125:0/684067479 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba80ceb20 con 0x7f0ba815c810 2023-11-28T11:12:41.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0b9dffb700 1 -- 172.21.15.125:0/684067479 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0007310 con 0x7f0ba815c810 2023-11-28T11:12:41.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.913+0000 7f0baf9af700 1 -- 172.21.15.125:0/684067479 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba8161010 con 0x7f0ba815c810 2023-11-28T11:12:41.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.914+0000 7f0baf9af700 1 -- 172.21.15.125:0/684067479 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba80ce740 con 0x7f0ba815c810 2023-11-28T11:12:41.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.915+0000 7f0b9dffb700 1 -- 172.21.15.125:0/684067479 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0ba001a030 con 0x7f0ba815c810 2023-11-28T11:12:41.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.915+0000 7f0b9dffb700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 0x7f0b8c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:41.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.915+0000 7f0b9dffb700 1 -- 172.21.15.125:0/684067479 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0ba0085ae0 con 0x7f0ba815c810 2023-11-28T11:12:41.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.915+0000 7f0bad74b700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 0x7f0b8c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:41.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.915+0000 7f0bad74b700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 0x7f0b8c06a7a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009a10 tx=0x7f0b98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:41.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:41.919+0000 7f0b9dffb700 1 -- 172.21.15.125:0/684067479 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0ba00522b0 con 0x7f0ba815c810 2023-11-28T11:12:42.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.102+0000 7f0baf9af700 1 -- 172.21.15.125:0/684067479 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ba80743f0 con 0x7f0ba815c810 2023-11-28T11:12:42.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.102+0000 7f0b9dffb700 1 -- 172.21.15.125:0/684067479 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ba00180a0 con 0x7f0ba815c810 2023-11-28T11:12:42.103 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:12:42.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.104+0000 7f0baf9af700 1 -- 172.21.15.125:0/684067479 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 msgr2=0x7f0b8c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.104+0000 7f0baf9af700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 0x7f0b8c06a7a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009a10 tx=0x7f0b98008040 comp rx=0 tx=0).stop 2023-11-28T11:12:42.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.104+0000 7f0baf9af700 1 -- 172.21.15.125:0/684067479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba815c810 msgr2=0x7f0ba81f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.104+0000 7f0baf9af700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba815c810 0x7f0ba81f5bc0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000cc20 tx=0x7f0ba000a060 comp rx=0 tx=0).stop 2023-11-28T11:12:42.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.104+0000 7f0baf9af700 1 -- 172.21.15.125:0/684067479 shutdown_connections 2023-11-28T11:12:42.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.104+0000 7f0baf9af700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba815c810 0x7f0ba81f5bc0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.104+0000 7f0baf9af700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f0b8c0682f0 0x7f0b8c06a7a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.104+0000 7f0baf9af700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba806cdc0 0x7f0ba81f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.104+0000 7f0baf9af700 1 --2- 172.21.15.125:0/684067479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba80718e0 0x7f0ba81f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.104+0000 7f0baf9af700 1 -- 172.21.15.125:0/684067479 >> 172.21.15.125:0/684067479 conn(0x7f0ba806c010 msgr2=0x7f0ba80cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:42.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.104+0000 7f0baf9af700 1 -- 172.21.15.125:0/684067479 shutdown_connections 2023-11-28T11:12:42.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.105+0000 7f0baf9af700 1 -- 172.21.15.125:0/684067479 wait complete. 2023-11-28T11:12:42.117 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:12:42.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.241+0000 7f276059d700 1 Processor -- start 2023-11-28T11:12:42.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.241+0000 7f276059d700 1 -- start start 2023-11-28T11:12:42.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.242+0000 7f276059d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f275815a5f0 0x7f27580d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.242+0000 7f276059d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f27580b2ee0 0x7f27580ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.242+0000 7f276059d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275815a9c0 con 0x7f27580cc200 2023-11-28T11:12:42.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.242+0000 7f276059d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580c7b80 con 0x7f27580b2ee0 2023-11-28T11:12:42.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.242+0000 7f276059d700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580cc990 con 0x7f275815a5f0 2023-11-28T11:12:42.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.242+0000 7f275eb3a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f27580b2ee0 0x7f27580ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.242+0000 7f275db38700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f27580cc200 0x7f27580b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45922/0 (socket says 172.21.15.125:45922) 2023-11-28T11:12:42.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.242+0000 7f275db38700 1 -- 172.21.15.125:0/690287179 learned_addr learned my addr 172.21.15.125:0/690287179 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:42.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f275e339700 1 --2- 172.21.15.125:0/690287179 >> v2:172.21.15.167:3300/0 conn(0x7f275815a5f0 0x7f27580d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f275eb3a700 1 -- 172.21.15.125:0/690287179 >> v2:172.21.15.167:3300/0 conn(0x7f275815a5f0 msgr2=0x7f27580d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:42.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f275eb3a700 1 --2- 172.21.15.125:0/690287179 >> v2:172.21.15.167:3300/0 conn(0x7f275815a5f0 0x7f27580d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f275eb3a700 1 -- 172.21.15.125:0/690287179 >> v1:172.21.15.125:6789/0 conn(0x7f27580cc200 legacy=0x7f27580b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f275eb3a700 1 -- 172.21.15.125:0/690287179 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580ccc70 con 0x7f27580b2ee0 2023-11-28T11:12:42.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f275d337700 1 -- 172.21.15.125:0/690287179 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546554432 0 0) 0x7f275815a9c0 con 0x7f27580cc200 2023-11-28T11:12:42.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f275e339700 1 --2- 172.21.15.125:0/690287179 >> v2:172.21.15.167:3300/0 conn(0x7f275815a5f0 0x7f27580d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:42.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f275eb3a700 1 --2- 172.21.15.125:0/690287179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27580b2ee0 0x7f27580ced30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f27580d1d40 tx=0x7f275000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8112625bb7a790e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:42.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f275d337700 1 -- 172.21.15.125:0/690287179 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275000e070 con 0x7f27580b2ee0 2023-11-28T11:12:42.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f275d337700 1 -- 172.21.15.125:0/690287179 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275000bbd0 con 0x7f27580b2ee0 2023-11-28T11:12:42.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f275d337700 1 -- 172.21.15.125:0/690287179 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750012430 con 0x7f27580b2ee0 2023-11-28T11:12:42.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f276059d700 1 -- 172.21.15.125:0/690287179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27580b2ee0 msgr2=0x7f27580ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.243+0000 7f276059d700 1 --2- 172.21.15.125:0/690287179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27580b2ee0 0x7f27580ced30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f27580d1d40 tx=0x7f275000b330 comp rx=0 tx=0).stop 2023-11-28T11:12:42.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.244+0000 7f276059d700 1 -- 172.21.15.125:0/690287179 shutdown_connections 2023-11-28T11:12:42.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.244+0000 7f276059d700 1 --2- 172.21.15.125:0/690287179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27580b2ee0 0x7f27580ced30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.244+0000 7f276059d700 1 --2- 172.21.15.125:0/690287179 >> v2:172.21.15.167:3300/0 conn(0x7f275815a5f0 0x7f27580d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.244+0000 7f276059d700 1 -- 172.21.15.125:0/690287179 >> 172.21.15.125:0/690287179 conn(0x7f275806ea80 msgr2=0x7f275806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:42.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.244+0000 7f276059d700 1 -- 172.21.15.125:0/690287179 shutdown_connections 2023-11-28T11:12:42.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.244+0000 7f276059d700 1 -- 172.21.15.125:0/690287179 wait complete. 2023-11-28T11:12:42.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.245+0000 7f276059d700 1 Processor -- start 2023-11-28T11:12:42.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.245+0000 7f276059d700 1 -- start start 2023-11-28T11:12:42.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.245+0000 7f276059d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27580b2ee0 0x7f275814e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.245+0000 7f276059d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580cc200 0x7f27580c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.245+0000 7f276059d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f275815a5f0 0x7f27580c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f276059d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27580c7e00 con 0x7f275815a5f0 2023-11-28T11:12:42.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f276059d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27580c8c60 con 0x7f27580cc200 2023-11-28T11:12:42.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f276059d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275814e770 con 0x7f27580b2ee0 2023-11-28T11:12:42.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275eb3a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f275815a5f0 0x7f27580c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275eb3a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f275815a5f0 0x7f27580c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33576/0 (socket says 172.21.15.125:33576) 2023-11-28T11:12:42.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275eb3a700 1 -- 172.21.15.125:0/2064409845 learned_addr learned my addr 172.21.15.125:0/2064409845 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:42.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275db38700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580cc200 0x7f27580c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275e339700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27580b2ee0 0x7f275814e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275eb3a700 1 -- 172.21.15.125:0/2064409845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27580b2ee0 msgr2=0x7f275814e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275eb3a700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27580b2ee0 0x7f275814e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275eb3a700 1 -- 172.21.15.125:0/2064409845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580cc200 msgr2=0x7f27580c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275eb3a700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580cc200 0x7f27580c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275eb3a700 1 -- 172.21.15.125:0/2064409845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750009a70 con 0x7f275815a5f0 2023-11-28T11:12:42.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275db38700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580cc200 0x7f27580c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:42.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f275eb3a700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f275815a5f0 0x7f27580c9b00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f275000b370 tx=0x7f2750004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:42.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f274effd700 1 -- 172.21.15.125:0/2064409845 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750012430 con 0x7f275815a5f0 2023-11-28T11:12:42.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f274effd700 1 -- 172.21.15.125:0/2064409845 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750020070 con 0x7f275815a5f0 2023-11-28T11:12:42.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f274effd700 1 -- 172.21.15.125:0/2064409845 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750004280 con 0x7f275815a5f0 2023-11-28T11:12:42.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f276059d700 1 -- 172.21.15.125:0/2064409845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27580cd230 con 0x7f275815a5f0 2023-11-28T11:12:42.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.246+0000 7f276059d700 1 -- 172.21.15.125:0/2064409845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27580ccf50 con 0x7f275815a5f0 2023-11-28T11:12:42.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.247+0000 7f276059d700 1 -- 172.21.15.125:0/2064409845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27580cd510 con 0x7f275815a5f0 2023-11-28T11:12:42.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.248+0000 7f274effd700 1 -- 172.21.15.125:0/2064409845 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f275002e070 con 0x7f275815a5f0 2023-11-28T11:12:42.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.248+0000 7f274effd700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f273c0682f0 0x7f273c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.248+0000 7f274effd700 1 -- 172.21.15.125:0/2064409845 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f2750022070 con 0x7f275815a5f0 2023-11-28T11:12:42.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.248+0000 7f275e339700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f273c0682f0 0x7f273c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.248+0000 7f275e339700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f273c0682f0 0x7f273c06a7a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2748006fd0 tx=0x7f2748008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:42.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.252+0000 7f274effd700 1 -- 172.21.15.125:0/2064409845 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f27500543c0 con 0x7f275815a5f0 2023-11-28T11:12:42.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.436+0000 7f276059d700 1 -- 172.21.15.125:0/2064409845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f27580743f0 con 0x7f275815a5f0 2023-11-28T11:12:42.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.436+0000 7f274effd700 1 -- 172.21.15.125:0/2064409845 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f275002c020 con 0x7f275815a5f0 2023-11-28T11:12:42.437 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:12:42.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 -- 172.21.15.125:0/2064409845 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f273c0682f0 msgr2=0x7f273c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f273c0682f0 0x7f273c06a7a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2748006fd0 tx=0x7f2748008040 comp rx=0 tx=0).stop 2023-11-28T11:12:42.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 -- 172.21.15.125:0/2064409845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f275815a5f0 msgr2=0x7f27580c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f275815a5f0 0x7f27580c9b00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f275000b370 tx=0x7f2750004ad0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 -- 172.21.15.125:0/2064409845 shutdown_connections 2023-11-28T11:12:42.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f275815a5f0 0x7f27580c9b00 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f273c0682f0 0x7f273c06a7a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27580b2ee0 0x7f275814e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 --2- 172.21.15.125:0/2064409845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580cc200 0x7f27580c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 -- 172.21.15.125:0/2064409845 >> 172.21.15.125:0/2064409845 conn(0x7f275806ea80 msgr2=0x7f2758154f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:42.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 -- 172.21.15.125:0/2064409845 shutdown_connections 2023-11-28T11:12:42.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.438+0000 7f276059d700 1 -- 172.21.15.125:0/2064409845 wait complete. 2023-11-28T11:12:42.450 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:12:42.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.573+0000 7f39c5c4d700 1 Processor -- start 2023-11-28T11:12:42.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.573+0000 7f39c5c4d700 1 -- start start 2023-11-28T11:12:42.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.573+0000 7f39c5c4d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39c00718e0 0x7f39c006c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.573+0000 7f39c5c4d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39c006cdc0 0x7f39c006a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.573+0000 7f39c5c4d700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c0160a50 con 0x7f39c015c810 2023-11-28T11:12:42.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.573+0000 7f39c5c4d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c015cbe0 con 0x7f39c00718e0 2023-11-28T11:12:42.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.573+0000 7f39c5c4d700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c0160d30 con 0x7f39c006cdc0 2023-11-28T11:12:42.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39beffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39c00718e0 0x7f39c006c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39beffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39c00718e0 0x7f39c006c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33582/0 (socket says 172.21.15.125:33582) 2023-11-28T11:12:42.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39beffd700 1 -- 172.21.15.125:0/3554357280 learned_addr learned my addr 172.21.15.125:0/3554357280 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:42.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39bffff700 1 --2- 172.21.15.125:0/3554357280 >> v2:172.21.15.167:3300/0 conn(0x7f39c006cdc0 0x7f39c006a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39beffd700 1 -- 172.21.15.125:0/3554357280 >> v2:172.21.15.167:3300/0 conn(0x7f39c006cdc0 msgr2=0x7f39c006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:42.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39beffd700 1 --2- 172.21.15.125:0/3554357280 >> v2:172.21.15.167:3300/0 conn(0x7f39c006cdc0 0x7f39c006a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39beffd700 1 -- 172.21.15.125:0/3554357280 >> v1:172.21.15.167:6789/0 conn(0x7f39c015c810 legacy=0x7f39c0160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39beffd700 1 -- 172.21.15.125:0/3554357280 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0161010 con 0x7f39c00718e0 2023-11-28T11:12:42.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39beffd700 1 --2- 172.21.15.125:0/3554357280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39c00718e0 0x7f39c006c880 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f39a80098f0 tx=0x7f39a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb6179d90bbcd79 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:42.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39be7fc700 1 -- 172.21.15.125:0/3554357280 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8011830 con 0x7f39c00718e0 2023-11-28T11:12:42.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39be7fc700 1 -- 172.21.15.125:0/3554357280 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8011990 con 0x7f39c00718e0 2023-11-28T11:12:42.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.574+0000 7f39be7fc700 1 -- 172.21.15.125:0/3554357280 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8011d20 con 0x7f39c00718e0 2023-11-28T11:12:42.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.575+0000 7f39c5c4d700 1 -- 172.21.15.125:0/3554357280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39c00718e0 msgr2=0x7f39c006c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.575+0000 7f39c5c4d700 1 --2- 172.21.15.125:0/3554357280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39c00718e0 0x7f39c006c880 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f39a80098f0 tx=0x7f39a8009c00 comp rx=0 tx=0).stop 2023-11-28T11:12:42.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.575+0000 7f39c5c4d700 1 -- 172.21.15.125:0/3554357280 shutdown_connections 2023-11-28T11:12:42.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.575+0000 7f39c5c4d700 1 --2- 172.21.15.125:0/3554357280 >> v2:172.21.15.167:3300/0 conn(0x7f39c006cdc0 0x7f39c006a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.575+0000 7f39c5c4d700 1 --2- 172.21.15.125:0/3554357280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39c00718e0 0x7f39c006c880 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.575+0000 7f39c5c4d700 1 -- 172.21.15.125:0/3554357280 >> 172.21.15.125:0/3554357280 conn(0x7f39c006c010 msgr2=0x7f39c00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:42.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.575+0000 7f39c5c4d700 1 -- 172.21.15.125:0/3554357280 shutdown_connections 2023-11-28T11:12:42.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.575+0000 7f39c5c4d700 1 -- 172.21.15.125:0/3554357280 wait complete. 2023-11-28T11:12:42.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.576+0000 7f39c5c4d700 1 Processor -- start 2023-11-28T11:12:42.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.576+0000 7f39c5c4d700 1 -- start start 2023-11-28T11:12:42.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39c5c4d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39c006cdc0 0x7f39c014fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39c5c4d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c00718e0 0x7f39c00ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39c5c4d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c015c810 0x7f39c00adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39c5c4d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c0150160 con 0x7f39c006cdc0 2023-11-28T11:12:42.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39c5c4d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00b2aa0 con 0x7f39c015c810 2023-11-28T11:12:42.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39c5c4d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00b2d80 con 0x7f39c00718e0 2023-11-28T11:12:42.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39bf7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39c006cdc0 0x7f39c014fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39bf7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39c006cdc0 0x7f39c014fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33586/0 (socket says 172.21.15.125:33586) 2023-11-28T11:12:42.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39bf7fe700 1 -- 172.21.15.125:0/1039051303 learned_addr learned my addr 172.21.15.125:0/1039051303 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:42.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39beffd700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c00718e0 0x7f39c00ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39bffff700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c015c810 0x7f39c00adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39bf7fe700 1 -- 172.21.15.125:0/1039051303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c00718e0 msgr2=0x7f39c00ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39bf7fe700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c00718e0 0x7f39c00ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39bf7fe700 1 -- 172.21.15.125:0/1039051303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c015c810 msgr2=0x7f39c00adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39bf7fe700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c015c810 0x7f39c00adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39bf7fe700 1 -- 172.21.15.125:0/1039051303 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a8009550 con 0x7f39c006cdc0 2023-11-28T11:12:42.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39bffff700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c015c810 0x7f39c00adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:42.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.577+0000 7f39bf7fe700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39c006cdc0 0x7f39c014fc20 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c450 tx=0x7f39b000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:42.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.578+0000 7f39b7fff700 1 -- 172.21.15.125:0/1039051303 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00052d0 con 0x7f39c006cdc0 2023-11-28T11:12:42.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.578+0000 7f39b7fff700 1 -- 172.21.15.125:0/1039051303 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b0005430 con 0x7f39c006cdc0 2023-11-28T11:12:42.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.578+0000 7f39c5c4d700 1 -- 172.21.15.125:0/1039051303 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c00ce740 con 0x7f39c006cdc0 2023-11-28T11:12:42.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.578+0000 7f39b7fff700 1 -- 172.21.15.125:0/1039051303 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00038c0 con 0x7f39c006cdc0 2023-11-28T11:12:42.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.578+0000 7f39c5c4d700 1 -- 172.21.15.125:0/1039051303 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c00ceb20 con 0x7f39c006cdc0 2023-11-28T11:12:42.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.579+0000 7f39c5c4d700 1 -- 172.21.15.125:0/1039051303 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c00ce8d0 con 0x7f39c006cdc0 2023-11-28T11:12:42.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.579+0000 7f39b7fff700 1 -- 172.21.15.125:0/1039051303 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f39b0019030 con 0x7f39c006cdc0 2023-11-28T11:12:42.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.579+0000 7f39b7fff700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39a00682f0 0x7f39a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.579+0000 7f39b7fff700 1 -- 172.21.15.125:0/1039051303 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f39b0084f10 con 0x7f39c006cdc0 2023-11-28T11:12:42.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.580+0000 7f39beffd700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39a00682f0 0x7f39a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.580+0000 7f39beffd700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39a00682f0 0x7f39a006a7a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f39a8000c00 tx=0x7f39a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:42.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.584+0000 7f39b7fff700 1 -- 172.21.15.125:0/1039051303 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f39b00516e0 con 0x7f39c006cdc0 2023-11-28T11:12:42.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.766+0000 7f39c5c4d700 1 -- 172.21.15.125:0/1039051303 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39c00cfab0 con 0x7f39c006cdc0 2023-11-28T11:12:42.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.766+0000 7f39b7fff700 1 -- 172.21.15.125:0/1039051303 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39b0054d00 con 0x7f39c006cdc0 2023-11-28T11:12:42.767 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:12:42.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.768+0000 7f39c5c4d700 1 -- 172.21.15.125:0/1039051303 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39a00682f0 msgr2=0x7f39a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.769+0000 7f39c5c4d700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39a00682f0 0x7f39a006a7a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f39a8000c00 tx=0x7f39a8008030 comp rx=0 tx=0).stop 2023-11-28T11:12:42.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.769+0000 7f39c5c4d700 1 -- 172.21.15.125:0/1039051303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39c006cdc0 msgr2=0x7f39c014fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.769+0000 7f39c5c4d700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39c006cdc0 0x7f39c014fc20 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c450 tx=0x7f39b000c810 comp rx=0 tx=0).stop 2023-11-28T11:12:42.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.769+0000 7f39c5c4d700 1 -- 172.21.15.125:0/1039051303 shutdown_connections 2023-11-28T11:12:42.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.769+0000 7f39c5c4d700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c015c810 0x7f39c00adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.769+0000 7f39c5c4d700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39c006cdc0 0x7f39c014fc20 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.769+0000 7f39c5c4d700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f39a00682f0 0x7f39a006a7a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.769+0000 7f39c5c4d700 1 --2- 172.21.15.125:0/1039051303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c00718e0 0x7f39c00ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.769+0000 7f39c5c4d700 1 -- 172.21.15.125:0/1039051303 >> 172.21.15.125:0/1039051303 conn(0x7f39c006c010 msgr2=0x7f39c00d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:42.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.769+0000 7f39c5c4d700 1 -- 172.21.15.125:0/1039051303 shutdown_connections 2023-11-28T11:12:42.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.769+0000 7f39c5c4d700 1 -- 172.21.15.125:0/1039051303 wait complete. 2023-11-28T11:12:42.781 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:12:42.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.903+0000 7f449ab9d700 1 Processor -- start 2023-11-28T11:12:42.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.904+0000 7f449ab9d700 1 -- start start 2023-11-28T11:12:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.904+0000 7f449ab9d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f449415a070 0x7f449406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.904+0000 7f449ab9d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406a980 0x7f449415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.904+0000 7f449ab9d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449406e9b0 con 0x7f449406e330 2023-11-28T11:12:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.904+0000 7f449ab9d700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449415b930 con 0x7f449415a070 2023-11-28T11:12:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.904+0000 7f449ab9d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449406e7a0 con 0x7f449406a980 2023-11-28T11:12:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f449939a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f449406e330 0x7f449406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45950/0 (socket says 172.21.15.125:45950) 2023-11-28T11:12:42.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f449939a700 1 -- 172.21.15.125:0/2128832939 learned_addr learned my addr 172.21.15.125:0/2128832939 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:42.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f449a39c700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406a980 0x7f449415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4499b9b700 1 --2- 172.21.15.125:0/2128832939 >> v2:172.21.15.167:3300/0 conn(0x7f449415a070 0x7f449406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128986247 0 0) 0x7f449406e9b0 con 0x7f449406e330 2023-11-28T11:12:42.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44800035b0 con 0x7f449406e330 2023-11-28T11:12:42.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3984470387 0 0) 0x7f44800035b0 con 0x7f449406e330 2023-11-28T11:12:42.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406a980 msgr2=0x7f449415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:42.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406a980 0x7f449415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 >> v2:172.21.15.167:3300/0 conn(0x7f449415a070 msgr2=0x7f449406ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:42.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 --2- 172.21.15.125:0/2128832939 >> v2:172.21.15.167:3300/0 conn(0x7f449415a070 0x7f449406ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449406ec90 con 0x7f449406e330 2023-11-28T11:12:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f4490001670 con 0x7f449406e330 2023-11-28T11:12:42.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 >> v1:172.21.15.125:6789/0 conn(0x7f449406e330 legacy=0x7f449406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 0x7f4480003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406a980 0x7f4480004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4480004d90 0x7f4480005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449415b930 con 0x7f4480003a00 2023-11-28T11:12:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449406e7a0 con 0x7f4480004d90 2023-11-28T11:12:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448000ba10 con 0x7f449406a980 2023-11-28T11:12:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4499b9b700 1 --2- 172.21.15.125:0/2128832939 >> v2:172.21.15.167:3300/0 conn(0x7f449415a070 0x7f449406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:12:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f4499b9b700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 0x7f4480003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f449a39c700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4480004d90 0x7f4480005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.905+0000 7f449939a700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406a980 0x7f4480004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f4499b9b700 1 -- 172.21.15.125:0/2128832939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406a980 msgr2=0x7f4480004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f4499b9b700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406a980 0x7f4480004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f4499b9b700 1 -- 172.21.15.125:0/2128832939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4480004d90 msgr2=0x7f4480005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f4499b9b700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4480004d90 0x7f4480005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f4499b9b700 1 -- 172.21.15.125:0/2128832939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44800035b0 con 0x7f4480003a00 2023-11-28T11:12:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f4499b9b700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 0x7f4480003e30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4484009d10 tx=0x7f4480005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2c0e27dbfe6250 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484009e60 con 0x7f4480003a00 2023-11-28T11:12:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4484004030 con 0x7f4480003a00 2023-11-28T11:12:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f4498b99700 1 -- 172.21.15.125:0/2128832939 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840043a0 con 0x7f4480003a00 2023-11-28T11:12:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f449ab9d700 1 -- 172.21.15.125:0/2128832939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 msgr2=0x7f4480003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f449ab9d700 1 --2- 172.21.15.125:0/2128832939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 0x7f4480003e30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4484009d10 tx=0x7f4480005880 comp rx=0 tx=0).stop 2023-11-28T11:12:42.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f449a39c700 1 -- 172.21.15.125:0/2128832939 reap_dead start 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f449ab9d700 1 -- 172.21.15.125:0/2128832939 shutdown_connections 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.906+0000 7f449ab9d700 1 -- 172.21.15.125:0/2128832939 >> 172.21.15.125:0/2128832939 conn(0x7f44940b15e0 msgr2=0x7f44940b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.907+0000 7f449ab9d700 1 -- 172.21.15.125:0/2128832939 shutdown_connections 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.907+0000 7f449ab9d700 1 -- 172.21.15.125:0/2128832939 wait complete. 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.908+0000 7f449ab9d700 1 Processor -- start 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.908+0000 7f449ab9d700 1 -- start start 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.908+0000 7f449ab9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 0x7f44941ef300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.908+0000 7f449ab9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44940c3500 0x7f44940c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.908+0000 7f449ab9d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44940b4bf0 0x7f44940b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.908+0000 7f449ab9d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940c4c00 con 0x7f4480003a00 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.908+0000 7f449ab9d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940b55a0 con 0x7f44940c3500 2023-11-28T11:12:42.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.908+0000 7f449ab9d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44941ef840 con 0x7f44940b4bf0 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f4499b9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 0x7f44941ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f4499b9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 0x7f44941ef300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33606/0 (socket says 172.21.15.125:33606) 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f4499b9b700 1 -- 172.21.15.125:0/416654803 learned_addr learned my addr 172.21.15.125:0/416654803 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f449939a700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44940c3500 0x7f44940c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f449a39c700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44940b4bf0 0x7f44940b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f4499b9b700 1 -- 172.21.15.125:0/416654803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44940b4bf0 msgr2=0x7f44940b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f4499b9b700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44940b4bf0 0x7f44940b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f4499b9b700 1 -- 172.21.15.125:0/416654803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44940c3500 msgr2=0x7f44940c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f4499b9b700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44940c3500 0x7f44940c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f4499b9b700 1 -- 172.21.15.125:0/416654803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449406f250 con 0x7f4480003a00 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f4499b9b700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 0x7f44941ef300 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f448400e790 tx=0x7f44840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:42.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f448a7fc700 1 -- 172.21.15.125:0/416654803 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484021070 con 0x7f4480003a00 2023-11-28T11:12:42.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f448a7fc700 1 -- 172.21.15.125:0/416654803 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4484004590 con 0x7f4480003a00 2023-11-28T11:12:42.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f449ab9d700 1 -- 172.21.15.125:0/416654803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449406ef70 con 0x7f4480003a00 2023-11-28T11:12:42.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f448a7fc700 1 -- 172.21.15.125:0/416654803 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484003ad0 con 0x7f4480003a00 2023-11-28T11:12:42.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.909+0000 7f449ab9d700 1 -- 172.21.15.125:0/416654803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449415df80 con 0x7f4480003a00 2023-11-28T11:12:42.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.910+0000 7f449ab9d700 1 -- 172.21.15.125:0/416654803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44940678c0 con 0x7f4480003a00 2023-11-28T11:12:42.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.911+0000 7f448a7fc700 1 -- 172.21.15.125:0/416654803 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f448402d030 con 0x7f4480003a00 2023-11-28T11:12:42.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.911+0000 7f448a7fc700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f44780682f0 0x7f447806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:42.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.911+0000 7f448a7fc700 1 -- 172.21.15.125:0/416654803 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4484087000 con 0x7f4480003a00 2023-11-28T11:12:42.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.911+0000 7f449939a700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f44780682f0 0x7f447806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:42.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.911+0000 7f449939a700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f44780682f0 0x7f447806a7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4490001050 tx=0x7f4490007980 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:42.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:42.915+0000 7f448a7fc700 1 -- 172.21.15.125:0/416654803 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f44840537d0 con 0x7f4480003a00 2023-11-28T11:12:43.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.104+0000 7f449ab9d700 1 -- 172.21.15.125:0/416654803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4494070dd0 con 0x7f4480003a00 2023-11-28T11:12:43.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.105+0000 7f448a7fc700 1 -- 172.21.15.125:0/416654803 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4484056df0 con 0x7f4480003a00 2023-11-28T11:12:43.105 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:12:43.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.106+0000 7f449ab9d700 1 -- 172.21.15.125:0/416654803 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f44780682f0 msgr2=0x7f447806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:43.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.106+0000 7f449ab9d700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f44780682f0 0x7f447806a7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4490001050 tx=0x7f4490007980 comp rx=0 tx=0).stop 2023-11-28T11:12:43.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.106+0000 7f449ab9d700 1 -- 172.21.15.125:0/416654803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 msgr2=0x7f44941ef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:43.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.107+0000 7f449ab9d700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 0x7f44941ef300 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f448400e790 tx=0x7f44840047c0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.107+0000 7f449ab9d700 1 -- 172.21.15.125:0/416654803 shutdown_connections 2023-11-28T11:12:43.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.107+0000 7f449ab9d700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f44780682f0 0x7f447806a7a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.107+0000 7f449ab9d700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44940b4bf0 0x7f44940b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.107+0000 7f449ab9d700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4480003a00 0x7f44941ef300 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.107+0000 7f449ab9d700 1 --2- 172.21.15.125:0/416654803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44940c3500 0x7f44940c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.107+0000 7f449ab9d700 1 -- 172.21.15.125:0/416654803 >> 172.21.15.125:0/416654803 conn(0x7f44940b15e0 msgr2=0x7f4494157c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:43.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.107+0000 7f449ab9d700 1 -- 172.21.15.125:0/416654803 shutdown_connections 2023-11-28T11:12:43.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.107+0000 7f449ab9d700 1 -- 172.21.15.125:0/416654803 wait complete. 2023-11-28T11:12:43.119 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:12:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.240+0000 7f88f8651700 1 Processor -- start 2023-11-28T11:12:43.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.241+0000 7f88f8651700 1 -- start start 2023-11-28T11:12:43.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.241+0000 7f88f8651700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88f00ae850 0x7f88f006c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.241+0000 7f88f8651700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f88f006c980 0x7f88f0070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f8651700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f00cbcc0 con 0x7f88f0158e10 2023-11-28T11:12:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f8651700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f006ac30 con 0x7f88f006c980 2023-11-28T11:12:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f8651700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f006ce00 con 0x7f88f00ae850 2023-11-28T11:12:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f6bee700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f88f006c980 0x7f88f0070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f6bee700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f88f006c980 0x7f88f0070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33618/0 (socket says 172.21.15.125:33618) 2023-11-28T11:12:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f6bee700 1 -- 172.21.15.125:0/782162583 learned_addr learned my addr 172.21.15.125:0/782162583 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f5bec700 1 --2- 172.21.15.125:0/782162583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88f00ae850 0x7f88f006c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f6bee700 1 -- 172.21.15.125:0/782162583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88f00ae850 msgr2=0x7f88f006c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f6bee700 1 --2- 172.21.15.125:0/782162583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88f00ae850 0x7f88f006c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f6bee700 1 -- 172.21.15.125:0/782162583 >> v1:172.21.15.167:6789/0 conn(0x7f88f0158e10 legacy=0x7f88f00cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f6bee700 1 -- 172.21.15.125:0/782162583 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f00ca140 con 0x7f88f006c980 2023-11-28T11:12:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f6bee700 1 --2- 172.21.15.125:0/782162583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88f006c980 0x7f88f0070370 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009e50 tx=0x7f88e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34968d683de212f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f53eb700 1 -- 172.21.15.125:0/782162583 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800e070 con 0x7f88f006c980 2023-11-28T11:12:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f53eb700 1 -- 172.21.15.125:0/782162583 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e8003a20 con 0x7f88f006c980 2023-11-28T11:12:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.242+0000 7f88f53eb700 1 -- 172.21.15.125:0/782162583 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8003dd0 con 0x7f88f006c980 2023-11-28T11:12:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.243+0000 7f88f8651700 1 -- 172.21.15.125:0/782162583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88f006c980 msgr2=0x7f88f0070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.243+0000 7f88f8651700 1 --2- 172.21.15.125:0/782162583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88f006c980 0x7f88f0070370 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009e50 tx=0x7f88e800b330 comp rx=0 tx=0).stop 2023-11-28T11:12:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.243+0000 7f88f8651700 1 -- 172.21.15.125:0/782162583 shutdown_connections 2023-11-28T11:12:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.243+0000 7f88f8651700 1 --2- 172.21.15.125:0/782162583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88f006c980 0x7f88f0070370 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.243+0000 7f88f8651700 1 --2- 172.21.15.125:0/782162583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88f00ae850 0x7f88f006c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.243+0000 7f88f8651700 1 -- 172.21.15.125:0/782162583 >> 172.21.15.125:0/782162583 conn(0x7f88f00cf400 msgr2=0x7f88f00cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.243+0000 7f88f8651700 1 -- 172.21.15.125:0/782162583 shutdown_connections 2023-11-28T11:12:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.243+0000 7f88f8651700 1 -- 172.21.15.125:0/782162583 wait complete. 2023-11-28T11:12:43.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.244+0000 7f88f8651700 1 Processor -- start 2023-11-28T11:12:43.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.244+0000 7f88f8651700 1 -- start start 2023-11-28T11:12:43.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f8651700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88f006c980 0x7f88f01e2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f8651700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88f00ae850 0x7f88f0152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f8651700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88f0158e10 0x7f88f01f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f8651700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0159260 con 0x7f88f00ae850 2023-11-28T11:12:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f8651700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0152770 con 0x7f88f0158e10 2023-11-28T11:12:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f8651700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f01e3240 con 0x7f88f006c980 2023-11-28T11:12:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f5bec700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88f00ae850 0x7f88f0152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f5bec700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88f00ae850 0x7f88f0152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33624/0 (socket says 172.21.15.125:33624) 2023-11-28T11:12:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f5bec700 1 -- 172.21.15.125:0/2582423373 learned_addr learned my addr 172.21.15.125:0/2582423373 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f63ed700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88f006c980 0x7f88f01e2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f6bee700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88f0158e10 0x7f88f01f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f5bec700 1 -- 172.21.15.125:0/2582423373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88f006c980 msgr2=0x7f88f01e2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f5bec700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88f006c980 0x7f88f01e2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f5bec700 1 -- 172.21.15.125:0/2582423373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88f0158e10 msgr2=0x7f88f01f3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f5bec700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88f0158e10 0x7f88f01f3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f5bec700 1 -- 172.21.15.125:0/2582423373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8009b30 con 0x7f88f00ae850 2023-11-28T11:12:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.245+0000 7f88f5bec700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88f00ae850 0x7f88f0152230 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00c7f0 tx=0x7f88ec00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.246+0000 7f88e6ffd700 1 -- 172.21.15.125:0/2582423373 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec004220 con 0x7f88f00ae850 2023-11-28T11:12:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.246+0000 7f88e6ffd700 1 -- 172.21.15.125:0/2582423373 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec004380 con 0x7f88f00ae850 2023-11-28T11:12:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.246+0000 7f88f8651700 1 -- 172.21.15.125:0/2582423373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f00c9e60 con 0x7f88f00ae850 2023-11-28T11:12:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.246+0000 7f88e6ffd700 1 -- 172.21.15.125:0/2582423373 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0036a0 con 0x7f88f00ae850 2023-11-28T11:12:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.246+0000 7f88f8651700 1 -- 172.21.15.125:0/2582423373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f00c9b80 con 0x7f88f00ae850 2023-11-28T11:12:43.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.247+0000 7f88f8651700 1 -- 172.21.15.125:0/2582423373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f006ae20 con 0x7f88f00ae850 2023-11-28T11:12:43.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.247+0000 7f88e6ffd700 1 -- 172.21.15.125:0/2582423373 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f88ec020070 con 0x7f88f00ae850 2023-11-28T11:12:43.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.247+0000 7f88e6ffd700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f88d40682f0 0x7f88d406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:43.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.247+0000 7f88f63ed700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f88d40682f0 0x7f88d406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:43.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.248+0000 7f88e6ffd700 1 -- 172.21.15.125:0/2582423373 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f88ec085720 con 0x7f88f00ae850 2023-11-28T11:12:43.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.248+0000 7f88f63ed700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f88d40682f0 0x7f88d406a7a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009960 tx=0x7f88e00090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:43.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.252+0000 7f88e6ffd700 1 -- 172.21.15.125:0/2582423373 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f88ec051ef0 con 0x7f88f00ae850 2023-11-28T11:12:43.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.449+0000 7f88f8651700 1 -- 172.21.15.125:0/2582423373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f88f00743f0 con 0x7f88f00ae850 2023-11-28T11:12:43.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.450+0000 7f88e6ffd700 1 -- 172.21.15.125:0/2582423373 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) v1 ==== 80+0+0 (secure 0 0 0) 0x7f88ec055510 con 0x7f88f00ae850 2023-11-28T11:12:43.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 -- 172.21.15.125:0/2582423373 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f88d40682f0 msgr2=0x7f88d406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:43.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f88d40682f0 0x7f88d406a7a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009960 tx=0x7f88e00090e0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 -- 172.21.15.125:0/2582423373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88f00ae850 msgr2=0x7f88f0152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:43.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88f00ae850 0x7f88f0152230 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00c7f0 tx=0x7f88ec00cb00 comp rx=0 tx=0).stop 2023-11-28T11:12:43.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 -- 172.21.15.125:0/2582423373 shutdown_connections 2023-11-28T11:12:43.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88f0158e10 0x7f88f01f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f88d40682f0 0x7f88d406a7a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88f006c980 0x7f88f01e2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 --2- 172.21.15.125:0/2582423373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88f00ae850 0x7f88f0152230 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:43.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 -- 172.21.15.125:0/2582423373 >> 172.21.15.125:0/2582423373 conn(0x7f88f00cf400 msgr2=0x7f88f0154870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:43.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 -- 172.21.15.125:0/2582423373 shutdown_connections 2023-11-28T11:12:43.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:43.452+0000 7f88f8651700 1 -- 172.21.15.125:0/2582423373 wait complete. 2023-11-28T11:12:43.454 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-11-28T11:12:43.464 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-11-28T11:12:43.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:43.464 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T11:12:43.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[127318]: fuse finished with error 0 and tester_r 0 2023-11-28T11:12:43.502 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:12:43.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:43.503 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:12:43.672 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:12:43.672 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:12:43.691 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:12:43.691 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:12:43.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:43.692 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T11:12:43.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:12:43.749 INFO:teuthology.orchestra.run.smithi167.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T11:12:43.750 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:12:43.750 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:12:43.768 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16093 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T11:12:43.768 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:12:43.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:43.768 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T11:12:43.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:12:43.825 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T11:12:43.826 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:12:43.826 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:12:43.844 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:12:43.844 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:12:43.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:43.844 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T11:12:43.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:12:43.905 INFO:teuthology.orchestra.run.smithi167.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T11:12:43.905 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:12:44.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.024+0000 7f3ec9052700 1 Processor -- start 2023-11-28T11:12:44.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.024+0000 7f3ec9052700 1 -- start start 2023-11-28T11:12:44.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec9052700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ec415cc80 0x7f3ec406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec9052700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3ec406e3a0 0x7f3ec4070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec9052700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec40b1810 con 0x7f3ec406a270 2023-11-28T11:12:44.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec9052700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec40b2490 con 0x7f3ec415cc80 2023-11-28T11:12:44.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec9052700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec40b1af0 con 0x7f3ec406e3a0 2023-11-28T11:12:44.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ec415cc80 0x7f3ec406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec2d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3ec406a270 0x7f3ec406a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45984/0 (socket says 172.21.15.125:45984) 2023-11-28T11:12:44.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec2d9d700 1 -- 172.21.15.125:0/3747992605 learned_addr learned my addr 172.21.15.125:0/3747992605 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:44.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec359e700 1 --2- 172.21.15.125:0/3747992605 >> v2:172.21.15.167:3300/0 conn(0x7f3ec406e3a0 0x7f3ec4070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec259c700 1 -- 172.21.15.125:0/3747992605 >> v2:172.21.15.167:3300/0 conn(0x7f3ec406e3a0 msgr2=0x7f3ec4070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:44.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec259c700 1 --2- 172.21.15.125:0/3747992605 >> v2:172.21.15.167:3300/0 conn(0x7f3ec406e3a0 0x7f3ec4070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec259c700 1 -- 172.21.15.125:0/3747992605 >> v1:172.21.15.125:6789/0 conn(0x7f3ec406a270 legacy=0x7f3ec406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec259c700 1 -- 172.21.15.125:0/3747992605 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec40b1dd0 con 0x7f3ec415cc80 2023-11-28T11:12:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.025+0000 7f3ec1d9b700 1 -- 172.21.15.125:0/3747992605 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687877509 0 0) 0x7f3ec40b1810 con 0x7f3ec406a270 2023-11-28T11:12:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec259c700 1 --2- 172.21.15.125:0/3747992605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ec415cc80 0x7f3ec406de60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3ec406ee30 tx=0x7f3eb4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf965dbf73737d47 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec1d9b700 1 -- 172.21.15.125:0/3747992605 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4011830 con 0x7f3ec415cc80 2023-11-28T11:12:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec1d9b700 1 -- 172.21.15.125:0/3747992605 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb4011990 con 0x7f3ec415cc80 2023-11-28T11:12:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec1d9b700 1 -- 172.21.15.125:0/3747992605 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4011d20 con 0x7f3ec415cc80 2023-11-28T11:12:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec9052700 1 -- 172.21.15.125:0/3747992605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ec415cc80 msgr2=0x7f3ec406de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec9052700 1 --2- 172.21.15.125:0/3747992605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ec415cc80 0x7f3ec406de60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3ec406ee30 tx=0x7f3eb4009b20 comp rx=0 tx=0).stop 2023-11-28T11:12:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec9052700 1 -- 172.21.15.125:0/3747992605 shutdown_connections 2023-11-28T11:12:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec9052700 1 --2- 172.21.15.125:0/3747992605 >> v2:172.21.15.167:3300/0 conn(0x7f3ec406e3a0 0x7f3ec4070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec9052700 1 --2- 172.21.15.125:0/3747992605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ec415cc80 0x7f3ec406de60 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec9052700 1 -- 172.21.15.125:0/3747992605 >> 172.21.15.125:0/3747992605 conn(0x7f3ec406c010 msgr2=0x7f3ec40cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:44.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec9052700 1 -- 172.21.15.125:0/3747992605 shutdown_connections 2023-11-28T11:12:44.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.026+0000 7f3ec9052700 1 -- 172.21.15.125:0/3747992605 wait complete. 2023-11-28T11:12:44.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.028+0000 7f3ec9052700 1 Processor -- start 2023-11-28T11:12:44.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.028+0000 7f3ec9052700 1 -- start start 2023-11-28T11:12:44.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.028+0000 7f3ec9052700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec406a270 0x7f3ec41532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.028+0000 7f3ec9052700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec406e3a0 0x7f3ec40c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.028+0000 7f3ec9052700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ec415cc80 0x7f3ec40c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.028+0000 7f3ec9052700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40b3560 con 0x7f3ec415cc80 2023-11-28T11:12:44.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.028+0000 7f3ec9052700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40c9ff0 con 0x7f3ec406a270 2023-11-28T11:12:44.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.028+0000 7f3ec9052700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4153800 con 0x7f3ec406e3a0 2023-11-28T11:12:44.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ec415cc80 0x7f3ec40c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ec415cc80 0x7f3ec40c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33638/0 (socket says 172.21.15.125:33638) 2023-11-28T11:12:44.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec359e700 1 -- 172.21.15.125:0/1328886381 learned_addr learned my addr 172.21.15.125:0/1328886381 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:44.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec259c700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec406e3a0 0x7f3ec40c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec2d9d700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec406a270 0x7f3ec41532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec359e700 1 -- 172.21.15.125:0/1328886381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec406e3a0 msgr2=0x7f3ec40c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec359e700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec406e3a0 0x7f3ec40c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec359e700 1 -- 172.21.15.125:0/1328886381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec406a270 msgr2=0x7f3ec41532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec359e700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec406a270 0x7f3ec41532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec359e700 1 -- 172.21.15.125:0/1328886381 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40094a0 con 0x7f3ec415cc80 2023-11-28T11:12:44.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec2d9d700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec406a270 0x7f3ec41532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:44.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec359e700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ec415cc80 0x7f3ec40c97b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc007e40 tx=0x7f3ebc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:44.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3eab7fe700 1 -- 172.21.15.125:0/1328886381 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00ede0 con 0x7f3ec415cc80 2023-11-28T11:12:44.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3eab7fe700 1 -- 172.21.15.125:0/1328886381 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc014420 con 0x7f3ec415cc80 2023-11-28T11:12:44.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec9052700 1 -- 172.21.15.125:0/1328886381 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec406e7c0 con 0x7f3ec415cc80 2023-11-28T11:12:44.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3eab7fe700 1 -- 172.21.15.125:0/1328886381 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0147d0 con 0x7f3ec415cc80 2023-11-28T11:12:44.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.029+0000 7f3ec9052700 1 -- 172.21.15.125:0/1328886381 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec40b20b0 con 0x7f3ec415cc80 2023-11-28T11:12:44.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.030+0000 7f3ec9052700 1 -- 172.21.15.125:0/1328886381 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec406e950 con 0x7f3ec415cc80 2023-11-28T11:12:44.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.031+0000 7f3eab7fe700 1 -- 172.21.15.125:0/1328886381 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3ebc012050 con 0x7f3ec415cc80 2023-11-28T11:12:44.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.031+0000 7f3eab7fe700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb00682f0 0x7f3eb006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.031+0000 7f3eab7fe700 1 -- 172.21.15.125:0/1328886381 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f3ebc086350 con 0x7f3ec415cc80 2023-11-28T11:12:44.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.031+0000 7f3ec2d9d700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb00682f0 0x7f3eb006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.031+0000 7f3ec2d9d700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb00682f0 0x7f3eb006a7a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8000f60 tx=0x7f3eb8007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:44.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.035+0000 7f3eab7fe700 1 -- 172.21.15.125:0/1328886381 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3ec406e950 con 0x7f3ec415cc80 2023-11-28T11:12:44.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.260+0000 7f3ec9052700 1 -- 172.21.15.125:0/1328886381 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ec406e950 con 0x7f3ec415cc80 2023-11-28T11:12:44.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.261+0000 7f3eab7fe700 1 -- 172.21.15.125:0/1328886381 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4661 (secure 0 0 0) 0x7f3ec406e950 con 0x7f3ec415cc80 2023-11-28T11:12:44.262 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:44.262 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5710,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3518974696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3518974696},{"type":"v1","addr":"172.21.15.167:6834","nonce":3518974696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/2475008501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2475008501},{"type":"v1","addr":"172.21.15.125:6836","nonce":2475008501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2392518832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":2392518832},{"type":"v1","addr":"172.21.15.125:6837","nonce":2392518832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:11:39.473096+0000","modified":"2023-11-28T11:11:51.944585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":6,"addr":"172.21.15.167:6835/1701437437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1701437437},{"type":"v1","addr":"172.21.15.167:6835","nonce":1701437437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:12:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.262+0000 7f3ec9052700 1 -- 172.21.15.125:0/1328886381 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb00682f0 msgr2=0x7f3eb006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.262+0000 7f3ec9052700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb00682f0 0x7f3eb006a7a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8000f60 tx=0x7f3eb8007d30 comp rx=0 tx=0).stop 2023-11-28T11:12:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.262+0000 7f3ec9052700 1 -- 172.21.15.125:0/1328886381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ec415cc80 msgr2=0x7f3ec40c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.262+0000 7f3ec9052700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ec415cc80 0x7f3ec40c97b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc007e40 tx=0x7f3ebc00e3c0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.262+0000 7f3ec9052700 1 -- 172.21.15.125:0/1328886381 shutdown_connections 2023-11-28T11:12:44.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.262+0000 7f3ec9052700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ec415cc80 0x7f3ec40c97b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.262+0000 7f3ec9052700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec406a270 0x7f3ec41532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.262+0000 7f3ec9052700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f3eb00682f0 0x7f3eb006a7a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.262+0000 7f3ec9052700 1 --2- 172.21.15.125:0/1328886381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec406e3a0 0x7f3ec40c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.263+0000 7f3ec9052700 1 -- 172.21.15.125:0/1328886381 >> 172.21.15.125:0/1328886381 conn(0x7f3ec406c010 msgr2=0x7f3ec40aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:44.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.263+0000 7f3ec9052700 1 -- 172.21.15.125:0/1328886381 shutdown_connections 2023-11-28T11:12:44.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.263+0000 7f3ec9052700 1 -- 172.21.15.125:0/1328886381 wait complete. 2023-11-28T11:12:44.265 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 32 2023-11-28T11:12:44.275 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:12:44.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.395+0000 7fe595375700 1 Processor -- start 2023-11-28T11:12:44.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.395+0000 7fe595375700 1 -- start start 2023-11-28T11:12:44.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.395+0000 7fe595375700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe5900cd5a0 0x7fe5900cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.395+0000 7fe595375700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900d1ee0 con 0x7fe5900b22a0 2023-11-28T11:12:44.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.395+0000 7fe595375700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900cdb10 con 0x7fe59006ab10 2023-11-28T11:12:44.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.395+0000 7fe595375700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5900d1890 con 0x7fe5900cd5a0 2023-11-28T11:12:44.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.396+0000 7fe58e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe5900cd5a0 0x7fe5900cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.396+0000 7fe58f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe5900b22a0 0x7fe5900cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46002/0 (socket says 172.21.15.125:46002) 2023-11-28T11:12:44.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.396+0000 7fe58f7fe700 1 -- 172.21.15.125:0/3872105379 learned_addr learned my addr 172.21.15.125:0/3872105379 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:44.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.396+0000 7fe58e7fc700 1 -- 172.21.15.125:0/3872105379 >> v1:172.21.15.167:6789/0 conn(0x7fe59006ab10 legacy=0x7fe59006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.396+0000 7fe58e7fc700 1 -- 172.21.15.125:0/3872105379 >> v1:172.21.15.125:6789/0 conn(0x7fe5900b22a0 legacy=0x7fe5900cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.396+0000 7fe58e7fc700 1 -- 172.21.15.125:0/3872105379 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900d1b70 con 0x7fe5900cd5a0 2023-11-28T11:12:44.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.396+0000 7fe58dffb700 1 -- 172.21.15.125:0/3872105379 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160461789 0 0) 0x7fe5900d1ee0 con 0x7fe5900b22a0 2023-11-28T11:12:44.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.396+0000 7fe58e7fc700 1 --2- 172.21.15.125:0/3872105379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5900cd5a0 0x7fe5900cf440 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe580009840 tx=0x7fe580009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9626cb194128b16 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:44.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.396+0000 7fe58dffb700 1 -- 172.21.15.125:0/3872105379 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580011830 con 0x7fe5900cd5a0 2023-11-28T11:12:44.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.396+0000 7fe58dffb700 1 -- 172.21.15.125:0/3872105379 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe580011990 con 0x7fe5900cd5a0 2023-11-28T11:12:44.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.396+0000 7fe58dffb700 1 -- 172.21.15.125:0/3872105379 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580011d20 con 0x7fe5900cd5a0 2023-11-28T11:12:44.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.397+0000 7fe595375700 1 -- 172.21.15.125:0/3872105379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5900cd5a0 msgr2=0x7fe5900cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.397+0000 7fe595375700 1 --2- 172.21.15.125:0/3872105379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5900cd5a0 0x7fe5900cf440 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe580009840 tx=0x7fe580009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:44.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.397+0000 7fe595375700 1 -- 172.21.15.125:0/3872105379 shutdown_connections 2023-11-28T11:12:44.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.397+0000 7fe595375700 1 --2- 172.21.15.125:0/3872105379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5900cd5a0 0x7fe5900cf440 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.397+0000 7fe595375700 1 -- 172.21.15.125:0/3872105379 >> 172.21.15.125:0/3872105379 conn(0x7fe59006c520 msgr2=0x7fe59006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:44.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.397+0000 7fe595375700 1 -- 172.21.15.125:0/3872105379 shutdown_connections 2023-11-28T11:12:44.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.397+0000 7fe595375700 1 -- 172.21.15.125:0/3872105379 wait complete. 2023-11-28T11:12:44.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.398+0000 7fe595375700 1 Processor -- start 2023-11-28T11:12:44.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.398+0000 7fe595375700 1 -- start start 2023-11-28T11:12:44.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe595375700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe59006ab10 0x7fe5900cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe595375700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5900b22a0 0x7fe5900c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe595375700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5900cd5a0 0x7fe5901f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe595375700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5901f6930 con 0x7fe5900b22a0 2023-11-28T11:12:44.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe595375700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900c81d0 con 0x7fe59006ab10 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe595375700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900c84b0 con 0x7fe5900cd5a0 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe58e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5900b22a0 0x7fe5900c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe58e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5900b22a0 0x7fe5900c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33650/0 (socket says 172.21.15.125:33650) 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe58e7fc700 1 -- 172.21.15.125:0/918207462 learned_addr learned my addr 172.21.15.125:0/918207462 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe58effd700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe59006ab10 0x7fe5900cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe58f7fe700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5900cd5a0 0x7fe5901f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe58e7fc700 1 -- 172.21.15.125:0/918207462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5900cd5a0 msgr2=0x7fe5901f63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe58e7fc700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5900cd5a0 0x7fe5901f63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe58e7fc700 1 -- 172.21.15.125:0/918207462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe59006ab10 msgr2=0x7fe5900cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe58e7fc700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe59006ab10 0x7fe5900cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe58e7fc700 1 -- 172.21.15.125:0/918207462 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5800094a0 con 0x7fe5900b22a0 2023-11-28T11:12:44.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe58e7fc700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5900b22a0 0x7fe5900c7ad0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe580014040 tx=0x7fe580004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:44.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.399+0000 7fe5877fe700 1 -- 172.21.15.125:0/918207462 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58001a860 con 0x7fe5900b22a0 2023-11-28T11:12:44.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.400+0000 7fe5877fe700 1 -- 172.21.15.125:0/918207462 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58001a9c0 con 0x7fe5900b22a0 2023-11-28T11:12:44.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.400+0000 7fe595375700 1 -- 172.21.15.125:0/918207462 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5900b1ec0 con 0x7fe5900b22a0 2023-11-28T11:12:44.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.400+0000 7fe5877fe700 1 -- 172.21.15.125:0/918207462 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58001ad50 con 0x7fe5900b22a0 2023-11-28T11:12:44.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.400+0000 7fe595375700 1 -- 172.21.15.125:0/918207462 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59015cad0 con 0x7fe5900b22a0 2023-11-28T11:12:44.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.401+0000 7fe595375700 1 -- 172.21.15.125:0/918207462 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5900b2050 con 0x7fe5900b22a0 2023-11-28T11:12:44.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.401+0000 7fe5877fe700 1 -- 172.21.15.125:0/918207462 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe58002b030 con 0x7fe5900b22a0 2023-11-28T11:12:44.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.401+0000 7fe5877fe700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe5700682f0 0x7fe57006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.401+0000 7fe5877fe700 1 -- 172.21.15.125:0/918207462 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fe580086f20 con 0x7fe5900b22a0 2023-11-28T11:12:44.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.401+0000 7fe58effd700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe5700682f0 0x7fe57006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.402+0000 7fe58effd700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe5700682f0 0x7fe57006a7a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe578007fd0 tx=0x7fe578009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:44.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.405+0000 7fe5877fe700 1 -- 172.21.15.125:0/918207462 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe5800b85e0 con 0x7fe5900b22a0 2023-11-28T11:12:44.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.594+0000 7fe595375700 1 -- 172.21.15.125:0/918207462 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5900743f0 con 0x7fe5900b22a0 2023-11-28T11:12:44.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.595+0000 7fe5877fe700 1 -- 172.21.15.125:0/918207462 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18209 (secure 0 0 0) 0x7fe580029090 con 0x7fe5900b22a0 2023-11-28T11:12:44.596 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:44.596 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":68,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:12:20.977445+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:11:37.512888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T11:11:38.435309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.31","mappings":[{"from":7,"to":3}]},{"pgid":"10.35","mappings":[{"from":4,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:12:44.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 -- 172.21.15.125:0/918207462 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe5700682f0 msgr2=0x7fe57006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe5700682f0 0x7fe57006a7a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe578007fd0 tx=0x7fe578009040 comp rx=0 tx=0).stop 2023-11-28T11:12:44.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 -- 172.21.15.125:0/918207462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5900b22a0 msgr2=0x7fe5900c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5900b22a0 0x7fe5900c7ad0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe580014040 tx=0x7fe580004750 comp rx=0 tx=0).stop 2023-11-28T11:12:44.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 -- 172.21.15.125:0/918207462 shutdown_connections 2023-11-28T11:12:44.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe5700682f0 0x7fe57006a7a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5900cd5a0 0x7fe5901f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe59006ab10 0x7fe5900cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 --2- 172.21.15.125:0/918207462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5900b22a0 0x7fe5900c7ad0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 -- 172.21.15.125:0/918207462 >> 172.21.15.125:0/918207462 conn(0x7fe59006c520 msgr2=0x7fe5900b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:44.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 -- 172.21.15.125:0/918207462 shutdown_connections 2023-11-28T11:12:44.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.597+0000 7fe595375700 1 -- 172.21.15.125:0/918207462 wait complete. 2023-11-28T11:12:44.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:08:25.663356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:08:30.568881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:11:37.512888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:11:38.435309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:12:44.611 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:12:44.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.733+0000 7fe15faa2700 1 Processor -- start 2023-11-28T11:12:44.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.733+0000 7fe15faa2700 1 -- start start 2023-11-28T11:12:44.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15faa2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1580d0ad0 0x7fe1580cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15faa2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1580cc740 con 0x7fe1580b2ee0 2023-11-28T11:12:44.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15faa2700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15815a9c0 con 0x7fe15815a5f0 2023-11-28T11:12:44.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15faa2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580c7b80 con 0x7fe1580d0ad0 2023-11-28T11:12:44.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15d03d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe1580b2ee0 0x7fe1580ced30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46014/0 (socket says 172.21.15.125:46014) 2023-11-28T11:12:44.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15d03d700 1 -- 172.21.15.125:0/627427242 learned_addr learned my addr 172.21.15.125:0/627427242 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:44.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927890098 0 0) 0x7fe1580cc740 con 0x7fe1580b2ee0 2023-11-28T11:12:44.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1440035b0 con 0x7fe1580b2ee0 2023-11-28T11:12:44.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15e03f700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1580d0ad0 0x7fe1580cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048239775 0 0) 0x7fe1440035b0 con 0x7fe1580b2ee0 2023-11-28T11:12:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1580d0ad0 msgr2=0x7fe1580cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1580d0ad0 0x7fe1580cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 >> v1:172.21.15.167:6789/0 conn(0x7fe15815a5f0 legacy=0x7fe1580b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1580cc990 con 0x7fe1580b2ee0 2023-11-28T11:12:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fe154001670 con 0x7fe1580b2ee0 2023-11-28T11:12:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 >> v1:172.21.15.125:6789/0 conn(0x7fe1580b2ee0 legacy=0x7fe1580ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1580d0ad0 0x7fe144003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe144004060 0x7fe144004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe144004d90 0x7fe144005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580c7b80 con 0x7fe144004d90 2023-11-28T11:12:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14400bba0 con 0x7fe144004060 2023-11-28T11:12:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14400bd60 con 0x7fe1580d0ad0 2023-11-28T11:12:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.734+0000 7fe15e03f700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe144004d90 0x7fe144005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15d83e700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1580d0ad0 0x7fe144003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15d03d700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe144004060 0x7fe144004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15e03f700 1 -- 172.21.15.125:0/627427242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1580d0ad0 msgr2=0x7fe144003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15e03f700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1580d0ad0 0x7fe144003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15e03f700 1 -- 172.21.15.125:0/627427242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe144004060 msgr2=0x7fe144004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15e03f700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe144004060 0x7fe144004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15e03f700 1 -- 172.21.15.125:0/627427242 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1440035b0 con 0x7fe144004d90 2023-11-28T11:12:44.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15e03f700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe144004d90 0x7fe144005200 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe150007360 tx=0x7fe144005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e855ef972275471a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:44.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150007e80 con 0x7fe144004d90 2023-11-28T11:12:44.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150014400 con 0x7fe144004d90 2023-11-28T11:12:44.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15c83c700 1 -- 172.21.15.125:0/627427242 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150014790 con 0x7fe144004d90 2023-11-28T11:12:44.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15faa2700 1 -- 172.21.15.125:0/627427242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe144004d90 msgr2=0x7fe144005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15faa2700 1 --2- 172.21.15.125:0/627427242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe144004d90 0x7fe144005200 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe150007360 tx=0x7fe144005880 comp rx=0 tx=0).stop 2023-11-28T11:12:44.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.735+0000 7fe15e03f700 1 -- 172.21.15.125:0/627427242 reap_dead start 2023-11-28T11:12:44.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.736+0000 7fe15faa2700 1 -- 172.21.15.125:0/627427242 shutdown_connections 2023-11-28T11:12:44.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.736+0000 7fe15faa2700 1 -- 172.21.15.125:0/627427242 >> 172.21.15.125:0/627427242 conn(0x7fe15806ea80 msgr2=0x7fe15806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:44.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.736+0000 7fe15faa2700 1 -- 172.21.15.125:0/627427242 shutdown_connections 2023-11-28T11:12:44.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.736+0000 7fe15faa2700 1 -- 172.21.15.125:0/627427242 wait complete. 2023-11-28T11:12:44.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.737+0000 7fe15faa2700 1 Processor -- start 2023-11-28T11:12:44.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.737+0000 7fe15faa2700 1 -- start start 2023-11-28T11:12:44.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15faa2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1580c6a50 0x7fe15815c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15faa2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158156850 0x7fe1580b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15faa2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe158156cc0 0x7fe1580b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15faa2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe158148ef0 con 0x7fe1580c6a50 2023-11-28T11:12:44.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15faa2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15815ae60 con 0x7fe158156850 2023-11-28T11:12:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15faa2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1581482e0 con 0x7fe158156cc0 2023-11-28T11:12:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15d83e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1580c6a50 0x7fe15815c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15d83e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1580c6a50 0x7fe15815c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33668/0 (socket says 172.21.15.125:33668) 2023-11-28T11:12:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15d83e700 1 -- 172.21.15.125:0/1122021337 learned_addr learned my addr 172.21.15.125:0/1122021337 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15e03f700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe158156cc0 0x7fe1580b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15d03d700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158156850 0x7fe1580b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15d83e700 1 -- 172.21.15.125:0/1122021337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe158156cc0 msgr2=0x7fe1580b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15d83e700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe158156cc0 0x7fe1580b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15d83e700 1 -- 172.21.15.125:0/1122021337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158156850 msgr2=0x7fe1580b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15d83e700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158156850 0x7fe1580b57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15d83e700 1 -- 172.21.15.125:0/1122021337 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1580ccf50 con 0x7fe1580c6a50 2023-11-28T11:12:44.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15d03d700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158156850 0x7fe1580b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:44.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15d83e700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1580c6a50 0x7fe15815c6b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe14800f850 tx=0x7fe14800fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:44.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe14e7fc700 1 -- 172.21.15.125:0/1122021337 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148017070 con 0x7fe1580c6a50 2023-11-28T11:12:44.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe14e7fc700 1 -- 172.21.15.125:0/1122021337 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1480052e0 con 0x7fe1580c6a50 2023-11-28T11:12:44.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15faa2700 1 -- 172.21.15.125:0/1122021337 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1580ccc70 con 0x7fe1580c6a50 2023-11-28T11:12:44.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe14e7fc700 1 -- 172.21.15.125:0/1122021337 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148005490 con 0x7fe1580c6a50 2023-11-28T11:12:44.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.738+0000 7fe15faa2700 1 -- 172.21.15.125:0/1122021337 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1580cd230 con 0x7fe1580c6a50 2023-11-28T11:12:44.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.739+0000 7fe15faa2700 1 -- 172.21.15.125:0/1122021337 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1580743f0 con 0x7fe1580c6a50 2023-11-28T11:12:44.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.739+0000 7fe14e7fc700 1 -- 172.21.15.125:0/1122021337 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe148006860 con 0x7fe1580c6a50 2023-11-28T11:12:44.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.740+0000 7fe14e7fc700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe13c068320 0x7fe13c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:44.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.740+0000 7fe14e7fc700 1 -- 172.21.15.125:0/1122021337 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fe1480854b0 con 0x7fe1580c6a50 2023-11-28T11:12:44.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.740+0000 7fe15d03d700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe13c068320 0x7fe13c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:44.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.740+0000 7fe15d03d700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe13c068320 0x7fe13c06a7d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe15815c4a0 tx=0x7fe154009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:44.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.744+0000 7fe14e7fc700 1 -- 172.21.15.125:0/1122021337 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe148051c80 con 0x7fe1580c6a50 2023-11-28T11:12:44.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.926+0000 7fe15faa2700 1 -- 172.21.15.125:0/1122021337 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe15806ab80 con 0x7fe1580c6a50 2023-11-28T11:12:44.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.926+0000 7fe14e7fc700 1 -- 172.21.15.125:0/1122021337 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1480552a0 con 0x7fe1580c6a50 2023-11-28T11:12:44.927 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-11-28T11:12:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.928+0000 7fe15faa2700 1 -- 172.21.15.125:0/1122021337 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe13c068320 msgr2=0x7fe13c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.928+0000 7fe15faa2700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe13c068320 0x7fe13c06a7d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe15815c4a0 tx=0x7fe154009040 comp rx=0 tx=0).stop 2023-11-28T11:12:44.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.928+0000 7fe15faa2700 1 -- 172.21.15.125:0/1122021337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1580c6a50 msgr2=0x7fe15815c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.928+0000 7fe15faa2700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1580c6a50 0x7fe15815c6b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe14800f850 tx=0x7fe14800fb60 comp rx=0 tx=0).stop 2023-11-28T11:12:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.929+0000 7fe15faa2700 1 -- 172.21.15.125:0/1122021337 shutdown_connections 2023-11-28T11:12:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.929+0000 7fe15faa2700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fe13c068320 0x7fe13c06a7d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.929+0000 7fe15faa2700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe158156cc0 0x7fe1580b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.929+0000 7fe15faa2700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe1580c6a50 0x7fe15815c6b0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.929+0000 7fe15faa2700 1 --2- 172.21.15.125:0/1122021337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158156850 0x7fe1580b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.929+0000 7fe15faa2700 1 -- 172.21.15.125:0/1122021337 >> 172.21.15.125:0/1122021337 conn(0x7fe15806ea80 msgr2=0x7fe1580cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.929+0000 7fe15faa2700 1 -- 172.21.15.125:0/1122021337 shutdown_connections 2023-11-28T11:12:44.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:44.929+0000 7fe15faa2700 1 -- 172.21.15.125:0/1122021337 wait complete. 2023-11-28T11:12:44.941 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:12:45.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.065+0000 7f2b10d60700 1 Processor -- start 2023-11-28T11:12:45.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.066+0000 7f2b10d60700 1 -- start start 2023-11-28T11:12:45.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.066+0000 7f2b10d60700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b0c15c810 0x7f2b0c160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.066+0000 7f2b10d60700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b0c06a270 0x7f2b0c06a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.066+0000 7f2b10d60700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c06abf0 con 0x7f2b0c0718e0 2023-11-28T11:12:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.066+0000 7f2b10d60700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c15cbe0 con 0x7f2b0c15c810 2023-11-28T11:12:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b10d60700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c1607a0 con 0x7f2b0c06a270 2023-11-28T11:12:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b0a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b0c15c810 0x7f2b0c160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b09d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2b0c0718e0 0x7f2b0c06c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46032/0 (socket says 172.21.15.125:46032) 2023-11-28T11:12:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b09d9b700 1 -- 172.21.15.125:0/4107479105 learned_addr learned my addr 172.21.15.125:0/4107479105 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b0a59c700 1 -- 172.21.15.125:0/4107479105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b0c06a270 msgr2=0x7f2b0c06a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b0a59c700 1 --2- 172.21.15.125:0/4107479105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b0c06a270 0x7f2b0c06a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b0a59c700 1 -- 172.21.15.125:0/4107479105 >> v1:172.21.15.125:6789/0 conn(0x7f2b0c0718e0 legacy=0x7f2b0c06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b0a59c700 1 -- 172.21.15.125:0/4107479105 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c160a50 con 0x7f2b0c15c810 2023-11-28T11:12:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b0959a700 1 -- 172.21.15.125:0/4107479105 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543077028 0 0) 0x7f2b0c06abf0 con 0x7f2b0c0718e0 2023-11-28T11:12:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b0a59c700 1 --2- 172.21.15.125:0/4107479105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b0c15c810 0x7f2b0c160260 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009840 tx=0x7f2b00009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56eaa40831c523b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b0959a700 1 -- 172.21.15.125:0/4107479105 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00011830 con 0x7f2b0c15c810 2023-11-28T11:12:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b0959a700 1 -- 172.21.15.125:0/4107479105 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00011990 con 0x7f2b0c15c810 2023-11-28T11:12:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.067+0000 7f2b0959a700 1 -- 172.21.15.125:0/4107479105 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00011d20 con 0x7f2b0c15c810 2023-11-28T11:12:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.068+0000 7f2b10d60700 1 -- 172.21.15.125:0/4107479105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b0c15c810 msgr2=0x7f2b0c160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.068+0000 7f2b10d60700 1 --2- 172.21.15.125:0/4107479105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b0c15c810 0x7f2b0c160260 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009840 tx=0x7f2b00009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.068+0000 7f2b10d60700 1 -- 172.21.15.125:0/4107479105 shutdown_connections 2023-11-28T11:12:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.068+0000 7f2b10d60700 1 --2- 172.21.15.125:0/4107479105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b0c06a270 0x7f2b0c06a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.068+0000 7f2b10d60700 1 --2- 172.21.15.125:0/4107479105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b0c15c810 0x7f2b0c160260 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.068+0000 7f2b10d60700 1 -- 172.21.15.125:0/4107479105 >> 172.21.15.125:0/4107479105 conn(0x7f2b0c06c010 msgr2=0x7f2b0c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.068+0000 7f2b10d60700 1 -- 172.21.15.125:0/4107479105 shutdown_connections 2023-11-28T11:12:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.068+0000 7f2b10d60700 1 -- 172.21.15.125:0/4107479105 wait complete. 2023-11-28T11:12:45.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.070+0000 7f2b10d60700 1 Processor -- start 2023-11-28T11:12:45.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.070+0000 7f2b10d60700 1 -- start start 2023-11-28T11:12:45.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.070+0000 7f2b10d60700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b0c06a270 0x7f2b0c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.070+0000 7f2b10d60700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b0c0718e0 0x7f2b0c1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b10d60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b0c15c810 0x7f2b0c15ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b10d60700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0b0bd0 con 0x7f2b0c15c810 2023-11-28T11:12:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b10d60700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0b02e0 con 0x7f2b0c06a270 2023-11-28T11:12:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b10d60700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c15e1f0 con 0x7f2b0c0718e0 2023-11-28T11:12:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b0ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b0c15c810 0x7f2b0c15ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b0ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b0c15c810 0x7f2b0c15ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33686/0 (socket says 172.21.15.125:33686) 2023-11-28T11:12:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b0ad9d700 1 -- 172.21.15.125:0/3237440669 learned_addr learned my addr 172.21.15.125:0/3237440669 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b09d9b700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b0c0718e0 0x7f2b0c1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b0a59c700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b0c06a270 0x7f2b0c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b0ad9d700 1 -- 172.21.15.125:0/3237440669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b0c0718e0 msgr2=0x7f2b0c1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b0ad9d700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b0c0718e0 0x7f2b0c1547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b0ad9d700 1 -- 172.21.15.125:0/3237440669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b0c06a270 msgr2=0x7f2b0c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b0ad9d700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b0c06a270 0x7f2b0c0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b0ad9d700 1 -- 172.21.15.125:0/3237440669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b000094a0 con 0x7f2b0c15c810 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b0a59c700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b0c06a270 0x7f2b0c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b0ad9d700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b0c15c810 0x7f2b0c15ef50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400b970 tx=0x7f2b0400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2afaffd700 1 -- 172.21.15.125:0/3237440669 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400c930 con 0x7f2b0c15c810 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2afaffd700 1 -- 172.21.15.125:0/3237440669 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0400cab0 con 0x7f2b0c15c810 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b10d60700 1 -- 172.21.15.125:0/3237440669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0c161010 con 0x7f2b0c15c810 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2afaffd700 1 -- 172.21.15.125:0/3237440669 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400ce60 con 0x7f2b0c15c810 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.071+0000 7f2b10d60700 1 -- 172.21.15.125:0/3237440669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0c160d30 con 0x7f2b0c15c810 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.072+0000 7f2b10d60700 1 -- 172.21.15.125:0/3237440669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0c0ceb20 con 0x7f2b0c15c810 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.073+0000 7f2afaffd700 1 -- 172.21.15.125:0/3237440669 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2b0401b030 con 0x7f2b0c15c810 2023-11-28T11:12:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.073+0000 7f2afaffd700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2aec0682f0 0x7f2aec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.073+0000 7f2afaffd700 1 -- 172.21.15.125:0/3237440669 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f2b040858d0 con 0x7f2b0c15c810 2023-11-28T11:12:45.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.073+0000 7f2b0a59c700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2aec0682f0 0x7f2aec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.073+0000 7f2b0a59c700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2aec0682f0 0x7f2aec06a7a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2b000090b0 tx=0x7f2b00008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:45.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.077+0000 7f2afaffd700 1 -- 172.21.15.125:0/3237440669 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2b040520a0 con 0x7f2b0c15c810 2023-11-28T11:12:45.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.259+0000 7f2b10d60700 1 -- 172.21.15.125:0/3237440669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2b0c0743f0 con 0x7f2b0c15c810 2023-11-28T11:12:45.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.260+0000 7f2afaffd700 1 -- 172.21.15.125:0/3237440669 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2b040190a0 con 0x7f2b0c15c810 2023-11-28T11:12:45.261 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-11-28T11:12:45.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 -- 172.21.15.125:0/3237440669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2aec0682f0 msgr2=0x7f2aec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2aec0682f0 0x7f2aec06a7a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2b000090b0 tx=0x7f2b00008030 comp rx=0 tx=0).stop 2023-11-28T11:12:45.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 -- 172.21.15.125:0/3237440669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b0c15c810 msgr2=0x7f2b0c15ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b0c15c810 0x7f2b0c15ef50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400b970 tx=0x7f2b0400bc80 comp rx=0 tx=0).stop 2023-11-28T11:12:45.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 -- 172.21.15.125:0/3237440669 shutdown_connections 2023-11-28T11:12:45.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b0c15c810 0x7f2b0c15ef50 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b0c06a270 0x7f2b0c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2aec0682f0 0x7f2aec06a7a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 --2- 172.21.15.125:0/3237440669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b0c0718e0 0x7f2b0c1547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 -- 172.21.15.125:0/3237440669 >> 172.21.15.125:0/3237440669 conn(0x7f2b0c06c010 msgr2=0x7f2b0c0cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:45.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 -- 172.21.15.125:0/3237440669 shutdown_connections 2023-11-28T11:12:45.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.262+0000 7f2b10d60700 1 -- 172.21.15.125:0/3237440669 wait complete. 2023-11-28T11:12:45.275 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:12:45.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.396+0000 7fb0862ab700 1 Processor -- start 2023-11-28T11:12:45.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.396+0000 7fb0862ab700 1 -- start start 2023-11-28T11:12:45.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb0862ab700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb08015a5f0 0x7fb0800d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb0862ab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0800cc200 0x7fb0800b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb0862ab700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08015a9c0 con 0x7fb0800b2d10 2023-11-28T11:12:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb0862ab700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0800b3190 con 0x7fb0800cc200 2023-11-28T11:12:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb0862ab700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0800c7b80 con 0x7fb08015a5f0 2023-11-28T11:12:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb07f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0800cc200 0x7fb0800b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb07f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb0800cc200 0x7fb0800b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33694/0 (socket says 172.21.15.125:33694) 2023-11-28T11:12:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb07f7fe700 1 -- 172.21.15.125:0/196550809 learned_addr learned my addr 172.21.15.125:0/196550809 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb07f7fe700 1 -- 172.21.15.125:0/196550809 >> v2:172.21.15.167:3300/0 conn(0x7fb08015a5f0 msgr2=0x7fb0800d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb07ffff700 1 --2- 172.21.15.125:0/196550809 >> v2:172.21.15.167:3300/0 conn(0x7fb08015a5f0 0x7fb0800d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb07f7fe700 1 --2- 172.21.15.125:0/196550809 >> v2:172.21.15.167:3300/0 conn(0x7fb08015a5f0 0x7fb0800d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb07f7fe700 1 -- 172.21.15.125:0/196550809 >> v1:172.21.15.167:6789/0 conn(0x7fb0800b2d10 legacy=0x7fb08015e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb07f7fe700 1 -- 172.21.15.125:0/196550809 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800cc990 con 0x7fb0800cc200 2023-11-28T11:12:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.397+0000 7fb07ffff700 1 --2- 172.21.15.125:0/196550809 >> v2:172.21.15.167:3300/0 conn(0x7fb08015a5f0 0x7fb0800d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb07f7fe700 1 --2- 172.21.15.125:0/196550809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0800cc200 0x7fb0800b27d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb0800d1d40 tx=0x7fb070009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50acdee0c806e964 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb07effd700 1 -- 172.21.15.125:0/196550809 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070004230 con 0x7fb0800cc200 2023-11-28T11:12:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb07effd700 1 -- 172.21.15.125:0/196550809 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070004390 con 0x7fb0800cc200 2023-11-28T11:12:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb07effd700 1 -- 172.21.15.125:0/196550809 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0700036a0 con 0x7fb0800cc200 2023-11-28T11:12:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb0862ab700 1 -- 172.21.15.125:0/196550809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0800cc200 msgr2=0x7fb0800b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb0862ab700 1 --2- 172.21.15.125:0/196550809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0800cc200 0x7fb0800b27d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb0800d1d40 tx=0x7fb070009bd0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb0862ab700 1 -- 172.21.15.125:0/196550809 shutdown_connections 2023-11-28T11:12:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb0862ab700 1 --2- 172.21.15.125:0/196550809 >> v2:172.21.15.167:3300/0 conn(0x7fb08015a5f0 0x7fb0800d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb0862ab700 1 --2- 172.21.15.125:0/196550809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0800cc200 0x7fb0800b27d0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb0862ab700 1 -- 172.21.15.125:0/196550809 >> 172.21.15.125:0/196550809 conn(0x7fb08006ea80 msgr2=0x7fb08006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:45.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb0862ab700 1 -- 172.21.15.125:0/196550809 shutdown_connections 2023-11-28T11:12:45.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.398+0000 7fb0862ab700 1 -- 172.21.15.125:0/196550809 wait complete. 2023-11-28T11:12:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.400+0000 7fb0862ab700 1 Processor -- start 2023-11-28T11:12:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.400+0000 7fb0862ab700 1 -- start start 2023-11-28T11:12:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.400+0000 7fb0862ab700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0800b2d10 0x7fb0800ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.400+0000 7fb0862ab700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0800cc200 0x7fb0801f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.400+0000 7fb0862ab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08015a5f0 0x7fb0800b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.400+0000 7fb0862ab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800b6240 con 0x7fb08015a5f0 2023-11-28T11:12:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.400+0000 7fb0862ab700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800c5400 con 0x7fb0800b2d10 2023-11-28T11:12:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.400+0000 7fb0862ab700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801f37d0 con 0x7fb0800cc200 2023-11-28T11:12:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb084848700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08015a5f0 0x7fb0800b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb084848700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08015a5f0 0x7fb0800b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33700/0 (socket says 172.21.15.125:33700) 2023-11-28T11:12:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb084848700 1 -- 172.21.15.125:0/3450005746 learned_addr learned my addr 172.21.15.125:0/3450005746 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb07ffff700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0800b2d10 0x7fb0800ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb07f7fe700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0800cc200 0x7fb0801f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb084848700 1 -- 172.21.15.125:0/3450005746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0800cc200 msgr2=0x7fb0801f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb084848700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0800cc200 0x7fb0801f3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb084848700 1 -- 172.21.15.125:0/3450005746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0800b2d10 msgr2=0x7fb0800ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb084848700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0800b2d10 0x7fb0800ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb084848700 1 -- 172.21.15.125:0/3450005746 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb070009550 con 0x7fb08015a5f0 2023-11-28T11:12:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb084848700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08015a5f0 0x7fb0800b1800 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb07800b970 tx=0x7fb07800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb07cff9700 1 -- 172.21.15.125:0/3450005746 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800d860 con 0x7fb08015a5f0 2023-11-28T11:12:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb07cff9700 1 -- 172.21.15.125:0/3450005746 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07800d9c0 con 0x7fb08015a5f0 2023-11-28T11:12:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb0862ab700 1 -- 172.21.15.125:0/3450005746 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0800ccf50 con 0x7fb08015a5f0 2023-11-28T11:12:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb07cff9700 1 -- 172.21.15.125:0/3450005746 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800dd70 con 0x7fb08015a5f0 2023-11-28T11:12:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.401+0000 7fb0862ab700 1 -- 172.21.15.125:0/3450005746 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0800ccc70 con 0x7fb08015a5f0 2023-11-28T11:12:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.402+0000 7fb0862ab700 1 -- 172.21.15.125:0/3450005746 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0800cd230 con 0x7fb08015a5f0 2023-11-28T11:12:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.403+0000 7fb07cff9700 1 -- 172.21.15.125:0/3450005746 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb07800e430 con 0x7fb08015a5f0 2023-11-28T11:12:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.403+0000 7fb07cff9700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb06c0682f0 0x7fb06c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.403+0000 7fb07cff9700 1 -- 172.21.15.125:0/3450005746 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fb078085fa0 con 0x7fb08015a5f0 2023-11-28T11:12:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.403+0000 7fb07ffff700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb06c0682f0 0x7fb06c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.403+0000 7fb07ffff700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb06c0682f0 0x7fb06c06a7a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb074006fd0 tx=0x7fb074008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:45.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.407+0000 7fb07cff9700 1 -- 172.21.15.125:0/3450005746 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb078052710 con 0x7fb08015a5f0 2023-11-28T11:12:45.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.588+0000 7fb0862ab700 1 -- 172.21.15.125:0/3450005746 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0800743f0 con 0x7fb08015a5f0 2023-11-28T11:12:45.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.588+0000 7fb07cff9700 1 -- 172.21.15.125:0/3450005746 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb078055d30 con 0x7fb08015a5f0 2023-11-28T11:12:45.589 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-11-28T11:12:45.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 -- 172.21.15.125:0/3450005746 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb06c0682f0 msgr2=0x7fb06c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb06c0682f0 0x7fb06c06a7a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb074006fd0 tx=0x7fb074008040 comp rx=0 tx=0).stop 2023-11-28T11:12:45.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 -- 172.21.15.125:0/3450005746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08015a5f0 msgr2=0x7fb0800b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08015a5f0 0x7fb0800b1800 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb07800b970 tx=0x7fb07800bc80 comp rx=0 tx=0).stop 2023-11-28T11:12:45.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 -- 172.21.15.125:0/3450005746 shutdown_connections 2023-11-28T11:12:45.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08015a5f0 0x7fb0800b1800 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0800b2d10 0x7fb0800ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb06c0682f0 0x7fb06c06a7a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 --2- 172.21.15.125:0/3450005746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0800cc200 0x7fb0801f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 -- 172.21.15.125:0/3450005746 >> 172.21.15.125:0/3450005746 conn(0x7fb08006ea80 msgr2=0x7fb0800cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:45.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 -- 172.21.15.125:0/3450005746 shutdown_connections 2023-11-28T11:12:45.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.590+0000 7fb0862ab700 1 -- 172.21.15.125:0/3450005746 wait complete. 2023-11-28T11:12:45.603 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:12:45.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.725+0000 7f97c4c05700 1 Processor -- start 2023-11-28T11:12:45.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.725+0000 7f97c4c05700 1 -- start start 2023-11-28T11:12:45.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.726+0000 7f97c4c05700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f97c015a5f0 0x7f97c00d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.726+0000 7f97c4c05700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c015a9c0 con 0x7f97c00cc200 2023-11-28T11:12:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.726+0000 7f97c4c05700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c00c7b80 con 0x7f97c00b2ee0 2023-11-28T11:12:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.726+0000 7f97c4c05700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c00cc990 con 0x7f97c015a5f0 2023-11-28T11:12:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.726+0000 7f97bdd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f97c00cc200 0x7f97c00b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46060/0 (socket says 172.21.15.125:46060) 2023-11-28T11:12:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.726+0000 7f97bdd9b700 1 -- 172.21.15.125:0/3283563694 learned_addr learned my addr 172.21.15.125:0/3283563694 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.726+0000 7f97be59c700 1 --2- 172.21.15.125:0/3283563694 >> v2:172.21.15.167:3300/0 conn(0x7f97c015a5f0 0x7f97c00d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.727+0000 7f97bd59a700 1 -- 172.21.15.125:0/3283563694 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085935036 0 0) 0x7f97c015a9c0 con 0x7f97c00cc200 2023-11-28T11:12:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.727+0000 7f97bd59a700 1 -- 172.21.15.125:0/3283563694 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97a80035b0 con 0x7f97c00cc200 2023-11-28T11:12:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.727+0000 7f97be59c700 1 -- 172.21.15.125:0/3283563694 >> v1:172.21.15.167:6789/0 conn(0x7f97c00b2ee0 legacy=0x7f97c00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.727+0000 7f97be59c700 1 -- 172.21.15.125:0/3283563694 >> v1:172.21.15.125:6789/0 conn(0x7f97c00cc200 legacy=0x7f97c00b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.727+0000 7f97bd59a700 1 -- 172.21.15.125:0/3283563694 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2328282278 0 0) 0x7f97a80035b0 con 0x7f97c00cc200 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.727+0000 7f97be59c700 1 -- 172.21.15.125:0/3283563694 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c00ccc70 con 0x7f97c015a5f0 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.727+0000 7f97be59c700 1 --2- 172.21.15.125:0/3283563694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c015a5f0 0x7f97c00d0ad0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009840 tx=0x7f97b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3580e3f7ebea87de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.727+0000 7f97bd59a700 1 -- 172.21.15.125:0/3283563694 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0001670 con 0x7f97c015a5f0 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.727+0000 7f97bd59a700 1 -- 172.21.15.125:0/3283563694 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b4004030 con 0x7f97c015a5f0 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.727+0000 7f97bd59a700 1 -- 172.21.15.125:0/3283563694 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b40043a0 con 0x7f97c015a5f0 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.728+0000 7f97c4c05700 1 -- 172.21.15.125:0/3283563694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c015a5f0 msgr2=0x7f97c00d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.728+0000 7f97c4c05700 1 --2- 172.21.15.125:0/3283563694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c015a5f0 0x7f97c00d0ad0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009840 tx=0x7f97b4009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.728+0000 7f97c4c05700 1 -- 172.21.15.125:0/3283563694 shutdown_connections 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.728+0000 7f97c4c05700 1 --2- 172.21.15.125:0/3283563694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c015a5f0 0x7f97c00d0ad0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.728+0000 7f97c4c05700 1 -- 172.21.15.125:0/3283563694 >> 172.21.15.125:0/3283563694 conn(0x7f97c006ea80 msgr2=0x7f97c006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.728+0000 7f97c4c05700 1 -- 172.21.15.125:0/3283563694 shutdown_connections 2023-11-28T11:12:45.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.728+0000 7f97c4c05700 1 -- 172.21.15.125:0/3283563694 wait complete. 2023-11-28T11:12:45.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.729+0000 7f97c4c05700 1 Processor -- start 2023-11-28T11:12:45.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.729+0000 7f97c4c05700 1 -- start start 2023-11-28T11:12:45.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97c4c05700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c00b2ee0 0x7f97c00ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97c4c05700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cc200 0x7f97c01510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97c4c05700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c015a5f0 0x7f97c00b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97c4c05700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c01525b0 con 0x7f97c00cc200 2023-11-28T11:12:45.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97c4c05700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c01519e0 con 0x7f97c015a5f0 2023-11-28T11:12:45.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97c4c05700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00cac10 con 0x7f97c00b2ee0 2023-11-28T11:12:45.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97bdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cc200 0x7f97c01510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97bdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cc200 0x7f97c01510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33712/0 (socket says 172.21.15.125:33712) 2023-11-28T11:12:45.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97bdd9b700 1 -- 172.21.15.125:0/3476139644 learned_addr learned my addr 172.21.15.125:0/3476139644 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:45.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97be59c700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c00b2ee0 0x7f97c00ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97bed9d700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c015a5f0 0x7f97c00b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97bdd9b700 1 -- 172.21.15.125:0/3476139644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c00b2ee0 msgr2=0x7f97c00ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97bdd9b700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c00b2ee0 0x7f97c00ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97bdd9b700 1 -- 172.21.15.125:0/3476139644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c015a5f0 msgr2=0x7f97c00b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97bdd9b700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c015a5f0 0x7f97c00b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97bdd9b700 1 -- 172.21.15.125:0/3476139644 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b40094a0 con 0x7f97c00cc200 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97bdd9b700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cc200 0x7f97c01510d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f97b000c520 tx=0x7f97b000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97aeffd700 1 -- 172.21.15.125:0/3476139644 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0004c80 con 0x7f97c00cc200 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97aeffd700 1 -- 172.21.15.125:0/3476139644 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b0004de0 con 0x7f97c00cc200 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.730+0000 7f97c4c05700 1 -- 172.21.15.125:0/3476139644 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c00cd230 con 0x7f97c00cc200 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.731+0000 7f97aeffd700 1 -- 172.21.15.125:0/3476139644 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0007310 con 0x7f97c00cc200 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.731+0000 7f97c4c05700 1 -- 172.21.15.125:0/3476139644 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c00ccf50 con 0x7f97c00cc200 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.731+0000 7f97c4c05700 1 -- 172.21.15.125:0/3476139644 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c00cd510 con 0x7f97c00cc200 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.732+0000 7f97aeffd700 1 -- 172.21.15.125:0/3476139644 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f97b001a020 con 0x7f97c00cc200 2023-11-28T11:12:45.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.732+0000 7f97aeffd700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a00682f0 0x7f97a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:45.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.732+0000 7f97aeffd700 1 -- 172.21.15.125:0/3476139644 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f97b0085940 con 0x7f97c00cc200 2023-11-28T11:12:45.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.732+0000 7f97be59c700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a00682f0 0x7f97a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:45.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.733+0000 7f97be59c700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a00682f0 0x7f97a006a7a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009790 tx=0x7f97b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:45.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.736+0000 7f97aeffd700 1 -- 172.21.15.125:0/3476139644 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f97b0052020 con 0x7f97c00cc200 2023-11-28T11:12:45.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.917+0000 7f97c4c05700 1 -- 172.21.15.125:0/3476139644 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97c00743f0 con 0x7f97c00cc200 2023-11-28T11:12:45.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.918+0000 7f97aeffd700 1 -- 172.21.15.125:0/3476139644 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97b0055640 con 0x7f97c00cc200 2023-11-28T11:12:45.918 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-11-28T11:12:45.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 -- 172.21.15.125:0/3476139644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a00682f0 msgr2=0x7f97a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a00682f0 0x7f97a006a7a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009790 tx=0x7f97b4008030 comp rx=0 tx=0).stop 2023-11-28T11:12:45.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 -- 172.21.15.125:0/3476139644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cc200 msgr2=0x7f97c01510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:45.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cc200 0x7f97c01510d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f97b000c520 tx=0x7f97b000c830 comp rx=0 tx=0).stop 2023-11-28T11:12:45.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 -- 172.21.15.125:0/3476139644 shutdown_connections 2023-11-28T11:12:45.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c015a5f0 0x7f97c00b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f97a00682f0 0x7f97a006a7a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97c00b2ee0 0x7f97c00ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 --2- 172.21.15.125:0/3476139644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cc200 0x7f97c01510d0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:45.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 -- 172.21.15.125:0/3476139644 >> 172.21.15.125:0/3476139644 conn(0x7f97c006ea80 msgr2=0x7f97c00d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:45.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 -- 172.21.15.125:0/3476139644 shutdown_connections 2023-11-28T11:12:45.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:45.920+0000 7f97c4c05700 1 -- 172.21.15.125:0/3476139644 wait complete. 2023-11-28T11:12:45.933 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:12:46.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.052+0000 7fac2b932700 1 Processor -- start 2023-11-28T11:12:46.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.053+0000 7fac2b932700 1 -- start start 2023-11-28T11:12:46.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.053+0000 7fac2b932700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac2406feb0 0x7fac240cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.053+0000 7fac2b932700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240b4fc0 con 0x7fac240ced70 2023-11-28T11:12:46.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.053+0000 7fac2b932700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240b05e0 con 0x7fac240b4b00 2023-11-28T11:12:46.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.053+0000 7fac2b932700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac24159c30 con 0x7fac2406feb0 2023-11-28T11:12:46.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac28ecd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fac2406feb0 0x7fac240cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac296ce700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fac240ced70 0x7fac240b43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46074/0 (socket says 172.21.15.125:46074) 2023-11-28T11:12:46.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac296ce700 1 -- 172.21.15.125:0/4173015823 learned_addr learned my addr 172.21.15.125:0/4173015823 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:46.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac1bfff700 1 -- 172.21.15.125:0/4173015823 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985923046 0 0) 0x7fac240b4fc0 con 0x7fac240ced70 2023-11-28T11:12:46.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac1bfff700 1 -- 172.21.15.125:0/4173015823 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac100035b0 con 0x7fac240ced70 2023-11-28T11:12:46.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac28ecd700 1 -- 172.21.15.125:0/4173015823 >> v1:172.21.15.167:6789/0 conn(0x7fac240b4b00 legacy=0x7fac240cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac28ecd700 1 -- 172.21.15.125:0/4173015823 >> v1:172.21.15.125:6789/0 conn(0x7fac240ced70 legacy=0x7fac240b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac28ecd700 1 -- 172.21.15.125:0/4173015823 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240b08c0 con 0x7fac2406feb0 2023-11-28T11:12:46.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac28ecd700 1 --2- 172.21.15.125:0/4173015823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac2406feb0 0x7fac240cd1d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fac14009840 tx=0x7fac14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d772ea6e15340bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:46.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac1bfff700 1 -- 172.21.15.125:0/4173015823 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14011830 con 0x7fac2406feb0 2023-11-28T11:12:46.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac1bfff700 1 -- 172.21.15.125:0/4173015823 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14011990 con 0x7fac2406feb0 2023-11-28T11:12:46.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.054+0000 7fac1bfff700 1 -- 172.21.15.125:0/4173015823 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14011d20 con 0x7fac2406feb0 2023-11-28T11:12:46.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.055+0000 7fac2b932700 1 -- 172.21.15.125:0/4173015823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac2406feb0 msgr2=0x7fac240cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.055+0000 7fac2b932700 1 --2- 172.21.15.125:0/4173015823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac2406feb0 0x7fac240cd1d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fac14009840 tx=0x7fac14009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:46.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.055+0000 7fac2b932700 1 -- 172.21.15.125:0/4173015823 shutdown_connections 2023-11-28T11:12:46.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.055+0000 7fac2b932700 1 --2- 172.21.15.125:0/4173015823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac2406feb0 0x7fac240cd1d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.055+0000 7fac2b932700 1 -- 172.21.15.125:0/4173015823 >> 172.21.15.125:0/4173015823 conn(0x7fac240b2fc0 msgr2=0x7fac24071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:46.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.055+0000 7fac2b932700 1 -- 172.21.15.125:0/4173015823 shutdown_connections 2023-11-28T11:12:46.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.055+0000 7fac2b932700 1 -- 172.21.15.125:0/4173015823 wait complete. 2023-11-28T11:12:46.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.056+0000 7fac2b932700 1 Processor -- start 2023-11-28T11:12:46.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.056+0000 7fac2b932700 1 -- start start 2023-11-28T11:12:46.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac2b932700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac2406feb0 0x7fac2415bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac2b932700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac240b4b00 0x7fac2415c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac2b932700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac240ced70 0x7fac24099930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac2b932700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2409a660 con 0x7fac2406feb0 2023-11-28T11:12:46.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac2b932700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2409a940 con 0x7fac240ced70 2023-11-28T11:12:46.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac2b932700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2409ac20 con 0x7fac240b4b00 2023-11-28T11:12:46.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac296ce700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac2406feb0 0x7fac2415bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac296ce700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac2406feb0 0x7fac2415bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33724/0 (socket says 172.21.15.125:33724) 2023-11-28T11:12:46.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac296ce700 1 -- 172.21.15.125:0/372909457 learned_addr learned my addr 172.21.15.125:0/372909457 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:46.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac29ecf700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac240ced70 0x7fac24099930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac28ecd700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac240b4b00 0x7fac2415c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac296ce700 1 -- 172.21.15.125:0/372909457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac240b4b00 msgr2=0x7fac2415c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac296ce700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac240b4b00 0x7fac2415c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac296ce700 1 -- 172.21.15.125:0/372909457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac240ced70 msgr2=0x7fac24099930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac296ce700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac240ced70 0x7fac24099930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac296ce700 1 -- 172.21.15.125:0/372909457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140094a0 con 0x7fac2406feb0 2023-11-28T11:12:46.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac296ce700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac2406feb0 0x7fac2415bf00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fac20001eb0 tx=0x7fac2000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:46.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac19ffb700 1 -- 172.21.15.125:0/372909457 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20005d70 con 0x7fac2406feb0 2023-11-28T11:12:46.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac19ffb700 1 -- 172.21.15.125:0/372909457 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac200070d0 con 0x7fac2406feb0 2023-11-28T11:12:46.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac19ffb700 1 -- 172.21.15.125:0/372909457 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20007460 con 0x7fac2406feb0 2023-11-28T11:12:46.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.057+0000 7fac2b932700 1 -- 172.21.15.125:0/372909457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac240b5260 con 0x7fac2406feb0 2023-11-28T11:12:46.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.058+0000 7fac2b932700 1 -- 172.21.15.125:0/372909457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac240b0ba0 con 0x7fac2406feb0 2023-11-28T11:12:46.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.059+0000 7fac2b932700 1 -- 172.21.15.125:0/372909457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2406b280 con 0x7fac2406feb0 2023-11-28T11:12:46.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.059+0000 7fac19ffb700 1 -- 172.21.15.125:0/372909457 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fac20019030 con 0x7fac2406feb0 2023-11-28T11:12:46.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.059+0000 7fac19ffb700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac080682f0 0x7fac0806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.059+0000 7fac19ffb700 1 -- 172.21.15.125:0/372909457 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fac20085210 con 0x7fac2406feb0 2023-11-28T11:12:46.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.059+0000 7fac28ecd700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac080682f0 0x7fac0806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.060+0000 7fac28ecd700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac080682f0 0x7fac0806a7a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fac14009840 tx=0x7fac14008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:46.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.064+0000 7fac19ffb700 1 -- 172.21.15.125:0/372909457 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fac200518f0 con 0x7fac2406feb0 2023-11-28T11:12:46.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.287+0000 7fac2b932700 1 -- 172.21.15.125:0/372909457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac24067370 con 0x7fac2406feb0 2023-11-28T11:12:46.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.287+0000 7fac19ffb700 1 -- 172.21.15.125:0/372909457 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4661 (secure 0 0 0) 0x7fac20054f10 con 0x7fac2406feb0 2023-11-28T11:12:46.288 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:46.288 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5710,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3518974696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3518974696},{"type":"v1","addr":"172.21.15.167:6834","nonce":3518974696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/2475008501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2475008501},{"type":"v1","addr":"172.21.15.125:6836","nonce":2475008501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2392518832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":2392518832},{"type":"v1","addr":"172.21.15.125:6837","nonce":2392518832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:11:39.473096+0000","modified":"2023-11-28T11:11:51.944585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":6,"addr":"172.21.15.167:6835/1701437437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1701437437},{"type":"v1","addr":"172.21.15.167:6835","nonce":1701437437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:12:46.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 -- 172.21.15.125:0/372909457 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac080682f0 msgr2=0x7fac0806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac080682f0 0x7fac0806a7a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fac14009840 tx=0x7fac14008030 comp rx=0 tx=0).stop 2023-11-28T11:12:46.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 -- 172.21.15.125:0/372909457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac2406feb0 msgr2=0x7fac2415bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac2406feb0 0x7fac2415bf00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fac20001eb0 tx=0x7fac2000c860 comp rx=0 tx=0).stop 2023-11-28T11:12:46.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 -- 172.21.15.125:0/372909457 shutdown_connections 2023-11-28T11:12:46.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac240ced70 0x7fac24099930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac2406feb0 0x7fac2415bf00 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac080682f0 0x7fac0806a7a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 --2- 172.21.15.125:0/372909457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac240b4b00 0x7fac2415c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 -- 172.21.15.125:0/372909457 >> 172.21.15.125:0/372909457 conn(0x7fac240b2fc0 msgr2=0x7fac2406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:46.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 -- 172.21.15.125:0/372909457 shutdown_connections 2023-11-28T11:12:46.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.289+0000 7fac2b932700 1 -- 172.21.15.125:0/372909457 wait complete. 2023-11-28T11:12:46.291 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 32 2023-11-28T11:12:46.302 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:12:46.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.421+0000 7f99e08a9700 1 Processor -- start 2023-11-28T11:12:46.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.421+0000 7f99e08a9700 1 -- start start 2023-11-28T11:12:46.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.422+0000 7f99e08a9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99dc0ce040 0x7f99dc15d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.422+0000 7f99e08a9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99dc13fc90 con 0x7f99dc0b1770 2023-11-28T11:12:46.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.422+0000 7f99e08a9700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99dc13f480 con 0x7f99dc142db0 2023-11-28T11:12:46.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.422+0000 7f99e08a9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc13f6d0 con 0x7f99dc0ce040 2023-11-28T11:12:46.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.422+0000 7f99dad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f99dc0b1770 0x7f99dc13cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46090/0 (socket says 172.21.15.125:46090) 2023-11-28T11:12:46.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.422+0000 7f99dad9d700 1 -- 172.21.15.125:0/2425484888 learned_addr learned my addr 172.21.15.125:0/2425484888 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:46.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99da59c700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99dc0ce040 0x7f99dc15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460202041 0 0) 0x7f99dc13fc90 con 0x7f99dc0b1770 2023-11-28T11:12:46.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99c40035b0 con 0x7f99dc0b1770 2023-11-28T11:12:46.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664143884 0 0) 0x7f99c40035b0 con 0x7f99dc0b1770 2023-11-28T11:12:46.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99dc0ce040 msgr2=0x7f99dc15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:46.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99dc0ce040 0x7f99dc15d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 >> v1:172.21.15.167:6789/0 conn(0x7f99dc142db0 legacy=0x7f99dc13ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc13f9b0 con 0x7f99dc0b1770 2023-11-28T11:12:46.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f99d40019f0 con 0x7f99dc0b1770 2023-11-28T11:12:46.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 >> v1:172.21.15.125:6789/0 conn(0x7f99dc0b1770 legacy=0x7f99dc13cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99dc0ce040 0x7f99c4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99c4003f70 0x7f99c4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99c4004d90 0x7f99c4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc13f6d0 con 0x7f99c4003f70 2023-11-28T11:12:46.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c400ba40 con 0x7f99c4004d90 2023-11-28T11:12:46.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c400bc00 con 0x7f99dc0ce040 2023-11-28T11:12:46.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d9d9b700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99c4003f70 0x7f99c4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99da59c700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99dc0ce040 0x7f99c4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99dad9d700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99c4004d90 0x7f99c4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d9d9b700 1 -- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99dc0ce040 msgr2=0x7f99c4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d9d9b700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99dc0ce040 0x7f99c4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d9d9b700 1 -- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99c4004d90 msgr2=0x7f99c4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d9d9b700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99c4004d90 0x7f99c4005200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99d9d9b700 1 -- 172.21.15.125:0/2425484888 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c40035b0 con 0x7f99c4003f70 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.423+0000 7f99da59c700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99dc0ce040 0x7f99c4003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.424+0000 7f99d9d9b700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99c4003f70 0x7f99c4004850 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0018d0 tx=0x7f99c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2eda89ff611ea2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.424+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00c690 con 0x7f99c4003f70 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.424+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc00c7f0 con 0x7f99c4003f70 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.424+0000 7f99d959a700 1 -- 172.21.15.125:0/2425484888 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00cba0 con 0x7f99c4003f70 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.424+0000 7f99e08a9700 1 -- 172.21.15.125:0/2425484888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99c4003f70 msgr2=0x7f99c4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.424+0000 7f99e08a9700 1 --2- 172.21.15.125:0/2425484888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99c4003f70 0x7f99c4004850 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0018d0 tx=0x7f99c4005880 comp rx=0 tx=0).stop 2023-11-28T11:12:46.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.424+0000 7f99dad9d700 1 -- 172.21.15.125:0/2425484888 reap_dead start 2023-11-28T11:12:46.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.424+0000 7f99e08a9700 1 -- 172.21.15.125:0/2425484888 shutdown_connections 2023-11-28T11:12:46.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.424+0000 7f99e08a9700 1 -- 172.21.15.125:0/2425484888 >> 172.21.15.125:0/2425484888 conn(0x7f99dc06c010 msgr2=0x7f99dc0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:46.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.424+0000 7f99e08a9700 1 -- 172.21.15.125:0/2425484888 shutdown_connections 2023-11-28T11:12:46.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.424+0000 7f99e08a9700 1 -- 172.21.15.125:0/2425484888 wait complete. 2023-11-28T11:12:46.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.426+0000 7f99e08a9700 1 Processor -- start 2023-11-28T11:12:46.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.426+0000 7f99e08a9700 1 -- start start 2023-11-28T11:12:46.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99e08a9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99c4003f70 0x7f99dc0c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99e08a9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99dc0c2be0 0x7f99dc0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99e08a9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc140480 0x7f99dc140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99e08a9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc140e60 con 0x7f99dc140480 2023-11-28T11:12:46.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99e08a9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0b5af0 con 0x7f99dc0c2be0 2023-11-28T11:12:46.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99e08a9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc1e3400 con 0x7f99c4003f70 2023-11-28T11:12:46.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99dad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc140480 0x7f99dc140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99dad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc140480 0x7f99dc140920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33746/0 (socket says 172.21.15.125:33746) 2023-11-28T11:12:46.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99dad9d700 1 -- 172.21.15.125:0/1797556128 learned_addr learned my addr 172.21.15.125:0/1797556128 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:46.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99d9d9b700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99dc0c2be0 0x7f99dc0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99da59c700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99c4003f70 0x7f99dc0c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99dad9d700 1 -- 172.21.15.125:0/1797556128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99c4003f70 msgr2=0x7f99dc0c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99dad9d700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99c4003f70 0x7f99dc0c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99dad9d700 1 -- 172.21.15.125:0/1797556128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99dc0c2be0 msgr2=0x7f99dc0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99dad9d700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99dc0c2be0 0x7f99dc0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99dad9d700 1 -- 172.21.15.125:0/1797556128 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc15d3e0 con 0x7f99dc140480 2023-11-28T11:12:46.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.427+0000 7f99d9d9b700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99dc0c2be0 0x7f99dc0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:46.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.428+0000 7f99dad9d700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc140480 0x7f99dc140920 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f99dc067320 tx=0x7f99d400b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:46.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.428+0000 7f99caffd700 1 -- 172.21.15.125:0/1797556128 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d400bb80 con 0x7f99dc140480 2023-11-28T11:12:46.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.428+0000 7f99caffd700 1 -- 172.21.15.125:0/1797556128 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d400bd00 con 0x7f99dc140480 2023-11-28T11:12:46.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.428+0000 7f99caffd700 1 -- 172.21.15.125:0/1797556128 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4007310 con 0x7f99dc140480 2023-11-28T11:12:46.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.428+0000 7f99e08a9700 1 -- 172.21.15.125:0/1797556128 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99dc15d100 con 0x7f99dc140480 2023-11-28T11:12:46.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.428+0000 7f99e08a9700 1 -- 172.21.15.125:0/1797556128 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc0ce410 con 0x7f99dc140480 2023-11-28T11:12:46.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.429+0000 7f99e08a9700 1 -- 172.21.15.125:0/1797556128 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc0708c0 con 0x7f99dc140480 2023-11-28T11:12:46.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.429+0000 7f99caffd700 1 -- 172.21.15.125:0/1797556128 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f99d4007470 con 0x7f99dc140480 2023-11-28T11:12:46.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.429+0000 7f99caffd700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f99bc0682f0 0x7f99bc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.430+0000 7f99caffd700 1 -- 172.21.15.125:0/1797556128 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f99d4085cc0 con 0x7f99dc140480 2023-11-28T11:12:46.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.430+0000 7f99da59c700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f99bc0682f0 0x7f99bc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.430+0000 7f99da59c700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f99bc0682f0 0x7f99bc06a7a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f99dc1f40a0 tx=0x7f99d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:46.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.434+0000 7f99caffd700 1 -- 172.21.15.125:0/1797556128 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f99d4052430 con 0x7f99dc140480 2023-11-28T11:12:46.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.619+0000 7f99e08a9700 1 -- 172.21.15.125:0/1797556128 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99dc0cecd0 con 0x7f99dc140480 2023-11-28T11:12:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.620+0000 7f99caffd700 1 -- 172.21.15.125:0/1797556128 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f99d4019020 con 0x7f99dc140480 2023-11-28T11:12:46.621 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:46.621 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":68,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:12:20.977445+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:11:37.512888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T11:11:38.435309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.31","mappings":[{"from":7,"to":3}]},{"pgid":"10.35","mappings":[{"from":4,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:12:46.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.622+0000 7f99e08a9700 1 -- 172.21.15.125:0/1797556128 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f99bc0682f0 msgr2=0x7f99bc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.622+0000 7f99e08a9700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f99bc0682f0 0x7f99bc06a7a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f99dc1f40a0 tx=0x7f99d0008040 comp rx=0 tx=0).stop 2023-11-28T11:12:46.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.622+0000 7f99e08a9700 1 -- 172.21.15.125:0/1797556128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc140480 msgr2=0x7f99dc140920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.622+0000 7f99e08a9700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc140480 0x7f99dc140920 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f99dc067320 tx=0x7f99d400b0d0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.623+0000 7f99e08a9700 1 -- 172.21.15.125:0/1797556128 shutdown_connections 2023-11-28T11:12:46.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.623+0000 7f99e08a9700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc140480 0x7f99dc140920 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.623+0000 7f99e08a9700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f99bc0682f0 0x7f99bc06a7a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.623+0000 7f99e08a9700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99c4003f70 0x7f99dc0c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.623+0000 7f99e08a9700 1 --2- 172.21.15.125:0/1797556128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99dc0c2be0 0x7f99dc0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.623+0000 7f99e08a9700 1 -- 172.21.15.125:0/1797556128 >> 172.21.15.125:0/1797556128 conn(0x7f99dc06c010 msgr2=0x7f99dc152060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:46.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.623+0000 7f99e08a9700 1 -- 172.21.15.125:0/1797556128 shutdown_connections 2023-11-28T11:12:46.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.623+0000 7f99e08a9700 1 -- 172.21.15.125:0/1797556128 wait complete. 2023-11-28T11:12:46.636 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:12:46.636 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:12:46.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.755+0000 7fd273277700 1 Processor -- start 2023-11-28T11:12:46.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.755+0000 7fd273277700 1 -- start start 2023-11-28T11:12:46.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd273277700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd26c06a270 0x7fd26c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd273277700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd26c06e570 0x7fd26c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd273277700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c06ab80 con 0x7fd26c15cc80 2023-11-28T11:12:46.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd273277700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26c0b2490 con 0x7fd26c06a270 2023-11-28T11:12:46.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd273277700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0b1810 con 0x7fd26c06e570 2023-11-28T11:12:46.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd271013700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd26c06a270 0x7fd26c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd270812700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd26c15cc80 0x7fd26c06de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46106/0 (socket says 172.21.15.125:46106) 2023-11-28T11:12:46.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd270812700 1 -- 172.21.15.125:0/3200450879 learned_addr learned my addr 172.21.15.125:0/3200450879 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:46.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd271814700 1 --2- 172.21.15.125:0/3200450879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd26c06e570 0x7fd26c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd271013700 1 -- 172.21.15.125:0/3200450879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd26c06e570 msgr2=0x7fd26c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:46.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd271013700 1 --2- 172.21.15.125:0/3200450879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd26c06e570 0x7fd26c070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd271013700 1 -- 172.21.15.125:0/3200450879 >> v1:172.21.15.125:6789/0 conn(0x7fd26c15cc80 legacy=0x7fd26c06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd271013700 1 -- 172.21.15.125:0/3200450879 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c0b1af0 con 0x7fd26c06a270 2023-11-28T11:12:46.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd263fff700 1 -- 172.21.15.125:0/3200450879 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135977098 0 0) 0x7fd26c06ab80 con 0x7fd26c15cc80 2023-11-28T11:12:46.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd271013700 1 --2- 172.21.15.125:0/3200450879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd26c06a270 0x7fd26c06a640 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd268009840 tx=0x7fd268009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b789370244e9472 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:46.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd263fff700 1 -- 172.21.15.125:0/3200450879 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268011830 con 0x7fd26c06a270 2023-11-28T11:12:46.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd263fff700 1 -- 172.21.15.125:0/3200450879 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd268011990 con 0x7fd26c06a270 2023-11-28T11:12:46.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.756+0000 7fd263fff700 1 -- 172.21.15.125:0/3200450879 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268011d20 con 0x7fd26c06a270 2023-11-28T11:12:46.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.757+0000 7fd273277700 1 -- 172.21.15.125:0/3200450879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd26c06a270 msgr2=0x7fd26c06a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.757+0000 7fd273277700 1 --2- 172.21.15.125:0/3200450879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd26c06a270 0x7fd26c06a640 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd268009840 tx=0x7fd268009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:46.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.757+0000 7fd273277700 1 -- 172.21.15.125:0/3200450879 shutdown_connections 2023-11-28T11:12:46.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.757+0000 7fd273277700 1 --2- 172.21.15.125:0/3200450879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd26c06e570 0x7fd26c070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.757+0000 7fd273277700 1 --2- 172.21.15.125:0/3200450879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd26c06a270 0x7fd26c06a640 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.757+0000 7fd273277700 1 -- 172.21.15.125:0/3200450879 >> 172.21.15.125:0/3200450879 conn(0x7fd26c06c010 msgr2=0x7fd26c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:46.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.757+0000 7fd273277700 1 -- 172.21.15.125:0/3200450879 shutdown_connections 2023-11-28T11:12:46.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.757+0000 7fd273277700 1 -- 172.21.15.125:0/3200450879 wait complete. 2023-11-28T11:12:46.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.758+0000 7fd273277700 1 Processor -- start 2023-11-28T11:12:46.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.758+0000 7fd273277700 1 -- start start 2023-11-28T11:12:46.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd273277700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd26c06a270 0x7fd26c0b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd273277700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd26c06e570 0x7fd26c0b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd273277700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd26c15cc80 0x7fd26c15f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd273277700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0b4550 con 0x7fd26c06e570 2023-11-28T11:12:46.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd273277700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0b4830 con 0x7fd26c15cc80 2023-11-28T11:12:46.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd273277700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0b4b10 con 0x7fd26c06a270 2023-11-28T11:12:46.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd270812700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd26c06e570 0x7fd26c0b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd270812700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd26c06e570 0x7fd26c0b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33756/0 (socket says 172.21.15.125:33756) 2023-11-28T11:12:46.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd270812700 1 -- 172.21.15.125:0/2854771000 learned_addr learned my addr 172.21.15.125:0/2854771000 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:46.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd271013700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd26c06a270 0x7fd26c0b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd270812700 1 -- 172.21.15.125:0/2854771000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd26c06a270 msgr2=0x7fd26c0b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd271814700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd26c15cc80 0x7fd26c15f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd270812700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd26c06a270 0x7fd26c0b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd270812700 1 -- 172.21.15.125:0/2854771000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd26c15cc80 msgr2=0x7fd26c15f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd270812700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd26c15cc80 0x7fd26c15f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd270812700 1 -- 172.21.15.125:0/2854771000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2680094a0 con 0x7fd26c06e570 2023-11-28T11:12:46.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.759+0000 7fd270812700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd26c06e570 0x7fd26c0b3c50 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0011e0 tx=0x7fd25c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:46.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.760+0000 7fd261ffb700 1 -- 172.21.15.125:0/2854771000 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c004c80 con 0x7fd26c06e570 2023-11-28T11:12:46.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.760+0000 7fd261ffb700 1 -- 172.21.15.125:0/2854771000 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c004e00 con 0x7fd26c06e570 2023-11-28T11:12:46.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.760+0000 7fd273277700 1 -- 172.21.15.125:0/2854771000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26c0b20b0 con 0x7fd26c06e570 2023-11-28T11:12:46.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.760+0000 7fd261ffb700 1 -- 172.21.15.125:0/2854771000 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c007310 con 0x7fd26c06e570 2023-11-28T11:12:46.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.760+0000 7fd273277700 1 -- 172.21.15.125:0/2854771000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26c0b1dd0 con 0x7fd26c06e570 2023-11-28T11:12:46.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.761+0000 7fd273277700 1 -- 172.21.15.125:0/2854771000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26c15daa0 con 0x7fd26c06e570 2023-11-28T11:12:46.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.761+0000 7fd261ffb700 1 -- 172.21.15.125:0/2854771000 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd25c01a020 con 0x7fd26c06e570 2023-11-28T11:12:46.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.761+0000 7fd261ffb700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 0x7fd25006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:46.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.761+0000 7fd261ffb700 1 -- 172.21.15.125:0/2854771000 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd25c085960 con 0x7fd26c06e570 2023-11-28T11:12:46.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.761+0000 7fd271013700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 0x7fd25006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:46.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.762+0000 7fd271013700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 0x7fd25006a7a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd268000c00 tx=0x7fd268008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:46.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.766+0000 7fd261ffb700 1 -- 172.21.15.125:0/2854771000 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd25c0521e0 con 0x7fd26c06e570 2023-11-28T11:12:46.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.993+0000 7fd273277700 1 -- 172.21.15.125:0/2854771000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd26c0743f0 con 0x7fd26c06e570 2023-11-28T11:12:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.993+0000 7fd261ffb700 1 -- 172.21.15.125:0/2854771000 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4661 (secure 0 0 0) 0x7fd25c055800 con 0x7fd26c06e570 2023-11-28T11:12:46.994 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:46.994 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5710,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3518974696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3518974696},{"type":"v1","addr":"172.21.15.167:6834","nonce":3518974696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/2475008501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2475008501},{"type":"v1","addr":"172.21.15.125:6836","nonce":2475008501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2392518832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":2392518832},{"type":"v1","addr":"172.21.15.125:6837","nonce":2392518832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:11:39.473096+0000","modified":"2023-11-28T11:11:51.944585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":6,"addr":"172.21.15.167:6835/1701437437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1701437437},{"type":"v1","addr":"172.21.15.167:6835","nonce":1701437437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:12:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 -- 172.21.15.125:0/2854771000 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 msgr2=0x7fd25006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 0x7fd25006a7a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd268000c00 tx=0x7fd268008030 comp rx=0 tx=0).stop 2023-11-28T11:12:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 -- 172.21.15.125:0/2854771000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd26c06e570 msgr2=0x7fd26c0b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:46.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd26c06e570 0x7fd26c0b3c50 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0011e0 tx=0x7fd25c00cae0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 -- 172.21.15.125:0/2854771000 shutdown_connections 2023-11-28T11:12:46.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd26c15cc80 0x7fd26c15f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fd2500682f0 0x7fd25006a7a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd26c06a270 0x7fd26c0b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 --2- 172.21.15.125:0/2854771000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd26c06e570 0x7fd26c0b3c50 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:46.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 -- 172.21.15.125:0/2854771000 >> 172.21.15.125:0/2854771000 conn(0x7fd26c06c010 msgr2=0x7fd26c06ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:46.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 -- 172.21.15.125:0/2854771000 shutdown_connections 2023-11-28T11:12:46.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:46.996+0000 7fd273277700 1 -- 172.21.15.125:0/2854771000 wait complete. 2023-11-28T11:12:46.998 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 32 2023-11-28T11:12:47.008 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:12:47.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.128+0000 7fbed14bf700 1 Processor -- start 2023-11-28T11:12:47.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.128+0000 7fbed14bf700 1 -- start start 2023-11-28T11:12:47.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.129+0000 7fbed14bf700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbecc06ab10 0x7fbecc06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.129+0000 7fbed14bf700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc0cd5a0 0x7fbecc160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.129+0000 7fbed14bf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc0d1ee0 con 0x7fbecc0b22a0 2023-11-28T11:12:47.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.129+0000 7fbed14bf700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbecc06b420 con 0x7fbecc06ab10 2023-11-28T11:12:47.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.129+0000 7fbed14bf700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0cdb10 con 0x7fbecc0cd5a0 2023-11-28T11:12:47.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.129+0000 7fbecb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbecc0b22a0 0x7fbecc160840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46120/0 (socket says 172.21.15.125:46120) 2023-11-28T11:12:47.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.129+0000 7fbecb7fe700 1 -- 172.21.15.125:0/3822777837 learned_addr learned my addr 172.21.15.125:0/3822777837 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:47.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.129+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561088480 0 0) 0x7fbecc0d1ee0 con 0x7fbecc0b22a0 2023-11-28T11:12:47.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.129+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb40035b0 con 0x7fbecc0b22a0 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.129+0000 7fbecaffd700 1 --2- 172.21.15.125:0/3822777837 >> v2:172.21.15.167:3300/0 conn(0x7fbecc06ab10 0x7fbecc06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.129+0000 7fbeca7fc700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc0cd5a0 0x7fbecc160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2264796347 0 0) 0x7fbeb40035b0 con 0x7fbecc0b22a0 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc0cd5a0 msgr2=0x7fbecc160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc0cd5a0 0x7fbecc160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 >> v2:172.21.15.167:3300/0 conn(0x7fbecc06ab10 msgr2=0x7fbecc06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 --2- 172.21.15.125:0/3822777837 >> v2:172.21.15.167:3300/0 conn(0x7fbecc06ab10 0x7fbecc06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0d1890 con 0x7fbecc0b22a0 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fbec40019f0 con 0x7fbecc0b22a0 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 >> v1:172.21.15.125:6789/0 conn(0x7fbecc0b22a0 legacy=0x7fbecc160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeb4003a00 0x7fbeb4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc0cd5a0 0x7fbeb4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbeb4004d90 0x7fbeb4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc06b420 con 0x7fbeb4004d90 2023-11-28T11:12:47.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0cdb10 con 0x7fbeb4003a00 2023-11-28T11:12:47.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb400ba10 con 0x7fbecc0cd5a0 2023-11-28T11:12:47.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbecb7fe700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbeb4004d90 0x7fbeb4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbecaffd700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeb4003a00 0x7fbeb4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbeca7fc700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc0cd5a0 0x7fbeb4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbecb7fe700 1 -- 172.21.15.125:0/3822777837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc0cd5a0 msgr2=0x7fbeb4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:47.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbecb7fe700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc0cd5a0 0x7fbeb4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbecb7fe700 1 -- 172.21.15.125:0/3822777837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeb4003a00 msgr2=0x7fbeb4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:47.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbecb7fe700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeb4003a00 0x7fbeb4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbecb7fe700 1 -- 172.21.15.125:0/3822777837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40035b0 con 0x7fbeb4004d90 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbecb7fe700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbeb4004d90 0x7fbeb4005200 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fbec400a8d0 tx=0x7fbeb4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383903f5ed82c414 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec400a340 con 0x7fbeb4004d90 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4012600 con 0x7fbeb4004d90 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.130+0000 7fbec9ffb700 1 -- 172.21.15.125:0/3822777837 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40129b0 con 0x7fbeb4004d90 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.131+0000 7fbed14bf700 1 -- 172.21.15.125:0/3822777837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbeb4004d90 msgr2=0x7fbeb4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.131+0000 7fbed14bf700 1 --2- 172.21.15.125:0/3822777837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbeb4004d90 0x7fbeb4005200 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fbec400a8d0 tx=0x7fbeb4005880 comp rx=0 tx=0).stop 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.131+0000 7fbecb7fe700 1 -- 172.21.15.125:0/3822777837 reap_dead start 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.131+0000 7fbed14bf700 1 -- 172.21.15.125:0/3822777837 shutdown_connections 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.131+0000 7fbed14bf700 1 -- 172.21.15.125:0/3822777837 >> 172.21.15.125:0/3822777837 conn(0x7fbecc06c520 msgr2=0x7fbecc06c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.131+0000 7fbed14bf700 1 -- 172.21.15.125:0/3822777837 shutdown_connections 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.131+0000 7fbed14bf700 1 -- 172.21.15.125:0/3822777837 wait complete. 2023-11-28T11:12:47.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.132+0000 7fbed14bf700 1 Processor -- start 2023-11-28T11:12:47.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.132+0000 7fbed14bf700 1 -- start start 2023-11-28T11:12:47.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbed14bf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc0ca290 0x7fbecc0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbed14bf700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc0ca660 0x7fbecc0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbed14bf700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc153a80 0x7fbecc1556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbed14bf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0cca50 con 0x7fbecc0ca290 2023-11-28T11:12:47.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbed14bf700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0c98a0 con 0x7fbecc0ca660 2023-11-28T11:12:47.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbed14bf700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0c6bb0 con 0x7fbecc153a80 2023-11-28T11:12:47.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbecaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc0ca290 0x7fbecc0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbecaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc0ca290 0x7fbecc0c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33772/0 (socket says 172.21.15.125:33772) 2023-11-28T11:12:47.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbecaffd700 1 -- 172.21.15.125:0/4020813910 learned_addr learned my addr 172.21.15.125:0/4020813910 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:47.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbeca7fc700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc0ca660 0x7fbecc0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbecaffd700 1 -- 172.21.15.125:0/4020813910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc153a80 msgr2=0x7fbecc1556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbecaffd700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc153a80 0x7fbecc1556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbecaffd700 1 -- 172.21.15.125:0/4020813910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc0ca660 msgr2=0x7fbecc0cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbecaffd700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc0ca660 0x7fbecc0cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbecaffd700 1 -- 172.21.15.125:0/4020813910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc15cad0 con 0x7fbecc0ca290 2023-11-28T11:12:47.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbeca7fc700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc0ca660 0x7fbecc0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:47.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.133+0000 7fbecaffd700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc0ca290 0x7fbecc0c91a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fbec0011aa0 tx=0x7fbec0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:47.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.134+0000 7fbeb37fe700 1 -- 172.21.15.125:0/4020813910 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000f900 con 0x7fbecc0ca290 2023-11-28T11:12:47.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.134+0000 7fbeb37fe700 1 -- 172.21.15.125:0/4020813910 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec000fa80 con 0x7fbecc0ca290 2023-11-28T11:12:47.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.134+0000 7fbed14bf700 1 -- 172.21.15.125:0/4020813910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc0d1b70 con 0x7fbecc0ca290 2023-11-28T11:12:47.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.134+0000 7fbeb37fe700 1 -- 172.21.15.125:0/4020813910 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000fe30 con 0x7fbecc0ca290 2023-11-28T11:12:47.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.134+0000 7fbed14bf700 1 -- 172.21.15.125:0/4020813910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc0b1ec0 con 0x7fbecc0ca290 2023-11-28T11:12:47.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.135+0000 7fbed14bf700 1 -- 172.21.15.125:0/4020813910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbecc0743f0 con 0x7fbecc0ca290 2023-11-28T11:12:47.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.135+0000 7fbeb37fe700 1 -- 172.21.15.125:0/4020813910 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbec0014440 con 0x7fbecc0ca290 2023-11-28T11:12:47.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.135+0000 7fbeb37fe700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbeb80682f0 0x7fbeb806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.135+0000 7fbeb37fe700 1 -- 172.21.15.125:0/4020813910 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fbec0086600 con 0x7fbecc0ca290 2023-11-28T11:12:47.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.135+0000 7fbeca7fc700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbeb80682f0 0x7fbeb806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.136+0000 7fbeca7fc700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbeb80682f0 0x7fbeb806a7a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009b50 tx=0x7fbebc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:47.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.140+0000 7fbeb37fe700 1 -- 172.21.15.125:0/4020813910 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbec0052e30 con 0x7fbecc0ca290 2023-11-28T11:12:47.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.367+0000 7fbed14bf700 1 -- 172.21.15.125:0/4020813910 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbecc0b5420 con 0x7fbecc0ca290 2023-11-28T11:12:47.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.367+0000 7fbeb37fe700 1 -- 172.21.15.125:0/4020813910 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4661 (secure 0 0 0) 0x7fbec0056450 con 0x7fbecc0ca290 2023-11-28T11:12:47.369 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:47.370 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5710,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3518974696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3518974696},{"type":"v1","addr":"172.21.15.167:6834","nonce":3518974696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/2475008501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2475008501},{"type":"v1","addr":"172.21.15.125:6836","nonce":2475008501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2392518832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":2392518832},{"type":"v1","addr":"172.21.15.125:6837","nonce":2392518832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:11:39.473096+0000","modified":"2023-11-28T11:11:51.944585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":6,"addr":"172.21.15.167:6835/1701437437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1701437437},{"type":"v1","addr":"172.21.15.167:6835","nonce":1701437437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:12:47.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 -- 172.21.15.125:0/4020813910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbeb80682f0 msgr2=0x7fbeb806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbeb80682f0 0x7fbeb806a7a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009b50 tx=0x7fbebc008040 comp rx=0 tx=0).stop 2023-11-28T11:12:47.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 -- 172.21.15.125:0/4020813910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc0ca290 msgr2=0x7fbecc0c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc0ca290 0x7fbecc0c91a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fbec0011aa0 tx=0x7fbec0011e60 comp rx=0 tx=0).stop 2023-11-28T11:12:47.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 -- 172.21.15.125:0/4020813910 shutdown_connections 2023-11-28T11:12:47.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbeb80682f0 0x7fbeb806a7a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbecc153a80 0x7fbecc1556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc0ca290 0x7fbecc0c91a0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 --2- 172.21.15.125:0/4020813910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbecc0ca660 0x7fbecc0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 -- 172.21.15.125:0/4020813910 >> 172.21.15.125:0/4020813910 conn(0x7fbecc06c520 msgr2=0x7fbecc0b7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:47.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 -- 172.21.15.125:0/4020813910 shutdown_connections 2023-11-28T11:12:47.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.369+0000 7fbed14bf700 1 -- 172.21.15.125:0/4020813910 wait complete. 2023-11-28T11:12:47.373 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 32 2023-11-28T11:12:47.383 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:12:47.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.501+0000 7fa1e3fee700 1 Processor -- start 2023-11-28T11:12:47.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.502+0000 7fa1e3fee700 1 -- start start 2023-11-28T11:12:47.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.502+0000 7fa1e3fee700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1dc15cc80 0x7fa1dc06de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.502+0000 7fa1e3fee700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa1dc06e3a0 0x7fa1dc070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e3fee700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1dc0b1810 con 0x7fa1dc06a270 2023-11-28T11:12:47.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e3fee700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc0b2490 con 0x7fa1dc06e3a0 2023-11-28T11:12:47.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e3fee700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0b1af0 con 0x7fa1dc15cc80 2023-11-28T11:12:47.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e258b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa1dc06e3a0 0x7fa1dc070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e258b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa1dc06e3a0 0x7fa1dc070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33784/0 (socket says 172.21.15.125:33784) 2023-11-28T11:12:47.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e258b700 1 -- 172.21.15.125:0/2555741942 learned_addr learned my addr 172.21.15.125:0/2555741942 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:47.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e1589700 1 --2- 172.21.15.125:0/2555741942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1dc15cc80 0x7fa1dc06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e258b700 1 -- 172.21.15.125:0/2555741942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1dc15cc80 msgr2=0x7fa1dc06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e258b700 1 --2- 172.21.15.125:0/2555741942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1dc15cc80 0x7fa1dc06de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e258b700 1 -- 172.21.15.125:0/2555741942 >> v1:172.21.15.167:6789/0 conn(0x7fa1dc06a270 legacy=0x7fa1dc06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e258b700 1 -- 172.21.15.125:0/2555741942 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0b1dd0 con 0x7fa1dc06e3a0 2023-11-28T11:12:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e258b700 1 --2- 172.21.15.125:0/2555741942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1dc06e3a0 0x7fa1dc070d20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009e50 tx=0x7fa1d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3402236aa0be74ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e0d88700 1 -- 172.21.15.125:0/2555741942 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d400e070 con 0x7fa1dc06e3a0 2023-11-28T11:12:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e0d88700 1 -- 172.21.15.125:0/2555741942 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d4003a20 con 0x7fa1dc06e3a0 2023-11-28T11:12:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.503+0000 7fa1e0d88700 1 -- 172.21.15.125:0/2555741942 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4003dd0 con 0x7fa1dc06e3a0 2023-11-28T11:12:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.504+0000 7fa1e3fee700 1 -- 172.21.15.125:0/2555741942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1dc06e3a0 msgr2=0x7fa1dc070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.504+0000 7fa1e3fee700 1 --2- 172.21.15.125:0/2555741942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1dc06e3a0 0x7fa1dc070d20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009e50 tx=0x7fa1d400b330 comp rx=0 tx=0).stop 2023-11-28T11:12:47.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.504+0000 7fa1e3fee700 1 -- 172.21.15.125:0/2555741942 shutdown_connections 2023-11-28T11:12:47.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.504+0000 7fa1e3fee700 1 --2- 172.21.15.125:0/2555741942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1dc06e3a0 0x7fa1dc070d20 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.504+0000 7fa1e3fee700 1 --2- 172.21.15.125:0/2555741942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1dc15cc80 0x7fa1dc06de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.504+0000 7fa1e3fee700 1 -- 172.21.15.125:0/2555741942 >> 172.21.15.125:0/2555741942 conn(0x7fa1dc06c010 msgr2=0x7fa1dc0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:47.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.504+0000 7fa1e3fee700 1 -- 172.21.15.125:0/2555741942 shutdown_connections 2023-11-28T11:12:47.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.504+0000 7fa1e3fee700 1 -- 172.21.15.125:0/2555741942 wait complete. 2023-11-28T11:12:47.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.505+0000 7fa1e3fee700 1 Processor -- start 2023-11-28T11:12:47.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.505+0000 7fa1e3fee700 1 -- start start 2023-11-28T11:12:47.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e3fee700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1dc06a270 0x7fa1dc153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e3fee700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc06e3a0 0x7fa1dc0b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e3fee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1dc15cc80 0x7fa1dc0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e3fee700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0affd0 con 0x7fa1dc15cc80 2023-11-28T11:12:47.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e3fee700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc153670 con 0x7fa1dc06e3a0 2023-11-28T11:12:47.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e3fee700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0af3c0 con 0x7fa1dc06a270 2023-11-28T11:12:47.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e258b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1dc15cc80 0x7fa1dc0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e258b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1dc15cc80 0x7fa1dc0c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33790/0 (socket says 172.21.15.125:33790) 2023-11-28T11:12:47.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e258b700 1 -- 172.21.15.125:0/3146076560 learned_addr learned my addr 172.21.15.125:0/3146076560 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:47.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e1589700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc06e3a0 0x7fa1dc0b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e1d8a700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1dc06a270 0x7fa1dc153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e258b700 1 -- 172.21.15.125:0/3146076560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1dc06a270 msgr2=0x7fa1dc153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e258b700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1dc06a270 0x7fa1dc153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e258b700 1 -- 172.21.15.125:0/3146076560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc06e3a0 msgr2=0x7fa1dc0b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e258b700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc06e3a0 0x7fa1dc0b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e258b700 1 -- 172.21.15.125:0/3146076560 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d4009b30 con 0x7fa1dc15cc80 2023-11-28T11:12:47.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.506+0000 7fa1e258b700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1dc15cc80 0x7fa1dc0c7b40 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4015040 tx=0x7fa1d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:47.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.507+0000 7fa1d27fc700 1 -- 172.21.15.125:0/3146076560 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4004440 con 0x7fa1dc15cc80 2023-11-28T11:12:47.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.507+0000 7fa1d27fc700 1 -- 172.21.15.125:0/3146076560 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d40045c0 con 0x7fa1dc15cc80 2023-11-28T11:12:47.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.507+0000 7fa1d27fc700 1 -- 172.21.15.125:0/3146076560 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4004970 con 0x7fa1dc15cc80 2023-11-28T11:12:47.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.507+0000 7fa1e3fee700 1 -- 172.21.15.125:0/3146076560 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc06e7e0 con 0x7fa1dc15cc80 2023-11-28T11:12:47.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.507+0000 7fa1e3fee700 1 -- 172.21.15.125:0/3146076560 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc0b20b0 con 0x7fa1dc15cc80 2023-11-28T11:12:47.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.507+0000 7fa1e3fee700 1 -- 172.21.15.125:0/3146076560 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc15daa0 con 0x7fa1dc15cc80 2023-11-28T11:12:47.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.509+0000 7fa1d27fc700 1 -- 172.21.15.125:0/3146076560 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa1d4022030 con 0x7fa1dc15cc80 2023-11-28T11:12:47.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.509+0000 7fa1d27fc700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1c00682f0 0x7fa1c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.509+0000 7fa1d27fc700 1 -- 172.21.15.125:0/3146076560 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fa1d40873b0 con 0x7fa1dc15cc80 2023-11-28T11:12:47.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.509+0000 7fa1e1d8a700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1c00682f0 0x7fa1c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.509+0000 7fa1e1d8a700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1c00682f0 0x7fa1c006a7a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009960 tx=0x7fa1cc0090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:47.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.512+0000 7fa1d27fc700 1 -- 172.21.15.125:0/3146076560 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa1d4053c20 con 0x7fa1dc15cc80 2023-11-28T11:12:47.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.695+0000 7fa1e3fee700 1 -- 172.21.15.125:0/3146076560 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1dc0743f0 con 0x7fa1dc15cc80 2023-11-28T11:12:47.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.696+0000 7fa1d27fc700 1 -- 172.21.15.125:0/3146076560 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18209 (secure 0 0 0) 0x7fa1d4011390 con 0x7fa1dc15cc80 2023-11-28T11:12:47.698 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:47.699 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":68,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:12:20.977445+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:11:37.512888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T11:11:38.435309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.31","mappings":[{"from":7,"to":3}]},{"pgid":"10.35","mappings":[{"from":4,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:12:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 -- 172.21.15.125:0/3146076560 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1c00682f0 msgr2=0x7fa1c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1c00682f0 0x7fa1c006a7a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009960 tx=0x7fa1cc0090e0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 -- 172.21.15.125:0/3146076560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1dc15cc80 msgr2=0x7fa1dc0c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1dc15cc80 0x7fa1dc0c7b40 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4015040 tx=0x7fa1d4004ad0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 -- 172.21.15.125:0/3146076560 shutdown_connections 2023-11-28T11:12:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1dc15cc80 0x7fa1dc0c7b40 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa1c00682f0 0x7fa1c006a7a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1dc06a270 0x7fa1dc153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 --2- 172.21.15.125:0/3146076560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc06e3a0 0x7fa1dc0b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 -- 172.21.15.125:0/3146076560 >> 172.21.15.125:0/3146076560 conn(0x7fa1dc06c010 msgr2=0x7fa1dc15a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:47.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 -- 172.21.15.125:0/3146076560 shutdown_connections 2023-11-28T11:12:47.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.698+0000 7fa1e3fee700 1 -- 172.21.15.125:0/3146076560 wait complete. 2023-11-28T11:12:47.712 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T11:12:47.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.832+0000 7f94b1c68700 1 Processor -- start 2023-11-28T11:12:47.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.832+0000 7f94b1c68700 1 -- start start 2023-11-28T11:12:47.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94b1c68700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94ac15c810 0x7f94ac160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94b1c68700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f94ac0718e0 0x7f94ac06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94b1c68700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac1607a0 con 0x7f94ac06cdc0 2023-11-28T11:12:47.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94b1c68700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac15cbe0 con 0x7f94ac0718e0 2023-11-28T11:12:47.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94b1c68700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac160a50 con 0x7f94ac15c810 2023-11-28T11:12:47.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94aaffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f94ac0718e0 0x7f94ac06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94aaffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f94ac0718e0 0x7f94ac06c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33794/0 (socket says 172.21.15.125:33794) 2023-11-28T11:12:47.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94aaffd700 1 -- 172.21.15.125:0/692945257 learned_addr learned my addr 172.21.15.125:0/692945257 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:47.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94aaffd700 1 -- 172.21.15.125:0/692945257 >> v2:172.21.15.167:3300/0 conn(0x7f94ac15c810 msgr2=0x7f94ac160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94aaffd700 1 --2- 172.21.15.125:0/692945257 >> v2:172.21.15.167:3300/0 conn(0x7f94ac15c810 0x7f94ac160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94aaffd700 1 -- 172.21.15.125:0/692945257 >> v1:172.21.15.167:6789/0 conn(0x7f94ac06cdc0 legacy=0x7f94ac06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94aaffd700 1 -- 172.21.15.125:0/692945257 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac160d30 con 0x7f94ac0718e0 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94aaffd700 1 --2- 172.21.15.125:0/692945257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94ac0718e0 0x7f94ac06c880 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0b27c0 tx=0x7f949c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8084ce4d1c19f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94aa7fc700 1 -- 172.21.15.125:0/692945257 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c004230 con 0x7f94ac0718e0 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.833+0000 7f94aa7fc700 1 -- 172.21.15.125:0/692945257 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c004390 con 0x7f94ac0718e0 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.834+0000 7f94aa7fc700 1 -- 172.21.15.125:0/692945257 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0036a0 con 0x7f94ac0718e0 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.834+0000 7f94b1c68700 1 -- 172.21.15.125:0/692945257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94ac0718e0 msgr2=0x7f94ac06c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.834+0000 7f94b1c68700 1 --2- 172.21.15.125:0/692945257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94ac0718e0 0x7f94ac06c880 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0b27c0 tx=0x7f949c009bd0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.834+0000 7f94b1c68700 1 -- 172.21.15.125:0/692945257 shutdown_connections 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.834+0000 7f94b1c68700 1 --2- 172.21.15.125:0/692945257 >> v2:172.21.15.167:3300/0 conn(0x7f94ac15c810 0x7f94ac160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.834+0000 7f94b1c68700 1 --2- 172.21.15.125:0/692945257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94ac0718e0 0x7f94ac06c880 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.834+0000 7f94b1c68700 1 -- 172.21.15.125:0/692945257 >> 172.21.15.125:0/692945257 conn(0x7f94ac06c010 msgr2=0x7f94ac0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:47.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.834+0000 7f94b1c68700 1 -- 172.21.15.125:0/692945257 shutdown_connections 2023-11-28T11:12:47.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.834+0000 7f94b1c68700 1 -- 172.21.15.125:0/692945257 wait complete. 2023-11-28T11:12:47.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.835+0000 7f94b1c68700 1 Processor -- start 2023-11-28T11:12:47.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.835+0000 7f94b1c68700 1 -- start start 2023-11-28T11:12:47.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.836+0000 7f94b1c68700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94ac06cdc0 0x7f94ac152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.836+0000 7f94b1c68700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94ac0718e0 0x7f94ac0b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.836+0000 7f94b1c68700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94ac15c810 0x7f94ac15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.836+0000 7f94b1c68700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0b39a0 con 0x7f94ac06cdc0 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.836+0000 7f94b1c68700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0b33e0 con 0x7f94ac0718e0 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.836+0000 7f94b1c68700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0b36c0 con 0x7f94ac15c810 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.836+0000 7f94ab7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94ac06cdc0 0x7f94ac152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.836+0000 7f94ab7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94ac06cdc0 0x7f94ac152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33800/0 (socket says 172.21.15.125:33800) 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.836+0000 7f94ab7fe700 1 -- 172.21.15.125:0/3485262641 learned_addr learned my addr 172.21.15.125:0/3485262641 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.836+0000 7f94aaffd700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94ac0718e0 0x7f94ac0b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.836+0000 7f94abfff700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94ac15c810 0x7f94ac15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f94ab7fe700 1 -- 172.21.15.125:0/3485262641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94ac15c810 msgr2=0x7f94ac15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f94ab7fe700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94ac15c810 0x7f94ac15d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f94ab7fe700 1 -- 172.21.15.125:0/3485262641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94ac0718e0 msgr2=0x7f94ac0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f94ab7fe700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94ac0718e0 0x7f94ac0b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f94ab7fe700 1 -- 172.21.15.125:0/3485262641 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c009550 con 0x7f94ac06cdc0 2023-11-28T11:12:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f94abfff700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94ac15c810 0x7f94ac15d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f94ab7fe700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94ac06cdc0 0x7f94ac152b30 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f94a000b4a0 tx=0x7f94a000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f9493fff700 1 -- 172.21.15.125:0/3485262641 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0011830 con 0x7f94ac06cdc0 2023-11-28T11:12:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f9493fff700 1 -- 172.21.15.125:0/3485262641 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a0011990 con 0x7f94ac06cdc0 2023-11-28T11:12:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f94b1c68700 1 -- 172.21.15.125:0/3485262641 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac0ceb20 con 0x7f94ac06cdc0 2023-11-28T11:12:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f9493fff700 1 -- 172.21.15.125:0/3485262641 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0011d40 con 0x7f94ac06cdc0 2023-11-28T11:12:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.837+0000 7f94b1c68700 1 -- 172.21.15.125:0/3485262641 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac161010 con 0x7f94ac06cdc0 2023-11-28T11:12:47.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.838+0000 7f94b1c68700 1 -- 172.21.15.125:0/3485262641 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac0ce740 con 0x7f94ac06cdc0 2023-11-28T11:12:47.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.838+0000 7f9493fff700 1 -- 172.21.15.125:0/3485262641 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f94a0021070 con 0x7f94ac06cdc0 2023-11-28T11:12:47.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.838+0000 7f9493fff700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94980682f0 0x7f949806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:47.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.839+0000 7f9493fff700 1 -- 172.21.15.125:0/3485262641 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f94a0085ce0 con 0x7f94ac06cdc0 2023-11-28T11:12:47.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.839+0000 7f94aaffd700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94980682f0 0x7f949806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:47.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.839+0000 7f94aaffd700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94980682f0 0x7f949806a7a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f949c009130 tx=0x7f949c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:47.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:47.843+0000 7f9493fff700 1 -- 172.21.15.125:0/3485262641 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f94a0052430 con 0x7f94ac06cdc0 2023-11-28T11:12:48.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:48.069+0000 7f94b1c68700 1 -- 172.21.15.125:0/3485262641 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f94ac0743f0 con 0x7f94ac06cdc0 2023-11-28T11:12:49.056 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-11-28T11:12:49.054+0000 7f87cb91a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T11:12:49.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.062+0000 7f9493fff700 1 -- 172.21.15.125:0/3485262641 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f94a0015020 con 0x7f94ac06cdc0 2023-11-28T11:12:49.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 -- 172.21.15.125:0/3485262641 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94980682f0 msgr2=0x7f949806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:49.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94980682f0 0x7f949806a7a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f949c009130 tx=0x7f949c008030 comp rx=0 tx=0).stop 2023-11-28T11:12:49.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 -- 172.21.15.125:0/3485262641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94ac06cdc0 msgr2=0x7f94ac152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:49.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94ac06cdc0 0x7f94ac152b30 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f94a000b4a0 tx=0x7f94a000b860 comp rx=0 tx=0).stop 2023-11-28T11:12:49.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 -- 172.21.15.125:0/3485262641 shutdown_connections 2023-11-28T11:12:49.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f94980682f0 0x7f949806a7a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:49.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94ac15c810 0x7f94ac15d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:49.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94ac06cdc0 0x7f94ac152b30 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:49.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 --2- 172.21.15.125:0/3485262641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94ac0718e0 0x7f94ac0b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:49.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 -- 172.21.15.125:0/3485262641 >> 172.21.15.125:0/3485262641 conn(0x7f94ac06c010 msgr2=0x7f94ac0cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:49.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 -- 172.21.15.125:0/3485262641 shutdown_connections 2023-11-28T11:12:49.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.065+0000 7f94b1c68700 1 -- 172.21.15.125:0/3485262641 wait complete. 2023-11-28T11:12:49.068 INFO:tasks.ceph.mds.b.smithi167.stderr: -5195> 2023-11-28T11:11:45.067+0000 7fe14c8e1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:12:49.068 INFO:teuthology.orchestra.run.smithi125.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T11:12:49.069 INFO:tasks.ceph.mds.b.smithi167.stderr: -3706> 2023-11-28T11:11:48.471+0000 7fe1490da700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6432=0-4194304@1} caps={6432=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6432 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x555f201f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T11:12:49.080 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T11:12:49.098 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2023-11-28T11:12:49.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.203+0000 7facb9449700 1 Processor -- start 2023-11-28T11:12:49.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.203+0000 7facb9449700 1 -- start start 2023-11-28T11:12:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.204+0000 7facb9449700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7facb4158e10 0x7facb40cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.204+0000 7facb9449700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb40ae850 0x7facb406c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:49.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.204+0000 7facb9449700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facb406c980 0x7facb415c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.204+0000 7facb9449700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb406ac30 con 0x7facb406c980 2023-11-28T11:12:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.204+0000 7facb9449700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb406ce00 con 0x7facb4158e10 2023-11-28T11:12:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.204+0000 7facb9449700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb40ca140 con 0x7facb40ae850 2023-11-28T11:12:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.204+0000 7facb37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facb406c980 0x7facb415c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.204+0000 7facb37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7facb406c980 0x7facb415c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33812/0 (socket says 172.21.15.125:33812) 2023-11-28T11:12:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.204+0000 7facb37fe700 1 -- 172.21.15.125:0/1902947527 learned_addr learned my addr 172.21.15.125:0/1902947527 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.204+0000 7facb2ffd700 1 --2- 172.21.15.125:0/1902947527 >> v2:172.21.15.167:3300/0 conn(0x7facb4158e10 0x7facb40cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.204+0000 7facaa7fc700 1 --2- 172.21.15.125:0/1902947527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb40ae850 0x7facb406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.205+0000 7facb37fe700 1 -- 172.21.15.125:0/1902947527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb40ae850 msgr2=0x7facb406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:49.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.205+0000 7facb37fe700 1 --2- 172.21.15.125:0/1902947527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb40ae850 0x7facb406c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.205+0000 7facb37fe700 1 -- 172.21.15.125:0/1902947527 >> v2:172.21.15.167:3300/0 conn(0x7facb4158e10 msgr2=0x7facb40cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.205+0000 7facb37fe700 1 --2- 172.21.15.125:0/1902947527 >> v2:172.21.15.167:3300/0 conn(0x7facb4158e10 0x7facb40cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.205+0000 7facb37fe700 1 -- 172.21.15.125:0/1902947527 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb40c9b80 con 0x7facb406c980 2023-11-28T11:12:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.205+0000 7facb37fe700 1 --2- 172.21.15.125:0/1902947527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb406c980 0x7facb415c7c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7facb406fb70 tx=0x7facac00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7bbd8bf9c6df11 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.205+0000 7facb27fc700 1 -- 172.21.15.125:0/1902947527 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac010070 con 0x7facb406c980 2023-11-28T11:12:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.205+0000 7facb27fc700 1 -- 172.21.15.125:0/1902947527 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac00dad0 con 0x7facb406c980 2023-11-28T11:12:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.205+0000 7facb27fc700 1 -- 172.21.15.125:0/1902947527 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac00de60 con 0x7facb406c980 2023-11-28T11:12:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.206+0000 7facb9449700 1 -- 172.21.15.125:0/1902947527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb406c980 msgr2=0x7facb415c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.206+0000 7facb9449700 1 --2- 172.21.15.125:0/1902947527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb406c980 0x7facb415c7c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7facb406fb70 tx=0x7facac00d430 comp rx=0 tx=0).stop 2023-11-28T11:12:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.206+0000 7facb9449700 1 -- 172.21.15.125:0/1902947527 shutdown_connections 2023-11-28T11:12:49.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.206+0000 7facb9449700 1 --2- 172.21.15.125:0/1902947527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb406c980 0x7facb415c7c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.206+0000 7facb9449700 1 --2- 172.21.15.125:0/1902947527 >> v2:172.21.15.167:3300/0 conn(0x7facb4158e10 0x7facb40cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.206+0000 7facb9449700 1 --2- 172.21.15.125:0/1902947527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb40ae850 0x7facb406c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.206+0000 7facb9449700 1 -- 172.21.15.125:0/1902947527 >> 172.21.15.125:0/1902947527 conn(0x7facb40cf400 msgr2=0x7facb40cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.206+0000 7facb9449700 1 -- 172.21.15.125:0/1902947527 shutdown_connections 2023-11-28T11:12:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.206+0000 7facb9449700 1 -- 172.21.15.125:0/1902947527 wait complete. 2023-11-28T11:12:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.207+0000 7facb9449700 1 Processor -- start 2023-11-28T11:12:49.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.207+0000 7facb9449700 1 -- start start 2023-11-28T11:12:49.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.208+0000 7facb9449700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb406c980 0x7facb40c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:49.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.208+0000 7facb9449700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb40ae850 0x7facb4157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:49.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.208+0000 7facb9449700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb4158e10 0x7facb4157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:49.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.208+0000 7facb9449700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb41f1fc0 con 0x7facb406c980 2023-11-28T11:12:49.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.208+0000 7facb9449700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb41f1340 con 0x7facb4158e10 2023-11-28T11:12:49.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.208+0000 7facb9449700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb41f1620 con 0x7facb40ae850 2023-11-28T11:12:49.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.208+0000 7facb2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb406c980 0x7facb40c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:49.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.208+0000 7facb2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb406c980 0x7facb40c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33814/0 (socket says 172.21.15.125:33814) 2023-11-28T11:12:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.208+0000 7facb2ffd700 1 -- 172.21.15.125:0/1461582066 learned_addr learned my addr 172.21.15.125:0/1461582066 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.208+0000 7facaa7fc700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb40ae850 0x7facb4157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.208+0000 7facb37fe700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb4158e10 0x7facb4157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.209+0000 7facb2ffd700 1 -- 172.21.15.125:0/1461582066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb40ae850 msgr2=0x7facb4157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.209+0000 7facb2ffd700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb40ae850 0x7facb4157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.209+0000 7facb2ffd700 1 -- 172.21.15.125:0/1461582066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb4158e10 msgr2=0x7facb4157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.209+0000 7facb2ffd700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb4158e10 0x7facb4157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.209+0000 7facb2ffd700 1 -- 172.21.15.125:0/1461582066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac00bd40 con 0x7facb406c980 2023-11-28T11:12:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.209+0000 7facb2ffd700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb406c980 0x7facb40c5100 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7faca400e870 tx=0x7faca400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.209+0000 7facabfff700 1 -- 172.21.15.125:0/1461582066 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4009590 con 0x7facb406c980 2023-11-28T11:12:49.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.209+0000 7facabfff700 1 -- 172.21.15.125:0/1461582066 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca4013680 con 0x7facb406c980 2023-11-28T11:12:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.209+0000 7facb9449700 1 -- 172.21.15.125:0/1461582066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb406ae20 con 0x7facb406c980 2023-11-28T11:12:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.209+0000 7facabfff700 1 -- 172.21.15.125:0/1461582066 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca40139f0 con 0x7facb406c980 2023-11-28T11:12:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.209+0000 7facb9449700 1 -- 172.21.15.125:0/1461582066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb40c9e60 con 0x7facb406c980 2023-11-28T11:12:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.210+0000 7facb9449700 1 -- 172.21.15.125:0/1461582066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb406b100 con 0x7facb406c980 2023-11-28T11:12:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.210+0000 7facabfff700 1 -- 172.21.15.125:0/1461582066 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7faca4019030 con 0x7facb406c980 2023-11-28T11:12:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.211+0000 7facabfff700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac940682f0 0x7fac9406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.211+0000 7facabfff700 1 -- 172.21.15.125:0/1461582066 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6293+0+0 (secure 0 0 0) 0x7faca4085aa0 con 0x7facb406c980 2023-11-28T11:12:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.211+0000 7facaa7fc700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac940682f0 0x7fac9406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:49.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.211+0000 7facaa7fc700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac940682f0 0x7fac9406a7a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7facb40c8bf0 tx=0x7fac9c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:49.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.215+0000 7facabfff700 1 -- 172.21.15.125:0/1461582066 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7faca40521b0 con 0x7facb406c980 2023-11-28T11:12:49.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:49.442+0000 7facb9449700 1 -- 172.21.15.125:0/1461582066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7facb40743f0 con 0x7facb406c980 2023-11-28T11:12:50.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.071+0000 7facabfff700 1 -- 172.21.15.125:0/1461582066 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7faca40557d0 con 0x7facb406c980 2023-11-28T11:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 -- 172.21.15.125:0/1461582066 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac940682f0 msgr2=0x7fac9406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac940682f0 0x7fac9406a7a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7facb40c8bf0 tx=0x7fac9c009210 comp rx=0 tx=0).stop 2023-11-28T11:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 -- 172.21.15.125:0/1461582066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb406c980 msgr2=0x7facb40c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb406c980 0x7facb40c5100 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7faca400e870 tx=0x7faca400eb80 comp rx=0 tx=0).stop 2023-11-28T11:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 -- 172.21.15.125:0/1461582066 shutdown_connections 2023-11-28T11:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb4158e10 0x7facb4157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facb406c980 0x7facb40c5100 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fac940682f0 0x7fac9406a7a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 --2- 172.21.15.125:0/1461582066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb40ae850 0x7facb4157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 -- 172.21.15.125:0/1461582066 >> 172.21.15.125:0/1461582066 conn(0x7facb40cf400 msgr2=0x7facb4154980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 -- 172.21.15.125:0/1461582066 shutdown_connections 2023-11-28T11:12:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.074+0000 7facb9449700 1 -- 172.21.15.125:0/1461582066 wait complete. 2023-11-28T11:12:50.090 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T11:12:50.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.217+0000 7f424bd7e700 1 Processor -- start 2023-11-28T11:12:50.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.217+0000 7f424bd7e700 1 -- start start 2023-11-28T11:12:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.218+0000 7f424bd7e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f424415cce0 0x7f424406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.218+0000 7f424bd7e700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f424415dc40 0x7f4244070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.218+0000 7f424bd7e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440cdc10 con 0x7f4244071150 2023-11-28T11:12:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.218+0000 7f424bd7e700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440715d0 con 0x7f424415dc40 2023-11-28T11:12:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.218+0000 7f424bd7e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424415d0b0 con 0x7f424415cce0 2023-11-28T11:12:50.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.218+0000 7f424a31b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4244071150 0x7f42440c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46182/0 (socket says 172.21.15.125:46182) 2023-11-28T11:12:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.218+0000 7f424a31b700 1 -- 172.21.15.125:0/3414437164 learned_addr learned my addr 172.21.15.125:0/3414437164 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4249319700 1 --2- 172.21.15.125:0/3414437164 >> v2:172.21.15.167:3300/0 conn(0x7f424415dc40 0x7f4244070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4249b1a700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f424415cce0 0x7f424406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776018483 0 0) 0x7f42440cdc10 con 0x7f4244071150 2023-11-28T11:12:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42300035b0 con 0x7f4244071150 2023-11-28T11:12:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 134808187 0 0) 0x7f42300035b0 con 0x7f4244071150 2023-11-28T11:12:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f424415cce0 msgr2=0x7f424406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f424415cce0 0x7f424406b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 >> v2:172.21.15.167:3300/0 conn(0x7f424415dc40 msgr2=0x7f4244070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:50.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 --2- 172.21.15.125:0/3414437164 >> v2:172.21.15.167:3300/0 conn(0x7f424415dc40 0x7f4244070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440cfa10 con 0x7f4244071150 2023-11-28T11:12:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f423c0019f0 con 0x7f4244071150 2023-11-28T11:12:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 >> v1:172.21.15.125:6789/0 conn(0x7f4244071150 legacy=0x7f42440c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f424415cce0 0x7f4230003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4230003f80 0x7f4230004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4230004d90 0x7f4230005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42440715d0 con 0x7f4230003f80 2023-11-28T11:12:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424415d0b0 con 0x7f4230004d90 2023-11-28T11:12:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423000ba40 con 0x7f424415cce0 2023-11-28T11:12:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4249319700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4230003f80 0x7f4230004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:50.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4249b1a700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f424415cce0 0x7f4230003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f424a31b700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4230004d90 0x7f4230005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4249319700 1 -- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f424415cce0 msgr2=0x7f4230003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4249319700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f424415cce0 0x7f4230003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4249319700 1 -- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4230004d90 msgr2=0x7f4230005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4249319700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4230004d90 0x7f4230005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4249319700 1 -- 172.21.15.125:0/3414437164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300035b0 con 0x7f4230003f80 2023-11-28T11:12:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f424a31b700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4230004d90 0x7f4230005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.219+0000 7f4249319700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4230003f80 0x7f4230004850 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4240009b60 tx=0x7f4230005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287b69975ab57778 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.220+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000e660 con 0x7f4230003f80 2023-11-28T11:12:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.220+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424000e7c0 con 0x7f4230003f80 2023-11-28T11:12:50.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.220+0000 7f4248b18700 1 -- 172.21.15.125:0/3414437164 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000eb30 con 0x7f4230003f80 2023-11-28T11:12:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.220+0000 7f424bd7e700 1 -- 172.21.15.125:0/3414437164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4230003f80 msgr2=0x7f4230004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.220+0000 7f424bd7e700 1 --2- 172.21.15.125:0/3414437164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4230003f80 0x7f4230004850 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4240009b60 tx=0x7f4230005880 comp rx=0 tx=0).stop 2023-11-28T11:12:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.220+0000 7f424a31b700 1 -- 172.21.15.125:0/3414437164 reap_dead start 2023-11-28T11:12:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.220+0000 7f424bd7e700 1 -- 172.21.15.125:0/3414437164 shutdown_connections 2023-11-28T11:12:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.220+0000 7f424bd7e700 1 -- 172.21.15.125:0/3414437164 >> 172.21.15.125:0/3414437164 conn(0x7f42440cfc30 msgr2=0x7f42440d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.220+0000 7f424bd7e700 1 -- 172.21.15.125:0/3414437164 shutdown_connections 2023-11-28T11:12:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.220+0000 7f424bd7e700 1 -- 172.21.15.125:0/3414437164 wait complete. 2023-11-28T11:12:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.221+0000 7f424bd7e700 1 Processor -- start 2023-11-28T11:12:50.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.221+0000 7f424bd7e700 1 -- start start 2023-11-28T11:12:50.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.222+0000 7f424bd7e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4230003f80 0x7f42440ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:50.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.222+0000 7f424bd7e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42440b50e0 0x7f42440cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:50.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.222+0000 7f424bd7e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4244156d90 0x7f4244157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:50.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.222+0000 7f424bd7e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244157770 con 0x7f4244156d90 2023-11-28T11:12:50.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.222+0000 7f424bd7e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42440cabb0 con 0x7f42440b50e0 2023-11-28T11:12:50.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.222+0000 7f424bd7e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440cae90 con 0x7f4230003f80 2023-11-28T11:12:50.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.222+0000 7f424a31b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4244156d90 0x7f4244157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:50.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.222+0000 7f424a31b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4244156d90 0x7f4244157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33836/0 (socket says 172.21.15.125:33836) 2023-11-28T11:12:50.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.222+0000 7f424a31b700 1 -- 172.21.15.125:0/3400368697 learned_addr learned my addr 172.21.15.125:0/3400368697 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:50.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.222+0000 7f4249b1a700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4230003f80 0x7f42440ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:50.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.222+0000 7f4249319700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42440b50e0 0x7f42440cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:50.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.223+0000 7f424a31b700 1 -- 172.21.15.125:0/3400368697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4230003f80 msgr2=0x7f42440ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:50.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.223+0000 7f424a31b700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4230003f80 0x7f42440ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.223+0000 7f424a31b700 1 -- 172.21.15.125:0/3400368697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42440b50e0 msgr2=0x7f42440cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.223+0000 7f424a31b700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42440b50e0 0x7f42440cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.223+0000 7f424a31b700 1 -- 172.21.15.125:0/3400368697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440cd8a0 con 0x7f4244156d90 2023-11-28T11:12:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.223+0000 7f424a31b700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4244156d90 0x7f4244157230 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f423c001330 tx=0x7f423c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.223+0000 7f423a7fc700 1 -- 172.21.15.125:0/3400368697 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c00ee90 con 0x7f4244156d90 2023-11-28T11:12:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.223+0000 7f423a7fc700 1 -- 172.21.15.125:0/3400368697 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c013420 con 0x7f4244156d90 2023-11-28T11:12:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.223+0000 7f424bd7e700 1 -- 172.21.15.125:0/3400368697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42440cf730 con 0x7f4244156d90 2023-11-28T11:12:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.223+0000 7f423a7fc700 1 -- 172.21.15.125:0/3400368697 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0137d0 con 0x7f4244156d90 2023-11-28T11:12:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.223+0000 7f424bd7e700 1 -- 172.21.15.125:0/3400368697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424415e0b0 con 0x7f4244156d90 2023-11-28T11:12:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.224+0000 7f424bd7e700 1 -- 172.21.15.125:0/3400368697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42440743f0 con 0x7f4244156d90 2023-11-28T11:12:50.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.224+0000 7f423a7fc700 1 -- 172.21.15.125:0/3400368697 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f423c013930 con 0x7f4244156d90 2023-11-28T11:12:50.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.225+0000 7f423a7fc700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4228068320 0x7f422806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:50.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.225+0000 7f423a7fc700 1 -- 172.21.15.125:0/3400368697 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f423c0865a0 con 0x7f4244156d90 2023-11-28T11:12:50.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.225+0000 7f4249b1a700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4228068320 0x7f422806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:50.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.225+0000 7f4249b1a700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4228068320 0x7f422806a7d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f424415d410 tx=0x7f4234008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:50.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.229+0000 7f423a7fc700 1 -- 172.21.15.125:0/3400368697 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f423c052d10 con 0x7f4244156d90 2023-11-28T11:12:50.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:50.413+0000 7f424bd7e700 1 -- 172.21.15.125:0/3400368697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f42440d0330 con 0x7f4244156d90 2023-11-28T11:12:51.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.122+0000 7f423a7fc700 1 -- 172.21.15.125:0/3400368697 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v70) v1 ==== 181+0+0 (secure 0 0 0) 0x7f423c056330 con 0x7f4244156d90 2023-11-28T11:12:51.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.125+0000 7f424bd7e700 1 -- 172.21.15.125:0/3400368697 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4228068320 msgr2=0x7f422806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:51.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.125+0000 7f424bd7e700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4228068320 0x7f422806a7d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f424415d410 tx=0x7f4234008040 comp rx=0 tx=0).stop 2023-11-28T11:12:51.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.125+0000 7f424bd7e700 1 -- 172.21.15.125:0/3400368697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4244156d90 msgr2=0x7f4244157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:51.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.125+0000 7f424bd7e700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4244156d90 0x7f4244157230 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f423c001330 tx=0x7f423c00e720 comp rx=0 tx=0).stop 2023-11-28T11:12:51.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.126+0000 7f424bd7e700 1 -- 172.21.15.125:0/3400368697 shutdown_connections 2023-11-28T11:12:51.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.126+0000 7f424bd7e700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4244156d90 0x7f4244157230 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:51.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.126+0000 7f424bd7e700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f4228068320 0x7f422806a7d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:51.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.126+0000 7f424bd7e700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4230003f80 0x7f42440ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:51.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.126+0000 7f424bd7e700 1 --2- 172.21.15.125:0/3400368697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42440b50e0 0x7f42440cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:51.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.126+0000 7f424bd7e700 1 -- 172.21.15.125:0/3400368697 >> 172.21.15.125:0/3400368697 conn(0x7f42440cfc30 msgr2=0x7f42440af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:51.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.126+0000 7f424bd7e700 1 -- 172.21.15.125:0/3400368697 shutdown_connections 2023-11-28T11:12:51.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.126+0000 7f424bd7e700 1 -- 172.21.15.125:0/3400368697 wait complete. 2023-11-28T11:12:51.129 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' removed 2023-11-28T11:12:51.142 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T11:12:51.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.269+0000 7f331d4f0700 1 Processor -- start 2023-11-28T11:12:51.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.269+0000 7f331d4f0700 1 -- start start 2023-11-28T11:12:51.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.269+0000 7f331d4f0700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f331806d830 0x7f331815d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:51.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.269+0000 7f331d4f0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806ff90 0x7f3318070410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:51.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.269+0000 7f331d4f0700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331806de10 con 0x7f33181592f0 2023-11-28T11:12:51.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.269+0000 7f331d4f0700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331806fb00 con 0x7f331806d830 2023-11-28T11:12:51.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.269+0000 7f331d4f0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33181596c0 con 0x7f331806ff90 2023-11-28T11:12:51.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.270+0000 7f33177fe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806ff90 0x7f3318070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:51.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.270+0000 7f33167fc700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f331806d830 0x7f331815d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:51.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.270+0000 7f3316ffd700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f33181592f0 0x7f331815ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:49000/0 (socket says 172.21.15.125:49000) 2023-11-28T11:12:51.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.270+0000 7f33177fe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806ff90 0x7f3318070410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:57086/0 (socket says 172.21.15.125:57086) 2023-11-28T11:12:51.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.270+0000 7f3316ffd700 1 -- 172.21.15.125:0/2974043998 learned_addr learned my addr 172.21.15.125:0/2974043998 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:51.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.270+0000 7f33177fe700 1 -- 172.21.15.125:0/2974043998 >> v2:172.21.15.167:3300/0 conn(0x7f331806d830 msgr2=0x7f331815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:51.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.270+0000 7f33177fe700 1 --2- 172.21.15.125:0/2974043998 >> v2:172.21.15.167:3300/0 conn(0x7f331806d830 0x7f331815d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:51.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.270+0000 7f33177fe700 1 -- 172.21.15.125:0/2974043998 >> v1:172.21.15.167:6789/0 conn(0x7f33181592f0 legacy=0x7f331815ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:51.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.270+0000 7f33177fe700 1 -- 172.21.15.125:0/2974043998 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180b24d0 con 0x7f331806ff90 2023-11-28T11:12:51.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.270+0000 7f33167fc700 1 --2- 172.21.15.125:0/2974043998 >> v2:172.21.15.167:3300/0 conn(0x7f331806d830 0x7f331815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:12:51.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.270+0000 7f33177fe700 1 --2- 172.21.15.125:0/2974043998 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806ff90 0x7f3318070410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3310009d90 tx=0x7f331000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb0c67eaeac617fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:51.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.271+0000 7f3315ffb700 1 -- 172.21.15.125:0/2974043998 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331000e070 con 0x7f331806ff90 2023-11-28T11:12:51.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.271+0000 7f3315ffb700 1 -- 172.21.15.125:0/2974043998 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331000bb20 con 0x7f331806ff90 2023-11-28T11:12:51.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.271+0000 7f3315ffb700 1 -- 172.21.15.125:0/2974043998 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310012430 con 0x7f331806ff90 2023-11-28T11:12:51.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.271+0000 7f331d4f0700 1 -- 172.21.15.125:0/2974043998 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806ff90 msgr2=0x7f3318070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:51.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.271+0000 7f331d4f0700 1 --2- 172.21.15.125:0/2974043998 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806ff90 0x7f3318070410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3310009d90 tx=0x7f331000b330 comp rx=0 tx=0).stop 2023-11-28T11:12:51.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.271+0000 7f331d4f0700 1 -- 172.21.15.125:0/2974043998 shutdown_connections 2023-11-28T11:12:51.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.271+0000 7f331d4f0700 1 --2- 172.21.15.125:0/2974043998 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806ff90 0x7f3318070410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:51.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.271+0000 7f331d4f0700 1 --2- 172.21.15.125:0/2974043998 >> v2:172.21.15.167:3300/0 conn(0x7f331806d830 0x7f331815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:51.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.271+0000 7f331d4f0700 1 -- 172.21.15.125:0/2974043998 >> 172.21.15.125:0/2974043998 conn(0x7f3318065ef0 msgr2=0x7f33180662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:51.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.271+0000 7f331d4f0700 1 -- 172.21.15.125:0/2974043998 shutdown_connections 2023-11-28T11:12:51.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.271+0000 7f331d4f0700 1 -- 172.21.15.125:0/2974043998 wait complete. 2023-11-28T11:12:51.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.273+0000 7f331d4f0700 1 Processor -- start 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.273+0000 7f331d4f0700 1 -- start start 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.273+0000 7f331d4f0700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806d830 0x7f3318147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.273+0000 7f331d4f0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f331806ff90 0x7f33180cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.273+0000 7f331d4f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33181592f0 0x7f33180cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.273+0000 7f331d4f0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33180c9180 con 0x7f33181592f0 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.273+0000 7f331d4f0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318147ad0 con 0x7f331806ff90 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.273+0000 7f331d4f0700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33181f6660 con 0x7f331806d830 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.273+0000 7f33177fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33181592f0 0x7f33180cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f33177fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33181592f0 0x7f33180cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33852/0 (socket says 172.21.15.125:33852) 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f33177fe700 1 -- 172.21.15.125:0/4288342143 learned_addr learned my addr 172.21.15.125:0/4288342143 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f33167fc700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f331806ff90 0x7f33180cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f3316ffd700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806d830 0x7f3318147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f33177fe700 1 -- 172.21.15.125:0/4288342143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806d830 msgr2=0x7f3318147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f33177fe700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806d830 0x7f3318147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f33177fe700 1 -- 172.21.15.125:0/4288342143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f331806ff90 msgr2=0x7f33180cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f33177fe700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f331806ff90 0x7f33180cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f33177fe700 1 -- 172.21.15.125:0/4288342143 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c0094a0 con 0x7f33181592f0 2023-11-28T11:12:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f33177fe700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33181592f0 0x7f33180cefb0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3310014040 tx=0x7f3310004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f32ff7fe700 1 -- 172.21.15.125:0/4288342143 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310012430 con 0x7f33181592f0 2023-11-28T11:12:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f32ff7fe700 1 -- 172.21.15.125:0/4288342143 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3310020070 con 0x7f33181592f0 2023-11-28T11:12:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f331d4f0700 1 -- 172.21.15.125:0/4288342143 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3310009a70 con 0x7f33181592f0 2023-11-28T11:12:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f32ff7fe700 1 -- 172.21.15.125:0/4288342143 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310003ea0 con 0x7f33181592f0 2023-11-28T11:12:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.274+0000 7f331d4f0700 1 -- 172.21.15.125:0/4288342143 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33180b2a90 con 0x7f33181592f0 2023-11-28T11:12:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.275+0000 7f331d4f0700 1 -- 172.21.15.125:0/4288342143 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33180b27b0 con 0x7f33181592f0 2023-11-28T11:12:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.276+0000 7f32ff7fe700 1 -- 172.21.15.125:0/4288342143 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3310004040 con 0x7f33181592f0 2023-11-28T11:12:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.276+0000 7f32ff7fe700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f33040682f0 0x7f330406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.276+0000 7f32ff7fe700 1 -- 172.21.15.125:0/4288342143 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5826+0+0 (secure 0 0 0) 0x7f3310022070 con 0x7f33181592f0 2023-11-28T11:12:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.276+0000 7f3316ffd700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f33040682f0 0x7f330406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.276+0000 7f3316ffd700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f33040682f0 0x7f330406a7a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3308005910 tx=0x7f3308009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:51.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.280+0000 7f32ff7fe700 1 -- 172.21.15.125:0/4288342143 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f33100545e0 con 0x7f33181592f0 2023-11-28T11:12:51.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:51.464+0000 7f331d4f0700 1 -- 172.21.15.125:0/4288342143 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f331806be00 con 0x7f33181592f0 2023-11-28T11:12:52.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.123+0000 7f32ff7fe700 1 -- 172.21.15.125:0/4288342143 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3310057c00 con 0x7f33181592f0 2023-11-28T11:12:52.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.127+0000 7f331d4f0700 1 -- 172.21.15.125:0/4288342143 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f33040682f0 msgr2=0x7f330406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:52.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.127+0000 7f331d4f0700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f33040682f0 0x7f330406a7a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3308005910 tx=0x7f3308009040 comp rx=0 tx=0).stop 2023-11-28T11:12:52.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.127+0000 7f331d4f0700 1 -- 172.21.15.125:0/4288342143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33181592f0 msgr2=0x7f33180cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:52.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.127+0000 7f331d4f0700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33181592f0 0x7f33180cefb0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3310014040 tx=0x7f3310004ad0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.127+0000 7f331d4f0700 1 -- 172.21.15.125:0/4288342143 shutdown_connections 2023-11-28T11:12:52.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.127+0000 7f331d4f0700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33181592f0 0x7f33180cefb0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.127+0000 7f331d4f0700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f33040682f0 0x7f330406a7a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.127+0000 7f331d4f0700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f331806d830 0x7f3318147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.127+0000 7f331d4f0700 1 --2- 172.21.15.125:0/4288342143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f331806ff90 0x7f33180cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.127+0000 7f331d4f0700 1 -- 172.21.15.125:0/4288342143 >> 172.21.15.125:0/4288342143 conn(0x7f3318065ef0 msgr2=0x7f33180ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:52.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.128+0000 7f331d4f0700 1 -- 172.21.15.125:0/4288342143 shutdown_connections 2023-11-28T11:12:52.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.128+0000 7f331d4f0700 1 -- 172.21.15.125:0/4288342143 wait complete. 2023-11-28T11:12:52.134 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' removed 2023-11-28T11:12:52.145 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T11:12:52.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.267+0000 7f7b9cc92700 1 Processor -- start 2023-11-28T11:12:52.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.267+0000 7f7b9cc92700 1 -- start start 2023-11-28T11:12:52.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b9cc92700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b9815fe50 0x7f7b9806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b9cc92700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7b980b3b80 0x7f7b98160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b9cc92700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7b980b27d0 0x7f7b980b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b9cc92700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b980b3190 con 0x7f7b980b27d0 2023-11-28T11:12:52.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b9cc92700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b98160220 con 0x7f7b980b3b80 2023-11-28T11:12:52.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b9cc92700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b98161370 con 0x7f7b9815fe50 2023-11-28T11:12:52.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b96d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7b980b27d0 0x7f7b980b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b96d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7b980b27d0 0x7f7b980b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33858/0 (socket says 172.21.15.125:33858) 2023-11-28T11:12:52.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b96d9d700 1 -- 172.21.15.125:0/3795781187 learned_addr learned my addr 172.21.15.125:0/3795781187 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:52.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b95d9b700 1 --2- 172.21.15.125:0/3795781187 >> v2:172.21.15.167:3300/0 conn(0x7f7b980b3b80 0x7f7b98160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b96d9d700 1 -- 172.21.15.125:0/3795781187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b9815fe50 msgr2=0x7f7b9806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:52.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b96d9d700 1 --2- 172.21.15.125:0/3795781187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b9815fe50 0x7f7b9806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b96d9d700 1 -- 172.21.15.125:0/3795781187 >> v2:172.21.15.167:3300/0 conn(0x7f7b980b3b80 msgr2=0x7f7b98160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:52.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b96d9d700 1 --2- 172.21.15.125:0/3795781187 >> v2:172.21.15.167:3300/0 conn(0x7f7b980b3b80 0x7f7b98160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b96d9d700 1 -- 172.21.15.125:0/3795781187 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980cf700 con 0x7f7b980b27d0 2023-11-28T11:12:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b95d9b700 1 --2- 172.21.15.125:0/3795781187 >> v2:172.21.15.167:3300/0 conn(0x7f7b980b3b80 0x7f7b98160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.268+0000 7f7b96d9d700 1 --2- 172.21.15.125:0/3795781187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b980b27d0 0x7f7b980b2c50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7b980719d0 tx=0x7f7b9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ee53a2e9b25a68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9559a700 1 -- 172.21.15.125:0/3795781187 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9000e070 con 0x7f7b980b27d0 2023-11-28T11:12:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9559a700 1 -- 172.21.15.125:0/3795781187 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9000b980 con 0x7f7b980b27d0 2023-11-28T11:12:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9559a700 1 -- 172.21.15.125:0/3795781187 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9000bd30 con 0x7f7b980b27d0 2023-11-28T11:12:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3795781187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b980b27d0 msgr2=0x7f7b980b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9cc92700 1 --2- 172.21.15.125:0/3795781187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b980b27d0 0x7f7b980b2c50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7b980719d0 tx=0x7f7b9000b330 comp rx=0 tx=0).stop 2023-11-28T11:12:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3795781187 shutdown_connections 2023-11-28T11:12:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9cc92700 1 --2- 172.21.15.125:0/3795781187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b980b27d0 0x7f7b980b2c50 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9cc92700 1 --2- 172.21.15.125:0/3795781187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b9815fe50 0x7f7b9806d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9cc92700 1 --2- 172.21.15.125:0/3795781187 >> v2:172.21.15.167:3300/0 conn(0x7f7b980b3b80 0x7f7b98160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3795781187 >> 172.21.15.125:0/3795781187 conn(0x7f7b9806ea80 msgr2=0x7f7b9806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3795781187 shutdown_connections 2023-11-28T11:12:52.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.269+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3795781187 wait complete. 2023-11-28T11:12:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.271+0000 7f7b9cc92700 1 Processor -- start 2023-11-28T11:12:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.271+0000 7f7b9cc92700 1 -- start start 2023-11-28T11:12:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9cc92700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b980b27d0 0x7f7b9815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9cc92700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b980b3b80 0x7f7b980c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9cc92700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b9815fe50 0x7f7b980c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9cc92700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980c7290 con 0x7f7b980b27d0 2023-11-28T11:12:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9cc92700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980c7570 con 0x7f7b9815fe50 2023-11-28T11:12:52.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9cc92700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980c7f80 con 0x7f7b980b3b80 2023-11-28T11:12:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b980b27d0 0x7f7b9815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b980b27d0 0x7f7b9815c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33862/0 (socket says 172.21.15.125:33862) 2023-11-28T11:12:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9659c700 1 -- 172.21.15.125:0/3343495881 learned_addr learned my addr 172.21.15.125:0/3343495881 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b95d9b700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b980b3b80 0x7f7b980c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b96d9d700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b9815fe50 0x7f7b980c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9659c700 1 -- 172.21.15.125:0/3343495881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b980b3b80 msgr2=0x7f7b980c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9659c700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b980b3b80 0x7f7b980c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9659c700 1 -- 172.21.15.125:0/3343495881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b9815fe50 msgr2=0x7f7b980c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9659c700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b9815fe50 0x7f7b980c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.272+0000 7f7b9659c700 1 -- 172.21.15.125:0/3343495881 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b90009b30 con 0x7f7b980b27d0 2023-11-28T11:12:52.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.273+0000 7f7b9659c700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b980b27d0 0x7f7b9815c870 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00b4a0 tx=0x7f7b8c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.273+0000 7f7b86ffd700 1 -- 172.21.15.125:0/3343495881 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c011830 con 0x7f7b980b27d0 2023-11-28T11:12:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.273+0000 7f7b86ffd700 1 -- 172.21.15.125:0/3343495881 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c011990 con 0x7f7b980b27d0 2023-11-28T11:12:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.273+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3343495881 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b980cedd0 con 0x7f7b980b27d0 2023-11-28T11:12:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.273+0000 7f7b86ffd700 1 -- 172.21.15.125:0/3343495881 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c011d40 con 0x7f7b980b27d0 2023-11-28T11:12:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.273+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3343495881 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b980b3fd0 con 0x7f7b980b27d0 2023-11-28T11:12:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.274+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3343495881 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b980cf0b0 con 0x7f7b980b27d0 2023-11-28T11:12:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.274+0000 7f7b86ffd700 1 -- 172.21.15.125:0/3343495881 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7b8c021070 con 0x7f7b980b27d0 2023-11-28T11:12:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.274+0000 7f7b86ffd700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7b780682f0 0x7f7b7806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.274+0000 7f7b86ffd700 1 -- 172.21.15.125:0/3343495881 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7b8c085900 con 0x7f7b980b27d0 2023-11-28T11:12:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.274+0000 7f7b95d9b700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7b780682f0 0x7f7b7806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.275+0000 7f7b95d9b700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7b780682f0 0x7f7b7806a7a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7b88006fd0 tx=0x7f7b88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:52.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.279+0000 7f7b86ffd700 1 -- 172.21.15.125:0/3343495881 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7b8c0523e0 con 0x7f7b980b27d0 2023-11-28T11:12:52.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.461+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3343495881 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7b980c7de0 con 0x7f7b980b27d0 2023-11-28T11:12:52.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.465+0000 7f7b86ffd700 1 -- 172.21.15.125:0/3343495881 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7b980c7de0 con 0x7f7b980b27d0 2023-11-28T11:12:52.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3343495881 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7b780682f0 msgr2=0x7f7b7806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:52.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7b780682f0 0x7f7b7806a7a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7b88006fd0 tx=0x7f7b88008040 comp rx=0 tx=0).stop 2023-11-28T11:12:52.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3343495881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b980b27d0 msgr2=0x7f7b9815c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:52.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b980b27d0 0x7f7b9815c870 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00b4a0 tx=0x7f7b8c00b860 comp rx=0 tx=0).stop 2023-11-28T11:12:52.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3343495881 shutdown_connections 2023-11-28T11:12:52.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b9815fe50 0x7f7b980c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b980b27d0 0x7f7b9815c870 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7b780682f0 0x7f7b7806a7a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 --2- 172.21.15.125:0/3343495881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b980b3b80 0x7f7b980c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3343495881 >> 172.21.15.125:0/3343495881 conn(0x7f7b9806ea80 msgr2=0x7f7b98160410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:52.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3343495881 shutdown_connections 2023-11-28T11:12:52.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.467+0000 7f7b9cc92700 1 -- 172.21.15.125:0/3343495881 wait complete. 2023-11-28T11:12:52.481 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-28T11:12:52.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.599+0000 7f004ee67700 1 Processor -- start 2023-11-28T11:12:52.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.599+0000 7f004ee67700 1 -- start start 2023-11-28T11:12:52.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.600+0000 7f004ee67700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00480cd5a0 0x7f00480cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.600+0000 7f004ee67700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00480b22a0 0x7f00480cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.600+0000 7f004ee67700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00480d1ee0 con 0x7f004806ab10 2023-11-28T11:12:52.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.600+0000 7f004ee67700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00480cdb10 con 0x7f00480b22a0 2023-11-28T11:12:52.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.600+0000 7f004ee67700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00480d1890 con 0x7f00480cd5a0 2023-11-28T11:12:52.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.600+0000 7f004cc03700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f004806ab10 0x7f004806aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46226/0 (socket says 172.21.15.125:46226) 2023-11-28T11:12:52.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.600+0000 7f004cc03700 1 -- 172.21.15.125:0/3777692822 learned_addr learned my addr 172.21.15.125:0/3777692822 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:52.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.600+0000 7f004d404700 1 --2- 172.21.15.125:0/3777692822 >> v2:172.21.15.125:3300/0 conn(0x7f00480b22a0 0x7f00480cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.600+0000 7f0047fff700 1 --2- 172.21.15.125:0/3777692822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00480cd5a0 0x7f00480cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.601+0000 7f00477fe700 1 -- 172.21.15.125:0/3777692822 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735464032 0 0) 0x7f00480d1ee0 con 0x7f004806ab10 2023-11-28T11:12:52.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.601+0000 7f00477fe700 1 -- 172.21.15.125:0/3777692822 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00380035b0 con 0x7f004806ab10 2023-11-28T11:12:52.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.601+0000 7f004d404700 1 -- 172.21.15.125:0/3777692822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00480cd5a0 msgr2=0x7f00480cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:52.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.601+0000 7f004d404700 1 --2- 172.21.15.125:0/3777692822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00480cd5a0 0x7f00480cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.601+0000 7f004d404700 1 -- 172.21.15.125:0/3777692822 >> v1:172.21.15.125:6789/0 conn(0x7f004806ab10 legacy=0x7f004806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:52.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.601+0000 7f004d404700 1 -- 172.21.15.125:0/3777692822 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00480d1b70 con 0x7f00480b22a0 2023-11-28T11:12:52.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.601+0000 7f004d404700 1 --2- 172.21.15.125:0/3777692822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00480b22a0 0x7f00480cf980 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0040009d90 tx=0x7f004000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de2eb8f822348c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:52.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.601+0000 7f00477fe700 1 -- 172.21.15.125:0/3777692822 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000e070 con 0x7f00480b22a0 2023-11-28T11:12:52.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.601+0000 7f00477fe700 1 -- 172.21.15.125:0/3777692822 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004000bb20 con 0x7f00480b22a0 2023-11-28T11:12:52.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.601+0000 7f00477fe700 1 -- 172.21.15.125:0/3777692822 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040012430 con 0x7f00480b22a0 2023-11-28T11:12:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.602+0000 7f004ee67700 1 -- 172.21.15.125:0/3777692822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00480b22a0 msgr2=0x7f00480cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.602+0000 7f004ee67700 1 --2- 172.21.15.125:0/3777692822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00480b22a0 0x7f00480cf980 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0040009d90 tx=0x7f004000b330 comp rx=0 tx=0).stop 2023-11-28T11:12:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.602+0000 7f004ee67700 1 -- 172.21.15.125:0/3777692822 shutdown_connections 2023-11-28T11:12:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.602+0000 7f004ee67700 1 --2- 172.21.15.125:0/3777692822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00480b22a0 0x7f00480cf980 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.602+0000 7f004ee67700 1 --2- 172.21.15.125:0/3777692822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00480cd5a0 0x7f00480cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.602+0000 7f004ee67700 1 -- 172.21.15.125:0/3777692822 >> 172.21.15.125:0/3777692822 conn(0x7f004806c520 msgr2=0x7f004806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.602+0000 7f004ee67700 1 -- 172.21.15.125:0/3777692822 shutdown_connections 2023-11-28T11:12:52.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.602+0000 7f004ee67700 1 -- 172.21.15.125:0/3777692822 wait complete. 2023-11-28T11:12:52.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.603+0000 7f004ee67700 1 Processor -- start 2023-11-28T11:12:52.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.603+0000 7f004ee67700 1 -- start start 2023-11-28T11:12:52.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004ee67700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f004806ab10 0x7f004815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004ee67700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00480b22a0 0x7f0048158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004ee67700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00480cd5a0 0x7f00480c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004ee67700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0048159400 con 0x7f00480cd5a0 2023-11-28T11:12:52.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004ee67700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00480c6c10 con 0x7f00480b22a0 2023-11-28T11:12:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004ee67700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00480c6eb0 con 0x7f004806ab10 2023-11-28T11:12:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004d404700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00480cd5a0 0x7f00480c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004d404700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00480cd5a0 0x7f00480c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33880/0 (socket says 172.21.15.125:33880) 2023-11-28T11:12:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004d404700 1 -- 172.21.15.125:0/2931575216 learned_addr learned my addr 172.21.15.125:0/2931575216 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004cc03700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f004806ab10 0x7f004815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f0047fff700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00480b22a0 0x7f0048158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004d404700 1 -- 172.21.15.125:0/2931575216 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f004806ab10 msgr2=0x7f004815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004d404700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f004806ab10 0x7f004815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004d404700 1 -- 172.21.15.125:0/2931575216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00480b22a0 msgr2=0x7f0048158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004d404700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00480b22a0 0x7f0048158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:52.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004d404700 1 -- 172.21.15.125:0/2931575216 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040009a70 con 0x7f00480cd5a0 2023-11-28T11:12:52.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f004d404700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00480cd5a0 0x7f00480c8dd0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f004000b370 tx=0x7f0040004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:52.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.604+0000 7f00457fa700 1 -- 172.21.15.125:0/2931575216 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040012430 con 0x7f00480cd5a0 2023-11-28T11:12:52.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.605+0000 7f00457fa700 1 -- 172.21.15.125:0/2931575216 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0040020070 con 0x7f00480cd5a0 2023-11-28T11:12:52.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.605+0000 7f004ee67700 1 -- 172.21.15.125:0/2931575216 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00480b1ec0 con 0x7f00480cd5a0 2023-11-28T11:12:52.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.605+0000 7f00457fa700 1 -- 172.21.15.125:0/2931575216 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00400098f0 con 0x7f00480cd5a0 2023-11-28T11:12:52.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.605+0000 7f004ee67700 1 -- 172.21.15.125:0/2931575216 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004815cad0 con 0x7f00480cd5a0 2023-11-28T11:12:52.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.606+0000 7f004ee67700 1 -- 172.21.15.125:0/2931575216 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00480b2050 con 0x7f00480cd5a0 2023-11-28T11:12:52.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.606+0000 7f00457fa700 1 -- 172.21.15.125:0/2931575216 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0040004040 con 0x7f00480cd5a0 2023-11-28T11:12:52.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.606+0000 7f00457fa700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f002c0682f0 0x7f002c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:52.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.606+0000 7f00457fa700 1 -- 172.21.15.125:0/2931575216 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0040022070 con 0x7f00480cd5a0 2023-11-28T11:12:52.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.606+0000 7f004cc03700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f002c0682f0 0x7f002c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:52.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.607+0000 7f004cc03700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f002c0682f0 0x7f002c06a7a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f003c007fd0 tx=0x7f003c007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:52.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.610+0000 7f00457fa700 1 -- 172.21.15.125:0/2931575216 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f00400544c0 con 0x7f00480cd5a0 2023-11-28T11:12:52.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:52.872+0000 7f004ee67700 1 -- 172.21.15.125:0/2931575216 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f00480c7020 con 0x7f00480cd5a0 2023-11-28T11:12:53.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.124+0000 7f00457fa700 1 -- 172.21.15.125:0/2931575216 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v225) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0040057ae0 con 0x7f00480cd5a0 2023-11-28T11:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 -- 172.21.15.125:0/2931575216 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f002c0682f0 msgr2=0x7f002c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f002c0682f0 0x7f002c06a7a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f003c007fd0 tx=0x7f003c007dc0 comp rx=0 tx=0).stop 2023-11-28T11:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 -- 172.21.15.125:0/2931575216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00480cd5a0 msgr2=0x7f00480c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00480cd5a0 0x7f00480c8dd0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f004000b370 tx=0x7f0040004ad0 comp rx=0 tx=0).stop 2023-11-28T11:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 -- 172.21.15.125:0/2931575216 shutdown_connections 2023-11-28T11:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00480cd5a0 0x7f00480c8dd0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f002c0682f0 0x7f002c06a7a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f004806ab10 0x7f004815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 --2- 172.21.15.125:0/2931575216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00480b22a0 0x7f0048158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:53.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 -- 172.21.15.125:0/2931575216 >> 172.21.15.125:0/2931575216 conn(0x7f004806c520 msgr2=0x7f00480cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:53.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 -- 172.21.15.125:0/2931575216 shutdown_connections 2023-11-28T11:12:53.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:53.126+0000 7f004ee67700 1 -- 172.21.15.125:0/2931575216 wait complete. 2023-11-28T11:12:53.141 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ERROR 2023-11-28T11:12:53.141 INFO:tasks.cephfs_test_runner: 2023-11-28T11:12:53.141 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T11:12:53.141 INFO:tasks.cephfs_test_runner:ERROR: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:12:53.141 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-28T11:12:53.141 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T11:12:53.141 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T11:12:53.141 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_e67b67438c1e5e13734a7203ff9e57e30b8e4d32/qa/tasks/cephfs/test_forward_scrub.py", line 500, in test_health_status_after_backtrace_repair 2023-11-28T11:12:53.141 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=20) 2023-11-28T11:12:53.142 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_e67b67438c1e5e13734a7203ff9e57e30b8e4d32/qa/tasks/ceph_test_case.py", line 212, in wait_until_true 2023-11-28T11:12:53.142 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-11-28T11:12:53.142 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 20s and 0 retries 2023-11-28T11:12:53.142 INFO:tasks.cephfs_test_runner: 2023-11-28T11:12:53.142 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T11:12:53.142 INFO:tasks.cephfs_test_runner:Ran 3 tests in 223.669s 2023-11-28T11:12:53.142 INFO:tasks.cephfs_test_runner: 2023-11-28T11:12:53.142 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-28T11:12:53.142 INFO:tasks.cephfs_test_runner: 2023-11-28T11:12:53.142 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T11:12:53.142 INFO:tasks.cephfs_test_runner:ERROR: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:12:53.143 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-28T11:12:53.143 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T11:12:53.143 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T11:12:53.143 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_e67b67438c1e5e13734a7203ff9e57e30b8e4d32/qa/tasks/cephfs/test_forward_scrub.py", line 500, in test_health_status_after_backtrace_repair 2023-11-28T11:12:53.143 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=20) 2023-11-28T11:12:53.143 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_e67b67438c1e5e13734a7203ff9e57e30b8e4d32/qa/tasks/ceph_test_case.py", line 212, in wait_until_true 2023-11-28T11:12:53.143 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-11-28T11:12:53.143 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 20s and 0 retries 2023-11-28T11:12:53.143 INFO:tasks.cephfs_test_runner: 2023-11-28T11:12:53.143 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_e67b67438c1e5e13734a7203ff9e57e30b8e4d32/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:12:53.218 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a49e98d90bf4486c85be3a404566665e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_e67b67438c1e5e13734a7203ff9e57e30b8e4d32/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:12:53.219 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-28T11:12:53.267 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-28T11:12:53.277 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-28T11:12:53.277 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:12:53.278 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:12:53.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16093 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T11:12:53.299 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-28T11:12:53.299 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:12:53.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16093 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T11:12:53.356 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:12:53.357 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:12:53.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:12:53.378 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T11:12:53.378 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:12:53.439 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2739 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T11:12:53.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:53.439 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-11-28T11:12:53.455 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T11:12:53.456 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:12:53.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:53.456 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:12:53.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:53.538 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:12:53.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:53.629 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2023-11-28T11:12:53.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:53.723 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-11-28T11:12:53.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-28T11:12:53.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T11:12:53.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:53.747 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T11:12:53.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:53.827 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T11:12:53.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:12:53.909 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2023-11-28T11:12:54.073 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-28T11:12:54.082 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T11:12:54.082 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:12:54.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.205+0000 7f5ad740e700 1 Processor -- start 2023-11-28T11:12:54.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.205+0000 7f5ad740e700 1 -- start start 2023-11-28T11:12:54.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad740e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad015a6c0 0x7f5ad00b0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad740e700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ad00b0ba0 0x7f5ad00ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad740e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ad00ca990 0x7f5ad00c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad740e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad00b1010 con 0x7f5ad00ca990 2023-11-28T11:12:54.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad740e700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad006bd10 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad740e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad006bff0 con 0x7f5ad015a6c0 2023-11-28T11:12:54.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad59ab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ad00ca990 0x7f5ad00c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad59ab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ad00ca990 0x7f5ad00c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33884/0 (socket says 172.21.15.125:33884) 2023-11-28T11:12:54.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad59ab700 1 -- 172.21.15.125:0/26928698 learned_addr learned my addr 172.21.15.125:0/26928698 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:54.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad51aa700 1 --2- 172.21.15.125:0/26928698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad015a6c0 0x7f5ad00b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad49a9700 1 --2- 172.21.15.125:0/26928698 >> v2:172.21.15.167:3300/0 conn(0x7f5ad00b0ba0 0x7f5ad00ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad59ab700 1 -- 172.21.15.125:0/26928698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad015a6c0 msgr2=0x7f5ad00b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:54.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad59ab700 1 --2- 172.21.15.125:0/26928698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad015a6c0 0x7f5ad00b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad59ab700 1 -- 172.21.15.125:0/26928698 >> v2:172.21.15.167:3300/0 conn(0x7f5ad00b0ba0 msgr2=0x7f5ad00ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:54.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad59ab700 1 --2- 172.21.15.125:0/26928698 >> v2:172.21.15.167:3300/0 conn(0x7f5ad00b0ba0 0x7f5ad00ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad59ab700 1 -- 172.21.15.125:0/26928698 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad006c2d0 con 0x7f5ad00ca990 2023-11-28T11:12:54.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.206+0000 7f5ad51aa700 1 --2- 172.21.15.125:0/26928698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad015a6c0 0x7f5ad00b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:54.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ad59ab700 1 --2- 172.21.15.125:0/26928698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ad00ca990 0x7f5ad00c9230 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5ad006eeb0 tx=0x7f5ac800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6271140c51f461b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:54.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ac7fff700 1 -- 172.21.15.125:0/26928698 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800e070 con 0x7f5ad00ca990 2023-11-28T11:12:54.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ac7fff700 1 -- 172.21.15.125:0/26928698 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac800b910 con 0x7f5ad00ca990 2023-11-28T11:12:54.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ac7fff700 1 -- 172.21.15.125:0/26928698 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800bcc0 con 0x7f5ad00ca990 2023-11-28T11:12:54.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ad740e700 1 -- 172.21.15.125:0/26928698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ad00ca990 msgr2=0x7f5ad00c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ad740e700 1 --2- 172.21.15.125:0/26928698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ad00ca990 0x7f5ad00c9230 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5ad006eeb0 tx=0x7f5ac800b330 comp rx=0 tx=0).stop 2023-11-28T11:12:54.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ad740e700 1 -- 172.21.15.125:0/26928698 shutdown_connections 2023-11-28T11:12:54.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ad740e700 1 --2- 172.21.15.125:0/26928698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ad00ca990 0x7f5ad00c9230 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ad740e700 1 --2- 172.21.15.125:0/26928698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad015a6c0 0x7f5ad00b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ad740e700 1 --2- 172.21.15.125:0/26928698 >> v2:172.21.15.167:3300/0 conn(0x7f5ad00b0ba0 0x7f5ad00ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ad740e700 1 -- 172.21.15.125:0/26928698 >> 172.21.15.125:0/26928698 conn(0x7f5ad00cb660 msgr2=0x7f5ad00cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:54.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ad740e700 1 -- 172.21.15.125:0/26928698 shutdown_connections 2023-11-28T11:12:54.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.207+0000 7f5ad740e700 1 -- 172.21.15.125:0/26928698 wait complete. 2023-11-28T11:12:54.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.209+0000 7f5ad740e700 1 Processor -- start 2023-11-28T11:12:54.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.209+0000 7f5ad740e700 1 -- start start 2023-11-28T11:12:54.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.209+0000 7f5ad740e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ad00b0ba0 0x7f5ad00b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.209+0000 7f5ad740e700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad00ca990 0x7f5ad01ef890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.209+0000 7f5ad740e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad015a6c0 0x7f5ad015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.209+0000 7f5ad740e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00c88b0 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.209+0000 7f5ad740e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00c82f0 con 0x7f5ad015a6c0 2023-11-28T11:12:54.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.209+0000 7f5ad740e700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00c85d0 con 0x7f5ad00ca990 2023-11-28T11:12:54.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.209+0000 7f5ad51aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ad00b0ba0 0x7f5ad00b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.209+0000 7f5ad51aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ad00b0ba0 0x7f5ad00b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33888/0 (socket says 172.21.15.125:33888) 2023-11-28T11:12:54.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.209+0000 7f5ad51aa700 1 -- 172.21.15.125:0/3711141327 learned_addr learned my addr 172.21.15.125:0/3711141327 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:54.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ad59ab700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad015a6c0 0x7f5ad015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ad49a9700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad00ca990 0x7f5ad01ef890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ad51aa700 1 -- 172.21.15.125:0/3711141327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad00ca990 msgr2=0x7f5ad01ef890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ad51aa700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad00ca990 0x7f5ad01ef890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ad51aa700 1 -- 172.21.15.125:0/3711141327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad015a6c0 msgr2=0x7f5ad015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ad51aa700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad015a6c0 0x7f5ad015cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ad51aa700 1 -- 172.21.15.125:0/3711141327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac8009b30 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ad59ab700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad015a6c0 0x7f5ad015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ad51aa700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ad00b0ba0 0x7f5ad00b44b0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000e760 tx=0x7f5ac000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ac5ffb700 1 -- 172.21.15.125:0/3711141327 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0013610 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ac5ffb700 1 -- 172.21.15.125:0/3711141327 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac0013770 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ad740e700 1 -- 172.21.15.125:0/3711141327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad006c890 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ac5ffb700 1 -- 172.21.15.125:0/3711141327 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0013b20 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.210+0000 7f5ad740e700 1 -- 172.21.15.125:0/3711141327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad006c5b0 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.211+0000 7f5ad740e700 1 -- 172.21.15.125:0/3711141327 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad00cae10 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.212+0000 7f5ac5ffb700 1 -- 172.21.15.125:0/3711141327 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5ac0023070 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.212+0000 7f5ac5ffb700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ab40682f0 0x7f5ab406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.212+0000 7f5ac5ffb700 1 -- 172.21.15.125:0/3711141327 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5ac0085530 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.212+0000 7f5ad49a9700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ab40682f0 0x7f5ab406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.212+0000 7f5ad49a9700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ab40682f0 0x7f5ab406a7a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0070250 tx=0x7f5acc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:54.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.216+0000 7f5ac5ffb700 1 -- 172.21.15.125:0/3711141327 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5ac0052090 con 0x7f5ad00b0ba0 2023-11-28T11:12:54.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.395+0000 7f5ad740e700 1 -- 172.21.15.125:0/3711141327 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ad0071d00 con 0x7f5ab40682f0 2023-11-28T11:12:54.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.397+0000 7f5ac5ffb700 1 -- 172.21.15.125:0/3711141327 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72829 (secure 0 0 0) 0x7f5ad0071d00 con 0x7f5ab40682f0 2023-11-28T11:12:54.400 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:54.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.399+0000 7f5ad740e700 1 -- 172.21.15.125:0/3711141327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ab40682f0 msgr2=0x7f5ab406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.399+0000 7f5ad740e700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ab40682f0 0x7f5ab406a7a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0070250 tx=0x7f5acc008040 comp rx=0 tx=0).stop 2023-11-28T11:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.399+0000 7f5ad740e700 1 -- 172.21.15.125:0/3711141327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ad00b0ba0 msgr2=0x7f5ad00b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.399+0000 7f5ad740e700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ad00b0ba0 0x7f5ad00b44b0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000e760 tx=0x7f5ac000eb20 comp rx=0 tx=0).stop 2023-11-28T11:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.400+0000 7f5ad740e700 1 -- 172.21.15.125:0/3711141327 shutdown_connections 2023-11-28T11:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.400+0000 7f5ad740e700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad015a6c0 0x7f5ad015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.400+0000 7f5ad740e700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ad00b0ba0 0x7f5ad00b44b0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.400+0000 7f5ad740e700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5ab40682f0 0x7f5ab406a7a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.400+0000 7f5ad740e700 1 --2- 172.21.15.125:0/3711141327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad00ca990 0x7f5ad01ef890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.400+0000 7f5ad740e700 1 -- 172.21.15.125:0/3711141327 >> 172.21.15.125:0/3711141327 conn(0x7f5ad00cb660 msgr2=0x7f5ad0158090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.400+0000 7f5ad740e700 1 -- 172.21.15.125:0/3711141327 shutdown_connections 2023-11-28T11:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.400+0000 7f5ad740e700 1 -- 172.21.15.125:0/3711141327 wait complete. 2023-11-28T11:12:54.403 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:12:54.413 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-11-28T11:12:53.680639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":80440,"kb_used_data":7736,"kb_used_omap":0,"kb_used_meta":72640,"kb_avail":754894280,"statfs":{"total":773094113280,"available":773011742720,"internally_reserved":0,"allocated":7921664,"data_stored":4175170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":74383360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12289,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-76,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001183"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.660976+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:12:44.660976+0000","last_peered":"2023-11-28T11:12:44.660976+0000","last_clean":"2023-11-28T11:12:44.660976+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:12:44.660976+0000","last_undegraded":"2023-11-28T11:12:44.660976+0000","last_fullsized":"2023-11-28T11:12:44.660976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.663305+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:12:44.663305+0000","last_peered":"2023-11-28T11:12:44.663305+0000","last_clean":"2023-11-28T11:12:44.663305+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:12:44.663305+0000","last_undegraded":"2023-11-28T11:12:44.663305+0000","last_fullsized":"2023-11-28T11:12:44.663305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.656753+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:12:44.656753+0000","last_peered":"2023-11-28T11:12:44.656753+0000","last_clean":"2023-11-28T11:12:44.656753+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:12:44.656753+0000","last_undegraded":"2023-11-28T11:12:44.656753+0000","last_fullsized":"2023-11-28T11:12:44.656753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.663358+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:12:44.663358+0000","last_peered":"2023-11-28T11:12:44.663358+0000","last_clean":"2023-11-28T11:12:44.663358+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:12:44.663358+0000","last_undegraded":"2023-11-28T11:12:44.663358+0000","last_fullsized":"2023-11-28T11:12:44.663358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":214,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:29.661057+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:12:29.661057+0000","last_peered":"2023-11-28T11:12:29.661057+0000","last_clean":"2023-11-28T11:12:29.661057+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:12:29.661057+0000","last_undegraded":"2023-11-28T11:12:29.661057+0000","last_fullsized":"2023-11-28T11:12:29.661057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:34.661897+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:12:34.661897+0000","last_peered":"2023-11-28T11:12:34.661897+0000","last_clean":"2023-11-28T11:12:34.661897+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:12:34.661897+0000","last_undegraded":"2023-11-28T11:12:34.661897+0000","last_fullsized":"2023-11-28T11:12:34.661897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.663388+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:12:44.663388+0000","last_peered":"2023-11-28T11:12:44.663388+0000","last_clean":"2023-11-28T11:12:44.663388+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:12:44.663388+0000","last_undegraded":"2023-11-28T11:12:44.663388+0000","last_fullsized":"2023-11-28T11:12:44.663388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:20.987770+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:12:20.987770+0000","last_peered":"2023-11-28T11:12:20.987770+0000","last_clean":"2023-11-28T11:12:20.987770+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:12:20.987770+0000","last_undegraded":"2023-11-28T11:12:20.987770+0000","last_fullsized":"2023-11-28T11:12:20.987770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:20.985791+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:12:20.985791+0000","last_peered":"2023-11-28T11:12:20.985791+0000","last_clean":"2023-11-28T11:12:20.985791+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:12:20.985791+0000","last_undegraded":"2023-11-28T11:12:20.985791+0000","last_fullsized":"2023-11-28T11:12:20.985791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11080,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":9664,"kb_avail":94360760,"statfs":{"total":96636764160,"available":96625418240,"internally_reserved":0,"allocated":1441792,"data_stored":962360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9895936},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.66400000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.69899999999999995},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.68799999999999994,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.51300000000000001},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70999999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.753,"15min":0.753},"last":0.65000000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.74099999999999999},"min":{"1min":0.51900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66100000000000003,"5min":5.532,"15min":5.532},"last":0.751},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.46700000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.50700000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.70799999999999996}]},{"osd":4,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.379},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53600000000000003,"15min":0.55200000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40500000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56399999999999995,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72299999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.58199999999999996,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59499999999999997,"15min":0.629},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.754,"5min":0.995,"15min":0.995},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9528,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362312,"statfs":{"total":96636764160,"available":96627007488,"internally_reserved":0,"allocated":835584,"data_stored":371266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70199999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.378},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.307}]},{"osd":1,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.65400000000000003,"15min":0.747},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.503},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67600000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.66000000000000003,"15min":0.74299999999999999},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63900000000000001,"15min":0.70899999999999996},"min":{"1min":0.372,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71299999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.436},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.65400000000000003,"15min":0.747},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69599999999999995,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.47199999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52700000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51400000000000001,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.64300000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56699999999999995,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.67600000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56599999999999995}]},{"osd":7,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69699999999999995,"5min":1.137,"15min":1.137},"last":0.55500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9816,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362024,"statfs":{"total":96636764160,"available":96626712576,"internally_reserved":0,"allocated":868352,"data_stored":383487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.54200000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.25900000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48199999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.29899999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34499999999999997,"15min":0.34100000000000003},"min":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.372,"15min":0.36899999999999999},"min":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.25700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.32700000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.442},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80400000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46700000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.38500000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.999,"15min":0.999},"last":0.41899999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80500000000000005,"5min":1.036,"15min":1.036},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.39700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10872,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94360968,"statfs":{"total":96636764160,"available":96625631232,"internally_reserved":0,"allocated":1425408,"data_stored":961600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32500000000000001,"15min":0.311},"min":{"1min":0.22600000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.53200000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.26100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54800000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32800000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.38400000000000001,"15min":0.42299999999999999},"min":{"1min":0.22,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.436},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.41299999999999998,"15min":0.44500000000000001},"min":{"1min":0.25600000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.59399999999999997,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.41499999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.34999999999999998},"min":{"1min":0.307,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56499999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.317},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.379},"min":{"1min":0.29499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.39400000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85299999999999998,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.623}]},{"osd":5,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.629,"15min":0.67600000000000005},"min":{"1min":0.44500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84799999999999998,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.505,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56299999999999994}]},{"osd":6,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83399999999999996,"5min":3.298,"15min":3.298},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.66900000000000004,"15min":0.72699999999999998},"min":{"1min":0.48099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91000000000000003,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.53800000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.876,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.55200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9652,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362188,"statfs":{"total":96636764160,"available":96626880512,"internally_reserved":0,"allocated":831488,"data_stored":371232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.254,"5min":0.19,"15min":0.19},"max":{"1min":0.47699999999999998,"5min":0.503,"15min":0.503},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54700000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36299999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27400000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.309},{"interface":"front","average":{"1min":0.377,"5min":0.35699999999999998,"15min":0.34399999999999997},"min":{"1min":0.26700000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53900000000000003,"5min":1.002,"15min":1.002},"last":0.32200000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35899999999999999,"15min":0.35299999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46000000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.374},"min":{"1min":0.313,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34000000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.875,"15min":0.875},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67400000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47999999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.55700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77600000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71399999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.48999999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.498},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.753,"5min":1.05,"15min":1.05},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":1.222,"15min":1.222},"last":0.53500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9908,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361932,"statfs":{"total":96636764160,"available":96626618368,"internally_reserved":0,"allocated":831488,"data_stored":371232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.36299999999999999},"min":{"1min":0.24099999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.52700000000000002,"5min":1.365,"15min":1.365},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.505,"15min":0.67000000000000004},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.502,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.55200000000000005,"15min":0.74199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.53900000000000003,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.57499999999999996,"5min":1.448,"15min":1.448},"last":0.39900000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.42799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.435},{"interface":"front","average":{"1min":0.434,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.32000000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54900000000000004,"5min":1.474,"15min":1.474},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.72099999999999997,"15min":0.85699999999999998},"min":{"1min":0.38300000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.76800000000000002,"15min":0.94599999999999995},"min":{"1min":0.433,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76000000000000001,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.76700000000000002,"15min":0.93899999999999995},"min":{"1min":0.46700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":12.994,"15min":12.994},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.80000000000000004,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.754,"15min":0.90600000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.746,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.79600000000000004,"15min":0.97699999999999998},"min":{"1min":0.47799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78600000000000003,"5min":12.932,"15min":12.932},"last":0.83499999999999996}]},{"osd":7,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78000000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.75700000000000001,"15min":0.91100000000000003},"min":{"1min":0.443,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.81899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9864,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361976,"statfs":{"total":96636764160,"available":96626663424,"internally_reserved":0,"allocated":851968,"data_stored":382739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.50600000000000001},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":0.755,"15min":0.755},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69799999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53200000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.433,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68300000000000005,"5min":0.754,"15min":0.754},"last":0.65000000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.38400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.67900000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.63500000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70299999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.49199999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66700000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61199999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.67100000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61899999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77600000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69799999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9720,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362120,"statfs":{"total":96636764160,"available":96626810880,"internally_reserved":0,"allocated":835584,"data_stored":371254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.71299999999999997,"15min":0.62},"min":{"1min":0.433,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":11.763999999999999,"15min":11.763999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.76100000000000001,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74399999999999999,"5min":16.245000000000001,"15min":16.245000000000001},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.624,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67700000000000005,"5min":5.3849999999999998,"15min":5.3849999999999998},"last":0.46700000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71199999999999997,"5min":1.032,"15min":1.032},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.753,"5min":2.282,"15min":2.282},"last":0.52200000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.752,"5min":1.401,"15min":1.401},"last":0.5},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82899999999999996,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.63200000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65500000000000003,"5min":1.478,"15min":1.478},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.623},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77600000000000002,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79400000000000004,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73399999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.65400000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64000000000000001,"15min":0.67900000000000005},"min":{"1min":0.41199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80800000000000005,"5min":2.444,"15min":2.444},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82299999999999995,"5min":5.8079999999999998,"15min":5.8079999999999998},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:12:54.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:12:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.535+0000 7fa10031b700 1 Processor -- start 2023-11-28T11:12:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.535+0000 7fa10031b700 1 -- start start 2023-11-28T11:12:54.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa10031b700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa0f80ce040 0x7fa0f815d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa10031b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0f8142db0 0x7fa0f813ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa10031b700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f813fc90 con 0x7fa0f80b1770 2023-11-28T11:12:54.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa10031b700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f813f6d0 con 0x7fa0f80ce040 2023-11-28T11:12:54.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa10031b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f813f9b0 con 0x7fa0f8142db0 2023-11-28T11:12:54.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa0fd8b6700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0f8142db0 0x7fa0f813ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa0fe0b7700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa0f80ce040 0x7fa0f815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa0fe8b8700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa0f80b1770 0x7fa0f813cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:49056/0 (socket says 172.21.15.125:49056) 2023-11-28T11:12:54.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa0fe8b8700 1 -- 172.21.15.125:0/4118420658 learned_addr learned my addr 172.21.15.125:0/4118420658 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:54.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa0fd0b5700 1 -- 172.21.15.125:0/4118420658 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794206048 0 0) 0x7fa0f813fc90 con 0x7fa0f80b1770 2023-11-28T11:12:54.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa0fd0b5700 1 -- 172.21.15.125:0/4118420658 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0e40035b0 con 0x7fa0f80b1770 2023-11-28T11:12:54.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa0fd8b6700 1 -- 172.21.15.125:0/4118420658 >> v2:172.21.15.167:3300/0 conn(0x7fa0f80ce040 msgr2=0x7fa0f815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:54.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa0fd8b6700 1 --2- 172.21.15.125:0/4118420658 >> v2:172.21.15.167:3300/0 conn(0x7fa0f80ce040 0x7fa0f815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa0fd8b6700 1 -- 172.21.15.125:0/4118420658 >> v1:172.21.15.167:6789/0 conn(0x7fa0f80b1770 legacy=0x7fa0f813cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa0fd8b6700 1 -- 172.21.15.125:0/4118420658 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f815d100 con 0x7fa0f8142db0 2023-11-28T11:12:54.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.536+0000 7fa0fe0b7700 1 --2- 172.21.15.125:0/4118420658 >> v2:172.21.15.167:3300/0 conn(0x7fa0f80ce040 0x7fa0f815d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:12:54.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa0fd8b6700 1 --2- 172.21.15.125:0/4118420658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0f8142db0 0x7fa0f813ed70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009840 tx=0x7fa0e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56ce9d71d24c3898 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa0fd0b5700 1 -- 172.21.15.125:0/4118420658 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8011830 con 0x7fa0f8142db0 2023-11-28T11:12:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa0fd0b5700 1 -- 172.21.15.125:0/4118420658 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e8011990 con 0x7fa0f8142db0 2023-11-28T11:12:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa0fd0b5700 1 -- 172.21.15.125:0/4118420658 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8011d00 con 0x7fa0f8142db0 2023-11-28T11:12:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa10031b700 1 -- 172.21.15.125:0/4118420658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0f8142db0 msgr2=0x7fa0f813ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa10031b700 1 --2- 172.21.15.125:0/4118420658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0f8142db0 0x7fa0f813ed70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009840 tx=0x7fa0e8009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa10031b700 1 -- 172.21.15.125:0/4118420658 shutdown_connections 2023-11-28T11:12:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa10031b700 1 --2- 172.21.15.125:0/4118420658 >> v2:172.21.15.167:3300/0 conn(0x7fa0f80ce040 0x7fa0f815d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa10031b700 1 --2- 172.21.15.125:0/4118420658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0f8142db0 0x7fa0f813ed70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa10031b700 1 -- 172.21.15.125:0/4118420658 >> 172.21.15.125:0/4118420658 conn(0x7fa0f806c010 msgr2=0x7fa0f80cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa10031b700 1 -- 172.21.15.125:0/4118420658 shutdown_connections 2023-11-28T11:12:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.537+0000 7fa10031b700 1 -- 172.21.15.125:0/4118420658 wait complete. 2023-11-28T11:12:54.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.539+0000 7fa10031b700 1 Processor -- start 2023-11-28T11:12:54.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.539+0000 7fa10031b700 1 -- start start 2023-11-28T11:12:54.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.539+0000 7fa10031b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f80b1770 0x7fa0f81eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.539+0000 7fa10031b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0f80ce040 0x7fa0f81f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.539+0000 7fa10031b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0f8142db0 0x7fa0f81f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.539+0000 7fa10031b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8150d20 con 0x7fa0f80b1770 2023-11-28T11:12:54.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.539+0000 7fa10031b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8151000 con 0x7fa0f80ce040 2023-11-28T11:12:54.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.539+0000 7fa10031b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f81512e0 con 0x7fa0f8142db0 2023-11-28T11:12:54.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.539+0000 7fa0fe0b7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f80b1770 0x7fa0f81eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.539+0000 7fa0fe0b7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f80b1770 0x7fa0f81eee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33900/0 (socket says 172.21.15.125:33900) 2023-11-28T11:12:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.539+0000 7fa0fe0b7700 1 -- 172.21.15.125:0/430247197 learned_addr learned my addr 172.21.15.125:0/430247197 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa0fd8b6700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0f80ce040 0x7fa0f81f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa0fe8b8700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0f8142db0 0x7fa0f81f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa0fe0b7700 1 -- 172.21.15.125:0/430247197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0f8142db0 msgr2=0x7fa0f81f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa0fe0b7700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0f8142db0 0x7fa0f81f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa0fe0b7700 1 -- 172.21.15.125:0/430247197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0f80ce040 msgr2=0x7fa0f81f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa0fe0b7700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0f80ce040 0x7fa0f81f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa0fe0b7700 1 -- 172.21.15.125:0/430247197 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f40094a0 con 0x7fa0f80b1770 2023-11-28T11:12:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa0fe0b7700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f80b1770 0x7fa0f81eee00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4010df0 tx=0x7fa0f400e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa0eeffd700 1 -- 172.21.15.125:0/430247197 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f400eda0 con 0x7fa0f80b1770 2023-11-28T11:12:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa0eeffd700 1 -- 172.21.15.125:0/430247197 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f4011450 con 0x7fa0f80b1770 2023-11-28T11:12:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa10031b700 1 -- 172.21.15.125:0/430247197 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e80094a0 con 0x7fa0f80b1770 2023-11-28T11:12:54.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa0eeffd700 1 -- 172.21.15.125:0/430247197 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40117c0 con 0x7fa0f80b1770 2023-11-28T11:12:54.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.540+0000 7fa10031b700 1 -- 172.21.15.125:0/430247197 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f80ce410 con 0x7fa0f80b1770 2023-11-28T11:12:54.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.541+0000 7fa10031b700 1 -- 172.21.15.125:0/430247197 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f815d3e0 con 0x7fa0f80b1770 2023-11-28T11:12:54.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.541+0000 7fa0eeffd700 1 -- 172.21.15.125:0/430247197 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa0f4020030 con 0x7fa0f80b1770 2023-11-28T11:12:54.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.542+0000 7fa0eeffd700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa0dc0682f0 0x7fa0dc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.542+0000 7fa0eeffd700 1 -- 172.21.15.125:0/430247197 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa0f4087dd0 con 0x7fa0f80b1770 2023-11-28T11:12:54.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.542+0000 7fa0fd8b6700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa0dc0682f0 0x7fa0dc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.542+0000 7fa0fd8b6700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa0dc0682f0 0x7fa0dc06a7a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8000c00 tx=0x7fa0e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:54.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.546+0000 7fa0eeffd700 1 -- 172.21.15.125:0/430247197 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa0f4054930 con 0x7fa0f80b1770 2023-11-28T11:12:54.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.724+0000 7fa10031b700 1 -- 172.21.15.125:0/430247197 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0f80ce5a0 con 0x7fa0dc0682f0 2023-11-28T11:12:54.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.727+0000 7fa0eeffd700 1 -- 172.21.15.125:0/430247197 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72829 (secure 0 0 0) 0x7fa0f80ce5a0 con 0x7fa0dc0682f0 2023-11-28T11:12:54.730 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 -- 172.21.15.125:0/430247197 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa0dc0682f0 msgr2=0x7fa0dc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa0dc0682f0 0x7fa0dc06a7a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8000c00 tx=0x7fa0e8008030 comp rx=0 tx=0).stop 2023-11-28T11:12:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 -- 172.21.15.125:0/430247197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f80b1770 msgr2=0x7fa0f81eee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f80b1770 0x7fa0f81eee00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4010df0 tx=0x7fa0f400e640 comp rx=0 tx=0).stop 2023-11-28T11:12:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 -- 172.21.15.125:0/430247197 shutdown_connections 2023-11-28T11:12:54.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa0dc0682f0 0x7fa0dc06a7a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0f8142db0 0x7fa0f81f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f80b1770 0x7fa0f81eee00 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 --2- 172.21.15.125:0/430247197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0f80ce040 0x7fa0f81f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 -- 172.21.15.125:0/430247197 >> 172.21.15.125:0/430247197 conn(0x7fa0f806c010 msgr2=0x7fa0f8141560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:54.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 -- 172.21.15.125:0/430247197 shutdown_connections 2023-11-28T11:12:54.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.729+0000 7fa10031b700 1 -- 172.21.15.125:0/430247197 wait complete. 2023-11-28T11:12:54.734 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:12:54.743 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-11-28T11:12:53.680639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":80440,"kb_used_data":7736,"kb_used_omap":0,"kb_used_meta":72640,"kb_avail":754894280,"statfs":{"total":773094113280,"available":773011742720,"internally_reserved":0,"allocated":7921664,"data_stored":4175170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":74383360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12289,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-76,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001183"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.660976+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:12:44.660976+0000","last_peered":"2023-11-28T11:12:44.660976+0000","last_clean":"2023-11-28T11:12:44.660976+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:12:44.660976+0000","last_undegraded":"2023-11-28T11:12:44.660976+0000","last_fullsized":"2023-11-28T11:12:44.660976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.663305+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:12:44.663305+0000","last_peered":"2023-11-28T11:12:44.663305+0000","last_clean":"2023-11-28T11:12:44.663305+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:12:44.663305+0000","last_undegraded":"2023-11-28T11:12:44.663305+0000","last_fullsized":"2023-11-28T11:12:44.663305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.656753+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:12:44.656753+0000","last_peered":"2023-11-28T11:12:44.656753+0000","last_clean":"2023-11-28T11:12:44.656753+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:12:44.656753+0000","last_undegraded":"2023-11-28T11:12:44.656753+0000","last_fullsized":"2023-11-28T11:12:44.656753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.663358+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:12:44.663358+0000","last_peered":"2023-11-28T11:12:44.663358+0000","last_clean":"2023-11-28T11:12:44.663358+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:12:44.663358+0000","last_undegraded":"2023-11-28T11:12:44.663358+0000","last_fullsized":"2023-11-28T11:12:44.663358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":214,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:29.661057+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:12:29.661057+0000","last_peered":"2023-11-28T11:12:29.661057+0000","last_clean":"2023-11-28T11:12:29.661057+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:12:29.661057+0000","last_undegraded":"2023-11-28T11:12:29.661057+0000","last_fullsized":"2023-11-28T11:12:29.661057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:34.661897+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:12:34.661897+0000","last_peered":"2023-11-28T11:12:34.661897+0000","last_clean":"2023-11-28T11:12:34.661897+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:12:34.661897+0000","last_undegraded":"2023-11-28T11:12:34.661897+0000","last_fullsized":"2023-11-28T11:12:34.661897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.663388+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:12:44.663388+0000","last_peered":"2023-11-28T11:12:44.663388+0000","last_clean":"2023-11-28T11:12:44.663388+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:12:44.663388+0000","last_undegraded":"2023-11-28T11:12:44.663388+0000","last_fullsized":"2023-11-28T11:12:44.663388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:20.987770+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:12:20.987770+0000","last_peered":"2023-11-28T11:12:20.987770+0000","last_clean":"2023-11-28T11:12:20.987770+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:12:20.987770+0000","last_undegraded":"2023-11-28T11:12:20.987770+0000","last_fullsized":"2023-11-28T11:12:20.987770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:20.985791+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:12:20.985791+0000","last_peered":"2023-11-28T11:12:20.985791+0000","last_clean":"2023-11-28T11:12:20.985791+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:12:20.985791+0000","last_undegraded":"2023-11-28T11:12:20.985791+0000","last_fullsized":"2023-11-28T11:12:20.985791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11080,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":9664,"kb_avail":94360760,"statfs":{"total":96636764160,"available":96625418240,"internally_reserved":0,"allocated":1441792,"data_stored":962360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9895936},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.66400000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.69899999999999995},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.68799999999999994,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.51300000000000001},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70999999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.753,"15min":0.753},"last":0.65000000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.74099999999999999},"min":{"1min":0.51900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66100000000000003,"5min":5.532,"15min":5.532},"last":0.751},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.46700000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.50700000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.70799999999999996}]},{"osd":4,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.379},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53600000000000003,"15min":0.55200000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40500000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56399999999999995,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72299999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.58199999999999996,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59499999999999997,"15min":0.629},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.754,"5min":0.995,"15min":0.995},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9528,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362312,"statfs":{"total":96636764160,"available":96627007488,"internally_reserved":0,"allocated":835584,"data_stored":371266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70199999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.378},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.307}]},{"osd":1,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.65400000000000003,"15min":0.747},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.503},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67600000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.66000000000000003,"15min":0.74299999999999999},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63900000000000001,"15min":0.70899999999999996},"min":{"1min":0.372,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71299999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.436},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.65400000000000003,"15min":0.747},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69599999999999995,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.47199999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52700000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51400000000000001,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.64300000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56699999999999995,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.67600000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56599999999999995}]},{"osd":7,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69699999999999995,"5min":1.137,"15min":1.137},"last":0.55500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9816,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362024,"statfs":{"total":96636764160,"available":96626712576,"internally_reserved":0,"allocated":868352,"data_stored":383487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.54200000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.25900000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48199999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.29899999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34499999999999997,"15min":0.34100000000000003},"min":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.372,"15min":0.36899999999999999},"min":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.25700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.32700000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.442},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80400000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46700000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.38500000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.999,"15min":0.999},"last":0.41899999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80500000000000005,"5min":1.036,"15min":1.036},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.39700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10872,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94360968,"statfs":{"total":96636764160,"available":96625631232,"internally_reserved":0,"allocated":1425408,"data_stored":961600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32500000000000001,"15min":0.311},"min":{"1min":0.22600000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.53200000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.26100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54800000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32800000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.38400000000000001,"15min":0.42299999999999999},"min":{"1min":0.22,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.436},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.41299999999999998,"15min":0.44500000000000001},"min":{"1min":0.25600000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.59399999999999997,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.41499999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.34999999999999998},"min":{"1min":0.307,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56499999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.317},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.379},"min":{"1min":0.29499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.39400000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85299999999999998,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.623}]},{"osd":5,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.629,"15min":0.67600000000000005},"min":{"1min":0.44500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84799999999999998,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.505,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56299999999999994}]},{"osd":6,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83399999999999996,"5min":3.298,"15min":3.298},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.66900000000000004,"15min":0.72699999999999998},"min":{"1min":0.48099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91000000000000003,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.53800000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.876,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.55200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9652,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362188,"statfs":{"total":96636764160,"available":96626880512,"internally_reserved":0,"allocated":831488,"data_stored":371232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.254,"5min":0.19,"15min":0.19},"max":{"1min":0.47699999999999998,"5min":0.503,"15min":0.503},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54700000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36299999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27400000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.309},{"interface":"front","average":{"1min":0.377,"5min":0.35699999999999998,"15min":0.34399999999999997},"min":{"1min":0.26700000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53900000000000003,"5min":1.002,"15min":1.002},"last":0.32200000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35899999999999999,"15min":0.35299999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46000000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.374},"min":{"1min":0.313,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34000000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.875,"15min":0.875},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67400000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47999999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.55700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77600000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71399999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.48999999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.498},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.753,"5min":1.05,"15min":1.05},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":1.222,"15min":1.222},"last":0.53500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9908,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361932,"statfs":{"total":96636764160,"available":96626618368,"internally_reserved":0,"allocated":831488,"data_stored":371232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.36299999999999999},"min":{"1min":0.24099999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.52700000000000002,"5min":1.365,"15min":1.365},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.505,"15min":0.67000000000000004},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.502,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.55200000000000005,"15min":0.74199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.53900000000000003,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.57499999999999996,"5min":1.448,"15min":1.448},"last":0.39900000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.42799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.435},{"interface":"front","average":{"1min":0.434,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.32000000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54900000000000004,"5min":1.474,"15min":1.474},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.72099999999999997,"15min":0.85699999999999998},"min":{"1min":0.38300000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.76800000000000002,"15min":0.94599999999999995},"min":{"1min":0.433,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76000000000000001,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.76700000000000002,"15min":0.93899999999999995},"min":{"1min":0.46700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":12.994,"15min":12.994},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.80000000000000004,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.754,"15min":0.90600000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.746,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.79600000000000004,"15min":0.97699999999999998},"min":{"1min":0.47799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78600000000000003,"5min":12.932,"15min":12.932},"last":0.83499999999999996}]},{"osd":7,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78000000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.75700000000000001,"15min":0.91100000000000003},"min":{"1min":0.443,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.81899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9864,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361976,"statfs":{"total":96636764160,"available":96626663424,"internally_reserved":0,"allocated":851968,"data_stored":382739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.50600000000000001},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":0.755,"15min":0.755},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69799999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53200000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.433,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68300000000000005,"5min":0.754,"15min":0.754},"last":0.65000000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.38400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.67900000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.63500000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70299999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.49199999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66700000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61199999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.67100000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61899999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77600000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69799999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9720,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362120,"statfs":{"total":96636764160,"available":96626810880,"internally_reserved":0,"allocated":835584,"data_stored":371254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.71299999999999997,"15min":0.62},"min":{"1min":0.433,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":11.763999999999999,"15min":11.763999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.76100000000000001,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74399999999999999,"5min":16.245000000000001,"15min":16.245000000000001},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.624,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67700000000000005,"5min":5.3849999999999998,"15min":5.3849999999999998},"last":0.46700000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71199999999999997,"5min":1.032,"15min":1.032},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.753,"5min":2.282,"15min":2.282},"last":0.52200000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.752,"5min":1.401,"15min":1.401},"last":0.5},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82899999999999996,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.63200000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65500000000000003,"5min":1.478,"15min":1.478},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.623},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77600000000000002,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79400000000000004,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73399999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.65400000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64000000000000001,"15min":0.67900000000000005},"min":{"1min":0.41199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80800000000000005,"5min":2.444,"15min":2.444},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82299999999999995,"5min":5.8079999999999998,"15min":5.8079999999999998},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:12:54.746 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T11:12:54.747 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:12:54.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.865+0000 7f2d1b380700 1 Processor -- start 2023-11-28T11:12:54.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.865+0000 7f2d1b380700 1 -- start start 2023-11-28T11:12:54.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1b380700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2d1415cc80 0x7f2d1406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1b380700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d1406e3a0 0x7f2d14070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1b380700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d140b1810 con 0x7f2d1406a270 2023-11-28T11:12:54.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1b380700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d140b2490 con 0x7f2d1415cc80 2023-11-28T11:12:54.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1b380700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140b1af0 con 0x7f2d1406e3a0 2023-11-28T11:12:54.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1891b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2d1415cc80 0x7f2d1406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1891b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2d1415cc80 0x7f2d1406de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33910/0 (socket says 172.21.15.125:33910) 2023-11-28T11:12:54.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1891b700 1 -- 172.21.15.125:0/1003320304 learned_addr learned my addr 172.21.15.125:0/1003320304 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:54.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1991d700 1 --2- 172.21.15.125:0/1003320304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d1406e3a0 0x7f2d14070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1891b700 1 -- 172.21.15.125:0/1003320304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d1406e3a0 msgr2=0x7f2d14070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:54.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1891b700 1 --2- 172.21.15.125:0/1003320304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d1406e3a0 0x7f2d14070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1891b700 1 -- 172.21.15.125:0/1003320304 >> v1:172.21.15.167:6789/0 conn(0x7f2d1406a270 legacy=0x7f2d1406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1891b700 1 -- 172.21.15.125:0/1003320304 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d140b1dd0 con 0x7f2d1415cc80 2023-11-28T11:12:54.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.866+0000 7f2d1891b700 1 --2- 172.21.15.125:0/1003320304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1415cc80 0x7f2d1406de60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f2d040098f0 tx=0x7f2d04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1dab16ed20fdb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:54.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.867+0000 7f2d0bfff700 1 -- 172.21.15.125:0/1003320304 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400b8a0 con 0x7f2d1415cc80 2023-11-28T11:12:54.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.867+0000 7f2d0bfff700 1 -- 172.21.15.125:0/1003320304 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0400ba00 con 0x7f2d1415cc80 2023-11-28T11:12:54.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.867+0000 7f2d0bfff700 1 -- 172.21.15.125:0/1003320304 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400bd90 con 0x7f2d1415cc80 2023-11-28T11:12:54.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.867+0000 7f2d1b380700 1 -- 172.21.15.125:0/1003320304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1415cc80 msgr2=0x7f2d1406de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.867+0000 7f2d1b380700 1 --2- 172.21.15.125:0/1003320304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1415cc80 0x7f2d1406de60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f2d040098f0 tx=0x7f2d04009c00 comp rx=0 tx=0).stop 2023-11-28T11:12:54.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.867+0000 7f2d1b380700 1 -- 172.21.15.125:0/1003320304 shutdown_connections 2023-11-28T11:12:54.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.867+0000 7f2d1b380700 1 --2- 172.21.15.125:0/1003320304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d1406e3a0 0x7f2d14070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.867+0000 7f2d1b380700 1 --2- 172.21.15.125:0/1003320304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1415cc80 0x7f2d1406de60 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.867+0000 7f2d1b380700 1 -- 172.21.15.125:0/1003320304 >> 172.21.15.125:0/1003320304 conn(0x7f2d1406c010 msgr2=0x7f2d140cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:54.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.867+0000 7f2d1b380700 1 -- 172.21.15.125:0/1003320304 shutdown_connections 2023-11-28T11:12:54.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.867+0000 7f2d1b380700 1 -- 172.21.15.125:0/1003320304 wait complete. 2023-11-28T11:12:54.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.868+0000 7f2d1b380700 1 Processor -- start 2023-11-28T11:12:54.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.868+0000 7f2d1b380700 1 -- start start 2023-11-28T11:12:54.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1b380700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1406a270 0x7f2d140b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1b380700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d1406e3a0 0x7f2d140b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1b380700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d1415cc80 0x7f2d14150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1b380700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140b3e90 con 0x7f2d1406a270 2023-11-28T11:12:54.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1b380700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140b4170 con 0x7f2d1415cc80 2023-11-28T11:12:54.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1b380700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140b4450 con 0x7f2d1406e3a0 2023-11-28T11:12:54.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1911c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1406a270 0x7f2d140b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1911c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1406a270 0x7f2d140b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33916/0 (socket says 172.21.15.125:33916) 2023-11-28T11:12:54.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1911c700 1 -- 172.21.15.125:0/2271024176 learned_addr learned my addr 172.21.15.125:0/2271024176 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:54.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1991d700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d1415cc80 0x7f2d14150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1891b700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d1406e3a0 0x7f2d140b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1911c700 1 -- 172.21.15.125:0/2271024176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d1406e3a0 msgr2=0x7f2d140b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1911c700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d1406e3a0 0x7f2d140b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1911c700 1 -- 172.21.15.125:0/2271024176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d1415cc80 msgr2=0x7f2d14150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:54.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1911c700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d1415cc80 0x7f2d14150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:54.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.869+0000 7f2d1911c700 1 -- 172.21.15.125:0/2271024176 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d04009550 con 0x7f2d1406a270 2023-11-28T11:12:54.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.870+0000 7f2d1911c700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1406a270 0x7f2d140b3530 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000c450 tx=0x7f2d1000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:54.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.870+0000 7f2d09ffb700 1 -- 172.21.15.125:0/2271024176 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d100052d0 con 0x7f2d1406a270 2023-11-28T11:12:54.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.870+0000 7f2d09ffb700 1 -- 172.21.15.125:0/2271024176 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d10005430 con 0x7f2d1406a270 2023-11-28T11:12:54.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.870+0000 7f2d1b380700 1 -- 172.21.15.125:0/2271024176 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1406e800 con 0x7f2d1406a270 2023-11-28T11:12:54.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.870+0000 7f2d09ffb700 1 -- 172.21.15.125:0/2271024176 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d100038c0 con 0x7f2d1406a270 2023-11-28T11:12:54.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.870+0000 7f2d1b380700 1 -- 172.21.15.125:0/2271024176 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d140b20b0 con 0x7f2d1406a270 2023-11-28T11:12:54.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.871+0000 7f2d1b380700 1 -- 172.21.15.125:0/2271024176 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1415daa0 con 0x7f2d1406a270 2023-11-28T11:12:54.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.871+0000 7f2d09ffb700 1 -- 172.21.15.125:0/2271024176 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2d10019030 con 0x7f2d1406a270 2023-11-28T11:12:54.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.872+0000 7f2d09ffb700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2cf8068320 0x7f2cf806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:54.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.872+0000 7f2d09ffb700 1 -- 172.21.15.125:0/2271024176 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2d10084bc0 con 0x7f2d1406a270 2023-11-28T11:12:54.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.872+0000 7f2d1891b700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2cf8068320 0x7f2cf806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:54.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.872+0000 7f2d1891b700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2cf8068320 0x7f2cf806a7d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009c40 tx=0x7f2d0401d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:54.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:54.876+0000 7f2d09ffb700 1 -- 172.21.15.125:0/2271024176 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2d10051690 con 0x7f2d1406a270 2023-11-28T11:12:55.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.053+0000 7f2d1b380700 1 -- 172.21.15.125:0/2271024176 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d140743f0 con 0x7f2cf8068320 2023-11-28T11:12:55.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.055+0000 7f2d09ffb700 1 -- 172.21.15.125:0/2271024176 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72829 (secure 0 0 0) 0x7f2d140743f0 con 0x7f2cf8068320 2023-11-28T11:12:55.058 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:55.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 -- 172.21.15.125:0/2271024176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2cf8068320 msgr2=0x7f2cf806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:55.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2cf8068320 0x7f2cf806a7d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009c40 tx=0x7f2d0401d040 comp rx=0 tx=0).stop 2023-11-28T11:12:55.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 -- 172.21.15.125:0/2271024176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1406a270 msgr2=0x7f2d140b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:55.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1406a270 0x7f2d140b3530 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000c450 tx=0x7f2d1000c760 comp rx=0 tx=0).stop 2023-11-28T11:12:55.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 -- 172.21.15.125:0/2271024176 shutdown_connections 2023-11-28T11:12:55.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d1415cc80 0x7f2d14150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d1406a270 0x7f2d140b3530 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2cf8068320 0x7f2cf806a7d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 --2- 172.21.15.125:0/2271024176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d1406e3a0 0x7f2d140b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 -- 172.21.15.125:0/2271024176 >> 172.21.15.125:0/2271024176 conn(0x7f2d1406c010 msgr2=0x7f2d140aced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:55.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 -- 172.21.15.125:0/2271024176 shutdown_connections 2023-11-28T11:12:55.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.057+0000 7f2d1b380700 1 -- 172.21.15.125:0/2271024176 wait complete. 2023-11-28T11:12:55.061 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:12:55.071 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-11-28T11:12:53.680639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":80440,"kb_used_data":7736,"kb_used_omap":0,"kb_used_meta":72640,"kb_avail":754894280,"statfs":{"total":773094113280,"available":773011742720,"internally_reserved":0,"allocated":7921664,"data_stored":4175170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":74383360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12289,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-76,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001183"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.660976+0000","last_change":"2023-11-28T11:08:31.794809+0000","last_active":"2023-11-28T11:12:44.660976+0000","last_peered":"2023-11-28T11:12:44.660976+0000","last_clean":"2023-11-28T11:12:44.660976+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:12:44.660976+0000","last_undegraded":"2023-11-28T11:12:44.660976+0000","last_fullsized":"2023-11-28T11:12:44.660976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.663305+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:12:44.663305+0000","last_peered":"2023-11-28T11:12:44.663305+0000","last_clean":"2023-11-28T11:12:44.663305+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:12:44.663305+0000","last_undegraded":"2023-11-28T11:12:44.663305+0000","last_fullsized":"2023-11-28T11:12:44.663305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:25.711635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.656753+0000","last_change":"2023-11-28T11:08:32.636174+0000","last_active":"2023-11-28T11:12:44.656753+0000","last_peered":"2023-11-28T11:12:44.656753+0000","last_clean":"2023-11-28T11:12:44.656753+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:12:44.656753+0000","last_undegraded":"2023-11-28T11:12:44.656753+0000","last_fullsized":"2023-11-28T11:12:44.656753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.663358+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:12:44.663358+0000","last_peered":"2023-11-28T11:12:44.663358+0000","last_clean":"2023-11-28T11:12:44.663358+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:12:44.663358+0000","last_undegraded":"2023-11-28T11:12:44.663358+0000","last_fullsized":"2023-11-28T11:12:44.663358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:57.345804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":214,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:29.661057+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:12:29.661057+0000","last_peered":"2023-11-28T11:12:29.661057+0000","last_clean":"2023-11-28T11:12:29.661057+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:12:29.661057+0000","last_undegraded":"2023-11-28T11:12:29.661057+0000","last_fullsized":"2023-11-28T11:12:29.661057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:34.661897+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:12:34.661897+0000","last_peered":"2023-11-28T11:12:34.661897+0000","last_clean":"2023-11-28T11:12:34.661897+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:12:34.661897+0000","last_undegraded":"2023-11-28T11:12:34.661897+0000","last_fullsized":"2023-11-28T11:12:34.661897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:44.663388+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:12:44.663388+0000","last_peered":"2023-11-28T11:12:44.663388+0000","last_clean":"2023-11-28T11:12:44.663388+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:12:44.663388+0000","last_undegraded":"2023-11-28T11:12:44.663388+0000","last_fullsized":"2023-11-28T11:12:44.663388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:20.987770+0000","last_change":"2023-11-28T11:08:31.795946+0000","last_active":"2023-11-28T11:12:20.987770+0000","last_peered":"2023-11-28T11:12:20.987770+0000","last_clean":"2023-11-28T11:12:20.987770+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:12:20.987770+0000","last_undegraded":"2023-11-28T11:12:20.987770+0000","last_fullsized":"2023-11-28T11:12:20.987770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.541789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:12:20.985791+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:12:20.985791+0000","last_peered":"2023-11-28T11:12:20.985791+0000","last_clean":"2023-11-28T11:12:20.985791+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:12:20.985791+0000","last_undegraded":"2023-11-28T11:12:20.985791+0000","last_fullsized":"2023-11-28T11:12:20.985791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11080,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":9664,"kb_avail":94360760,"statfs":{"total":96636764160,"available":96625418240,"internally_reserved":0,"allocated":1441792,"data_stored":962360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9895936},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.66400000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.69899999999999995},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.68799999999999994,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.51300000000000001},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70999999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.753,"15min":0.753},"last":0.65000000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.74099999999999999},"min":{"1min":0.51900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66100000000000003,"5min":5.532,"15min":5.532},"last":0.751},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.46700000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.50700000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.70799999999999996}]},{"osd":4,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.379},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53600000000000003,"15min":0.55200000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40500000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56399999999999995,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72299999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.58199999999999996,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59499999999999997,"15min":0.629},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.754,"5min":0.995,"15min":0.995},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9528,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362312,"statfs":{"total":96636764160,"available":96627007488,"internally_reserved":0,"allocated":835584,"data_stored":371266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70199999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.378},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.307}]},{"osd":1,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.65400000000000003,"15min":0.747},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.503},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67600000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.66000000000000003,"15min":0.74299999999999999},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63900000000000001,"15min":0.70899999999999996},"min":{"1min":0.372,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71299999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.436},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.65400000000000003,"15min":0.747},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69599999999999995,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.47199999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52700000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51400000000000001,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.64300000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56699999999999995,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.67600000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56599999999999995}]},{"osd":7,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69699999999999995,"5min":1.137,"15min":1.137},"last":0.55500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9816,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362024,"statfs":{"total":96636764160,"available":96626712576,"internally_reserved":0,"allocated":868352,"data_stored":383487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.54200000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.25900000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48199999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.29899999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34499999999999997,"15min":0.34100000000000003},"min":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.372,"15min":0.36899999999999999},"min":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.25700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.32700000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.442},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80400000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46700000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.38500000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.999,"15min":0.999},"last":0.41899999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80500000000000005,"5min":1.036,"15min":1.036},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.39700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10872,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94360968,"statfs":{"total":96636764160,"available":96625631232,"internally_reserved":0,"allocated":1425408,"data_stored":961600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32500000000000001,"15min":0.311},"min":{"1min":0.22600000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.53200000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.26100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54800000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32800000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.38400000000000001,"15min":0.42299999999999999},"min":{"1min":0.22,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.436},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.41299999999999998,"15min":0.44500000000000001},"min":{"1min":0.25600000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.59399999999999997,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.41499999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.34999999999999998},"min":{"1min":0.307,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56499999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.317},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.379},"min":{"1min":0.29499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.39400000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85299999999999998,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.623}]},{"osd":5,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.629,"15min":0.67600000000000005},"min":{"1min":0.44500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84799999999999998,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.505,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56299999999999994}]},{"osd":6,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83399999999999996,"5min":3.298,"15min":3.298},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.66900000000000004,"15min":0.72699999999999998},"min":{"1min":0.48099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91000000000000003,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.53800000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.876,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.55200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9652,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362188,"statfs":{"total":96636764160,"available":96626880512,"internally_reserved":0,"allocated":831488,"data_stored":371232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.254,"5min":0.19,"15min":0.19},"max":{"1min":0.47699999999999998,"5min":0.503,"15min":0.503},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54700000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36299999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27400000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.309},{"interface":"front","average":{"1min":0.377,"5min":0.35699999999999998,"15min":0.34399999999999997},"min":{"1min":0.26700000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53900000000000003,"5min":1.002,"15min":1.002},"last":0.32200000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35899999999999999,"15min":0.35299999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46000000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.374},"min":{"1min":0.313,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34000000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.875,"15min":0.875},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67400000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47999999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.55700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77600000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71399999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.48999999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.498},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.753,"5min":1.05,"15min":1.05},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":1.222,"15min":1.222},"last":0.53500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9908,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361932,"statfs":{"total":96636764160,"available":96626618368,"internally_reserved":0,"allocated":831488,"data_stored":371232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.36299999999999999},"min":{"1min":0.24099999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.52700000000000002,"5min":1.365,"15min":1.365},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.505,"15min":0.67000000000000004},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.502,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.55200000000000005,"15min":0.74199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.53900000000000003,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.57499999999999996,"5min":1.448,"15min":1.448},"last":0.39900000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.42799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.435},{"interface":"front","average":{"1min":0.434,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.32000000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54900000000000004,"5min":1.474,"15min":1.474},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.72099999999999997,"15min":0.85699999999999998},"min":{"1min":0.38300000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.76800000000000002,"15min":0.94599999999999995},"min":{"1min":0.433,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76000000000000001,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.76700000000000002,"15min":0.93899999999999995},"min":{"1min":0.46700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":12.994,"15min":12.994},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.80000000000000004,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.754,"15min":0.90600000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.746,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.79600000000000004,"15min":0.97699999999999998},"min":{"1min":0.47799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78600000000000003,"5min":12.932,"15min":12.932},"last":0.83499999999999996}]},{"osd":7,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78000000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.75700000000000001,"15min":0.91100000000000003},"min":{"1min":0.443,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.81899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9864,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361976,"statfs":{"total":96636764160,"available":96626663424,"internally_reserved":0,"allocated":851968,"data_stored":382739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.50600000000000001},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":0.755,"15min":0.755},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69799999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53200000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.433,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68300000000000005,"5min":0.754,"15min":0.754},"last":0.65000000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.38400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.67900000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.63500000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70299999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.49199999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66700000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61199999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.67100000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61899999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77600000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69799999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9720,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362120,"statfs":{"total":96636764160,"available":96626810880,"internally_reserved":0,"allocated":835584,"data_stored":371254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.71299999999999997,"15min":0.62},"min":{"1min":0.433,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":11.763999999999999,"15min":11.763999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.76100000000000001,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74399999999999999,"5min":16.245000000000001,"15min":16.245000000000001},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.624,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67700000000000005,"5min":5.3849999999999998,"15min":5.3849999999999998},"last":0.46700000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71199999999999997,"5min":1.032,"15min":1.032},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.753,"5min":2.282,"15min":2.282},"last":0.52200000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.752,"5min":1.401,"15min":1.401},"last":0.5},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82899999999999996,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.63200000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65500000000000003,"5min":1.478,"15min":1.478},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.623},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77600000000000002,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79400000000000004,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73399999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.65400000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64000000000000001,"15min":0.67900000000000005},"min":{"1min":0.41199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80800000000000005,"5min":2.444,"15min":2.444},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82299999999999995,"5min":5.8079999999999998,"15min":5.8079999999999998},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:12:55.073 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:12:55.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.193+0000 7f21a8fd2700 1 Processor -- start 2023-11-28T11:12:55.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.193+0000 7f21a8fd2700 1 -- start start 2023-11-28T11:12:55.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a8fd2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21a406a270 0x7f21a406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:55.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a8fd2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21a415cc80 0x7f21a406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:55.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a8fd2700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f21a406e3a0 0x7f21a406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:55.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a8fd2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a40b2490 con 0x7f21a406a270 2023-11-28T11:12:55.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a8fd2700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a406ab80 con 0x7f21a406e3a0 2023-11-28T11:12:55.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a8fd2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40b1810 con 0x7f21a415cc80 2023-11-28T11:12:55.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21a406a270 0x7f21a406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:55.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21a406a270 0x7f21a406a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33922/0 (socket says 172.21.15.125:33922) 2023-11-28T11:12:55.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a259c700 1 -- 172.21.15.125:0/2189482157 learned_addr learned my addr 172.21.15.125:0/2189482157 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:55.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a2d9d700 1 --2- 172.21.15.125:0/2189482157 >> v2:172.21.15.167:3300/0 conn(0x7f21a406e3a0 0x7f21a406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:55.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a1d9b700 1 --2- 172.21.15.125:0/2189482157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21a415cc80 0x7f21a406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:55.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a259c700 1 -- 172.21.15.125:0/2189482157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21a415cc80 msgr2=0x7f21a406de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:55.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a259c700 1 --2- 172.21.15.125:0/2189482157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21a415cc80 0x7f21a406de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a259c700 1 -- 172.21.15.125:0/2189482157 >> v2:172.21.15.167:3300/0 conn(0x7f21a406e3a0 msgr2=0x7f21a406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:55.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a259c700 1 --2- 172.21.15.125:0/2189482157 >> v2:172.21.15.167:3300/0 conn(0x7f21a406e3a0 0x7f21a406ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.194+0000 7f21a259c700 1 -- 172.21.15.125:0/2189482157 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40b1af0 con 0x7f21a406a270 2023-11-28T11:12:55.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a259c700 1 --2- 172.21.15.125:0/2189482157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21a406a270 0x7f21a406a640 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f21a40af700 tx=0x7f2198009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586c9c15a345c1a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:55.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a159a700 1 -- 172.21.15.125:0/2189482157 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219800b870 con 0x7f21a406a270 2023-11-28T11:12:55.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a159a700 1 -- 172.21.15.125:0/2189482157 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219800b9d0 con 0x7f21a406a270 2023-11-28T11:12:55.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a159a700 1 -- 172.21.15.125:0/2189482157 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219800bd60 con 0x7f21a406a270 2023-11-28T11:12:55.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a8fd2700 1 -- 172.21.15.125:0/2189482157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21a406a270 msgr2=0x7f21a406a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:55.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a8fd2700 1 --2- 172.21.15.125:0/2189482157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21a406a270 0x7f21a406a640 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f21a40af700 tx=0x7f2198009bd0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a8fd2700 1 -- 172.21.15.125:0/2189482157 shutdown_connections 2023-11-28T11:12:55.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a8fd2700 1 --2- 172.21.15.125:0/2189482157 >> v2:172.21.15.167:3300/0 conn(0x7f21a406e3a0 0x7f21a406ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a8fd2700 1 --2- 172.21.15.125:0/2189482157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21a406a270 0x7f21a406a640 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a8fd2700 1 --2- 172.21.15.125:0/2189482157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21a415cc80 0x7f21a406de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a8fd2700 1 -- 172.21.15.125:0/2189482157 >> 172.21.15.125:0/2189482157 conn(0x7f21a406c010 msgr2=0x7f21a40cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:55.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a8fd2700 1 -- 172.21.15.125:0/2189482157 shutdown_connections 2023-11-28T11:12:55.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.195+0000 7f21a8fd2700 1 -- 172.21.15.125:0/2189482157 wait complete. 2023-11-28T11:12:55.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.197+0000 7f21a8fd2700 1 Processor -- start 2023-11-28T11:12:55.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.197+0000 7f21a8fd2700 1 -- start start 2023-11-28T11:12:55.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.197+0000 7f21a8fd2700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21a406a270 0x7f21a41525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:55.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.197+0000 7f21a8fd2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21a406e3a0 0x7f21a40ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:55.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.197+0000 7f21a8fd2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21a415cc80 0x7f21a40cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:55.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.197+0000 7f21a8fd2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40cb7d0 con 0x7f21a406e3a0 2023-11-28T11:12:55.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.197+0000 7f21a8fd2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4152b10 con 0x7f21a415cc80 2023-11-28T11:12:55.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.197+0000 7f21a8fd2700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40cab50 con 0x7f21a406a270 2023-11-28T11:12:55.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a1d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21a406e3a0 0x7f21a40ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:55.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a1d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21a406e3a0 0x7f21a40ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33930/0 (socket says 172.21.15.125:33930) 2023-11-28T11:12:55.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a1d9b700 1 -- 172.21.15.125:0/743419102 learned_addr learned my addr 172.21.15.125:0/743419102 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:55.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a259c700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21a406a270 0x7f21a41525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:55.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a2d9d700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21a415cc80 0x7f21a40cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:55.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a1d9b700 1 -- 172.21.15.125:0/743419102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21a406a270 msgr2=0x7f21a41525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:55.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a1d9b700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21a406a270 0x7f21a41525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a1d9b700 1 -- 172.21.15.125:0/743419102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21a415cc80 msgr2=0x7f21a40cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:55.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a1d9b700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21a415cc80 0x7f21a40cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a1d9b700 1 -- 172.21.15.125:0/743419102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198009550 con 0x7f21a406e3a0 2023-11-28T11:12:55.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a259c700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21a406a270 0x7f21a41525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:55.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a1d9b700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21a406e3a0 0x7f21a40ca320 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f219400e810 tx=0x7f219400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:55.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f2192ffd700 1 -- 172.21.15.125:0/743419102 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194013610 con 0x7f21a406e3a0 2023-11-28T11:12:55.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f2192ffd700 1 -- 172.21.15.125:0/743419102 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2194013770 con 0x7f21a406e3a0 2023-11-28T11:12:55.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a8fd2700 1 -- 172.21.15.125:0/743419102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a40b20b0 con 0x7f21a406e3a0 2023-11-28T11:12:55.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f2192ffd700 1 -- 172.21.15.125:0/743419102 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194013b20 con 0x7f21a406e3a0 2023-11-28T11:12:55.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.198+0000 7f21a8fd2700 1 -- 172.21.15.125:0/743419102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a40b1dd0 con 0x7f21a406e3a0 2023-11-28T11:12:55.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.199+0000 7f21a8fd2700 1 -- 172.21.15.125:0/743419102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a406e7e0 con 0x7f21a406e3a0 2023-11-28T11:12:55.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.200+0000 7f2192ffd700 1 -- 172.21.15.125:0/743419102 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2194023070 con 0x7f21a406e3a0 2023-11-28T11:12:55.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.200+0000 7f2192ffd700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21840682f0 0x7f218406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:55.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.200+0000 7f2192ffd700 1 -- 172.21.15.125:0/743419102 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2194085670 con 0x7f21a406e3a0 2023-11-28T11:12:55.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.200+0000 7f21a259c700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21840682f0 0x7f218406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:55.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.200+0000 7f21a259c700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21840682f0 0x7f218406a7a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2198014040 tx=0x7f2198008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:55.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.204+0000 7f2192ffd700 1 -- 172.21.15.125:0/743419102 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2194052150 con 0x7f21a406e3a0 2023-11-28T11:12:55.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.386+0000 7f21a8fd2700 1 -- 172.21.15.125:0/743419102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21a40cb910 con 0x7f21a406e3a0 2023-11-28T11:12:55.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.387+0000 7f2192ffd700 1 -- 172.21.15.125:0/743419102 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+14447 (secure 0 0 0) 0x7f21a40cb910 con 0x7f21a406e3a0 2023-11-28T11:12:55.389 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:12:55.389 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":71,"fsid":"1672cdc2-9fd2-4661-a2c8-9dd3e5aed0ea","created":"2023-11-28T11:08:12.142542+0000","modified":"2023-11-28T11:12:52.118181+0000","last_up_change":"2023-11-28T11:08:23.684287+0000","last_in_change":"2023-11-28T11:08:14.668319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:08:25.663356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:08:30.568881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73a843a4-1543-4cbf-8ac3-6f56ccfff058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":103586},{"type":"v1","addr":"172.21.15.125:6817","nonce":103586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":103586},{"type":"v1","addr":"172.21.15.125:6819","nonce":103586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":103586},{"type":"v1","addr":"172.21.15.125:6823","nonce":103586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":103586},{"type":"v1","addr":"172.21.15.125:6821","nonce":103586}]},"public_addr":"172.21.15.125:6817/103586","cluster_addr":"172.21.15.125:6819/103586","heartbeat_back_addr":"172.21.15.125:6823/103586","heartbeat_front_addr":"172.21.15.125:6821/103586","state":["exists","up"]},{"osd":1,"uuid":"a0488802-feba-40b2-a1e8-2ebd429f574c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":103588},{"type":"v1","addr":"172.21.15.125:6825","nonce":103588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":103588},{"type":"v1","addr":"172.21.15.125:6827","nonce":103588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":103588},{"type":"v1","addr":"172.21.15.125:6831","nonce":103588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":103588},{"type":"v1","addr":"172.21.15.125:6829","nonce":103588}]},"public_addr":"172.21.15.125:6825/103588","cluster_addr":"172.21.15.125:6827/103588","heartbeat_back_addr":"172.21.15.125:6831/103588","heartbeat_front_addr":"172.21.15.125:6829/103588","state":["exists","up"]},{"osd":2,"uuid":"3d8343cb-9b4b-4743-8414-4749e4f1398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":103587},{"type":"v1","addr":"172.21.15.125:6809","nonce":103587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":103587},{"type":"v1","addr":"172.21.15.125:6811","nonce":103587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":103587},{"type":"v1","addr":"172.21.15.125:6815","nonce":103587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":103587},{"type":"v1","addr":"172.21.15.125:6813","nonce":103587}]},"public_addr":"172.21.15.125:6809/103587","cluster_addr":"172.21.15.125:6811/103587","heartbeat_back_addr":"172.21.15.125:6815/103587","heartbeat_front_addr":"172.21.15.125:6813/103587","state":["exists","up"]},{"osd":3,"uuid":"4af8f54c-cfd4-4a71-9484-2ff65e59f020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":103585},{"type":"v1","addr":"172.21.15.125:6801","nonce":103585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":103585},{"type":"v1","addr":"172.21.15.125:6803","nonce":103585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":103585},{"type":"v1","addr":"172.21.15.125:6807","nonce":103585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":103585},{"type":"v1","addr":"172.21.15.125:6805","nonce":103585}]},"public_addr":"172.21.15.125:6801/103585","cluster_addr":"172.21.15.125:6803/103585","heartbeat_back_addr":"172.21.15.125:6807/103585","heartbeat_front_addr":"172.21.15.125:6805/103585","state":["exists","up"]},{"osd":4,"uuid":"ec19c071-e5ec-49e5-9f16-f734f48c73ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":103804},{"type":"v1","addr":"172.21.15.167:6801","nonce":103804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":103804},{"type":"v1","addr":"172.21.15.167:6803","nonce":103804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":103804},{"type":"v1","addr":"172.21.15.167:6807","nonce":103804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":103804},{"type":"v1","addr":"172.21.15.167:6805","nonce":103804}]},"public_addr":"172.21.15.167:6801/103804","cluster_addr":"172.21.15.167:6803/103804","heartbeat_back_addr":"172.21.15.167:6807/103804","heartbeat_front_addr":"172.21.15.167:6805/103804","state":["exists","up"]},{"osd":5,"uuid":"7e9e2115-bf6e-41a9-bbe6-05da61ac870d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":103820},{"type":"v1","addr":"172.21.15.167:6817","nonce":103820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":103820},{"type":"v1","addr":"172.21.15.167:6819","nonce":103820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":103820},{"type":"v1","addr":"172.21.15.167:6823","nonce":103820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":103820},{"type":"v1","addr":"172.21.15.167:6821","nonce":103820}]},"public_addr":"172.21.15.167:6817/103820","cluster_addr":"172.21.15.167:6819/103820","heartbeat_back_addr":"172.21.15.167:6823/103820","heartbeat_front_addr":"172.21.15.167:6821/103820","state":["exists","up"]},{"osd":6,"uuid":"61ecacef-15ca-45eb-b8dd-d9ca291ef525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":103805},{"type":"v1","addr":"172.21.15.167:6809","nonce":103805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":103805},{"type":"v1","addr":"172.21.15.167:6811","nonce":103805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":103805},{"type":"v1","addr":"172.21.15.167:6815","nonce":103805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":103805},{"type":"v1","addr":"172.21.15.167:6813","nonce":103805}]},"public_addr":"172.21.15.167:6809/103805","cluster_addr":"172.21.15.167:6811/103805","heartbeat_back_addr":"172.21.15.167:6815/103805","heartbeat_front_addr":"172.21.15.167:6813/103805","state":["exists","up"]},{"osd":7,"uuid":"f4090465-2f84-435b-aa4f-1a5e18d61e93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":103835},{"type":"v1","addr":"172.21.15.167:6825","nonce":103835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":103835},{"type":"v1","addr":"172.21.15.167:6827","nonce":103835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":103835},{"type":"v1","addr":"172.21.15.167:6831","nonce":103835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":103835},{"type":"v1","addr":"172.21.15.167:6829","nonce":103835}]},"public_addr":"172.21.15.167:6825/103835","cluster_addr":"172.21.15.167:6827/103835","heartbeat_back_addr":"172.21.15.167:6831/103835","heartbeat_front_addr":"172.21.15.167:6829/103835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.812733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.840324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.857361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.810710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.873907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.867822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:08:19.886289+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6835/1701437437":"2023-11-29T11:12:48.071217+0000","172.21.15.167:6833/1701437437":"2023-11-29T11:12:48.071217+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:12:55.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 -- 172.21.15.125:0/743419102 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21840682f0 msgr2=0x7f218406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:55.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21840682f0 0x7f218406a7a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2198014040 tx=0x7f2198008030 comp rx=0 tx=0).stop 2023-11-28T11:12:55.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 -- 172.21.15.125:0/743419102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21a406e3a0 msgr2=0x7f21a40ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:55.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21a406e3a0 0x7f21a40ca320 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f219400e810 tx=0x7f219400ebd0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 -- 172.21.15.125:0/743419102 shutdown_connections 2023-11-28T11:12:55.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21a415cc80 0x7f21a40cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f21840682f0 0x7f218406a7a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21a406a270 0x7f21a41525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 --2- 172.21.15.125:0/743419102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21a406e3a0 0x7f21a40ca320 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:55.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 -- 172.21.15.125:0/743419102 >> 172.21.15.125:0/743419102 conn(0x7f21a406c010 msgr2=0x7f21a40afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:55.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 -- 172.21.15.125:0/743419102 shutdown_connections 2023-11-28T11:12:55.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:55.389+0000 7f21a8fd2700 1 -- 172.21.15.125:0/743419102 wait complete. 2023-11-28T11:12:56.403 INFO:tasks.ceph:Scrubbing osd.0 2023-11-28T11:12:56.404 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:12:56.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.546+0000 7fec9e06b700 1 Processor -- start 2023-11-28T11:12:56.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.546+0000 7fec9e06b700 1 -- start start 2023-11-28T11:12:56.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.547+0000 7fec9e06b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec9815e070 0x7fec9806b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.547+0000 7fec9e06b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec980cea10 con 0x7fec980ceea0 2023-11-28T11:12:56.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.547+0000 7fec9e06b700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec980cbd10 con 0x7fec9815a860 2023-11-28T11:12:56.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.547+0000 7fec9e06b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9815ae80 con 0x7fec9815e070 2023-11-28T11:12:56.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.547+0000 7fec96ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fec980ceea0 0x7fec9815a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46292/0 (socket says 172.21.15.125:46292) 2023-11-28T11:12:56.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.547+0000 7fec96ffd700 1 -- 172.21.15.125:0/1667322534 learned_addr learned my addr 172.21.15.125:0/1667322534 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:56.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.547+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770536927 0 0) 0x7fec980cea10 con 0x7fec980ceea0 2023-11-28T11:12:56.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.547+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec840035b0 con 0x7fec980ceea0 2023-11-28T11:12:56.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec977fe700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec9815e070 0x7fec9806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340636665 0 0) 0x7fec840035b0 con 0x7fec980ceea0 2023-11-28T11:12:56.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec9815e070 msgr2=0x7fec9806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:56.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec9815e070 0x7fec9806b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 >> v1:172.21.15.167:6789/0 conn(0x7fec9815a860 legacy=0x7fec98150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980ce0e0 con 0x7fec980ceea0 2023-11-28T11:12:56.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7fec80001670 con 0x7fec980ceea0 2023-11-28T11:12:56.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 >> v1:172.21.15.125:6789/0 conn(0x7fec980ceea0 legacy=0x7fec9815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec9815e070 0x7fec84003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec84003f70 0x7fec84004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec84004d90 0x7fec84005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9815ae80 con 0x7fec84004d90 2023-11-28T11:12:56.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8400ba40 con 0x7fec84003f70 2023-11-28T11:12:56.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8400bc00 con 0x7fec9815e070 2023-11-28T11:12:56.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec97fff700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec84004d90 0x7fec84005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec977fe700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec9815e070 0x7fec84003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec96ffd700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec84003f70 0x7fec84004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec97fff700 1 -- 172.21.15.125:0/1667322534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec9815e070 msgr2=0x7fec84003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:56.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec97fff700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec9815e070 0x7fec84003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec97fff700 1 -- 172.21.15.125:0/1667322534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec84003f70 msgr2=0x7fec84004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:56.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec97fff700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec84003f70 0x7fec84004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec97fff700 1 -- 172.21.15.125:0/1667322534 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec840035b0 con 0x7fec84004d90 2023-11-28T11:12:56.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.548+0000 7fec97fff700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec84004d90 0x7fec84005200 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fec9000c240 tx=0x7fec84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8af148c7a23a756 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:56.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.549+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90001e70 con 0x7fec84004d90 2023-11-28T11:12:56.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.549+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9000cde0 con 0x7fec84004d90 2023-11-28T11:12:56.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.549+0000 7fec967fc700 1 -- 172.21.15.125:0/1667322534 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90012660 con 0x7fec84004d90 2023-11-28T11:12:56.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.549+0000 7fec9e06b700 1 -- 172.21.15.125:0/1667322534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec84004d90 msgr2=0x7fec84005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.549+0000 7fec9e06b700 1 --2- 172.21.15.125:0/1667322534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec84004d90 0x7fec84005200 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fec9000c240 tx=0x7fec84005880 comp rx=0 tx=0).stop 2023-11-28T11:12:56.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.549+0000 7fec97fff700 1 -- 172.21.15.125:0/1667322534 reap_dead start 2023-11-28T11:12:56.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.549+0000 7fec9e06b700 1 -- 172.21.15.125:0/1667322534 shutdown_connections 2023-11-28T11:12:56.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.549+0000 7fec9e06b700 1 -- 172.21.15.125:0/1667322534 >> 172.21.15.125:0/1667322534 conn(0x7fec980cfc30 msgr2=0x7fec980d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:56.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.549+0000 7fec9e06b700 1 -- 172.21.15.125:0/1667322534 shutdown_connections 2023-11-28T11:12:56.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.549+0000 7fec9e06b700 1 -- 172.21.15.125:0/1667322534 wait complete. 2023-11-28T11:12:56.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.550+0000 7fec9e06b700 1 Processor -- start 2023-11-28T11:12:56.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.551+0000 7fec9e06b700 1 -- start start 2023-11-28T11:12:56.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.551+0000 7fec9e06b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec84004d90 0x7fec9806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec9e06b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec981e4e60 0x7fec981e3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec9e06b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec981e52d0 0x7fec981e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec9e06b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec981e5840 con 0x7fec981e52d0 2023-11-28T11:12:56.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec9e06b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec980b2ba0 con 0x7fec981e4e60 2023-11-28T11:12:56.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec9e06b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec980b2e80 con 0x7fec84004d90 2023-11-28T11:12:56.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec97fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec981e52d0 0x7fec981e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec97fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec981e52d0 0x7fec981e3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33952/0 (socket says 172.21.15.125:33952) 2023-11-28T11:12:56.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec97fff700 1 -- 172.21.15.125:0/4139564068 learned_addr learned my addr 172.21.15.125:0/4139564068 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:56.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec96ffd700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec981e4e60 0x7fec981e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec977fe700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec84004d90 0x7fec9806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec97fff700 1 -- 172.21.15.125:0/4139564068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec84004d90 msgr2=0x7fec9806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec97fff700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec84004d90 0x7fec9806e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec97fff700 1 -- 172.21.15.125:0/4139564068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec981e4e60 msgr2=0x7fec981e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec97fff700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec981e4e60 0x7fec981e3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec97fff700 1 -- 172.21.15.125:0/4139564068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980ce6a0 con 0x7fec981e52d0 2023-11-28T11:12:56.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec96ffd700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec981e4e60 0x7fec981e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:56.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec97fff700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec981e52d0 0x7fec981e3690 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fec90014040 tx=0x7fec90001490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:56.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec8ffff700 1 -- 172.21.15.125:0/4139564068 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90003e90 con 0x7fec981e52d0 2023-11-28T11:12:56.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec8ffff700 1 -- 172.21.15.125:0/4139564068 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec900052d0 con 0x7fec981e52d0 2023-11-28T11:12:56.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec9e06b700 1 -- 172.21.15.125:0/4139564068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec980ce3c0 con 0x7fec981e52d0 2023-11-28T11:12:56.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec8ffff700 1 -- 172.21.15.125:0/4139564068 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90005680 con 0x7fec981e52d0 2023-11-28T11:12:56.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.552+0000 7fec9e06b700 1 -- 172.21.15.125:0/4139564068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec98150790 con 0x7fec981e52d0 2023-11-28T11:12:56.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.553+0000 7fec9e06b700 1 -- 172.21.15.125:0/4139564068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec980743f0 con 0x7fec981e52d0 2023-11-28T11:12:56.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.554+0000 7fec8ffff700 1 -- 172.21.15.125:0/4139564068 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fec90010050 con 0x7fec981e52d0 2023-11-28T11:12:56.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.554+0000 7fec8ffff700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fec780682f0 0x7fec7806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.554+0000 7fec8ffff700 1 -- 172.21.15.125:0/4139564068 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fec900875e0 con 0x7fec981e52d0 2023-11-28T11:12:56.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.554+0000 7fec977fe700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fec780682f0 0x7fec7806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.554+0000 7fec8ffff700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] conn(0x7fec7806e5f0 0x7fec78070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.554+0000 7fec8ffff700 1 -- 172.21.15.125:0/4139564068 --> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec780710d0 con 0x7fec7806e5f0 2023-11-28T11:12:56.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.554+0000 7fec8ffff700 1 -- 172.21.15.125:0/4139564068 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec90087950 con 0x7fec981e52d0 2023-11-28T11:12:56.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.555+0000 7fec96ffd700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] conn(0x7fec7806e5f0 0x7fec78070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.555+0000 7fec977fe700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fec780682f0 0x7fec7806a7a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fec88009aa0 tx=0x7fec88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:56.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.555+0000 7fec96ffd700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] conn(0x7fec7806e5f0 0x7fec78070a00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:56.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.555+0000 7fec8ffff700 1 -- 172.21.15.125:0/4139564068 <== osd.0 v2:172.21.15.125:6816/103586 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fec780710d0 con 0x7fec7806e5f0 2023-11-28T11:12:56.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.570+0000 7fec9e06b700 1 -- 172.21.15.125:0/4139564068 --> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fec980c5310 con 0x7fec7806e5f0 2023-11-28T11:12:56.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.570+0000 7fec8ffff700 1 -- 172.21.15.125:0/4139564068 <== osd.0 v2:172.21.15.125:6816/103586 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fec980c5310 con 0x7fec7806e5f0 2023-11-28T11:12:56.572 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:12:56.572 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:12:56.572 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:12:56.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.570+0000 7fec9e06b700 1 -- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] conn(0x7fec7806e5f0 msgr2=0x7fec78070a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.570+0000 7fec9e06b700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:6816/103586,v1:172.21.15.125:6817/103586] conn(0x7fec7806e5f0 0x7fec78070a00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.570+0000 7fec9e06b700 1 -- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fec780682f0 msgr2=0x7fec7806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.570+0000 7fec9e06b700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fec780682f0 0x7fec7806a7a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fec88009aa0 tx=0x7fec88008040 comp rx=0 tx=0).stop 2023-11-28T11:12:56.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.570+0000 7fec9e06b700 1 -- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec981e52d0 msgr2=0x7fec981e3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.570+0000 7fec9e06b700 1 --2- 172.21.15.125:0/4139564068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec981e52d0 0x7fec981e3690 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fec90014040 tx=0x7fec90001490 comp rx=0 tx=0).stop 2023-11-28T11:12:56.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.570+0000 7fec97fff700 1 -- 172.21.15.125:0/4139564068 reap_dead start 2023-11-28T11:12:56.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.570+0000 7fec9e06b700 1 -- 172.21.15.125:0/4139564068 shutdown_connections 2023-11-28T11:12:56.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.570+0000 7fec9e06b700 1 -- 172.21.15.125:0/4139564068 >> 172.21.15.125:0/4139564068 conn(0x7fec980cfc30 msgr2=0x7fec980c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:56.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.571+0000 7fec9e06b700 1 -- 172.21.15.125:0/4139564068 shutdown_connections 2023-11-28T11:12:56.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.571+0000 7fec9e06b700 1 -- 172.21.15.125:0/4139564068 wait complete. 2023-11-28T11:12:56.585 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-28T11:12:56.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.705+0000 7fa4b6c73700 1 Processor -- start 2023-11-28T11:12:56.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.705+0000 7fa4b6c73700 1 -- start start 2023-11-28T11:12:56.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4b6c73700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa4b015c810 0x7fa4b0160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4b6c73700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4b00718e0 0x7fa4b006c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4b6c73700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b01607a0 con 0x7fa4b006cdc0 2023-11-28T11:12:56.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4b6c73700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b015cbe0 con 0x7fa4b00718e0 2023-11-28T11:12:56.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4b6c73700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b0160a50 con 0x7fa4b015c810 2023-11-28T11:12:56.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4b5210700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa4b006cdc0 0x7fa4b006a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46316/0 (socket says 172.21.15.125:46316) 2023-11-28T11:12:56.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4b5210700 1 -- 172.21.15.125:0/1758714484 learned_addr learned my addr 172.21.15.125:0/1758714484 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:56.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4affff700 1 --2- 172.21.15.125:0/1758714484 >> v2:172.21.15.125:3300/0 conn(0x7fa4b00718e0 0x7fa4b006c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4b4a0f700 1 --2- 172.21.15.125:0/1758714484 >> v2:172.21.15.167:3300/0 conn(0x7fa4b015c810 0x7fa4b0160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4af7fe700 1 -- 172.21.15.125:0/1758714484 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695116418 0 0) 0x7fa4b01607a0 con 0x7fa4b006cdc0 2023-11-28T11:12:56.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4af7fe700 1 -- 172.21.15.125:0/1758714484 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a00035b0 con 0x7fa4b006cdc0 2023-11-28T11:12:56.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4affff700 1 -- 172.21.15.125:0/1758714484 >> v2:172.21.15.167:3300/0 conn(0x7fa4b015c810 msgr2=0x7fa4b0160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:56.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4affff700 1 --2- 172.21.15.125:0/1758714484 >> v2:172.21.15.167:3300/0 conn(0x7fa4b015c810 0x7fa4b0160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4affff700 1 -- 172.21.15.125:0/1758714484 >> v1:172.21.15.125:6789/0 conn(0x7fa4b006cdc0 legacy=0x7fa4b006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4affff700 1 -- 172.21.15.125:0/1758714484 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b0160d30 con 0x7fa4b00718e0 2023-11-28T11:12:56.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4b4a0f700 1 --2- 172.21.15.125:0/1758714484 >> v2:172.21.15.167:3300/0 conn(0x7fa4b015c810 0x7fa4b0160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:56.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.706+0000 7fa4affff700 1 --2- 172.21.15.125:0/1758714484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4b00718e0 0x7fa4b006c880 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00b27c0 tx=0x7fa49c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be9373708abcb3d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:56.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.707+0000 7fa4af7fe700 1 -- 172.21.15.125:0/1758714484 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c011830 con 0x7fa4b00718e0 2023-11-28T11:12:56.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.707+0000 7fa4af7fe700 1 -- 172.21.15.125:0/1758714484 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c011990 con 0x7fa4b00718e0 2023-11-28T11:12:56.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.707+0000 7fa4af7fe700 1 -- 172.21.15.125:0/1758714484 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c011d20 con 0x7fa4b00718e0 2023-11-28T11:12:56.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.707+0000 7fa4b6c73700 1 -- 172.21.15.125:0/1758714484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4b00718e0 msgr2=0x7fa4b006c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.707+0000 7fa4b6c73700 1 --2- 172.21.15.125:0/1758714484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4b00718e0 0x7fa4b006c880 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00b27c0 tx=0x7fa49c009b20 comp rx=0 tx=0).stop 2023-11-28T11:12:56.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.707+0000 7fa4b6c73700 1 -- 172.21.15.125:0/1758714484 shutdown_connections 2023-11-28T11:12:56.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.707+0000 7fa4b6c73700 1 --2- 172.21.15.125:0/1758714484 >> v2:172.21.15.167:3300/0 conn(0x7fa4b015c810 0x7fa4b0160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.707+0000 7fa4b6c73700 1 --2- 172.21.15.125:0/1758714484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4b00718e0 0x7fa4b006c880 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.707+0000 7fa4b6c73700 1 -- 172.21.15.125:0/1758714484 >> 172.21.15.125:0/1758714484 conn(0x7fa4b006c010 msgr2=0x7fa4b00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:56.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.707+0000 7fa4b6c73700 1 -- 172.21.15.125:0/1758714484 shutdown_connections 2023-11-28T11:12:56.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.707+0000 7fa4b6c73700 1 -- 172.21.15.125:0/1758714484 wait complete. 2023-11-28T11:12:56.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.708+0000 7fa4b6c73700 1 Processor -- start 2023-11-28T11:12:56.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.708+0000 7fa4b6c73700 1 -- start start 2023-11-28T11:12:56.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.709+0000 7fa4b6c73700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b006cdc0 0x7fa4b01413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.709+0000 7fa4b6c73700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4b00718e0 0x7fa4b015cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.709+0000 7fa4b6c73700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4b015c810 0x7fa4b015d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.709+0000 7fa4b6c73700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b0141e60 con 0x7fa4b00718e0 2023-11-28T11:12:56.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.709+0000 7fa4b6c73700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b0142140 con 0x7fa4b015c810 2023-11-28T11:12:56.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.709+0000 7fa4b6c73700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b0142420 con 0x7fa4b006cdc0 2023-11-28T11:12:56.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.709+0000 7fa4affff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4b00718e0 0x7fa4b015cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.709+0000 7fa4affff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4b00718e0 0x7fa4b015cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33966/0 (socket says 172.21.15.125:33966) 2023-11-28T11:12:56.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.709+0000 7fa4affff700 1 -- 172.21.15.125:0/3813583905 learned_addr learned my addr 172.21.15.125:0/3813583905 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:56.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.709+0000 7fa4b5210700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4b015c810 0x7fa4b015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.709+0000 7fa4b4a0f700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b006cdc0 0x7fa4b01413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4affff700 1 -- 172.21.15.125:0/3813583905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b006cdc0 msgr2=0x7fa4b01413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4affff700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b006cdc0 0x7fa4b01413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4affff700 1 -- 172.21.15.125:0/3813583905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4b015c810 msgr2=0x7fa4b015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4affff700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4b015c810 0x7fa4b015d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4affff700 1 -- 172.21.15.125:0/3813583905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c0094a0 con 0x7fa4b00718e0 2023-11-28T11:12:56.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4b4a0f700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b006cdc0 0x7fa4b01413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:56.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4affff700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4b00718e0 0x7fa4b015cd20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009b60 tx=0x7fa49c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:56.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4ad7fa700 1 -- 172.21.15.125:0/3813583905 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0036a0 con 0x7fa4b00718e0 2023-11-28T11:12:56.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4ad7fa700 1 -- 172.21.15.125:0/3813583905 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c01f070 con 0x7fa4b00718e0 2023-11-28T11:12:56.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4b6c73700 1 -- 172.21.15.125:0/3813583905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b00ceb20 con 0x7fa4b00718e0 2023-11-28T11:12:56.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4ad7fa700 1 -- 172.21.15.125:0/3813583905 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c003a40 con 0x7fa4b00718e0 2023-11-28T11:12:56.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.710+0000 7fa4b6c73700 1 -- 172.21.15.125:0/3813583905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b0161010 con 0x7fa4b00718e0 2023-11-28T11:12:56.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.711+0000 7fa4b6c73700 1 -- 172.21.15.125:0/3813583905 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b00ce740 con 0x7fa4b00718e0 2023-11-28T11:12:56.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.711+0000 7fa4ad7fa700 1 -- 172.21.15.125:0/3813583905 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa49c00f050 con 0x7fa4b00718e0 2023-11-28T11:12:56.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.712+0000 7fa4ad7fa700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4940682f0 0x7fa49406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:56.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.712+0000 7fa4ad7fa700 1 -- 172.21.15.125:0/3813583905 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa49c021070 con 0x7fa4b00718e0 2023-11-28T11:12:56.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.712+0000 7fa4b4a0f700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4940682f0 0x7fa49406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:56.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.712+0000 7fa4b4a0f700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4940682f0 0x7fa49406a7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40099b0 tx=0x7fa4a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:56.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.716+0000 7fa4ad7fa700 1 -- 172.21.15.125:0/3813583905 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa49c053db0 con 0x7fa4b00718e0 2023-11-28T11:12:56.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.897+0000 7fa4b6c73700 1 -- 172.21.15.125:0/3813583905 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4b01422b0 con 0x7fa4940682f0 2023-11-28T11:12:56.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.898+0000 7fa4ad7fa700 1 -- 172.21.15.125:0/3813583905 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa4b01422b0 con 0x7fa4940682f0 2023-11-28T11:12:56.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.899+0000 7fa4b6c73700 1 -- 172.21.15.125:0/3813583905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4940682f0 msgr2=0x7fa49406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.899+0000 7fa4b6c73700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4940682f0 0x7fa49406a7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40099b0 tx=0x7fa4a4008040 comp rx=0 tx=0).stop 2023-11-28T11:12:56.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.899+0000 7fa4b6c73700 1 -- 172.21.15.125:0/3813583905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4b00718e0 msgr2=0x7fa4b015cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:56.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.899+0000 7fa4b6c73700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4b00718e0 0x7fa4b015cd20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009b60 tx=0x7fa49c004750 comp rx=0 tx=0).stop 2023-11-28T11:12:56.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.899+0000 7fa4b6c73700 1 -- 172.21.15.125:0/3813583905 shutdown_connections 2023-11-28T11:12:56.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.899+0000 7fa4b6c73700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4b015c810 0x7fa4b015d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.899+0000 7fa4b6c73700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fa4940682f0 0x7fa49406a7a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.899+0000 7fa4b6c73700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b006cdc0 0x7fa4b01413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.899+0000 7fa4b6c73700 1 --2- 172.21.15.125:0/3813583905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4b00718e0 0x7fa4b015cd20 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:56.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.900+0000 7fa4b6c73700 1 -- 172.21.15.125:0/3813583905 >> 172.21.15.125:0/3813583905 conn(0x7fa4b006c010 msgr2=0x7fa4b006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:56.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.900+0000 7fa4b6c73700 1 -- 172.21.15.125:0/3813583905 shutdown_connections 2023-11-28T11:12:56.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:56.900+0000 7fa4b6c73700 1 -- 172.21.15.125:0/3813583905 wait complete. 2023-11-28T11:12:56.904 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 0 to deep-scrub 2023-11-28T11:12:56.913 INFO:tasks.ceph:Scrubbing osd.1 2023-11-28T11:12:56.913 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:12:57.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.035+0000 7f917e42f700 1 Processor -- start 2023-11-28T11:12:57.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.035+0000 7f917e42f700 1 -- start start 2023-11-28T11:12:57.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.036+0000 7f917e42f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f917815a5c0 0x7f91780ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.036+0000 7f917e42f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91780cce70 con 0x7f91780cedf0 2023-11-28T11:12:57.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.036+0000 7f917e42f700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91780cc260 con 0x7f91780cbc00 2023-11-28T11:12:57.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.036+0000 7f917e42f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917815a990 con 0x7f917815a5c0 2023-11-28T11:12:57.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.036+0000 7f9177fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f917815a5c0 0x7f91780ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.036+0000 7f91777fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f91780cedf0 0x7f91780cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46328/0 (socket says 172.21.15.125:46328) 2023-11-28T11:12:57.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.036+0000 7f91777fe700 1 -- 172.21.15.125:0/1459685658 learned_addr learned my addr 172.21.15.125:0/1459685658 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:57.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.037+0000 7f9177fff700 1 -- 172.21.15.125:0/1459685658 >> v1:172.21.15.167:6789/0 conn(0x7f91780cbc00 legacy=0x7f91780ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:57.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.037+0000 7f9177fff700 1 -- 172.21.15.125:0/1459685658 >> v1:172.21.15.125:6789/0 conn(0x7f91780cedf0 legacy=0x7f91780cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.037+0000 7f9176ffd700 1 -- 172.21.15.125:0/1459685658 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885338378 0 0) 0x7f91780cce70 con 0x7f91780cedf0 2023-11-28T11:12:57.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.037+0000 7f9177fff700 1 -- 172.21.15.125:0/1459685658 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780cc540 con 0x7f917815a5c0 2023-11-28T11:12:57.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.037+0000 7f9177fff700 1 --2- 172.21.15.125:0/1459685658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f917815a5c0 0x7f91780ce8b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9160009840 tx=0x7f9160009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d678427f88cde3d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.037+0000 7f9176ffd700 1 -- 172.21.15.125:0/1459685658 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160004230 con 0x7f917815a5c0 2023-11-28T11:12:57.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.037+0000 7f9176ffd700 1 -- 172.21.15.125:0/1459685658 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9160004390 con 0x7f917815a5c0 2023-11-28T11:12:57.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.037+0000 7f9176ffd700 1 -- 172.21.15.125:0/1459685658 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600036a0 con 0x7f917815a5c0 2023-11-28T11:12:57.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.037+0000 7f917e42f700 1 -- 172.21.15.125:0/1459685658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f917815a5c0 msgr2=0x7f91780ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.037+0000 7f917e42f700 1 --2- 172.21.15.125:0/1459685658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f917815a5c0 0x7f91780ce8b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9160009840 tx=0x7f9160009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:57.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.038+0000 7f917e42f700 1 -- 172.21.15.125:0/1459685658 shutdown_connections 2023-11-28T11:12:57.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.038+0000 7f917e42f700 1 --2- 172.21.15.125:0/1459685658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f917815a5c0 0x7f91780ce8b0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.038+0000 7f917e42f700 1 -- 172.21.15.125:0/1459685658 >> 172.21.15.125:0/1459685658 conn(0x7f917806ab90 msgr2=0x7f917809a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:57.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.038+0000 7f917e42f700 1 -- 172.21.15.125:0/1459685658 shutdown_connections 2023-11-28T11:12:57.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.038+0000 7f917e42f700 1 -- 172.21.15.125:0/1459685658 wait complete. 2023-11-28T11:12:57.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.039+0000 7f917e42f700 1 Processor -- start 2023-11-28T11:12:57.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.039+0000 7f917e42f700 1 -- start start 2023-11-28T11:12:57.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f917e42f700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91780cbc00 0x7f91781ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f917e42f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91780cedf0 0x7f917815b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f917e42f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f917815a5c0 0x7f91780b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f917e42f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780c5330 con 0x7f91780cedf0 2023-11-28T11:12:57.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f917e42f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780b55d0 con 0x7f917815a5c0 2023-11-28T11:12:57.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f917e42f700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91780c7230 con 0x7f91780cbc00 2023-11-28T11:12:57.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f91777fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91780cedf0 0x7f917815b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f91777fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91780cedf0 0x7f917815b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33980/0 (socket says 172.21.15.125:33980) 2023-11-28T11:12:57.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f91777fe700 1 -- 172.21.15.125:0/2493129214 learned_addr learned my addr 172.21.15.125:0/2493129214 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:57.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f917c9cc700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f917815a5c0 0x7f91780b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f9177fff700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91780cbc00 0x7f91781ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f91777fe700 1 -- 172.21.15.125:0/2493129214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91780cbc00 msgr2=0x7f91781ef7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f91777fe700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91780cbc00 0x7f91781ef7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f91777fe700 1 -- 172.21.15.125:0/2493129214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f917815a5c0 msgr2=0x7f91780b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f91777fe700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f917815a5c0 0x7f91780b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f91777fe700 1 -- 172.21.15.125:0/2493129214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600094a0 con 0x7f91780cedf0 2023-11-28T11:12:57.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f91777fe700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91780cedf0 0x7f917815b910 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f91680011e0 tx=0x7f916800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f9174ff9700 1 -- 172.21.15.125:0/2493129214 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168004c80 con 0x7f91780cedf0 2023-11-28T11:12:57.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f9174ff9700 1 -- 172.21.15.125:0/2493129214 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9168004e00 con 0x7f91780cedf0 2023-11-28T11:12:57.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f917e42f700 1 -- 172.21.15.125:0/2493129214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91780ccb00 con 0x7f91780cedf0 2023-11-28T11:12:57.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f9174ff9700 1 -- 172.21.15.125:0/2493129214 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168007310 con 0x7f91780cedf0 2023-11-28T11:12:57.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.040+0000 7f917e42f700 1 -- 172.21.15.125:0/2493129214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91780cc820 con 0x7f91780cedf0 2023-11-28T11:12:57.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.041+0000 7f917e42f700 1 -- 172.21.15.125:0/2493129214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91780adfc0 con 0x7f91780cedf0 2023-11-28T11:12:57.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.042+0000 7f9174ff9700 1 -- 172.21.15.125:0/2493129214 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f916801a020 con 0x7f91780cedf0 2023-11-28T11:12:57.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.042+0000 7f9174ff9700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f91580682f0 0x7f915806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.042+0000 7f9177fff700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f91580682f0 0x7f915806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.042+0000 7f9174ff9700 1 -- 172.21.15.125:0/2493129214 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f91680855e0 con 0x7f91780cedf0 2023-11-28T11:12:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.042+0000 7f9174ff9700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x7f915806e760 0x7f9158070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.042+0000 7f9174ff9700 1 -- 172.21.15.125:0/2493129214 --> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9158071240 con 0x7f915806e760 2023-11-28T11:12:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.042+0000 7f9174ff9700 1 -- 172.21.15.125:0/2493129214 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9168087c90 con 0x7f91780cedf0 2023-11-28T11:12:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.042+0000 7f917c9cc700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x7f915806e760 0x7f9158070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.043+0000 7f9177fff700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f91580682f0 0x7f915806a7a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f91600090b0 tx=0x7f9160008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.043+0000 7f917c9cc700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x7f915806e760 0x7f9158070b70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.043+0000 7f9174ff9700 1 -- 172.21.15.125:0/2493129214 <== osd.1 v2:172.21.15.125:6824/103588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9158071240 con 0x7f915806e760 2023-11-28T11:12:57.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917e42f700 1 -- 172.21.15.125:0/2493129214 --> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f91780d1930 con 0x7f915806e760 2023-11-28T11:12:57.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f9174ff9700 1 -- 172.21.15.125:0/2493129214 <== osd.1 v2:172.21.15.125:6824/103588 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f91780d1930 con 0x7f915806e760 2023-11-28T11:12:57.060 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:12:57.060 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:12:57.060 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:12:57.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917e42f700 1 -- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x7f915806e760 msgr2=0x7f9158070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917e42f700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:6824/103588,v1:172.21.15.125:6825/103588] conn(0x7f915806e760 0x7f9158070b70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917e42f700 1 -- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f91580682f0 msgr2=0x7f915806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917e42f700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f91580682f0 0x7f915806a7a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f91600090b0 tx=0x7f9160008030 comp rx=0 tx=0).stop 2023-11-28T11:12:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917e42f700 1 -- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91780cedf0 msgr2=0x7f917815b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917e42f700 1 --2- 172.21.15.125:0/2493129214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91780cedf0 0x7f917815b910 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f91680011e0 tx=0x7f916800cae0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917c9cc700 1 -- 172.21.15.125:0/2493129214 reap_dead start 2023-11-28T11:12:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917e42f700 1 -- 172.21.15.125:0/2493129214 shutdown_connections 2023-11-28T11:12:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917e42f700 1 -- 172.21.15.125:0/2493129214 >> 172.21.15.125:0/2493129214 conn(0x7f917806ab90 msgr2=0x7f91780cb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917e42f700 1 -- 172.21.15.125:0/2493129214 shutdown_connections 2023-11-28T11:12:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.058+0000 7f917e42f700 1 -- 172.21.15.125:0/2493129214 wait complete. 2023-11-28T11:12:57.071 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-28T11:12:57.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.192+0000 7f1b34896700 1 Processor -- start 2023-11-28T11:12:57.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.192+0000 7f1b34896700 1 -- start start 2023-11-28T11:12:57.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b34896700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1b3015a5f0 0x7f1b300d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b34896700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b300cc200 0x7f1b300b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b34896700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1b300b2d10 0x7f1b3015e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b34896700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b300b3190 con 0x7f1b300b2d10 2023-11-28T11:12:57.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b34896700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3015a9c0 con 0x7f1b3015a5f0 2023-11-28T11:12:57.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b34896700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300c7b80 con 0x7f1b300cc200 2023-11-28T11:12:57.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1b300b2d10 0x7f1b3015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1b300b2d10 0x7f1b3015e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33992/0 (socket says 172.21.15.125:33992) 2023-11-28T11:12:57.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2ed9d700 1 -- 172.21.15.125:0/3403985115 learned_addr learned my addr 172.21.15.125:0/3403985115 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:57.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2e59c700 1 --2- 172.21.15.125:0/3403985115 >> v2:172.21.15.167:3300/0 conn(0x7f1b3015a5f0 0x7f1b300d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2dd9b700 1 --2- 172.21.15.125:0/3403985115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b300cc200 0x7f1b300b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2ed9d700 1 -- 172.21.15.125:0/3403985115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b300cc200 msgr2=0x7f1b300b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:57.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2ed9d700 1 --2- 172.21.15.125:0/3403985115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b300cc200 0x7f1b300b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2ed9d700 1 -- 172.21.15.125:0/3403985115 >> v2:172.21.15.167:3300/0 conn(0x7f1b3015a5f0 msgr2=0x7f1b300d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:57.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2ed9d700 1 --2- 172.21.15.125:0/3403985115 >> v2:172.21.15.167:3300/0 conn(0x7f1b3015a5f0 0x7f1b300d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2ed9d700 1 -- 172.21.15.125:0/3403985115 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b300cc990 con 0x7f1b300b2d10 2023-11-28T11:12:57.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2e59c700 1 --2- 172.21.15.125:0/3403985115 >> v2:172.21.15.167:3300/0 conn(0x7f1b3015a5f0 0x7f1b300d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:57.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2dd9b700 1 --2- 172.21.15.125:0/3403985115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b300cc200 0x7f1b300b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:57.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.193+0000 7f1b2ed9d700 1 --2- 172.21.15.125:0/3403985115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300b2d10 0x7f1b3015e110 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1b300d1d40 tx=0x7f1b2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5d50709d252e91 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b2d59a700 1 -- 172.21.15.125:0/3403985115 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800e070 con 0x7f1b300b2d10 2023-11-28T11:12:57.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b2d59a700 1 -- 172.21.15.125:0/3403985115 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2800b9c0 con 0x7f1b300b2d10 2023-11-28T11:12:57.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b2d59a700 1 -- 172.21.15.125:0/3403985115 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800bd70 con 0x7f1b300b2d10 2023-11-28T11:12:57.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b34896700 1 -- 172.21.15.125:0/3403985115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300b2d10 msgr2=0x7f1b3015e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b34896700 1 --2- 172.21.15.125:0/3403985115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300b2d10 0x7f1b3015e110 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1b300d1d40 tx=0x7f1b2800b330 comp rx=0 tx=0).stop 2023-11-28T11:12:57.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b34896700 1 -- 172.21.15.125:0/3403985115 shutdown_connections 2023-11-28T11:12:57.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b34896700 1 --2- 172.21.15.125:0/3403985115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300b2d10 0x7f1b3015e110 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b34896700 1 --2- 172.21.15.125:0/3403985115 >> v2:172.21.15.167:3300/0 conn(0x7f1b3015a5f0 0x7f1b300d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b34896700 1 --2- 172.21.15.125:0/3403985115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b300cc200 0x7f1b300b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b34896700 1 -- 172.21.15.125:0/3403985115 >> 172.21.15.125:0/3403985115 conn(0x7f1b3006ea80 msgr2=0x7f1b3006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:57.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b34896700 1 -- 172.21.15.125:0/3403985115 shutdown_connections 2023-11-28T11:12:57.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.194+0000 7f1b34896700 1 -- 172.21.15.125:0/3403985115 wait complete. 2023-11-28T11:12:57.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.195+0000 7f1b34896700 1 Processor -- start 2023-11-28T11:12:57.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b34896700 1 -- start start 2023-11-28T11:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b34896700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b300b2d10 0x7f1b3014a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b34896700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300cc200 0x7f1b3014a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b34896700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b3015a5f0 0x7f1b3014b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b34896700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300b5930 con 0x7f1b300cc200 2023-11-28T11:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b34896700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300c8300 con 0x7f1b300b2d10 2023-11-28T11:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b34896700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300c85e0 con 0x7f1b3015a5f0 2023-11-28T11:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b2dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300cc200 0x7f1b3014a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b2dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300cc200 0x7f1b3014a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33996/0 (socket says 172.21.15.125:33996) 2023-11-28T11:12:57.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b2dd9b700 1 -- 172.21.15.125:0/2646972028 learned_addr learned my addr 172.21.15.125:0/2646972028 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:57.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b2e59c700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b300b2d10 0x7f1b3014a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.196+0000 7f1b2ed9d700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b3015a5f0 0x7f1b3014b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b2dd9b700 1 -- 172.21.15.125:0/2646972028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b3015a5f0 msgr2=0x7f1b3014b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b2dd9b700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b3015a5f0 0x7f1b3014b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b2dd9b700 1 -- 172.21.15.125:0/2646972028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b300b2d10 msgr2=0x7f1b3014a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b2dd9b700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b300b2d10 0x7f1b3014a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b2dd9b700 1 -- 172.21.15.125:0/2646972028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b28009b30 con 0x7f1b300cc200 2023-11-28T11:12:57.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b2ed9d700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b3015a5f0 0x7f1b3014b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:57.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b2e59c700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b300b2d10 0x7f1b3014a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:57.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b2dd9b700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300cc200 0x7f1b3014a3f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000e810 tx=0x7f1b2000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b1effd700 1 -- 172.21.15.125:0/2646972028 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20013610 con 0x7f1b300cc200 2023-11-28T11:12:57.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b1effd700 1 -- 172.21.15.125:0/2646972028 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20013770 con 0x7f1b300cc200 2023-11-28T11:12:57.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b34896700 1 -- 172.21.15.125:0/2646972028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b300ccf50 con 0x7f1b300cc200 2023-11-28T11:12:57.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b1effd700 1 -- 172.21.15.125:0/2646972028 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20013b20 con 0x7f1b300cc200 2023-11-28T11:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.197+0000 7f1b34896700 1 -- 172.21.15.125:0/2646972028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b300ccc70 con 0x7f1b300cc200 2023-11-28T11:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.198+0000 7f1b34896700 1 -- 172.21.15.125:0/2646972028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b300cd230 con 0x7f1b300cc200 2023-11-28T11:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.198+0000 7f1b1effd700 1 -- 172.21.15.125:0/2646972028 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1b20023070 con 0x7f1b300cc200 2023-11-28T11:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.199+0000 7f1b1effd700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1b100682f0 0x7f1b1006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.199+0000 7f1b1effd700 1 -- 172.21.15.125:0/2646972028 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1b20085600 con 0x7f1b300cc200 2023-11-28T11:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.199+0000 7f1b2e59c700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1b100682f0 0x7f1b1006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.199+0000 7f1b2e59c700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1b100682f0 0x7f1b1006a7a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1b300cd6b0 tx=0x7f1b24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.203+0000 7f1b1effd700 1 -- 172.21.15.125:0/2646972028 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1b20052160 con 0x7f1b300cc200 2023-11-28T11:12:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.388+0000 7f1b34896700 1 -- 172.21.15.125:0/2646972028 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b300b5aa0 con 0x7f1b100682f0 2023-11-28T11:12:57.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.388+0000 7f1b1effd700 1 -- 172.21.15.125:0/2646972028 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1b300b5aa0 con 0x7f1b100682f0 2023-11-28T11:12:57.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 -- 172.21.15.125:0/2646972028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1b100682f0 msgr2=0x7f1b1006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1b100682f0 0x7f1b1006a7a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1b300cd6b0 tx=0x7f1b24008040 comp rx=0 tx=0).stop 2023-11-28T11:12:57.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 -- 172.21.15.125:0/2646972028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300cc200 msgr2=0x7f1b3014a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300cc200 0x7f1b3014a3f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000e810 tx=0x7f1b2000ebd0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 -- 172.21.15.125:0/2646972028 shutdown_connections 2023-11-28T11:12:57.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f1b100682f0 0x7f1b1006a7a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b3015a5f0 0x7f1b3014b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b300b2d10 0x7f1b3014a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 --2- 172.21.15.125:0/2646972028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300cc200 0x7f1b3014a3f0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 -- 172.21.15.125:0/2646972028 >> 172.21.15.125:0/2646972028 conn(0x7f1b3006ea80 msgr2=0x7f1b300b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:57.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 -- 172.21.15.125:0/2646972028 shutdown_connections 2023-11-28T11:12:57.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.390+0000 7f1b34896700 1 -- 172.21.15.125:0/2646972028 wait complete. 2023-11-28T11:12:57.395 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 1 to deep-scrub 2023-11-28T11:12:57.404 INFO:tasks.ceph:Scrubbing osd.2 2023-11-28T11:12:57.404 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:12:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.527+0000 7f52677e8700 1 Processor -- start 2023-11-28T11:12:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.527+0000 7f52677e8700 1 -- start start 2023-11-28T11:12:57.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f52677e8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f526015cce0 0x7f526006b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f52677e8700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f526015dc40 0x7f5260070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f52677e8700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5260071150 0x7f52600c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f52677e8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526015d0b0 con 0x7f526015cce0 2023-11-28T11:12:57.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f52677e8700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52600cdc10 con 0x7f526015dc40 2023-11-28T11:12:57.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f52677e8700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52600715b0 con 0x7f5260071150 2023-11-28T11:12:57.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5265584700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f526015cce0 0x7f526006b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5265584700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f526015cce0 0x7f526006b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34002/0 (socket says 172.21.15.125:34002) 2023-11-28T11:12:57.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5265584700 1 -- 172.21.15.125:0/403334215 learned_addr learned my addr 172.21.15.125:0/403334215 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:57.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5265584700 1 -- 172.21.15.125:0/403334215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5260071150 msgr2=0x7f52600c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:57.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5265584700 1 --2- 172.21.15.125:0/403334215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5260071150 0x7f52600c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5265584700 1 -- 172.21.15.125:0/403334215 >> v2:172.21.15.167:3300/0 conn(0x7f526015dc40 msgr2=0x7f5260070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:57.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5264d83700 1 --2- 172.21.15.125:0/403334215 >> v2:172.21.15.167:3300/0 conn(0x7f526015dc40 0x7f5260070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5265584700 1 --2- 172.21.15.125:0/403334215 >> v2:172.21.15.167:3300/0 conn(0x7f526015dc40 0x7f5260070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5265584700 1 -- 172.21.15.125:0/403334215 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600cfa10 con 0x7f526015cce0 2023-11-28T11:12:57.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5264d83700 1 --2- 172.21.15.125:0/403334215 >> v2:172.21.15.167:3300/0 conn(0x7f526015dc40 0x7f5260070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:57.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5265584700 1 --2- 172.21.15.125:0/403334215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f526015cce0 0x7f526006b9f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f52600d0b00 tx=0x7f525c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7588ecfd0dad16 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5257fff700 1 -- 172.21.15.125:0/403334215 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c00b860 con 0x7f526015cce0 2023-11-28T11:12:57.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5257fff700 1 -- 172.21.15.125:0/403334215 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c00b9c0 con 0x7f526015cce0 2023-11-28T11:12:57.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.528+0000 7f5257fff700 1 -- 172.21.15.125:0/403334215 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c00bd50 con 0x7f526015cce0 2023-11-28T11:12:57.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.529+0000 7f52677e8700 1 -- 172.21.15.125:0/403334215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f526015cce0 msgr2=0x7f526006b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.529+0000 7f52677e8700 1 --2- 172.21.15.125:0/403334215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f526015cce0 0x7f526006b9f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f52600d0b00 tx=0x7f525c009c00 comp rx=0 tx=0).stop 2023-11-28T11:12:57.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.529+0000 7f52677e8700 1 -- 172.21.15.125:0/403334215 shutdown_connections 2023-11-28T11:12:57.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.529+0000 7f52677e8700 1 --2- 172.21.15.125:0/403334215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5260071150 0x7f52600c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.529+0000 7f52677e8700 1 --2- 172.21.15.125:0/403334215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f526015cce0 0x7f526006b9f0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.529+0000 7f52677e8700 1 --2- 172.21.15.125:0/403334215 >> v2:172.21.15.167:3300/0 conn(0x7f526015dc40 0x7f5260070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.529+0000 7f52677e8700 1 -- 172.21.15.125:0/403334215 >> 172.21.15.125:0/403334215 conn(0x7f52600cfc30 msgr2=0x7f52600d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:57.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.529+0000 7f52677e8700 1 -- 172.21.15.125:0/403334215 shutdown_connections 2023-11-28T11:12:57.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.529+0000 7f52677e8700 1 -- 172.21.15.125:0/403334215 wait complete. 2023-11-28T11:12:57.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.530+0000 7f52677e8700 1 Processor -- start 2023-11-28T11:12:57.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.530+0000 7f52677e8700 1 -- start start 2023-11-28T11:12:57.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f52677e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5260071150 0x7f52601470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f52677e8700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f526015cce0 0x7f526015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f52677e8700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f526015dc40 0x7f5260146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f52677e8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52600b4a60 con 0x7f5260071150 2023-11-28T11:12:57.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f52677e8700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526015bf30 con 0x7f526015dc40 2023-11-28T11:12:57.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f52677e8700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5260159130 con 0x7f526015cce0 2023-11-28T11:12:57.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5265584700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5260071150 0x7f52601470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5265584700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5260071150 0x7f52601470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34008/0 (socket says 172.21.15.125:34008) 2023-11-28T11:12:57.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5265584700 1 -- 172.21.15.125:0/1453648661 learned_addr learned my addr 172.21.15.125:0/1453648661 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:57.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5265d85700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f526015dc40 0x7f5260146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5264d83700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f526015cce0 0x7f526015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5265584700 1 -- 172.21.15.125:0/1453648661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f526015cce0 msgr2=0x7f526015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5265584700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f526015cce0 0x7f526015b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5265584700 1 -- 172.21.15.125:0/1453648661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f526015dc40 msgr2=0x7f5260146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5265584700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f526015dc40 0x7f5260146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5265584700 1 -- 172.21.15.125:0/1453648661 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c009550 con 0x7f5260071150 2023-11-28T11:12:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5264d83700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f526015cce0 0x7f526015b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.531+0000 7f5265584700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5260071150 0x7f52601470f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f525c014040 tx=0x7f525c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.532+0000 7f5255ffb700 1 -- 172.21.15.125:0/1453648661 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c0036a0 con 0x7f5260071150 2023-11-28T11:12:57.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.532+0000 7f5255ffb700 1 -- 172.21.15.125:0/1453648661 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c01e070 con 0x7f5260071150 2023-11-28T11:12:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.532+0000 7f52677e8700 1 -- 172.21.15.125:0/1453648661 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52600cd8a0 con 0x7f5260071150 2023-11-28T11:12:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.532+0000 7f5255ffb700 1 -- 172.21.15.125:0/1453648661 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c003a60 con 0x7f5260071150 2023-11-28T11:12:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.532+0000 7f52677e8700 1 -- 172.21.15.125:0/1453648661 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52600cf730 con 0x7f5260071150 2023-11-28T11:12:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.533+0000 7f52677e8700 1 -- 172.21.15.125:0/1453648661 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52600cf3e0 con 0x7f5260071150 2023-11-28T11:12:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.533+0000 7f5255ffb700 1 -- 172.21.15.125:0/1453648661 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f525c00f050 con 0x7f5260071150 2023-11-28T11:12:57.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.533+0000 7f5255ffb700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52440682f0 0x7f524406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.534+0000 7f5255ffb700 1 -- 172.21.15.125:0/1453648661 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f525c020070 con 0x7f5260071150 2023-11-28T11:12:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.534+0000 7f5264d83700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52440682f0 0x7f524406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.534+0000 7f5255ffb700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] conn(0x7f524406e760 0x7f5244070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.534+0000 7f5255ffb700 1 -- 172.21.15.125:0/1453648661 --> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5244071240 con 0x7f524406e760 2023-11-28T11:12:57.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.534+0000 7f5255ffb700 1 -- 172.21.15.125:0/1453648661 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f525c08c070 con 0x7f5260071150 2023-11-28T11:12:57.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.534+0000 7f5265d85700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] conn(0x7f524406e760 0x7f5244070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.534+0000 7f5264d83700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52440682f0 0x7f524406a7a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f526014a280 tx=0x7f5250008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.534+0000 7f5265d85700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] conn(0x7f524406e760 0x7f5244070b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.535+0000 7f5255ffb700 1 -- 172.21.15.125:0/1453648661 <== osd.2 v2:172.21.15.125:6808/103587 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5244071240 con 0x7f524406e760 2023-11-28T11:12:57.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f52677e8700 1 -- 172.21.15.125:0/1453648661 --> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f52600743f0 con 0x7f524406e760 2023-11-28T11:12:57.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f5255ffb700 1 -- 172.21.15.125:0/1453648661 <== osd.2 v2:172.21.15.125:6808/103587 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f52600743f0 con 0x7f524406e760 2023-11-28T11:12:57.552 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:12:57.552 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:12:57.552 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:12:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f52677e8700 1 -- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] conn(0x7f524406e760 msgr2=0x7f5244070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f52677e8700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:6808/103587,v1:172.21.15.125:6809/103587] conn(0x7f524406e760 0x7f5244070b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f52677e8700 1 -- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52440682f0 msgr2=0x7f524406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f52677e8700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f52440682f0 0x7f524406a7a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f526014a280 tx=0x7f5250008040 comp rx=0 tx=0).stop 2023-11-28T11:12:57.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f52677e8700 1 -- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5260071150 msgr2=0x7f52601470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f52677e8700 1 --2- 172.21.15.125:0/1453648661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5260071150 0x7f52601470f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f525c014040 tx=0x7f525c004750 comp rx=0 tx=0).stop 2023-11-28T11:12:57.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f5265d85700 1 -- 172.21.15.125:0/1453648661 reap_dead start 2023-11-28T11:12:57.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f52677e8700 1 -- 172.21.15.125:0/1453648661 shutdown_connections 2023-11-28T11:12:57.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f52677e8700 1 -- 172.21.15.125:0/1453648661 >> 172.21.15.125:0/1453648661 conn(0x7f52600cfc30 msgr2=0x7f526006e540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:57.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f52677e8700 1 -- 172.21.15.125:0/1453648661 shutdown_connections 2023-11-28T11:12:57.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.549+0000 7f52677e8700 1 -- 172.21.15.125:0/1453648661 wait complete. 2023-11-28T11:12:57.563 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-28T11:12:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.681+0000 7f7133e20700 1 Processor -- start 2023-11-28T11:12:57.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.682+0000 7f7133e20700 1 -- start start 2023-11-28T11:12:57.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.682+0000 7f7133e20700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f712c0cec00 0x7f712c065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.682+0000 7f7133e20700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c160300 0x7f712c15d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.682+0000 7f7133e20700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c15ceb0 con 0x7f712c15d880 2023-11-28T11:12:57.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.682+0000 7f7133e20700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c1608c0 con 0x7f712c0cec00 2023-11-28T11:12:57.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.682+0000 7f7133e20700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c160ba0 con 0x7f712c160300 2023-11-28T11:12:57.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.682+0000 7f71323bd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f712c15d880 0x7f712c0cac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46378/0 (socket says 172.21.15.125:46378) 2023-11-28T11:12:57.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f71323bd700 1 -- 172.21.15.125:0/450698263 learned_addr learned my addr 172.21.15.125:0/450698263 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:57.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f7131bbc700 1 --2- 172.21.15.125:0/450698263 >> v2:172.21.15.167:3300/0 conn(0x7f712c0cec00 0x7f712c065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f71313bb700 1 --2- 172.21.15.125:0/450698263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c160300 0x7f712c15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f7130bba700 1 -- 172.21.15.125:0/450698263 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672878340 0 0) 0x7f712c15ceb0 con 0x7f712c15d880 2023-11-28T11:12:57.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f7130bba700 1 -- 172.21.15.125:0/450698263 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71180035b0 con 0x7f712c15d880 2023-11-28T11:12:57.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f7131bbc700 1 -- 172.21.15.125:0/450698263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c160300 msgr2=0x7f712c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:57.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f7131bbc700 1 --2- 172.21.15.125:0/450698263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c160300 0x7f712c15d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f7131bbc700 1 -- 172.21.15.125:0/450698263 >> v1:172.21.15.125:6789/0 conn(0x7f712c15d880 legacy=0x7f712c0cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f7131bbc700 1 -- 172.21.15.125:0/450698263 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c160e80 con 0x7f712c0cec00 2023-11-28T11:12:57.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f71313bb700 1 --2- 172.21.15.125:0/450698263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c160300 0x7f712c15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:12:57.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f7131bbc700 1 --2- 172.21.15.125:0/450698263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f712c0cec00 0x7f712c065fd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f711c009840 tx=0x7f711c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a38e144afb76f3a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f7130bba700 1 -- 172.21.15.125:0/450698263 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c011830 con 0x7f712c0cec00 2023-11-28T11:12:57.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f7130bba700 1 -- 172.21.15.125:0/450698263 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c011990 con 0x7f712c0cec00 2023-11-28T11:12:57.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.683+0000 7f7130bba700 1 -- 172.21.15.125:0/450698263 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c011d20 con 0x7f712c0cec00 2023-11-28T11:12:57.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.684+0000 7f7133e20700 1 -- 172.21.15.125:0/450698263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f712c0cec00 msgr2=0x7f712c065fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.684+0000 7f7133e20700 1 --2- 172.21.15.125:0/450698263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f712c0cec00 0x7f712c065fd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f711c009840 tx=0x7f711c009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:57.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.684+0000 7f7133e20700 1 -- 172.21.15.125:0/450698263 shutdown_connections 2023-11-28T11:12:57.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.684+0000 7f7133e20700 1 --2- 172.21.15.125:0/450698263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f712c0cec00 0x7f712c065fd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.684+0000 7f7133e20700 1 --2- 172.21.15.125:0/450698263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c160300 0x7f712c15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.684+0000 7f7133e20700 1 -- 172.21.15.125:0/450698263 >> 172.21.15.125:0/450698263 conn(0x7f712c0cf400 msgr2=0x7f712c0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:57.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.684+0000 7f7133e20700 1 -- 172.21.15.125:0/450698263 shutdown_connections 2023-11-28T11:12:57.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.684+0000 7f7133e20700 1 -- 172.21.15.125:0/450698263 wait complete. 2023-11-28T11:12:57.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.685+0000 7f7133e20700 1 Processor -- start 2023-11-28T11:12:57.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.685+0000 7f7133e20700 1 -- start start 2023-11-28T11:12:57.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7133e20700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f712c0cec00 0x7f712c14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7133e20700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c15d880 0x7f712c15f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7133e20700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f712c160300 0x7f712c0713f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7133e20700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0ac990 con 0x7f712c0cec00 2023-11-28T11:12:57.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7133e20700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0acc70 con 0x7f712c160300 2023-11-28T11:12:57.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7133e20700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0acf50 con 0x7f712c15d880 2023-11-28T11:12:57.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7131bbc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f712c0cec00 0x7f712c14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7131bbc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f712c0cec00 0x7f712c14ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34024/0 (socket says 172.21.15.125:34024) 2023-11-28T11:12:57.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7131bbc700 1 -- 172.21.15.125:0/4161006347 learned_addr learned my addr 172.21.15.125:0/4161006347 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:57.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f71323bd700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f712c160300 0x7f712c0713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f71313bb700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c15d880 0x7f712c15f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7131bbc700 1 -- 172.21.15.125:0/4161006347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c15d880 msgr2=0x7f712c15f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7131bbc700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c15d880 0x7f712c15f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7131bbc700 1 -- 172.21.15.125:0/4161006347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f712c160300 msgr2=0x7f712c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7131bbc700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f712c160300 0x7f712c0713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7131bbc700 1 -- 172.21.15.125:0/4161006347 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280094a0 con 0x7f712c0cec00 2023-11-28T11:12:57.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f71313bb700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c15d880 0x7f712c15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:57.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f7131bbc700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f712c0cec00 0x7f712c14ba80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f711c0090b0 tx=0x7f711c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.686+0000 7f71227fc700 1 -- 172.21.15.125:0/4161006347 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0036a0 con 0x7f712c0cec00 2023-11-28T11:12:57.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.687+0000 7f71227fc700 1 -- 172.21.15.125:0/4161006347 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c01f070 con 0x7f712c0cec00 2023-11-28T11:12:57.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.687+0000 7f71227fc700 1 -- 172.21.15.125:0/4161006347 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c003a00 con 0x7f712c0cec00 2023-11-28T11:12:57.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.687+0000 7f7133e20700 1 -- 172.21.15.125:0/4161006347 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c0094a0 con 0x7f712c0cec00 2023-11-28T11:12:57.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.687+0000 7f7133e20700 1 -- 172.21.15.125:0/4161006347 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c066510 con 0x7f712c0cec00 2023-11-28T11:12:57.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.687+0000 7f7133e20700 1 -- 172.21.15.125:0/4161006347 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c161160 con 0x7f712c0cec00 2023-11-28T11:12:57.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.688+0000 7f71227fc700 1 -- 172.21.15.125:0/4161006347 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f711c00f050 con 0x7f712c0cec00 2023-11-28T11:12:57.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.688+0000 7f71227fc700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71100682f0 0x7f711006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:57.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.688+0000 7f71227fc700 1 -- 172.21.15.125:0/4161006347 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f711c021070 con 0x7f712c0cec00 2023-11-28T11:12:57.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.688+0000 7f71313bb700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71100682f0 0x7f711006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:57.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.689+0000 7f71313bb700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71100682f0 0x7f711006a7a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f712c15f230 tx=0x7f7128008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:57.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.692+0000 7f71227fc700 1 -- 172.21.15.125:0/4161006347 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f711c053e30 con 0x7f712c0cec00 2023-11-28T11:12:57.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.874+0000 7f7133e20700 1 -- 172.21.15.125:0/4161006347 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f712c0acde0 con 0x7f71100682f0 2023-11-28T11:12:57.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.874+0000 7f71227fc700 1 -- 172.21.15.125:0/4161006347 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f712c0acde0 con 0x7f71100682f0 2023-11-28T11:12:57.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 -- 172.21.15.125:0/4161006347 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71100682f0 msgr2=0x7f711006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71100682f0 0x7f711006a7a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f712c15f230 tx=0x7f7128008040 comp rx=0 tx=0).stop 2023-11-28T11:12:57.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 -- 172.21.15.125:0/4161006347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f712c0cec00 msgr2=0x7f712c14ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f712c0cec00 0x7f712c14ba80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f711c0090b0 tx=0x7f711c004750 comp rx=0 tx=0).stop 2023-11-28T11:12:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 -- 172.21.15.125:0/4161006347 shutdown_connections 2023-11-28T11:12:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f712c160300 0x7f712c0713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f712c0cec00 0x7f712c14ba80 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f71100682f0 0x7f711006a7a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 --2- 172.21.15.125:0/4161006347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f712c15d880 0x7f712c15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 -- 172.21.15.125:0/4161006347 >> 172.21.15.125:0/4161006347 conn(0x7f712c0cf400 msgr2=0x7f712c0b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 -- 172.21.15.125:0/4161006347 shutdown_connections 2023-11-28T11:12:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:57.876+0000 7f7133e20700 1 -- 172.21.15.125:0/4161006347 wait complete. 2023-11-28T11:12:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 2 to deep-scrub 2023-11-28T11:12:57.890 INFO:tasks.ceph:Scrubbing osd.3 2023-11-28T11:12:57.890 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:12:58.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.012+0000 7f7e2729d700 1 Processor -- start 2023-11-28T11:12:58.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.013+0000 7f7e2729d700 1 -- start start 2023-11-28T11:12:58.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.013+0000 7f7e2729d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e2015e070 0x7f7e2006b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.013+0000 7f7e2729d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e200cea10 con 0x7f7e200ceea0 2023-11-28T11:12:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.013+0000 7f7e2729d700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e200cbd10 con 0x7f7e2015a860 2023-11-28T11:12:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.013+0000 7f7e2729d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2015ae80 con 0x7f7e2015e070 2023-11-28T11:12:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.014+0000 7f7e25039700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e2015e070 0x7f7e2006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.014+0000 7f7e24838700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7e200ceea0 0x7f7e2015a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46388/0 (socket says 172.21.15.125:46388) 2023-11-28T11:12:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.014+0000 7f7e24838700 1 -- 172.21.15.125:0/3458159724 learned_addr learned my addr 172.21.15.125:0/3458159724 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:58.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.014+0000 7f7e25039700 1 -- 172.21.15.125:0/3458159724 >> v1:172.21.15.167:6789/0 conn(0x7f7e2015a860 legacy=0x7f7e20150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:58.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.014+0000 7f7e25039700 1 -- 172.21.15.125:0/3458159724 >> v1:172.21.15.125:6789/0 conn(0x7f7e200ceea0 legacy=0x7f7e2015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.014+0000 7f7e25039700 1 -- 172.21.15.125:0/3458159724 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e200ce0e0 con 0x7f7e2015e070 2023-11-28T11:12:58.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.014+0000 7f7e17fff700 1 -- 172.21.15.125:0/3458159724 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842695851 0 0) 0x7f7e200cea10 con 0x7f7e200ceea0 2023-11-28T11:12:58.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.014+0000 7f7e25039700 1 --2- 172.21.15.125:0/3458159724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e2015e070 0x7f7e2006b380 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009840 tx=0x7f7e10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572c68596c3d5663 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.014+0000 7f7e17fff700 1 -- 172.21.15.125:0/3458159724 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10004230 con 0x7f7e2015e070 2023-11-28T11:12:58.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.014+0000 7f7e17fff700 1 -- 172.21.15.125:0/3458159724 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e10004390 con 0x7f7e2015e070 2023-11-28T11:12:58.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.014+0000 7f7e17fff700 1 -- 172.21.15.125:0/3458159724 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e100036a0 con 0x7f7e2015e070 2023-11-28T11:12:58.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.015+0000 7f7e2729d700 1 -- 172.21.15.125:0/3458159724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e2015e070 msgr2=0x7f7e2006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.015+0000 7f7e2729d700 1 --2- 172.21.15.125:0/3458159724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e2015e070 0x7f7e2006b380 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009840 tx=0x7f7e10009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:58.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.015+0000 7f7e2729d700 1 -- 172.21.15.125:0/3458159724 shutdown_connections 2023-11-28T11:12:58.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.015+0000 7f7e2729d700 1 --2- 172.21.15.125:0/3458159724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e2015e070 0x7f7e2006b380 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.015+0000 7f7e2729d700 1 -- 172.21.15.125:0/3458159724 >> 172.21.15.125:0/3458159724 conn(0x7f7e200cfc30 msgr2=0x7f7e200d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:58.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.015+0000 7f7e2729d700 1 -- 172.21.15.125:0/3458159724 shutdown_connections 2023-11-28T11:12:58.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.015+0000 7f7e2729d700 1 -- 172.21.15.125:0/3458159724 wait complete. 2023-11-28T11:12:58.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.016+0000 7f7e2729d700 1 Processor -- start 2023-11-28T11:12:58.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.016+0000 7f7e2729d700 1 -- start start 2023-11-28T11:12:58.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e2729d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e200ceea0 0x7f7e2014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e2729d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e2015a860 0x7f7e201f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e2729d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e2015e070 0x7f7e201f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e2729d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200ac8e0 con 0x7f7e2015a860 2023-11-28T11:12:58.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e2729d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200acea0 con 0x7f7e200ceea0 2023-11-28T11:12:58.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e2729d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2006dbf0 con 0x7f7e2015e070 2023-11-28T11:12:58.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e24838700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e2015a860 0x7f7e201f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e24838700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e2015a860 0x7f7e201f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34040/0 (socket says 172.21.15.125:34040) 2023-11-28T11:12:58.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e24838700 1 -- 172.21.15.125:0/403922813 learned_addr learned my addr 172.21.15.125:0/403922813 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:58.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e24838700 1 -- 172.21.15.125:0/403922813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e2015e070 msgr2=0x7f7e201f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e24838700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e2015e070 0x7f7e201f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e24838700 1 -- 172.21.15.125:0/403922813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e200ceea0 msgr2=0x7f7e2014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e24838700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e200ceea0 0x7f7e2014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e24838700 1 -- 172.21.15.125:0/403922813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100094a0 con 0x7f7e2015a860 2023-11-28T11:12:58.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e24838700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e2015a860 0x7f7e201f5ab0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0011e0 tx=0x7f7e1c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e15ffb700 1 -- 172.21.15.125:0/403922813 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c004c80 con 0x7f7e2015a860 2023-11-28T11:12:58.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e15ffb700 1 -- 172.21.15.125:0/403922813 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c004e00 con 0x7f7e2015a860 2023-11-28T11:12:58.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e15ffb700 1 -- 172.21.15.125:0/403922813 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c007310 con 0x7f7e2015a860 2023-11-28T11:12:58.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.017+0000 7f7e2729d700 1 -- 172.21.15.125:0/403922813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e200ce6a0 con 0x7f7e2015a860 2023-11-28T11:12:58.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.018+0000 7f7e2729d700 1 -- 172.21.15.125:0/403922813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e200ce3c0 con 0x7f7e2015a860 2023-11-28T11:12:58.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.018+0000 7f7e2729d700 1 -- 172.21.15.125:0/403922813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e2006b8c0 con 0x7f7e2015a860 2023-11-28T11:12:58.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.019+0000 7f7e15ffb700 1 -- 172.21.15.125:0/403922813 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7e1c01a020 con 0x7f7e2015a860 2023-11-28T11:12:58.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.019+0000 7f7e15ffb700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7e040682f0 0x7f7e0406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.019+0000 7f7e15ffb700 1 -- 172.21.15.125:0/403922813 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7e1c085680 con 0x7f7e2015a860 2023-11-28T11:12:58.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.019+0000 7f7e25039700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7e040682f0 0x7f7e0406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.019+0000 7f7e15ffb700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] conn(0x7f7e0406e760 0x7f7e04070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.019+0000 7f7e15ffb700 1 -- 172.21.15.125:0/403922813 --> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e04071240 con 0x7f7e0406e760 2023-11-28T11:12:58.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.019+0000 7f7e15ffb700 1 -- 172.21.15.125:0/403922813 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e1c087c60 con 0x7f7e2015a860 2023-11-28T11:12:58.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.020+0000 7f7e2583a700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] conn(0x7f7e0406e760 0x7f7e04070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.020+0000 7f7e25039700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7e040682f0 0x7f7e0406a7a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7e100090b0 tx=0x7f7e10013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.020+0000 7f7e2583a700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] conn(0x7f7e0406e760 0x7f7e04070b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.020+0000 7f7e15ffb700 1 -- 172.21.15.125:0/403922813 <== osd.3 v2:172.21.15.125:6800/103585 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7e04071240 con 0x7f7e0406e760 2023-11-28T11:12:58.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.034+0000 7f7e2729d700 1 -- 172.21.15.125:0/403922813 --> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7e200c6ad0 con 0x7f7e0406e760 2023-11-28T11:12:58.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e15ffb700 1 -- 172.21.15.125:0/403922813 <== osd.3 v2:172.21.15.125:6800/103585 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7e200c6ad0 con 0x7f7e0406e760 2023-11-28T11:12:58.036 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:12:58.037 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:12:58.037 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:12:58.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e2729d700 1 -- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] conn(0x7f7e0406e760 msgr2=0x7f7e04070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e2729d700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:6800/103585,v1:172.21.15.125:6801/103585] conn(0x7f7e0406e760 0x7f7e04070b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e2729d700 1 -- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7e040682f0 msgr2=0x7f7e0406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e2729d700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7e040682f0 0x7f7e0406a7a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7e100090b0 tx=0x7f7e10013040 comp rx=0 tx=0).stop 2023-11-28T11:12:58.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e2729d700 1 -- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e2015a860 msgr2=0x7f7e201f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e2729d700 1 --2- 172.21.15.125:0/403922813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e2015a860 0x7f7e201f5ab0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0011e0 tx=0x7f7e1c00cae0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e2583a700 1 -- 172.21.15.125:0/403922813 reap_dead start 2023-11-28T11:12:58.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e2729d700 1 -- 172.21.15.125:0/403922813 shutdown_connections 2023-11-28T11:12:58.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e2729d700 1 -- 172.21.15.125:0/403922813 >> 172.21.15.125:0/403922813 conn(0x7f7e200cfc30 msgr2=0x7f7e20159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:58.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e2729d700 1 -- 172.21.15.125:0/403922813 shutdown_connections 2023-11-28T11:12:58.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.035+0000 7f7e2729d700 1 -- 172.21.15.125:0/403922813 wait complete. 2023-11-28T11:12:58.048 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-28T11:12:58.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.169+0000 7f15d6afe700 1 Processor -- start 2023-11-28T11:12:58.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.169+0000 7f15d6afe700 1 -- start start 2023-11-28T11:12:58.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.169+0000 7f15d6afe700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f15d00718e0 0x7f15d006c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.169+0000 7f15d6afe700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d0160a50 con 0x7f15d006cdc0 2023-11-28T11:12:58.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15d6afe700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d0160d30 con 0x7f15d015c810 2023-11-28T11:12:58.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15d6afe700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d015cbe0 con 0x7f15d00718e0 2023-11-28T11:12:58.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15d509b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f15d006cdc0 0x7f15d006a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46408/0 (socket says 172.21.15.125:46408) 2023-11-28T11:12:58.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15d509b700 1 -- 172.21.15.125:0/2129892339 learned_addr learned my addr 172.21.15.125:0/2129892339 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:58.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cffff700 1 --2- 172.21.15.125:0/2129892339 >> v2:172.21.15.167:3300/0 conn(0x7f15d00718e0 0x7f15d006c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613876862 0 0) 0x7f15d0160a50 con 0x7f15d006cdc0 2023-11-28T11:12:58.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c00035b0 con 0x7f15d006cdc0 2023-11-28T11:12:58.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 583655369 0 0) 0x7f15c00035b0 con 0x7f15d006cdc0 2023-11-28T11:12:58.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 >> v2:172.21.15.167:3300/0 conn(0x7f15d00718e0 msgr2=0x7f15d006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:58.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 --2- 172.21.15.125:0/2129892339 >> v2:172.21.15.167:3300/0 conn(0x7f15d00718e0 0x7f15d006c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 >> v1:172.21.15.167:6789/0 conn(0x7f15d015c810 legacy=0x7f15d0160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0161010 con 0x7f15d006cdc0 2023-11-28T11:12:58.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f15c80019f0 con 0x7f15d006cdc0 2023-11-28T11:12:58.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 >> v1:172.21.15.125:6789/0 conn(0x7f15d006cdc0 legacy=0x7f15d006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c0003a30 0x7f15c0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 0x7f15c0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c0005200 0x7f15c000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d015cbe0 con 0x7f15c0004850 2023-11-28T11:12:58.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c000c0e0 con 0x7f15c0005200 2023-11-28T11:12:58.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c000c270 con 0x7f15c0003a30 2023-11-28T11:12:58.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15cffff700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 0x7f15c0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15d489a700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c0003a30 0x7f15c0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.170+0000 7f15d509b700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c0005200 0x7f15c000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15cffff700 1 -- 172.21.15.125:0/2129892339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c0003a30 msgr2=0x7f15c0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:58.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15cffff700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c0003a30 0x7f15c0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15cffff700 1 -- 172.21.15.125:0/2129892339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c0005200 msgr2=0x7f15c000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:58.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15cffff700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c0005200 0x7f15c000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15cffff700 1 -- 172.21.15.125:0/2129892339 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c00035b0 con 0x7f15c0004850 2023-11-28T11:12:58.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15d489a700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c0003a30 0x7f15c0003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:58.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15d509b700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c0005200 0x7f15c000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:58.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15d509b700 1 -- 172.21.15.125:0/2129892339 reap_dead start 2023-11-28T11:12:58.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15cffff700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 0x7f15c0004cc0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009b30 tx=0x7f15c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a701b9b8a88bd154 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00e6c0 con 0x7f15c0004850 2023-11-28T11:12:58.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc00e820 con 0x7f15c0004850 2023-11-28T11:12:58.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15cf7fe700 1 -- 172.21.15.125:0/2129892339 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00eb90 con 0x7f15c0004850 2023-11-28T11:12:58.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15d6afe700 1 -- 172.21.15.125:0/2129892339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 msgr2=0x7f15c0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15d6afe700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 0x7f15c0004cc0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009b30 tx=0x7f15c0005880 comp rx=0 tx=0).stop 2023-11-28T11:12:58.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15d6afe700 1 -- 172.21.15.125:0/2129892339 shutdown_connections 2023-11-28T11:12:58.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15d6afe700 1 --2- 172.21.15.125:0/2129892339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 0x7f15c0004cc0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15d6afe700 1 -- 172.21.15.125:0/2129892339 >> 172.21.15.125:0/2129892339 conn(0x7f15d006c010 msgr2=0x7f15d00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:58.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15d6afe700 1 -- 172.21.15.125:0/2129892339 shutdown_connections 2023-11-28T11:12:58.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.171+0000 7f15d6afe700 1 -- 172.21.15.125:0/2129892339 wait complete. 2023-11-28T11:12:58.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.173+0000 7f15d6afe700 1 Processor -- start 2023-11-28T11:12:58.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.173+0000 7f15d6afe700 1 -- start start 2023-11-28T11:12:58.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.173+0000 7f15d6afe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 0x7f15d0157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.173+0000 7f15d6afe700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15d01f2d00 0x7f15d01f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.173+0000 7f15d6afe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15d00adb40 0x7f15d00adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.173+0000 7f15d6afe700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00ae520 con 0x7f15c0004850 2023-11-28T11:12:58.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.173+0000 7f15d6afe700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d01f1fe0 con 0x7f15d00adb40 2023-11-28T11:12:58.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.173+0000 7f15d6afe700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d01f6570 con 0x7f15d01f2d00 2023-11-28T11:12:58.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d489a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 0x7f15d0157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d489a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 0x7f15d0157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34060/0 (socket says 172.21.15.125:34060) 2023-11-28T11:12:58.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d489a700 1 -- 172.21.15.125:0/1635503544 learned_addr learned my addr 172.21.15.125:0/1635503544 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:58.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d509b700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15d00adb40 0x7f15d00adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15cffff700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15d01f2d00 0x7f15d01f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d489a700 1 -- 172.21.15.125:0/1635503544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15d01f2d00 msgr2=0x7f15d01f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d489a700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15d01f2d00 0x7f15d01f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d489a700 1 -- 172.21.15.125:0/1635503544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15d00adb40 msgr2=0x7f15d00adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d489a700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15d00adb40 0x7f15d00adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d489a700 1 -- 172.21.15.125:0/1635503544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d00ce740 con 0x7f15c0004850 2023-11-28T11:12:58.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15cffff700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15d01f2d00 0x7f15d01f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:58.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d489a700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 0x7f15d0157fa0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f15c400e460 tx=0x7f15c400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15cd7fa700 1 -- 172.21.15.125:0/1635503544 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c40052e0 con 0x7f15c0004850 2023-11-28T11:12:58.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15cd7fa700 1 -- 172.21.15.125:0/1635503544 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c4005440 con 0x7f15c0004850 2023-11-28T11:12:58.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15cd7fa700 1 -- 172.21.15.125:0/1635503544 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c40038c0 con 0x7f15c0004850 2023-11-28T11:12:58.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d6afe700 1 -- 172.21.15.125:0/1635503544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d00ceb20 con 0x7f15c0004850 2023-11-28T11:12:58.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.174+0000 7f15d6afe700 1 -- 172.21.15.125:0/1635503544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d00ce8d0 con 0x7f15c0004850 2023-11-28T11:12:58.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.175+0000 7f15d6afe700 1 -- 172.21.15.125:0/1635503544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d00743f0 con 0x7f15c0004850 2023-11-28T11:12:58.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.175+0000 7f15cd7fa700 1 -- 172.21.15.125:0/1635503544 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f15c4003a20 con 0x7f15c0004850 2023-11-28T11:12:58.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.176+0000 7f15cd7fa700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15b40682f0 0x7f15b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.176+0000 7f15cd7fa700 1 -- 172.21.15.125:0/1635503544 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f15c4084e10 con 0x7f15c0004850 2023-11-28T11:12:58.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.176+0000 7f15cffff700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15b40682f0 0x7f15b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.176+0000 7f15cffff700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15b40682f0 0x7f15b406a7a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f15d00b0be0 tx=0x7f15bc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.180+0000 7f15cd7fa700 1 -- 172.21.15.125:0/1635503544 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f15c4051970 con 0x7f15c0004850 2023-11-28T11:12:58.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.364+0000 7f15d6afe700 1 -- 172.21.15.125:0/1635503544 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f15d0066320 con 0x7f15b40682f0 2023-11-28T11:12:58.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.365+0000 7f15cd7fa700 1 -- 172.21.15.125:0/1635503544 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f15d0066320 con 0x7f15b40682f0 2023-11-28T11:12:58.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 -- 172.21.15.125:0/1635503544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15b40682f0 msgr2=0x7f15b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15b40682f0 0x7f15b406a7a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f15d00b0be0 tx=0x7f15bc008030 comp rx=0 tx=0).stop 2023-11-28T11:12:58.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 -- 172.21.15.125:0/1635503544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 msgr2=0x7f15d0157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 0x7f15d0157fa0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f15c400e460 tx=0x7f15c400e820 comp rx=0 tx=0).stop 2023-11-28T11:12:58.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 -- 172.21.15.125:0/1635503544 shutdown_connections 2023-11-28T11:12:58.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15d00adb40 0x7f15d00adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c0004850 0x7f15d0157fa0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f15b40682f0 0x7f15b406a7a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 --2- 172.21.15.125:0/1635503544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15d01f2d00 0x7f15d01f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 -- 172.21.15.125:0/1635503544 >> 172.21.15.125:0/1635503544 conn(0x7f15d006c010 msgr2=0x7f15d006a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:58.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 -- 172.21.15.125:0/1635503544 shutdown_connections 2023-11-28T11:12:58.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.367+0000 7f15d6afe700 1 -- 172.21.15.125:0/1635503544 wait complete. 2023-11-28T11:12:58.371 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 3 to deep-scrub 2023-11-28T11:12:58.380 INFO:tasks.ceph:Scrubbing osd.4 2023-11-28T11:12:58.380 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:12:58.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.502+0000 7fb3cba9b700 1 Processor -- start 2023-11-28T11:12:58.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.502+0000 7fb3cba9b700 1 -- start start 2023-11-28T11:12:58.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3cba9b700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3c415cc50 0x7fb3c40af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3cba9b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3c4071320 0x7fb3c406a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3cba9b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c40cf3e0 con 0x7fb3c4161160 2023-11-28T11:12:58.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3cba9b700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c40cd800 con 0x7fb3c415cc50 2023-11-28T11:12:58.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3cba9b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40cdae0 con 0x7fb3c4071320 2023-11-28T11:12:58.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3c9036700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb3c4161160 0x7fb3c4070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46424/0 (socket says 172.21.15.125:46424) 2023-11-28T11:12:58.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3c9036700 1 -- 172.21.15.125:0/3336030692 learned_addr learned my addr 172.21.15.125:0/3336030692 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:58.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3c9837700 1 --2- 172.21.15.125:0/3336030692 >> v2:172.21.15.167:3300/0 conn(0x7fb3c415cc50 0x7fb3c40af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3ca038700 1 --2- 172.21.15.125:0/3336030692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3c4071320 0x7fb3c406a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3c8835700 1 -- 172.21.15.125:0/3336030692 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193783200 0 0) 0x7fb3c40cf3e0 con 0x7fb3c4161160 2023-11-28T11:12:58.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3c8835700 1 -- 172.21.15.125:0/3336030692 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3b00035b0 con 0x7fb3c4161160 2023-11-28T11:12:58.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3c9837700 1 -- 172.21.15.125:0/3336030692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3c4071320 msgr2=0x7fb3c406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:58.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3c9837700 1 --2- 172.21.15.125:0/3336030692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3c4071320 0x7fb3c406a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3c9837700 1 -- 172.21.15.125:0/3336030692 >> v1:172.21.15.125:6789/0 conn(0x7fb3c4161160 legacy=0x7fb3c4070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.503+0000 7fb3c9837700 1 -- 172.21.15.125:0/3336030692 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40cdf70 con 0x7fb3c415cc50 2023-11-28T11:12:58.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.504+0000 7fb3c9837700 1 --2- 172.21.15.125:0/3336030692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c415cc50 0x7fb3c40af1f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4009840 tx=0x7fb3b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96108222d35fec97 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.504+0000 7fb3c8835700 1 -- 172.21.15.125:0/3336030692 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4011830 con 0x7fb3c415cc50 2023-11-28T11:12:58.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.504+0000 7fb3c8835700 1 -- 172.21.15.125:0/3336030692 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b4011990 con 0x7fb3c415cc50 2023-11-28T11:12:58.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.504+0000 7fb3c8835700 1 -- 172.21.15.125:0/3336030692 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4011d20 con 0x7fb3c415cc50 2023-11-28T11:12:58.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.504+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3336030692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c415cc50 msgr2=0x7fb3c40af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.504+0000 7fb3cba9b700 1 --2- 172.21.15.125:0/3336030692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c415cc50 0x7fb3c40af1f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4009840 tx=0x7fb3b4009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:58.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.504+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3336030692 shutdown_connections 2023-11-28T11:12:58.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.504+0000 7fb3cba9b700 1 --2- 172.21.15.125:0/3336030692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3c4071320 0x7fb3c406a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.504+0000 7fb3cba9b700 1 --2- 172.21.15.125:0/3336030692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c415cc50 0x7fb3c40af1f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.504+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3336030692 >> 172.21.15.125:0/3336030692 conn(0x7fb3c40cfc30 msgr2=0x7fb3c40d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:58.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.505+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3336030692 shutdown_connections 2023-11-28T11:12:58.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.505+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3336030692 wait complete. 2023-11-28T11:12:58.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.506+0000 7fb3cba9b700 1 Processor -- start 2023-11-28T11:12:58.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.506+0000 7fb3cba9b700 1 -- start start 2023-11-28T11:12:58.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3cba9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c4071320 0x7fb3c415fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3cba9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3c415cc50 0x7fb3c41487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3cba9b700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3c4161160 0x7fb3c406a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3cba9b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c415d860 con 0x7fb3c415cc50 2023-11-28T11:12:58.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3cba9b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c415d580 con 0x7fb3c4071320 2023-11-28T11:12:58.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3cba9b700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40b3d50 con 0x7fb3c4161160 2023-11-28T11:12:58.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3c9036700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3c415cc50 0x7fb3c41487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3c9036700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3c415cc50 0x7fb3c41487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34072/0 (socket says 172.21.15.125:34072) 2023-11-28T11:12:58.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3c9036700 1 -- 172.21.15.125:0/3991653212 learned_addr learned my addr 172.21.15.125:0/3991653212 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3c9837700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c4071320 0x7fb3c415fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3ca038700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3c4161160 0x7fb3c406a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3c9036700 1 -- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3c4161160 msgr2=0x7fb3c406a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3c9036700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3c4161160 0x7fb3c406a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3c9036700 1 -- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c4071320 msgr2=0x7fb3c415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3c9036700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c4071320 0x7fb3c415fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3c9036700 1 -- 172.21.15.125:0/3991653212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b40094a0 con 0x7fb3c415cc50 2023-11-28T11:12:58.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.507+0000 7fb3c9837700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c4071320 0x7fb3c415fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:58.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.508+0000 7fb3c9036700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3c415cc50 0x7fb3c41487a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0001eb0 tx=0x7fb3c000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.508+0000 7fb3ba7fc700 1 -- 172.21.15.125:0/3991653212 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0005d70 con 0x7fb3c415cc50 2023-11-28T11:12:58.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.508+0000 7fb3ba7fc700 1 -- 172.21.15.125:0/3991653212 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c00070d0 con 0x7fb3c415cc50 2023-11-28T11:12:58.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.508+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3991653212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c40cf610 con 0x7fb3c415cc50 2023-11-28T11:12:58.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.508+0000 7fb3ba7fc700 1 -- 172.21.15.125:0/3991653212 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0007460 con 0x7fb3c415cc50 2023-11-28T11:12:58.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.508+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3991653212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c41616b0 con 0x7fb3c415cc50 2023-11-28T11:12:58.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.508+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3991653212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3c415d020 con 0x7fb3c415cc50 2023-11-28T11:12:58.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.509+0000 7fb3ba7fc700 1 -- 172.21.15.125:0/3991653212 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb3c0019030 con 0x7fb3c415cc50 2023-11-28T11:12:58.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.509+0000 7fb3ba7fc700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb3a80682f0 0x7fb3a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.509+0000 7fb3ba7fc700 1 -- 172.21.15.125:0/3991653212 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb3c0084d90 con 0x7fb3c415cc50 2023-11-28T11:12:58.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.509+0000 7fb3c9837700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb3a80682f0 0x7fb3a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.510+0000 7fb3ba7fc700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] conn(0x7fb3a806e760 0x7fb3a8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.510+0000 7fb3ba7fc700 1 -- 172.21.15.125:0/3991653212 --> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3a8071240 con 0x7fb3a806e760 2023-11-28T11:12:58.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.510+0000 7fb3ba7fc700 1 -- 172.21.15.125:0/3991653212 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3c0087440 con 0x7fb3c415cc50 2023-11-28T11:12:58.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.510+0000 7fb3ca038700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] conn(0x7fb3a806e760 0x7fb3a8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.510+0000 7fb3c9837700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb3a80682f0 0x7fb3a806a7a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4000c00 tx=0x7fb3b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.510+0000 7fb3ca038700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] conn(0x7fb3a806e760 0x7fb3a8070b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.511+0000 7fb3ba7fc700 1 -- 172.21.15.125:0/3991653212 <== osd.4 v2:172.21.15.167:6800/103804 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb3a8071240 con 0x7fb3a806e760 2023-11-28T11:12:58.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.525+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3991653212 --> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb3c40743f0 con 0x7fb3a806e760 2023-11-28T11:12:58.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3ba7fc700 1 -- 172.21.15.125:0/3991653212 <== osd.4 v2:172.21.15.167:6800/103804 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb3c40743f0 con 0x7fb3a806e760 2023-11-28T11:12:58.527 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:12:58.527 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:12:58.528 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:12:58.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] conn(0x7fb3a806e760 msgr2=0x7fb3a8070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3cba9b700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.167:6800/103804,v1:172.21.15.167:6801/103804] conn(0x7fb3a806e760 0x7fb3a8070b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3991653212 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb3a80682f0 msgr2=0x7fb3a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3cba9b700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fb3a80682f0 0x7fb3a806a7a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4000c00 tx=0x7fb3b4008030 comp rx=0 tx=0).stop 2023-11-28T11:12:58.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3991653212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3c415cc50 msgr2=0x7fb3c41487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3cba9b700 1 --2- 172.21.15.125:0/3991653212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3c415cc50 0x7fb3c41487a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0001eb0 tx=0x7fb3c000c860 comp rx=0 tx=0).stop 2023-11-28T11:12:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3ca038700 1 -- 172.21.15.125:0/3991653212 reap_dead start 2023-11-28T11:12:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3991653212 shutdown_connections 2023-11-28T11:12:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3991653212 >> 172.21.15.125:0/3991653212 conn(0x7fb3c40cfc30 msgr2=0x7fb3c40afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3991653212 shutdown_connections 2023-11-28T11:12:58.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.526+0000 7fb3cba9b700 1 -- 172.21.15.125:0/3991653212 wait complete. 2023-11-28T11:12:58.541 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-28T11:12:58.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.661+0000 7fc39ccf9700 1 Processor -- start 2023-11-28T11:12:58.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.661+0000 7fc39ccf9700 1 -- start start 2023-11-28T11:12:58.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.662+0000 7fc39ccf9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3980cf710 0x7fc3980ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.662+0000 7fc39ccf9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc398071890 0x7fc398071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.662+0000 7fc39ccf9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39815cc10 con 0x7fc39806a270 2023-11-28T11:12:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.662+0000 7fc39ccf9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39806c9b0 con 0x7fc398071890 2023-11-28T11:12:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.662+0000 7fc39ccf9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39806cc90 con 0x7fc3980cf710 2023-11-28T11:12:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.662+0000 7fc395d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc398071890 0x7fc398071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.662+0000 7fc396d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc39806a270 0x7fc3980b1650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46442/0 (socket says 172.21.15.125:46442) 2023-11-28T11:12:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.662+0000 7fc396d9d700 1 -- 172.21.15.125:0/1270972315 learned_addr learned my addr 172.21.15.125:0/1270972315 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:58.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.662+0000 7fc39659c700 1 --2- 172.21.15.125:0/1270972315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3980cf710 0x7fc3980ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc395d9b700 1 -- 172.21.15.125:0/1270972315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3980cf710 msgr2=0x7fc3980ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:58.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc395d9b700 1 --2- 172.21.15.125:0/1270972315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3980cf710 0x7fc3980ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc395d9b700 1 -- 172.21.15.125:0/1270972315 >> v1:172.21.15.125:6789/0 conn(0x7fc39806a270 legacy=0x7fc3980b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc395d9b700 1 -- 172.21.15.125:0/1270972315 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39806cf70 con 0x7fc398071890 2023-11-28T11:12:58.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39559a700 1 -- 172.21.15.125:0/1270972315 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539329780 0 0) 0x7fc39815cc10 con 0x7fc39806a270 2023-11-28T11:12:58.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc395d9b700 1 --2- 172.21.15.125:0/1270972315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc398071890 0x7fc398071220 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fc388009840 tx=0x7fc388009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0b94e8d28fb994 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39559a700 1 -- 172.21.15.125:0/1270972315 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388011830 con 0x7fc398071890 2023-11-28T11:12:58.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39559a700 1 -- 172.21.15.125:0/1270972315 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc388011990 con 0x7fc398071890 2023-11-28T11:12:58.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39559a700 1 -- 172.21.15.125:0/1270972315 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388011d20 con 0x7fc398071890 2023-11-28T11:12:58.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39ccf9700 1 -- 172.21.15.125:0/1270972315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc398071890 msgr2=0x7fc398071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39ccf9700 1 --2- 172.21.15.125:0/1270972315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc398071890 0x7fc398071220 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fc388009840 tx=0x7fc388009b50 comp rx=0 tx=0).stop 2023-11-28T11:12:58.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39ccf9700 1 -- 172.21.15.125:0/1270972315 shutdown_connections 2023-11-28T11:12:58.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39ccf9700 1 --2- 172.21.15.125:0/1270972315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3980cf710 0x7fc3980ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39ccf9700 1 --2- 172.21.15.125:0/1270972315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc398071890 0x7fc398071220 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39ccf9700 1 -- 172.21.15.125:0/1270972315 >> 172.21.15.125:0/1270972315 conn(0x7fc39806c010 msgr2=0x7fc3980cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:58.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39ccf9700 1 -- 172.21.15.125:0/1270972315 shutdown_connections 2023-11-28T11:12:58.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.663+0000 7fc39ccf9700 1 -- 172.21.15.125:0/1270972315 wait complete. 2023-11-28T11:12:58.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.665+0000 7fc39ccf9700 1 Processor -- start 2023-11-28T11:12:58.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.665+0000 7fc39ccf9700 1 -- start start 2023-11-28T11:12:58.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.665+0000 7fc39ccf9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc39806a270 0x7fc3980cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39ccf9700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc398071890 0x7fc3981f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39ccf9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3980cf710 0x7fc3981e66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39ccf9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39815f670 con 0x7fc39806a270 2023-11-28T11:12:58.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39ccf9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3980ccb20 con 0x7fc3980cf710 2023-11-28T11:12:58.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39ccf9700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39815e9f0 con 0x7fc398071890 2023-11-28T11:12:58.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc39806a270 0x7fc3980cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc39806a270 0x7fc3980cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34088/0 (socket says 172.21.15.125:34088) 2023-11-28T11:12:58.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39659c700 1 -- 172.21.15.125:0/520684113 learned_addr learned my addr 172.21.15.125:0/520684113 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:58.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39659c700 1 -- 172.21.15.125:0/520684113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc398071890 msgr2=0x7fc3981f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc395d9b700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc398071890 0x7fc3981f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39659c700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc398071890 0x7fc3981f2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc396d9d700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3980cf710 0x7fc3981e66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39659c700 1 -- 172.21.15.125:0/520684113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3980cf710 msgr2=0x7fc3981e66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39659c700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3980cf710 0x7fc3981e66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39659c700 1 -- 172.21.15.125:0/520684113 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880094a0 con 0x7fc39806a270 2023-11-28T11:12:58.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc396d9d700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3980cf710 0x7fc3981e66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:58.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39659c700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc39806a270 0x7fc3980cc5e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c7f0 tx=0x7fc38c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc386ffd700 1 -- 172.21.15.125:0/520684113 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c011800 con 0x7fc39806a270 2023-11-28T11:12:58.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc386ffd700 1 -- 172.21.15.125:0/520684113 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c011960 con 0x7fc39806a270 2023-11-28T11:12:58.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39ccf9700 1 -- 172.21.15.125:0/520684113 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39806d530 con 0x7fc39806a270 2023-11-28T11:12:58.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc386ffd700 1 -- 172.21.15.125:0/520684113 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c011cf0 con 0x7fc39806a270 2023-11-28T11:12:58.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.666+0000 7fc39ccf9700 1 -- 172.21.15.125:0/520684113 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39806d250 con 0x7fc39806a270 2023-11-28T11:12:58.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.667+0000 7fc39ccf9700 1 -- 172.21.15.125:0/520684113 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39806a6f0 con 0x7fc39806a270 2023-11-28T11:12:58.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.668+0000 7fc386ffd700 1 -- 172.21.15.125:0/520684113 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc38c021070 con 0x7fc39806a270 2023-11-28T11:12:58.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.668+0000 7fc386ffd700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3780682f0 0x7fc37806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.668+0000 7fc386ffd700 1 -- 172.21.15.125:0/520684113 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc38c085780 con 0x7fc39806a270 2023-11-28T11:12:58.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.668+0000 7fc395d9b700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3780682f0 0x7fc37806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.668+0000 7fc395d9b700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3780682f0 0x7fc37806a7a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc3980724d0 tx=0x7fc388008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:58.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.672+0000 7fc386ffd700 1 -- 172.21.15.125:0/520684113 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc38c0522e0 con 0x7fc39806a270 2023-11-28T11:12:58.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.856+0000 7fc39ccf9700 1 -- 172.21.15.125:0/520684113 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3980743f0 con 0x7fc3780682f0 2023-11-28T11:12:58.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.856+0000 7fc386ffd700 1 -- 172.21.15.125:0/520684113 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc3980743f0 con 0x7fc3780682f0 2023-11-28T11:12:58.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 -- 172.21.15.125:0/520684113 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3780682f0 msgr2=0x7fc37806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3780682f0 0x7fc37806a7a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc3980724d0 tx=0x7fc388008030 comp rx=0 tx=0).stop 2023-11-28T11:12:58.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 -- 172.21.15.125:0/520684113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc39806a270 msgr2=0x7fc3980cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:58.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc39806a270 0x7fc3980cc5e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c7f0 tx=0x7fc38c00cbb0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 -- 172.21.15.125:0/520684113 shutdown_connections 2023-11-28T11:12:58.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3980cf710 0x7fc3981e66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc39806a270 0x7fc3980cc5e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fc3780682f0 0x7fc37806a7a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 --2- 172.21.15.125:0/520684113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc398071890 0x7fc3981f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:58.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 -- 172.21.15.125:0/520684113 >> 172.21.15.125:0/520684113 conn(0x7fc39806c010 msgr2=0x7fc3980cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:58.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 -- 172.21.15.125:0/520684113 shutdown_connections 2023-11-28T11:12:58.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.858+0000 7fc39ccf9700 1 -- 172.21.15.125:0/520684113 wait complete. 2023-11-28T11:12:58.862 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 4 to deep-scrub 2023-11-28T11:12:58.872 INFO:tasks.ceph:Scrubbing osd.5 2023-11-28T11:12:58.872 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:12:58.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.994+0000 7f8ac4c70700 1 Processor -- start 2023-11-28T11:12:58.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.994+0000 7f8ac4c70700 1 -- start start 2023-11-28T11:12:58.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8ac4c70700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8ac015cce0 0x7f8ac006b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8ac4c70700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ac0071320 0x7f8ac0160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:58.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8ac4c70700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac00cdc10 con 0x7f8ac015dc40 2023-11-28T11:12:58.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8ac4c70700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac015d0b0 con 0x7f8ac015cce0 2023-11-28T11:12:58.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8ac4c70700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac00cfa10 con 0x7f8ac0071320 2023-11-28T11:12:58.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8abe59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8ac015cce0 0x7f8ac006b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:58.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8abdd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8ac015dc40 0x7f8ac0070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46452/0 (socket says 172.21.15.125:46452) 2023-11-28T11:12:58.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8abdd9b700 1 -- 172.21.15.125:0/1579524896 learned_addr learned my addr 172.21.15.125:0/1579524896 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:58.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8abed9d700 1 --2- 172.21.15.125:0/1579524896 >> v2:172.21.15.167:3300/0 conn(0x7f8ac0071320 0x7f8ac0160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8abe59c700 1 -- 172.21.15.125:0/1579524896 >> v2:172.21.15.167:3300/0 conn(0x7f8ac0071320 msgr2=0x7f8ac0160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8abe59c700 1 --2- 172.21.15.125:0/1579524896 >> v2:172.21.15.167:3300/0 conn(0x7f8ac0071320 0x7f8ac0160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8abe59c700 1 -- 172.21.15.125:0/1579524896 >> v1:172.21.15.125:6789/0 conn(0x7f8ac015dc40 legacy=0x7f8ac0070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8abe59c700 1 -- 172.21.15.125:0/1579524896 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac00cf730 con 0x7f8ac015cce0 2023-11-28T11:12:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.995+0000 7f8abed9d700 1 --2- 172.21.15.125:0/1579524896 >> v2:172.21.15.167:3300/0 conn(0x7f8ac0071320 0x7f8ac0160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8abe59c700 1 --2- 172.21.15.125:0/1579524896 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ac015cce0 0x7f8ac006b9f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00ca210 tx=0x7f8ab4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4512ac44058de51b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8abd59a700 1 -- 172.21.15.125:0/1579524896 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4011830 con 0x7f8ac015cce0 2023-11-28T11:12:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8abd59a700 1 -- 172.21.15.125:0/1579524896 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4011990 con 0x7f8ac015cce0 2023-11-28T11:12:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8abd59a700 1 -- 172.21.15.125:0/1579524896 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4011d20 con 0x7f8ac015cce0 2023-11-28T11:12:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8ac4c70700 1 -- 172.21.15.125:0/1579524896 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ac015cce0 msgr2=0x7f8ac006b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8ac4c70700 1 --2- 172.21.15.125:0/1579524896 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ac015cce0 0x7f8ac006b9f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00ca210 tx=0x7f8ab4009b20 comp rx=0 tx=0).stop 2023-11-28T11:12:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8ac4c70700 1 -- 172.21.15.125:0/1579524896 shutdown_connections 2023-11-28T11:12:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8ac4c70700 1 --2- 172.21.15.125:0/1579524896 >> v2:172.21.15.167:3300/0 conn(0x7f8ac0071320 0x7f8ac0160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8ac4c70700 1 --2- 172.21.15.125:0/1579524896 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ac015cce0 0x7f8ac006b9f0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8ac4c70700 1 -- 172.21.15.125:0/1579524896 >> 172.21.15.125:0/1579524896 conn(0x7f8ac00cfc30 msgr2=0x7f8ac00d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:59.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8ac4c70700 1 -- 172.21.15.125:0/1579524896 shutdown_connections 2023-11-28T11:12:59.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.996+0000 7f8ac4c70700 1 -- 172.21.15.125:0/1579524896 wait complete. 2023-11-28T11:12:59.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.998+0000 7f8ac4c70700 1 Processor -- start 2023-11-28T11:12:59.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.998+0000 7f8ac4c70700 1 -- start start 2023-11-28T11:12:59.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.998+0000 7f8ac4c70700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac0071320 0x7f8ac014cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.998+0000 7f8ac4c70700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac015cce0 0x7f8ac00c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.998+0000 7f8ac4c70700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ac015dc40 0x7f8ac00c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.998+0000 7f8ac4c70700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00b5b30 con 0x7f8ac015dc40 2023-11-28T11:12:59.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.998+0000 7f8ac4c70700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00c8f20 con 0x7f8ac0071320 2023-11-28T11:12:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.998+0000 7f8ac4c70700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00b5570 con 0x7f8ac015cce0 2023-11-28T11:12:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8abed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ac015dc40 0x7f8ac00c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8abed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ac015dc40 0x7f8ac00c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34106/0 (socket says 172.21.15.125:34106) 2023-11-28T11:12:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8abed9d700 1 -- 172.21.15.125:0/3533679636 learned_addr learned my addr 172.21.15.125:0/3533679636 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8abed9d700 1 -- 172.21.15.125:0/3533679636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac015cce0 msgr2=0x7f8ac00c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8abed9d700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac015cce0 0x7f8ac00c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8abed9d700 1 -- 172.21.15.125:0/3533679636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac0071320 msgr2=0x7f8ac014cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8abe59c700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac0071320 0x7f8ac014cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8abed9d700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac0071320 0x7f8ac014cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8abed9d700 1 -- 172.21.15.125:0/3533679636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab40094a0 con 0x7f8ac015dc40 2023-11-28T11:12:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8abed9d700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ac015dc40 0x7f8ac00c7f40 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800cd50 tx=0x7f8ab800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8aaeffd700 1 -- 172.21.15.125:0/3533679636 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800f480 con 0x7f8ac015dc40 2023-11-28T11:12:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8aaeffd700 1 -- 172.21.15.125:0/3533679636 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab800f600 con 0x7f8ac015dc40 2023-11-28T11:12:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8aaeffd700 1 -- 172.21.15.125:0/3533679636 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800f9b0 con 0x7f8ac015dc40 2023-11-28T11:12:59.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8ac4c70700 1 -- 172.21.15.125:0/3533679636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac00cf3e0 con 0x7f8ac015dc40 2023-11-28T11:12:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:58.999+0000 7f8ac4c70700 1 -- 172.21.15.125:0/3533679636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac00cd8a0 con 0x7f8ac015dc40 2023-11-28T11:12:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.000+0000 7f8ac4c70700 1 -- 172.21.15.125:0/3533679636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ac015e090 con 0x7f8ac015dc40 2023-11-28T11:12:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.001+0000 7f8aaeffd700 1 -- 172.21.15.125:0/3533679636 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8ab8009030 con 0x7f8ac015dc40 2023-11-28T11:12:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.001+0000 7f8aaeffd700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8aa0068320 0x7f8aa006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.001+0000 7f8aaeffd700 1 -- 172.21.15.125:0/3533679636 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8ab80863c0 con 0x7f8ac015dc40 2023-11-28T11:12:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.001+0000 7f8abe59c700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8aa0068320 0x7f8aa006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.001+0000 7f8aaeffd700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x7f8aa006e790 0x7f8aa0070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.001+0000 7f8aaeffd700 1 -- 172.21.15.125:0/3533679636 --> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8aa0071270 con 0x7f8aa006e790 2023-11-28T11:12:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.001+0000 7f8aaeffd700 1 -- 172.21.15.125:0/3533679636 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab8088a70 con 0x7f8ac015dc40 2023-11-28T11:12:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.001+0000 7f8abdd9b700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x7f8aa006e790 0x7f8aa0070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.001+0000 7f8abe59c700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8aa0068320 0x7f8aa006a7d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40090b0 tx=0x7f8ab4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.002+0000 7f8abdd9b700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x7f8aa006e790 0x7f8aa0070ba0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.002+0000 7f8aaeffd700 1 -- 172.21.15.125:0/3533679636 <== osd.5 v2:172.21.15.167:6816/103820 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8aa0071270 con 0x7f8aa006e790 2023-11-28T11:12:59.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.016+0000 7f8ac4c70700 1 -- 172.21.15.125:0/3533679636 --> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8ac00743f0 con 0x7f8aa006e790 2023-11-28T11:12:59.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.017+0000 7f8aaeffd700 1 -- 172.21.15.125:0/3533679636 <== osd.5 v2:172.21.15.167:6816/103820 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8ac00743f0 con 0x7f8aa006e790 2023-11-28T11:12:59.019 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:12:59.019 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:12:59.019 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:12:59.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.017+0000 7f8ac4c70700 1 -- 172.21.15.125:0/3533679636 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x7f8aa006e790 msgr2=0x7f8aa0070ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.017+0000 7f8ac4c70700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.167:6816/103820,v1:172.21.15.167:6817/103820] conn(0x7f8aa006e790 0x7f8aa0070ba0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.017+0000 7f8ac4c70700 1 -- 172.21.15.125:0/3533679636 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8aa0068320 msgr2=0x7f8aa006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.017+0000 7f8ac4c70700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f8aa0068320 0x7f8aa006a7d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40090b0 tx=0x7f8ab4008030 comp rx=0 tx=0).stop 2023-11-28T11:12:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.018+0000 7f8ac4c70700 1 -- 172.21.15.125:0/3533679636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ac015dc40 msgr2=0x7f8ac00c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.018+0000 7f8ac4c70700 1 --2- 172.21.15.125:0/3533679636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ac015dc40 0x7f8ac00c7f40 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800cd50 tx=0x7f8ab800a560 comp rx=0 tx=0).stop 2023-11-28T11:12:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.018+0000 7f8abed9d700 1 -- 172.21.15.125:0/3533679636 reap_dead start 2023-11-28T11:12:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.018+0000 7f8ac4c70700 1 -- 172.21.15.125:0/3533679636 shutdown_connections 2023-11-28T11:12:59.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.018+0000 7f8ac4c70700 1 -- 172.21.15.125:0/3533679636 >> 172.21.15.125:0/3533679636 conn(0x7f8ac00cfc30 msgr2=0x7f8ac015ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:59.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.018+0000 7f8ac4c70700 1 -- 172.21.15.125:0/3533679636 shutdown_connections 2023-11-28T11:12:59.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.018+0000 7f8ac4c70700 1 -- 172.21.15.125:0/3533679636 wait complete. 2023-11-28T11:12:59.031 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-28T11:12:59.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.150+0000 7f7a4bcba700 1 Processor -- start 2023-11-28T11:12:59.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.150+0000 7f7a4bcba700 1 -- start start 2023-11-28T11:12:59.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.151+0000 7f7a4bcba700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7a440cec00 0x7f7a44065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.151+0000 7f7a4bcba700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7a440cac90 0x7f7a440cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.151+0000 7f7a4bcba700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4415ceb0 con 0x7f7a44160300 2023-11-28T11:12:59.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.151+0000 7f7a4bcba700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a440cb650 con 0x7f7a440cec00 2023-11-28T11:12:59.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.151+0000 7f7a4bcba700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a441608c0 con 0x7f7a440cac90 2023-11-28T11:12:59.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.151+0000 7f7a49a56700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7a440cec00 0x7f7a44065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.151+0000 7f7a49255700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7a44160300 0x7f7a4415d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46468/0 (socket says 172.21.15.125:46468) 2023-11-28T11:12:59.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.151+0000 7f7a49255700 1 -- 172.21.15.125:0/873731435 learned_addr learned my addr 172.21.15.125:0/873731435 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:59.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.151+0000 7f7a4a257700 1 --2- 172.21.15.125:0/873731435 >> v2:172.21.15.167:3300/0 conn(0x7f7a440cac90 0x7f7a440cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a49a56700 1 -- 172.21.15.125:0/873731435 >> v2:172.21.15.167:3300/0 conn(0x7f7a440cac90 msgr2=0x7f7a440cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:59.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a49a56700 1 --2- 172.21.15.125:0/873731435 >> v2:172.21.15.167:3300/0 conn(0x7f7a440cac90 0x7f7a440cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a49a56700 1 -- 172.21.15.125:0/873731435 >> v1:172.21.15.125:6789/0 conn(0x7f7a44160300 legacy=0x7f7a4415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a49a56700 1 -- 172.21.15.125:0/873731435 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a44160ba0 con 0x7f7a440cec00 2023-11-28T11:12:59.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a48a54700 1 -- 172.21.15.125:0/873731435 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140767608 0 0) 0x7f7a4415ceb0 con 0x7f7a44160300 2023-11-28T11:12:59.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a49a56700 1 --2- 172.21.15.125:0/873731435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a440cec00 0x7f7a44065fd0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f7a4406bae0 tx=0x7f7a34009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf3ba3a60c33891 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a48a54700 1 -- 172.21.15.125:0/873731435 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34011830 con 0x7f7a440cec00 2023-11-28T11:12:59.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a48a54700 1 -- 172.21.15.125:0/873731435 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34011990 con 0x7f7a440cec00 2023-11-28T11:12:59.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a48a54700 1 -- 172.21.15.125:0/873731435 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34011d20 con 0x7f7a440cec00 2023-11-28T11:12:59.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a4bcba700 1 -- 172.21.15.125:0/873731435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a440cec00 msgr2=0x7f7a44065fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a4bcba700 1 --2- 172.21.15.125:0/873731435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a440cec00 0x7f7a44065fd0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f7a4406bae0 tx=0x7f7a34009b20 comp rx=0 tx=0).stop 2023-11-28T11:12:59.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a4bcba700 1 -- 172.21.15.125:0/873731435 shutdown_connections 2023-11-28T11:12:59.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a4bcba700 1 --2- 172.21.15.125:0/873731435 >> v2:172.21.15.167:3300/0 conn(0x7f7a440cac90 0x7f7a440cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a4bcba700 1 --2- 172.21.15.125:0/873731435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a440cec00 0x7f7a44065fd0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.152+0000 7f7a4bcba700 1 -- 172.21.15.125:0/873731435 >> 172.21.15.125:0/873731435 conn(0x7f7a440cf400 msgr2=0x7f7a440cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:59.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.153+0000 7f7a4bcba700 1 -- 172.21.15.125:0/873731435 shutdown_connections 2023-11-28T11:12:59.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.153+0000 7f7a4bcba700 1 -- 172.21.15.125:0/873731435 wait complete. 2023-11-28T11:12:59.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.154+0000 7f7a4bcba700 1 Processor -- start 2023-11-28T11:12:59.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.154+0000 7f7a4bcba700 1 -- start start 2023-11-28T11:12:59.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.154+0000 7f7a4bcba700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a440cac90 0x7f7a441564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.154+0000 7f7a4bcba700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a440cec00 0x7f7a440ad940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.154+0000 7f7a4bcba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a44160300 0x7f7a440ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.154+0000 7f7a4bcba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a441f22d0 con 0x7f7a44160300 2023-11-28T11:12:59.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.154+0000 7f7a4bcba700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440b3bc0 con 0x7f7a440cec00 2023-11-28T11:12:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.154+0000 7f7a4bcba700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440c64d0 con 0x7f7a440cac90 2023-11-28T11:12:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a4a257700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a44160300 0x7f7a440ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a4a257700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a44160300 0x7f7a440ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34122/0 (socket says 172.21.15.125:34122) 2023-11-28T11:12:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a4a257700 1 -- 172.21.15.125:0/3649645050 learned_addr learned my addr 172.21.15.125:0/3649645050 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a49a56700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a440cac90 0x7f7a441564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a49255700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a440cec00 0x7f7a440ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a4a257700 1 -- 172.21.15.125:0/3649645050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a440cac90 msgr2=0x7f7a441564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a4a257700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a440cac90 0x7f7a441564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a4a257700 1 -- 172.21.15.125:0/3649645050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a440cec00 msgr2=0x7f7a440ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a4a257700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a440cec00 0x7f7a440ad940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a4a257700 1 -- 172.21.15.125:0/3649645050 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a340094a0 con 0x7f7a44160300 2023-11-28T11:12:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a4a257700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a44160300 0x7f7a440ade80 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00efc0 tx=0x7f7a3c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a3a7fc700 1 -- 172.21.15.125:0/3649645050 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00cd40 con 0x7f7a44160300 2023-11-28T11:12:59.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a3a7fc700 1 -- 172.21.15.125:0/3649645050 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c00f040 con 0x7f7a44160300 2023-11-28T11:12:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a4bcba700 1 -- 172.21.15.125:0/3649645050 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a44161160 con 0x7f7a44160300 2023-11-28T11:12:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a3a7fc700 1 -- 172.21.15.125:0/3649645050 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0146c0 con 0x7f7a44160300 2023-11-28T11:12:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.155+0000 7f7a4bcba700 1 -- 172.21.15.125:0/3649645050 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a44160e80 con 0x7f7a44160300 2023-11-28T11:12:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.156+0000 7f7a4bcba700 1 -- 172.21.15.125:0/3649645050 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a44066510 con 0x7f7a44160300 2023-11-28T11:12:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.157+0000 7f7a3a7fc700 1 -- 172.21.15.125:0/3649645050 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7a3c014820 con 0x7f7a44160300 2023-11-28T11:12:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.157+0000 7f7a3a7fc700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a280682f0 0x7f7a2806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.157+0000 7f7a3a7fc700 1 -- 172.21.15.125:0/3649645050 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7a3c086480 con 0x7f7a44160300 2023-11-28T11:12:59.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.157+0000 7f7a49a56700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a280682f0 0x7f7a2806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.157+0000 7f7a49a56700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a280682f0 0x7f7a2806a7a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7a340090b0 tx=0x7f7a34008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.161+0000 7f7a3a7fc700 1 -- 172.21.15.125:0/3649645050 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7a3c052fe0 con 0x7f7a44160300 2023-11-28T11:12:59.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.346+0000 7f7a4bcba700 1 -- 172.21.15.125:0/3649645050 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a440c6640 con 0x7f7a280682f0 2023-11-28T11:12:59.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.346+0000 7f7a3a7fc700 1 -- 172.21.15.125:0/3649645050 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7a440c6640 con 0x7f7a280682f0 2023-11-28T11:12:59.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 -- 172.21.15.125:0/3649645050 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a280682f0 msgr2=0x7f7a2806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a280682f0 0x7f7a2806a7a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7a340090b0 tx=0x7f7a34008030 comp rx=0 tx=0).stop 2023-11-28T11:12:59.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 -- 172.21.15.125:0/3649645050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a44160300 msgr2=0x7f7a440ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a44160300 0x7f7a440ade80 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00efc0 tx=0x7f7a3c00c3a0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 -- 172.21.15.125:0/3649645050 shutdown_connections 2023-11-28T11:12:59.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a44160300 0x7f7a440ade80 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f7a280682f0 0x7f7a2806a7a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a440cac90 0x7f7a441564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 --2- 172.21.15.125:0/3649645050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a440cec00 0x7f7a440ad940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 -- 172.21.15.125:0/3649645050 >> 172.21.15.125:0/3649645050 conn(0x7f7a440cf400 msgr2=0x7f7a440af210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:59.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 -- 172.21.15.125:0/3649645050 shutdown_connections 2023-11-28T11:12:59.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.349+0000 7f7a4bcba700 1 -- 172.21.15.125:0/3649645050 wait complete. 2023-11-28T11:12:59.352 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 5 to deep-scrub 2023-11-28T11:12:59.362 INFO:tasks.ceph:Scrubbing osd.6 2023-11-28T11:12:59.363 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:12:59.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.484+0000 7fbcb421d700 1 Processor -- start 2023-11-28T11:12:59.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.484+0000 7fbcb421d700 1 -- start start 2023-11-28T11:12:59.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb421d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcac071320 0x7fbcac0af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb421d700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbcac161160 0x7fbcac06a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb421d700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac0cf3e0 con 0x7fbcac15cc50 2023-11-28T11:12:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb421d700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac0cd800 con 0x7fbcac161160 2023-11-28T11:12:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb421d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0cdae0 con 0x7fbcac071320 2023-11-28T11:12:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb27ba700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbcac161160 0x7fbcac06a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb17b8700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcac071320 0x7fbcac0af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb27ba700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbcac161160 0x7fbcac06a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:59092/0 (socket says 172.21.15.125:59092) 2023-11-28T11:12:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb27ba700 1 -- 172.21.15.125:0/2026484292 learned_addr learned my addr 172.21.15.125:0/2026484292 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:59.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb17b8700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcac071320 0x7fbcac0af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:57368/0 (socket says 172.21.15.125:57368) 2023-11-28T11:12:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb27ba700 1 -- 172.21.15.125:0/2026484292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcac071320 msgr2=0x7fbcac0af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb27ba700 1 --2- 172.21.15.125:0/2026484292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcac071320 0x7fbcac0af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb27ba700 1 -- 172.21.15.125:0/2026484292 >> v1:172.21.15.167:6789/0 conn(0x7fbcac15cc50 legacy=0x7fbcac070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb27ba700 1 -- 172.21.15.125:0/2026484292 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0cdf70 con 0x7fbcac161160 2023-11-28T11:12:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.485+0000 7fbcb17b8700 1 --2- 172.21.15.125:0/2026484292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcac071320 0x7fbcac0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:12:59.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.486+0000 7fbcb27ba700 1 --2- 172.21.15.125:0/2026484292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcac161160 0x7fbcac06a270 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009e50 tx=0x7fbca400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15e4b086da707422 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.486+0000 7fbcb0fb7700 1 -- 172.21.15.125:0/2026484292 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca400e070 con 0x7fbcac161160 2023-11-28T11:12:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.486+0000 7fbcb0fb7700 1 -- 172.21.15.125:0/2026484292 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca400b910 con 0x7fbcac161160 2023-11-28T11:12:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.486+0000 7fbcb0fb7700 1 -- 172.21.15.125:0/2026484292 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca400bcc0 con 0x7fbcac161160 2023-11-28T11:12:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.486+0000 7fbcb421d700 1 -- 172.21.15.125:0/2026484292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcac161160 msgr2=0x7fbcac06a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.486+0000 7fbcb421d700 1 --2- 172.21.15.125:0/2026484292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcac161160 0x7fbcac06a270 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009e50 tx=0x7fbca400b330 comp rx=0 tx=0).stop 2023-11-28T11:12:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.486+0000 7fbcb421d700 1 -- 172.21.15.125:0/2026484292 shutdown_connections 2023-11-28T11:12:59.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.486+0000 7fbcb421d700 1 --2- 172.21.15.125:0/2026484292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcac161160 0x7fbcac06a270 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.486+0000 7fbcb421d700 1 --2- 172.21.15.125:0/2026484292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcac071320 0x7fbcac0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.486+0000 7fbcb421d700 1 -- 172.21.15.125:0/2026484292 >> 172.21.15.125:0/2026484292 conn(0x7fbcac0cfc30 msgr2=0x7fbcac0d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.487+0000 7fbcb421d700 1 -- 172.21.15.125:0/2026484292 shutdown_connections 2023-11-28T11:12:59.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.487+0000 7fbcb421d700 1 -- 172.21.15.125:0/2026484292 wait complete. 2023-11-28T11:12:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.488+0000 7fbcb421d700 1 Processor -- start 2023-11-28T11:12:59.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.488+0000 7fbcb421d700 1 -- start start 2023-11-28T11:12:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.488+0000 7fbcb421d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcac071320 0x7fbcac15e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.488+0000 7fbcb421d700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcac15cc50 0x7fbcac159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.488+0000 7fbcb421d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcac161160 0x7fbcac06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.488+0000 7fbcb421d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac157ba0 con 0x7fbcac161160 2023-11-28T11:12:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.488+0000 7fbcb421d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac15d230 con 0x7fbcac071320 2023-11-28T11:12:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.488+0000 7fbcb421d700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac15d4f0 con 0x7fbcac15cc50 2023-11-28T11:12:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb27ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcac161160 0x7fbcac06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb27ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcac161160 0x7fbcac06e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34136/0 (socket says 172.21.15.125:34136) 2023-11-28T11:12:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb27ba700 1 -- 172.21.15.125:0/1720905965 learned_addr learned my addr 172.21.15.125:0/1720905965 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb17b8700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcac15cc50 0x7fbcac159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb1fb9700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcac071320 0x7fbcac15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb27ba700 1 -- 172.21.15.125:0/1720905965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcac15cc50 msgr2=0x7fbcac159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb27ba700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcac15cc50 0x7fbcac159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb27ba700 1 -- 172.21.15.125:0/1720905965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcac071320 msgr2=0x7fbcac15e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb27ba700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcac071320 0x7fbcac15e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb27ba700 1 -- 172.21.15.125:0/1720905965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c0094a0 con 0x7fbcac161160 2023-11-28T11:12:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb27ba700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcac161160 0x7fbcac06e090 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fbca4012000 tx=0x7fbca4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbca27fc700 1 -- 172.21.15.125:0/1720905965 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4003ea0 con 0x7fbcac161160 2023-11-28T11:12:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbca27fc700 1 -- 172.21.15.125:0/1720905965 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca40099b0 con 0x7fbcac161160 2023-11-28T11:12:59.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb421d700 1 -- 172.21.15.125:0/1720905965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca4009b30 con 0x7fbcac161160 2023-11-28T11:12:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbca27fc700 1 -- 172.21.15.125:0/1720905965 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca401b670 con 0x7fbcac161160 2023-11-28T11:12:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.489+0000 7fbcb421d700 1 -- 172.21.15.125:0/1720905965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac0cf610 con 0x7fbcac161160 2023-11-28T11:12:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.490+0000 7fbcb421d700 1 -- 172.21.15.125:0/1720905965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbcac1616b0 con 0x7fbcac161160 2023-11-28T11:12:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.491+0000 7fbca27fc700 1 -- 172.21.15.125:0/1720905965 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbca4021030 con 0x7fbcac161160 2023-11-28T11:12:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.491+0000 7fbca27fc700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbc900682f0 0x7fbc9006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.491+0000 7fbca27fc700 1 -- 172.21.15.125:0/1720905965 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbca4086e90 con 0x7fbcac161160 2023-11-28T11:12:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.491+0000 7fbcb1fb9700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbc900682f0 0x7fbc9006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.491+0000 7fbca27fc700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x7fbc9006e760 0x7fbc90070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.491+0000 7fbca27fc700 1 -- 172.21.15.125:0/1720905965 --> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc90071240 con 0x7fbc9006e760 2023-11-28T11:12:59.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.491+0000 7fbca27fc700 1 -- 172.21.15.125:0/1720905965 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbca4089540 con 0x7fbcac161160 2023-11-28T11:12:59.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.491+0000 7fbcb17b8700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x7fbc9006e760 0x7fbc90070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.491+0000 7fbcb1fb9700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbc900682f0 0x7fbc9006a7a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbca80016c0 tx=0x7fbca8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.492+0000 7fbcb17b8700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x7fbc9006e760 0x7fbc90070b70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.492+0000 7fbca27fc700 1 -- 172.21.15.125:0/1720905965 <== osd.6 v2:172.21.15.167:6808/103805 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbc90071240 con 0x7fbc9006e760 2023-11-28T11:12:59.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.507+0000 7fbcb421d700 1 -- 172.21.15.125:0/1720905965 --> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbcac15d020 con 0x7fbc9006e760 2023-11-28T11:12:59.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbca27fc700 1 -- 172.21.15.125:0/1720905965 <== osd.6 v2:172.21.15.167:6808/103805 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbcac15d020 con 0x7fbc9006e760 2023-11-28T11:12:59.509 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:12:59.509 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:12:59.510 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:12:59.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbcb421d700 1 -- 172.21.15.125:0/1720905965 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x7fbc9006e760 msgr2=0x7fbc90070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbcb421d700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.167:6808/103805,v1:172.21.15.167:6809/103805] conn(0x7fbc9006e760 0x7fbc90070b70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbcb421d700 1 -- 172.21.15.125:0/1720905965 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbc900682f0 msgr2=0x7fbc9006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbcb421d700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbc900682f0 0x7fbc9006a7a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbca80016c0 tx=0x7fbca8009040 comp rx=0 tx=0).stop 2023-11-28T11:12:59.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbcb421d700 1 -- 172.21.15.125:0/1720905965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcac161160 msgr2=0x7fbcac06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbcb421d700 1 --2- 172.21.15.125:0/1720905965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcac161160 0x7fbcac06e090 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fbca4012000 tx=0x7fbca4004ad0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbcb27ba700 1 -- 172.21.15.125:0/1720905965 reap_dead start 2023-11-28T11:12:59.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbcb421d700 1 -- 172.21.15.125:0/1720905965 shutdown_connections 2023-11-28T11:12:59.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbcb421d700 1 -- 172.21.15.125:0/1720905965 >> 172.21.15.125:0/1720905965 conn(0x7fbcac0cfc30 msgr2=0x7fbcac0af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:59.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbcb421d700 1 -- 172.21.15.125:0/1720905965 shutdown_connections 2023-11-28T11:12:59.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.508+0000 7fbcb421d700 1 -- 172.21.15.125:0/1720905965 wait complete. 2023-11-28T11:12:59.521 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-28T11:12:59.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.640+0000 7f5f3a855700 1 Processor -- start 2023-11-28T11:12:59.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.640+0000 7f5f3a855700 1 -- start start 2023-11-28T11:12:59.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f3a855700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5f341599b0 0x7f5f3415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f3a855700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340af0a0 0x7f5f3415a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f3a855700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f34159ec0 con 0x7f5f340b1650 2023-11-28T11:12:59.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f3a855700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3415d8a0 con 0x7f5f341599b0 2023-11-28T11:12:59.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f3a855700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3415db80 con 0x7f5f340af0a0 2023-11-28T11:12:59.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f33fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5f340b1650 0x7f5f340b1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46498/0 (socket says 172.21.15.125:46498) 2023-11-28T11:12:59.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f33fff700 1 -- 172.21.15.125:0/848391157 learned_addr learned my addr 172.21.15.125:0/848391157 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:59.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f38df2700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340af0a0 0x7f5f3415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f337fe700 1 --2- 172.21.15.125:0/848391157 >> v2:172.21.15.167:3300/0 conn(0x7f5f341599b0 0x7f5f3415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435580876 0 0) 0x7f5f34159ec0 con 0x7f5f340b1650 2023-11-28T11:12:59.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f1c0035b0 con 0x7f5f340b1650 2023-11-28T11:12:59.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3429867479 0 0) 0x7f5f1c0035b0 con 0x7f5f340b1650 2023-11-28T11:12:59.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340af0a0 msgr2=0x7f5f3415a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:59.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f32ffd700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340af0a0 0x7f5f3415a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 >> v2:172.21.15.167:3300/0 conn(0x7f5f341599b0 msgr2=0x7f5f3415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:59.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f32ffd700 1 --2- 172.21.15.125:0/848391157 >> v2:172.21.15.167:3300/0 conn(0x7f5f341599b0 0x7f5f3415d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3415de60 con 0x7f5f340b1650 2023-11-28T11:12:59.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.641+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7f5f28001670 con 0x7f5f340b1650 2023-11-28T11:12:59.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 >> v1:172.21.15.125:6789/0 conn(0x7f5f340b1650 legacy=0x7f5f340b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f32ffd700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f1c003a00 0x7f5f1c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f32ffd700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f1c004430 0x7f5f1c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f32ffd700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340af0a0 0x7f5f1c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3415d8a0 con 0x7f5f1c003a00 2023-11-28T11:12:59.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3415db80 con 0x7f5f1c004430 2023-11-28T11:12:59.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c00ba10 con 0x7f5f340af0a0 2023-11-28T11:12:59.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f33fff700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f1c003a00 0x7f5f1c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f337fe700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f1c004430 0x7f5f1c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f38df2700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340af0a0 0x7f5f1c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f33fff700 1 -- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340af0a0 msgr2=0x7f5f1c004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:59.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f33fff700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340af0a0 0x7f5f1c004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f33fff700 1 -- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f1c004430 msgr2=0x7f5f1c0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:59.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f33fff700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f1c004430 0x7f5f1c0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f33fff700 1 -- 172.21.15.125:0/848391157 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c0035b0 con 0x7f5f1c003a00 2023-11-28T11:12:59.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f337fe700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f1c004430 0x7f5f1c0048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:12:59.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f33fff700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f1c003a00 0x7f5f1c003e10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c320 tx=0x7f5f1c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55db86a9275ec684 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800ce60 con 0x7f5f1c003a00 2023-11-28T11:12:59.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f28005960 con 0x7f5f1c003a00 2023-11-28T11:12:59.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.642+0000 7f5f32ffd700 1 -- 172.21.15.125:0/848391157 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28005cf0 con 0x7f5f1c003a00 2023-11-28T11:12:59.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.643+0000 7f5f3a855700 1 -- 172.21.15.125:0/848391157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f1c003a00 msgr2=0x7f5f1c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.643+0000 7f5f3a855700 1 --2- 172.21.15.125:0/848391157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f1c003a00 0x7f5f1c003e10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c320 tx=0x7f5f1c005880 comp rx=0 tx=0).stop 2023-11-28T11:12:59.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.643+0000 7f5f38df2700 1 -- 172.21.15.125:0/848391157 reap_dead start 2023-11-28T11:12:59.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.643+0000 7f5f3a855700 1 -- 172.21.15.125:0/848391157 shutdown_connections 2023-11-28T11:12:59.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.643+0000 7f5f3a855700 1 -- 172.21.15.125:0/848391157 >> 172.21.15.125:0/848391157 conn(0x7f5f3406c010 msgr2=0x7f5f340cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:59.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.643+0000 7f5f3a855700 1 -- 172.21.15.125:0/848391157 shutdown_connections 2023-11-28T11:12:59.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.643+0000 7f5f3a855700 1 -- 172.21.15.125:0/848391157 wait complete. 2023-11-28T11:12:59.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.644+0000 7f5f3a855700 1 Processor -- start 2023-11-28T11:12:59.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.644+0000 7f5f3a855700 1 -- start start 2023-11-28T11:12:59.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f3a855700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f1c003a00 0x7f5f340cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f3a855700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340c6130 0x7f5f341580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f3a855700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f340af630 0x7f5f340afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f3a855700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340b0010 con 0x7f5f340af630 2023-11-28T11:12:59.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f3a855700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f341f03f0 con 0x7f5f1c003a00 2023-11-28T11:12:59.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f3a855700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f341e4070 con 0x7f5f340c6130 2023-11-28T11:12:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f38df2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f340af630 0x7f5f340afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f38df2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f340af630 0x7f5f340afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34158/0 (socket says 172.21.15.125:34158) 2023-11-28T11:12:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f38df2700 1 -- 172.21.15.125:0/4292326078 learned_addr learned my addr 172.21.15.125:0/4292326078 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f33fff700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f1c003a00 0x7f5f340cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f337fe700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340c6130 0x7f5f341580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f38df2700 1 -- 172.21.15.125:0/4292326078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340c6130 msgr2=0x7f5f341580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f38df2700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340c6130 0x7f5f341580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f38df2700 1 -- 172.21.15.125:0/4292326078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f1c003a00 msgr2=0x7f5f340cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f38df2700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f1c003a00 0x7f5f340cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.645+0000 7f5f38df2700 1 -- 172.21.15.125:0/4292326078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3415a350 con 0x7f5f340af630 2023-11-28T11:12:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.646+0000 7f5f38df2700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f340af630 0x7f5f340afad0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5f3406e2a0 tx=0x7f5f2c0111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.646+0000 7f5f30ff9700 1 -- 172.21.15.125:0/4292326078 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00e070 con 0x7f5f340af630 2023-11-28T11:12:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.646+0000 7f5f30ff9700 1 -- 172.21.15.125:0/4292326078 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c003cf0 con 0x7f5f340af630 2023-11-28T11:12:59.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.646+0000 7f5f3a855700 1 -- 172.21.15.125:0/4292326078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3415d590 con 0x7f5f340af630 2023-11-28T11:12:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.646+0000 7f5f30ff9700 1 -- 172.21.15.125:0/4292326078 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0117a0 con 0x7f5f340af630 2023-11-28T11:12:59.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.646+0000 7f5f3a855700 1 -- 172.21.15.125:0/4292326078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3415a4e0 con 0x7f5f340af630 2023-11-28T11:12:59.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.647+0000 7f5f3a855700 1 -- 172.21.15.125:0/4292326078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f340743f0 con 0x7f5f340af630 2023-11-28T11:12:59.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.647+0000 7f5f30ff9700 1 -- 172.21.15.125:0/4292326078 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5f2c011900 con 0x7f5f340af630 2023-11-28T11:12:59.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.648+0000 7f5f30ff9700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5f200682f0 0x7f5f2006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.648+0000 7f5f30ff9700 1 -- 172.21.15.125:0/4292326078 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5f2c085f30 con 0x7f5f340af630 2023-11-28T11:12:59.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.648+0000 7f5f33fff700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5f200682f0 0x7f5f2006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.648+0000 7f5f33fff700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5f200682f0 0x7f5f2006a7a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5f28008fd0 tx=0x7f5f2800a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.652+0000 7f5f30ff9700 1 -- 172.21.15.125:0/4292326078 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5f2c052a30 con 0x7f5f340af630 2023-11-28T11:12:59.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.833+0000 7f5f3a855700 1 -- 172.21.15.125:0/4292326078 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f3406e620 con 0x7f5f200682f0 2023-11-28T11:12:59.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.834+0000 7f5f30ff9700 1 -- 172.21.15.125:0/4292326078 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5f3406e620 con 0x7f5f200682f0 2023-11-28T11:12:59.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 -- 172.21.15.125:0/4292326078 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5f200682f0 msgr2=0x7f5f2006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5f200682f0 0x7f5f2006a7a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5f28008fd0 tx=0x7f5f2800a000 comp rx=0 tx=0).stop 2023-11-28T11:12:59.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 -- 172.21.15.125:0/4292326078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f340af630 msgr2=0x7f5f340afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f340af630 0x7f5f340afad0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5f3406e2a0 tx=0x7f5f2c0111d0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 -- 172.21.15.125:0/4292326078 shutdown_connections 2023-11-28T11:12:59.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f340af630 0x7f5f340afad0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f1c003a00 0x7f5f340cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f5f200682f0 0x7f5f2006a7a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 --2- 172.21.15.125:0/4292326078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f340c6130 0x7f5f341580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 -- 172.21.15.125:0/4292326078 >> 172.21.15.125:0/4292326078 conn(0x7f5f3406c010 msgr2=0x7f5f3406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:59.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 -- 172.21.15.125:0/4292326078 shutdown_connections 2023-11-28T11:12:59.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.836+0000 7f5f3a855700 1 -- 172.21.15.125:0/4292326078 wait complete. 2023-11-28T11:12:59.840 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 6 to deep-scrub 2023-11-28T11:12:59.849 INFO:tasks.ceph:Scrubbing osd.7 2023-11-28T11:12:59.850 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:12:59.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.972+0000 7ff5a5acf700 1 Processor -- start 2023-11-28T11:12:59.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.972+0000 7ff5a5acf700 1 -- start start 2023-11-28T11:12:59.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff5a5acf700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff5a00cf030 0x7ff5a01650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff5a5acf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00af050 con 0x7ff5a015a4a0 2023-11-28T11:12:59.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff5a5acf700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00ae440 con 0x7ff5a00af4e0 2023-11-28T11:12:59.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff5a5acf700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a015a870 con 0x7ff5a00cf030 2023-11-28T11:12:59.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff5a015a4a0 0x7ff5a00ad980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46518/0 (socket says 172.21.15.125:46518) 2023-11-28T11:12:59.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59f7fe700 1 -- 172.21.15.125:0/1402078963 learned_addr learned my addr 172.21.15.125:0/1402078963 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:12:59.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893598131 0 0) 0x7ff5a00af050 con 0x7ff5a015a4a0 2023-11-28T11:12:59.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59ffff700 1 --2- 172.21.15.125:0/1402078963 >> v2:172.21.15.167:3300/0 conn(0x7ff5a00cf030 0x7ff5a01650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff58c0035b0 con 0x7ff5a015a4a0 2023-11-28T11:12:59.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1384397446 0 0) 0x7ff58c0035b0 con 0x7ff5a015a4a0 2023-11-28T11:12:59.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 >> v2:172.21.15.167:3300/0 conn(0x7ff5a00cf030 msgr2=0x7ff5a01650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:59.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 --2- 172.21.15.125:0/1402078963 >> v2:172.21.15.167:3300/0 conn(0x7ff5a00cf030 0x7ff5a01650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 >> v1:172.21.15.167:6789/0 conn(0x7ff5a00af4e0 legacy=0x7ff5a00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a00ae720 con 0x7ff5a015a4a0 2023-11-28T11:12:59.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2651668619 0 0) 0x7ff598001b70 con 0x7ff5a015a4a0 2023-11-28T11:12:59.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 >> v1:172.21.15.125:6789/0 conn(0x7ff5a015a4a0 legacy=0x7ff5a00ad980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 --2- 172.21.15.125:0/1402078963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff58c003a00 0x7ff58c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 --2- 172.21.15.125:0/1402078963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58c004850 0x7ff58c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 --2- 172.21.15.125:0/1402078963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff58c005200 0x7ff58c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a015a870 con 0x7ff58c004850 2023-11-28T11:12:59.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c00c080 con 0x7ff58c005200 2023-11-28T11:12:59.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.973+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c00c240 con 0x7ff58c003a00 2023-11-28T11:12:59.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59effd700 1 --2- 172.21.15.125:0/1402078963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58c004850 0x7ff58c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59ffff700 1 --2- 172.21.15.125:0/1402078963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff58c005200 0x7ff58c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59f7fe700 1 --2- 172.21.15.125:0/1402078963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff58c003a00 0x7ff58c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59effd700 1 -- 172.21.15.125:0/1402078963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff58c003a00 msgr2=0x7ff58c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:59.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59effd700 1 --2- 172.21.15.125:0/1402078963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff58c003a00 0x7ff58c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59effd700 1 -- 172.21.15.125:0/1402078963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff58c005200 msgr2=0x7ff58c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:12:59.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59effd700 1 --2- 172.21.15.125:0/1402078963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff58c005200 0x7ff58c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59effd700 1 -- 172.21.15.125:0/1402078963 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c0035b0 con 0x7ff58c004850 2023-11-28T11:12:59.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59ffff700 1 -- 172.21.15.125:0/1402078963 reap_dead start 2023-11-28T11:12:59.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59effd700 1 --2- 172.21.15.125:0/1402078963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58c004850 0x7ff58c004cc0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00af940 tx=0x7ff58c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d7aba6c52ec9b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5880052d0 con 0x7ff58c004850 2023-11-28T11:12:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff588005450 con 0x7ff58c004850 2023-11-28T11:12:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff59e7fc700 1 -- 172.21.15.125:0/1402078963 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5880038c0 con 0x7ff58c004850 2023-11-28T11:12:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.974+0000 7ff5a5acf700 1 -- 172.21.15.125:0/1402078963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58c004850 msgr2=0x7ff58c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.975+0000 7ff5a5acf700 1 --2- 172.21.15.125:0/1402078963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58c004850 0x7ff58c004cc0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00af940 tx=0x7ff58c005880 comp rx=0 tx=0).stop 2023-11-28T11:12:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.975+0000 7ff5a5acf700 1 -- 172.21.15.125:0/1402078963 shutdown_connections 2023-11-28T11:12:59.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.975+0000 7ff5a5acf700 1 --2- 172.21.15.125:0/1402078963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff58c004850 0x7ff58c004cc0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.975+0000 7ff5a5acf700 1 -- 172.21.15.125:0/1402078963 >> 172.21.15.125:0/1402078963 conn(0x7ff5a006ab90 msgr2=0x7ff5a0099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:12:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.975+0000 7ff5a5acf700 1 -- 172.21.15.125:0/1402078963 shutdown_connections 2023-11-28T11:12:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.975+0000 7ff5a5acf700 1 -- 172.21.15.125:0/1402078963 wait complete. 2023-11-28T11:12:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.976+0000 7ff5a5acf700 1 Processor -- start 2023-11-28T11:12:59.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.976+0000 7ff5a5acf700 1 -- start start 2023-11-28T11:12:59.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.977+0000 7ff5a5acf700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff58c004850 0x7ff5a014b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.977+0000 7ff5a5acf700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a0156120 0x7ff5a00c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.977+0000 7ff5a5acf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5a006e030 0x7ff5a006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.977+0000 7ff5a5acf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a014b760 con 0x7ff5a006e030 2023-11-28T11:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.977+0000 7ff5a5acf700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a006e9f0 con 0x7ff5a0156120 2023-11-28T11:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.977+0000 7ff5a5acf700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a01569a0 con 0x7ff58c004850 2023-11-28T11:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.977+0000 7ff59ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5a006e030 0x7ff5a006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.977+0000 7ff59ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5a006e030 0x7ff5a006e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34178/0 (socket says 172.21.15.125:34178) 2023-11-28T11:12:59.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.977+0000 7ff59ffff700 1 -- 172.21.15.125:0/3338533064 learned_addr learned my addr 172.21.15.125:0/3338533064 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff59effd700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a0156120 0x7ff5a00c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff59f7fe700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff58c004850 0x7ff5a014b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff59ffff700 1 -- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff58c004850 msgr2=0x7ff5a014b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff59ffff700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff58c004850 0x7ff5a014b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff59ffff700 1 -- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a0156120 msgr2=0x7ff5a00c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff59ffff700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a0156120 0x7ff5a00c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff59ffff700 1 -- 172.21.15.125:0/3338533064 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a00aece0 con 0x7ff5a006e030 2023-11-28T11:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff59effd700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a0156120 0x7ff5a00c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff59f7fe700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff58c004850 0x7ff5a014b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff59ffff700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5a006e030 0x7ff5a006e4b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00d0130 tx=0x7ff590011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff597fff700 1 -- 172.21.15.125:0/3338533064 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590004240 con 0x7ff5a006e030 2023-11-28T11:12:59.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff597fff700 1 -- 172.21.15.125:0/3338533064 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5900043a0 con 0x7ff5a006e030 2023-11-28T11:12:59.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff5a5acf700 1 -- 172.21.15.125:0/3338533064 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a00aea00 con 0x7ff5a006e030 2023-11-28T11:12:59.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff597fff700 1 -- 172.21.15.125:0/3338533064 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5900038e0 con 0x7ff5a006e030 2023-11-28T11:12:59.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.978+0000 7ff5a5acf700 1 -- 172.21.15.125:0/3338533064 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a00d0bd0 con 0x7ff5a006e030 2023-11-28T11:12:59.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.979+0000 7ff5a5acf700 1 -- 172.21.15.125:0/3338533064 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5a00743f0 con 0x7ff5a006e030 2023-11-28T11:12:59.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.979+0000 7ff597fff700 1 -- 172.21.15.125:0/3338533064 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff590003a40 con 0x7ff5a006e030 2023-11-28T11:12:59.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.980+0000 7ff597fff700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff5800682f0 0x7ff58006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.980+0000 7ff597fff700 1 -- 172.21.15.125:0/3338533064 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff590085c90 con 0x7ff5a006e030 2023-11-28T11:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.980+0000 7ff59f7fe700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff5800682f0 0x7ff58006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.980+0000 7ff597fff700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x7ff58006e760 0x7ff580070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.980+0000 7ff597fff700 1 -- 172.21.15.125:0/3338533064 --> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff580071240 con 0x7ff58006e760 2023-11-28T11:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.980+0000 7ff597fff700 1 -- 172.21.15.125:0/3338533064 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff590088340 con 0x7ff5a006e030 2023-11-28T11:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.980+0000 7ff59f7fe700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff5800682f0 0x7ff58006a7a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff598002190 tx=0x7ff598009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.980+0000 7ff59effd700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x7ff58006e760 0x7ff580070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:12:59.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.981+0000 7ff59effd700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x7ff58006e760 0x7ff580070b70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:12:59.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.981+0000 7ff597fff700 1 -- 172.21.15.125:0/3338533064 <== osd.7 v2:172.21.15.167:6824/103835 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff580071240 con 0x7ff58006e760 2023-11-28T11:12:59.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.995+0000 7ff5a5acf700 1 -- 172.21.15.125:0/3338533064 --> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff5a00c7790 con 0x7ff58006e760 2023-11-28T11:12:59.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.996+0000 7ff597fff700 1 -- 172.21.15.125:0/3338533064 <== osd.7 v2:172.21.15.167:6824/103835 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff5a00c7790 con 0x7ff58006e760 2023-11-28T11:12:59.998 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-28T11:12:59.998 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:12:59.998 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-28T11:12:59.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.996+0000 7ff5a5acf700 1 -- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x7ff58006e760 msgr2=0x7ff580070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.996+0000 7ff5a5acf700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.167:6824/103835,v1:172.21.15.167:6825/103835] conn(0x7ff58006e760 0x7ff580070b70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:12:59.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.996+0000 7ff5a5acf700 1 -- 172.21.15.125:0/3338533064 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff5800682f0 msgr2=0x7ff58006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:12:59.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.996+0000 7ff5a5acf700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ff5800682f0 0x7ff58006a7a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff598002190 tx=0x7ff598009040 comp rx=0 tx=0).stop 2023-11-28T11:13:00.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.996+0000 7ff5a5acf700 1 -- 172.21.15.125:0/3338533064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5a006e030 msgr2=0x7ff5a006e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.996+0000 7ff5a5acf700 1 --2- 172.21.15.125:0/3338533064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5a006e030 0x7ff5a006e4b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00d0130 tx=0x7ff590011bf0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.996+0000 7ff59ffff700 1 -- 172.21.15.125:0/3338533064 reap_dead start 2023-11-28T11:13:00.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.996+0000 7ff5a5acf700 1 -- 172.21.15.125:0/3338533064 shutdown_connections 2023-11-28T11:13:00.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.996+0000 7ff5a5acf700 1 -- 172.21.15.125:0/3338533064 >> 172.21.15.125:0/3338533064 conn(0x7ff5a006ab90 msgr2=0x7ff5a00b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:13:00.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.996+0000 7ff5a5acf700 1 -- 172.21.15.125:0/3338533064 shutdown_connections 2023-11-28T11:13:00.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:12:59.997+0000 7ff5a5acf700 1 -- 172.21.15.125:0/3338533064 wait complete. 2023-11-28T11:13:00.010 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-28T11:13:00.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.130+0000 7f06467d8700 1 Processor -- start 2023-11-28T11:13:00.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.130+0000 7f06467d8700 1 -- start start 2023-11-28T11:13:00.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f06467d8700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f064006a980 0x7f06400ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:00.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f06467d8700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0640071890 0x7f0640071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:00.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f06467d8700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064015cc10 con 0x7f06400cf710 2023-11-28T11:13:00.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f06467d8700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064006c9b0 con 0x7f064006a980 2023-11-28T11:13:00.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f06467d8700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064006cc90 con 0x7f0640071890 2023-11-28T11:13:00.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f063f7fe700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f064006a980 0x7f06400ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:00.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f0644d75700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0640071890 0x7f0640071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:00.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f063f7fe700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f064006a980 0x7f06400ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.125:59148/0 (socket says 172.21.15.125:59148) 2023-11-28T11:13:00.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f063ffff700 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f06400cf710 0x7f064006a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.125:49342/0 (socket says 172.21.15.125:49342) 2023-11-28T11:13:00.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f063f7fe700 1 -- 172.21.15.125:0/3358120171 learned_addr learned my addr 172.21.15.125:0/3358120171 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:13:00.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f063f7fe700 1 -- 172.21.15.125:0/3358120171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0640071890 msgr2=0x7f0640071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:13:00.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f063f7fe700 1 --2- 172.21.15.125:0/3358120171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0640071890 0x7f0640071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f063f7fe700 1 -- 172.21.15.125:0/3358120171 >> v1:172.21.15.167:6789/0 conn(0x7f06400cf710 legacy=0x7f064006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f063f7fe700 1 -- 172.21.15.125:0/3358120171 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064006cf70 con 0x7f064006a980 2023-11-28T11:13:00.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.131+0000 7f063f7fe700 1 --2- 172.21.15.125:0/3358120171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064006a980 0x7f06400ce740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f06340098f0 tx=0x7f0634009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba80da0b58d5b652 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:00.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.132+0000 7f063effd700 1 -- 172.21.15.125:0/3358120171 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634011830 con 0x7f064006a980 2023-11-28T11:13:00.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.132+0000 7f063effd700 1 -- 172.21.15.125:0/3358120171 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634011990 con 0x7f064006a980 2023-11-28T11:13:00.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.132+0000 7f063effd700 1 -- 172.21.15.125:0/3358120171 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634011d20 con 0x7f064006a980 2023-11-28T11:13:00.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.132+0000 7f06467d8700 1 -- 172.21.15.125:0/3358120171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064006a980 msgr2=0x7f06400ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.132+0000 7f06467d8700 1 --2- 172.21.15.125:0/3358120171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064006a980 0x7f06400ce740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f06340098f0 tx=0x7f0634009c00 comp rx=0 tx=0).stop 2023-11-28T11:13:00.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.132+0000 7f06467d8700 1 -- 172.21.15.125:0/3358120171 shutdown_connections 2023-11-28T11:13:00.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.132+0000 7f06467d8700 1 --2- 172.21.15.125:0/3358120171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0640071890 0x7f0640071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.132+0000 7f06467d8700 1 --2- 172.21.15.125:0/3358120171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064006a980 0x7f06400ce740 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.132+0000 7f06467d8700 1 -- 172.21.15.125:0/3358120171 >> 172.21.15.125:0/3358120171 conn(0x7f064006c010 msgr2=0x7f06400cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:13:00.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.132+0000 7f06467d8700 1 -- 172.21.15.125:0/3358120171 shutdown_connections 2023-11-28T11:13:00.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.132+0000 7f06467d8700 1 -- 172.21.15.125:0/3358120171 wait complete. 2023-11-28T11:13:00.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.133+0000 7f06467d8700 1 Processor -- start 2023-11-28T11:13:00.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.134+0000 7f06467d8700 1 -- start start 2023-11-28T11:13:00.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.134+0000 7f06467d8700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064006a980 0x7f0640147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:00.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.134+0000 7f06467d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0640071890 0x7f06401e5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:00.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.134+0000 7f06467d8700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06400cf710 0x7f064015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:00.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.134+0000 7f06467d8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0640147eb0 con 0x7f0640071890 2023-11-28T11:13:00.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.134+0000 7f06467d8700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06401e5f40 con 0x7f06400cf710 2023-11-28T11:13:00.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.134+0000 7f06467d8700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06401e6220 con 0x7f064006a980 2023-11-28T11:13:00.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.134+0000 7f063f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0640071890 0x7f06401e5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:00.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.134+0000 7f063f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0640071890 0x7f06401e5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34192/0 (socket says 172.21.15.125:34192) 2023-11-28T11:13:00.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.134+0000 7f063f7fe700 1 -- 172.21.15.125:0/3197297837 learned_addr learned my addr 172.21.15.125:0/3197297837 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:13:00.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f0644d75700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06400cf710 0x7f064015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:00.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f063ffff700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064006a980 0x7f0640147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:00.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f063f7fe700 1 -- 172.21.15.125:0/3197297837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064006a980 msgr2=0x7f0640147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f063f7fe700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064006a980 0x7f0640147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f063f7fe700 1 -- 172.21.15.125:0/3197297837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06400cf710 msgr2=0x7f064015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f063f7fe700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06400cf710 0x7f064015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f063f7fe700 1 -- 172.21.15.125:0/3197297837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634009550 con 0x7f0640071890 2023-11-28T11:13:00.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f063ffff700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064006a980 0x7f0640147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:13:00.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f063f7fe700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0640071890 0x7f06401e5580 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0634000c00 tx=0x7f0634004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:00.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f063cff9700 1 -- 172.21.15.125:0/3197297837 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634004480 con 0x7f0640071890 2023-11-28T11:13:00.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f063cff9700 1 -- 172.21.15.125:0/3197297837 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063401f070 con 0x7f0640071890 2023-11-28T11:13:00.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f06467d8700 1 -- 172.21.15.125:0/3197297837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064006d530 con 0x7f0640071890 2023-11-28T11:13:00.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f063cff9700 1 -- 172.21.15.125:0/3197297837 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340038c0 con 0x7f0640071890 2023-11-28T11:13:00.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.135+0000 7f06467d8700 1 -- 172.21.15.125:0/3197297837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064006d250 con 0x7f0640071890 2023-11-28T11:13:00.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.136+0000 7f06467d8700 1 -- 172.21.15.125:0/3197297837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0640160480 con 0x7f0640071890 2023-11-28T11:13:00.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.137+0000 7f063cff9700 1 -- 172.21.15.125:0/3197297837 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f063402a020 con 0x7f0640071890 2023-11-28T11:13:00.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.137+0000 7f063cff9700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f062c0682f0 0x7f062c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:00.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.137+0000 7f063cff9700 1 -- 172.21.15.125:0/3197297837 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0634086ef0 con 0x7f0640071890 2023-11-28T11:13:00.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.137+0000 7f063ffff700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f062c0682f0 0x7f062c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:00.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.137+0000 7f063ffff700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f062c0682f0 0x7f062c06a7a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0630000f60 tx=0x7f0630007dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:00.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.141+0000 7f063cff9700 1 -- 172.21.15.125:0/3197297837 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0634053a50 con 0x7f0640071890 2023-11-28T11:13:00.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.328+0000 7f06467d8700 1 -- 172.21.15.125:0/3197297837 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f06400743f0 con 0x7f062c0682f0 2023-11-28T11:13:00.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.328+0000 7f063cff9700 1 -- 172.21.15.125:0/3197297837 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f06400743f0 con 0x7f062c0682f0 2023-11-28T11:13:00.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 -- 172.21.15.125:0/3197297837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f062c0682f0 msgr2=0x7f062c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f062c0682f0 0x7f062c06a7a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0630000f60 tx=0x7f0630007dd0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 -- 172.21.15.125:0/3197297837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0640071890 msgr2=0x7f06401e5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0640071890 0x7f06401e5580 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0634000c00 tx=0x7f0634004750 comp rx=0 tx=0).stop 2023-11-28T11:13:00.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 -- 172.21.15.125:0/3197297837 shutdown_connections 2023-11-28T11:13:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06400cf710 0x7f064015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f062c0682f0 0x7f062c06a7a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064006a980 0x7f0640147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 --2- 172.21.15.125:0/3197297837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0640071890 0x7f06401e5580 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 -- 172.21.15.125:0/3197297837 >> 172.21.15.125:0/3197297837 conn(0x7f064006c010 msgr2=0x7f064015c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:13:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 -- 172.21.15.125:0/3197297837 shutdown_connections 2023-11-28T11:13:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.330+0000 7f06467d8700 1 -- 172.21.15.125:0/3197297837 wait complete. 2023-11-28T11:13:00.334 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 7 to deep-scrub 2023-11-28T11:13:00.344 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:13:00.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.461+0000 7f194b8b1700 1 Processor -- start 2023-11-28T11:13:00.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.462+0000 7f194b8b1700 1 -- start start 2023-11-28T11:13:00.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.462+0000 7f194b8b1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19440ad900 0x7f1944072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:00.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.462+0000 7f194b8b1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19440726c0 con 0x7f194406b7b0 2023-11-28T11:13:00.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.462+0000 7f194b8b1700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19440b43f0 con 0x7f19440b0880 2023-11-28T11:13:00.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.462+0000 7f194b8b1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194406bc50 con 0x7f19440ad900 2023-11-28T11:13:00.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.463+0000 7f1949e4e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19440ad900 0x7f1944072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:00.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.463+0000 7f1948e4c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f194406b7b0 0x7f19440ad1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46556/0 (socket says 172.21.15.125:46556) 2023-11-28T11:13:00.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.463+0000 7f1948e4c700 1 -- 172.21.15.125:0/2409476203 learned_addr learned my addr 172.21.15.125:0/2409476203 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:13:00.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.463+0000 7f1949e4e700 1 -- 172.21.15.125:0/2409476203 >> v1:172.21.15.167:6789/0 conn(0x7f19440b0880 legacy=0x7f19440aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.463+0000 7f1949e4e700 1 -- 172.21.15.125:0/2409476203 >> v1:172.21.15.125:6789/0 conn(0x7f194406b7b0 legacy=0x7f19440ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.463+0000 7f1937fff700 1 -- 172.21.15.125:0/2409476203 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407475253 0 0) 0x7f19440726c0 con 0x7f194406b7b0 2023-11-28T11:13:00.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.463+0000 7f1949e4e700 1 -- 172.21.15.125:0/2409476203 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19440b46d0 con 0x7f19440ad900 2023-11-28T11:13:00.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.463+0000 7f1949e4e700 1 --2- 172.21.15.125:0/2409476203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19440ad900 0x7f1944072180 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f193c009840 tx=0x7f193c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50631f1cf5942e70 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:00.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.463+0000 7f1937fff700 1 -- 172.21.15.125:0/2409476203 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c011830 con 0x7f19440ad900 2023-11-28T11:13:00.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.463+0000 7f1937fff700 1 -- 172.21.15.125:0/2409476203 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c011990 con 0x7f19440ad900 2023-11-28T11:13:00.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.463+0000 7f1937fff700 1 -- 172.21.15.125:0/2409476203 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c011d20 con 0x7f19440ad900 2023-11-28T11:13:00.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.464+0000 7f194b8b1700 1 -- 172.21.15.125:0/2409476203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19440ad900 msgr2=0x7f1944072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.464+0000 7f194b8b1700 1 --2- 172.21.15.125:0/2409476203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19440ad900 0x7f1944072180 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f193c009840 tx=0x7f193c009b50 comp rx=0 tx=0).stop 2023-11-28T11:13:00.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.464+0000 7f194b8b1700 1 -- 172.21.15.125:0/2409476203 shutdown_connections 2023-11-28T11:13:00.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.464+0000 7f194b8b1700 1 --2- 172.21.15.125:0/2409476203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19440ad900 0x7f1944072180 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.464+0000 7f194b8b1700 1 -- 172.21.15.125:0/2409476203 >> 172.21.15.125:0/2409476203 conn(0x7f19440b2fc0 msgr2=0x7f1944071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:13:00.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.464+0000 7f194b8b1700 1 -- 172.21.15.125:0/2409476203 shutdown_connections 2023-11-28T11:13:00.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.464+0000 7f194b8b1700 1 -- 172.21.15.125:0/2409476203 wait complete. 2023-11-28T11:13:00.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.465+0000 7f194b8b1700 1 Processor -- start 2023-11-28T11:13:00.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.465+0000 7f194b8b1700 1 -- start start 2023-11-28T11:13:00.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.466+0000 7f194b8b1700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194406b7b0 0x7f194415eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:00.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.466+0000 7f194b8b1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19440ad900 0x7f19440c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:00.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.466+0000 7f194b8b1700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19440b0880 0x7f1944156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:00.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.466+0000 7f194b8b1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1944158ea0 con 0x7f19440ad900 2023-11-28T11:13:00.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.466+0000 7f194b8b1700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194415f3e0 con 0x7f194406b7b0 2023-11-28T11:13:00.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.466+0000 7f194b8b1700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194415f6c0 con 0x7f19440b0880 2023-11-28T11:13:00.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.466+0000 7f1948e4c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19440ad900 0x7f19440c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:00.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.466+0000 7f1948e4c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19440ad900 0x7f19440c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34204/0 (socket says 172.21.15.125:34204) 2023-11-28T11:13:00.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.466+0000 7f1948e4c700 1 -- 172.21.15.125:0/2909841325 learned_addr learned my addr 172.21.15.125:0/2909841325 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:13:00.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f1949e4e700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19440b0880 0x7f1944156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:00.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f194964d700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194406b7b0 0x7f194415eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:00.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f1948e4c700 1 -- 172.21.15.125:0/2909841325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19440b0880 msgr2=0x7f1944156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f1948e4c700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19440b0880 0x7f1944156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f1948e4c700 1 -- 172.21.15.125:0/2909841325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194406b7b0 msgr2=0x7f194415eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f1948e4c700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194406b7b0 0x7f194415eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f1948e4c700 1 -- 172.21.15.125:0/2909841325 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c0094a0 con 0x7f19440ad900 2023-11-28T11:13:00.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f1949e4e700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19440b0880 0x7f1944156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:13:00.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f194964d700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194406b7b0 0x7f194415eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:13:00.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f1948e4c700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19440ad900 0x7f19440c87a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f194000cbe0 tx=0x7f194000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:00.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f1935ffb700 1 -- 172.21.15.125:0/2909841325 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194000abc0 con 0x7f19440ad900 2023-11-28T11:13:00.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f1935ffb700 1 -- 172.21.15.125:0/2909841325 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194000ad20 con 0x7f19440ad900 2023-11-28T11:13:00.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f194b8b1700 1 -- 172.21.15.125:0/2909841325 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19440b4fe0 con 0x7f19440ad900 2023-11-28T11:13:00.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f1935ffb700 1 -- 172.21.15.125:0/2909841325 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940007310 con 0x7f19440ad900 2023-11-28T11:13:00.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.467+0000 7f194b8b1700 1 -- 172.21.15.125:0/2909841325 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19440b4d00 con 0x7f19440ad900 2023-11-28T11:13:00.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.468+0000 7f194b8b1700 1 -- 172.21.15.125:0/2909841325 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19440b49b0 con 0x7f19440ad900 2023-11-28T11:13:00.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.468+0000 7f1935ffb700 1 -- 172.21.15.125:0/2909841325 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1940010070 con 0x7f19440ad900 2023-11-28T11:13:00.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.469+0000 7f1935ffb700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19280682f0 0x7f192806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:00.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.469+0000 7f1935ffb700 1 -- 172.21.15.125:0/2909841325 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1940085460 con 0x7f19440ad900 2023-11-28T11:13:00.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.469+0000 7f194964d700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19280682f0 0x7f192806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:00.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.469+0000 7f194964d700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19280682f0 0x7f192806a7a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1938000f60 tx=0x7f1938009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:00.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.473+0000 7f1935ffb700 1 -- 172.21.15.125:0/2909841325 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1940051f60 con 0x7f19440ad900 2023-11-28T11:13:00.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.651+0000 7f194b8b1700 1 -- 172.21.15.125:0/2909841325 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f194406e100 con 0x7f19280682f0 2023-11-28T11:13:00.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.653+0000 7f1935ffb700 1 -- 172.21.15.125:0/2909841325 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72831 (secure 0 0 0) 0x7f194406e100 con 0x7f19280682f0 2023-11-28T11:13:00.656 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:13:00.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 -- 172.21.15.125:0/2909841325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19280682f0 msgr2=0x7f192806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19280682f0 0x7f192806a7a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1938000f60 tx=0x7f1938009040 comp rx=0 tx=0).stop 2023-11-28T11:13:00.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 -- 172.21.15.125:0/2909841325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19440ad900 msgr2=0x7f19440c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:00.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19440ad900 0x7f19440c87a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f194000cbe0 tx=0x7f194000a060 comp rx=0 tx=0).stop 2023-11-28T11:13:00.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 -- 172.21.15.125:0/2909841325 shutdown_connections 2023-11-28T11:13:00.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f19280682f0 0x7f192806a7a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19440b0880 0x7f1944156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194406b7b0 0x7f194415eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 --2- 172.21.15.125:0/2909841325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19440ad900 0x7f19440c87a0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:00.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 -- 172.21.15.125:0/2909841325 >> 172.21.15.125:0/2909841325 conn(0x7f19440b2fc0 msgr2=0x7f194406cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:13:00.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 -- 172.21.15.125:0/2909841325 shutdown_connections 2023-11-28T11:13:00.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:00.656+0000 7f194b8b1700 1 -- 172.21.15.125:0/2909841325 wait complete. 2023-11-28T11:13:00.660 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:13:00.669 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2023-11-28T11:12:59.681674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":81320,"kb_used_data":7912,"kb_used_omap":0,"kb_used_meta":73344,"kb_avail":754893400,"statfs":{"total":773094113280,"available":773010841600,"internally_reserved":0,"allocated":8101888,"data_stored":4251320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":75104256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.562870"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:12:58.225632+0000","last_change":"2023-11-28T11:12:58.225611+0000","last_active":"2023-11-28T11:12:58.225632+0000","last_peered":"2023-11-28T11:12:58.225632+0000","last_clean":"2023-11-28T11:12:58.225632+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:12:58.225632+0000","last_undegraded":"2023-11-28T11:12:58.225632+0000","last_fullsized":"2023-11-28T11:12:58.225632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:12:58.225528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:12:58.225528+0000","last_clean_scrub_stamp":"2023-11-28T11:12:58.225528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:33:02.285830+0000","scrub_duration":0.0034565109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:12:52.734155+0000","last_change":"2023-11-28T11:08:31.795106+0000","last_active":"2023-11-28T11:12:52.734155+0000","last_peered":"2023-11-28T11:12:52.734155+0000","last_clean":"2023-11-28T11:12:52.734155+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:12:52.734155+0000","last_undegraded":"2023-11-28T11:12:52.734155+0000","last_fullsized":"2023-11-28T11:12:52.734155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:12:59.308380+0000","last_change":"2023-11-28T11:12:59.308339+0000","last_active":"2023-11-28T11:12:59.308380+0000","last_peered":"2023-11-28T11:12:59.308380+0000","last_clean":"2023-11-28T11:12:59.308380+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:12:59.308380+0000","last_undegraded":"2023-11-28T11:12:59.308380+0000","last_fullsized":"2023-11-28T11:12:59.308380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:12:59.308250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:12:59.308250+0000","last_clean_scrub_stamp":"2023-11-28T11:12:59.308250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:18:32.482036+0000","scrub_duration":0.0035285949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":54,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:12:52.735229+0000","last_change":"2023-11-28T11:08:31.790411+0000","last_active":"2023-11-28T11:12:52.735229+0000","last_peered":"2023-11-28T11:12:52.735229+0000","last_clean":"2023-11-28T11:12:52.735229+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:12:52.735229+0000","last_undegraded":"2023-11-28T11:12:52.735229+0000","last_fullsized":"2023-11-28T11:12:52.735229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":216,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:12:51.121338+0000","last_change":"2023-11-28T11:08:26.703823+0000","last_active":"2023-11-28T11:12:51.121338+0000","last_peered":"2023-11-28T11:12:51.121338+0000","last_clean":"2023-11-28T11:12:51.121338+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:12:51.121338+0000","last_undegraded":"2023-11-28T11:12:51.121338+0000","last_fullsized":"2023-11-28T11:12:51.121338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:25.687566+0000","last_clean_scrub_stamp":"2023-11-28T11:08:25.687566+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:14:13.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:12:51.121336+0000","last_change":"2023-11-28T11:08:31.795134+0000","last_active":"2023-11-28T11:12:51.121336+0000","last_peered":"2023-11-28T11:12:51.121336+0000","last_clean":"2023-11-28T11:12:51.121336+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:12:51.121336+0000","last_undegraded":"2023-11-28T11:12:51.121336+0000","last_fullsized":"2023-11-28T11:12:51.121336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:29.225598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:12:51.122757+0000","last_change":"2023-11-28T11:08:31.785047+0000","last_active":"2023-11-28T11:12:51.122757+0000","last_peered":"2023-11-28T11:12:51.122757+0000","last_clean":"2023-11-28T11:12:51.122757+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:12:51.122757+0000","last_undegraded":"2023-11-28T11:12:51.122757+0000","last_fullsized":"2023-11-28T11:12:51.122757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:38:33.625251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:12:59.190031+0000","last_change":"2023-11-28T11:12:59.189996+0000","last_active":"2023-11-28T11:12:59.190031+0000","last_peered":"2023-11-28T11:12:59.190031+0000","last_clean":"2023-11-28T11:12:59.190031+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:12:59.190031+0000","last_undegraded":"2023-11-28T11:12:59.190031+0000","last_fullsized":"2023-11-28T11:12:59.190031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:12:59.189831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:12:59.189831+0000","last_clean_scrub_stamp":"2023-11-28T11:12:59.189831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:33:54.277525+0000","scrub_duration":0.0037665540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:12:53.084374+0000","last_change":"2023-11-28T11:08:31.789316+0000","last_active":"2023-11-28T11:12:53.084374+0000","last_peered":"2023-11-28T11:12:53.084374+0000","last_clean":"2023-11-28T11:12:53.084374+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:12:53.084374+0000","last_undegraded":"2023-11-28T11:12:53.084374+0000","last_fullsized":"2023-11-28T11:12:53.084374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:08:30.774746+0000","last_clean_scrub_stamp":"2023-11-28T11:08:30.774746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:30.229998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11224,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":9792,"kb_avail":94360616,"statfs":{"total":96636764160,"available":96625270784,"internally_reserved":0,"allocated":1458176,"data_stored":974191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10027008},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.66400000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.69899999999999995},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.68799999999999994,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.34399999999999997}]},{"osd":1,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.51300000000000001},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70999999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.753,"15min":0.753},"last":0.53100000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.74099999999999999},"min":{"1min":0.51900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66100000000000003,"5min":5.532,"15min":5.532},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.46700000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.50700000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59299999999999997}]},{"osd":4,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53600000000000003,"15min":0.55200000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54300000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56399999999999995,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72299999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.58199999999999996,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55500000000000005}]},{"osd":6,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59499999999999997,"15min":0.629},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.754,"5min":0.995,"15min":0.995},"last":0.495}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9620,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362220,"statfs":{"total":96636764160,"available":96626913280,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70199999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.379},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48899999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.65400000000000003,"15min":0.747},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67600000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.66000000000000003,"15min":0.74299999999999999},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63900000000000001,"15min":0.70899999999999996},"min":{"1min":0.372,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71299999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.65400000000000003,"15min":0.747},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69599999999999995,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.44600000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51400000000000001,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.64300000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56699999999999995,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.67600000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51000000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69699999999999995,"5min":1.137,"15min":1.137},"last":0.52300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9940,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361900,"statfs":{"total":96636764160,"available":96626585600,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.54200000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.25900000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48199999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.21099999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34499999999999997,"15min":0.34100000000000003},"min":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.372,"15min":0.36899999999999999},"min":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.27400000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.25700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.28499999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80400000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47599999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.499}]},{"osd":6,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.999,"15min":0.999},"last":0.42499999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80500000000000005,"5min":1.036,"15min":1.036},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.46000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11032,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":94360808,"statfs":{"total":96636764160,"available":96625467392,"internally_reserved":0,"allocated":1458176,"data_stored":974191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32500000000000001,"15min":0.311},"min":{"1min":0.22600000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.53200000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.26100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54800000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.38400000000000001,"15min":0.42299999999999999},"min":{"1min":0.22,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.41299999999999998,"15min":0.44500000000000001},"min":{"1min":0.25600000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.59399999999999997,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.374}]},{"osd":3,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.34999999999999998},"min":{"1min":0.307,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56499999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.379},"min":{"1min":0.29499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.35799999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85299999999999998,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.52600000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.629,"15min":0.67600000000000005},"min":{"1min":0.44500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84799999999999998,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.505,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.436}]},{"osd":6,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83399999999999996,"5min":3.298,"15min":3.298},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.66900000000000004,"15min":0.72699999999999998},"min":{"1min":0.48099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91000000000000003,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.55000000000000004}]},{"osd":7,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.876,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9748,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362092,"statfs":{"total":96636764160,"available":96626782208,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.254,"5min":0.19,"15min":0.19},"max":{"1min":0.47699999999999998,"5min":0.503,"15min":0.503},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54700000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.34100000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27400000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.249},{"interface":"front","average":{"1min":0.377,"5min":0.35699999999999998,"15min":0.34399999999999997},"min":{"1min":0.26700000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53900000000000003,"5min":1.002,"15min":1.002},"last":0.315}]},{"osd":3,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35899999999999999,"15min":0.35299999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46000000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.374},"min":{"1min":0.313,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.30299999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.875,"15min":0.875},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67400000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56299999999999994}]},{"osd":5,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.55700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77600000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71399999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64400000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70799999999999996}]},{"osd":7,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.753,"5min":1.05,"15min":1.05},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":1.222,"15min":1.222},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10004,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361836,"statfs":{"total":96636764160,"available":96626520064,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.36299999999999999},"min":{"1min":0.24099999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.52700000000000002,"5min":1.365,"15min":1.365},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.505,"15min":0.67000000000000004},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.502,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.246}]},{"osd":1,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.55200000000000005,"15min":0.74199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.53900000000000003,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.57499999999999996,"5min":1.448,"15min":1.448},"last":0.36099999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.42799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.32000000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54900000000000004,"5min":1.474,"15min":1.474},"last":0.34200000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.72099999999999997,"15min":0.85699999999999998},"min":{"1min":0.38300000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.76800000000000002,"15min":0.94599999999999995},"min":{"1min":0.433,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76000000000000001,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.53200000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.76700000000000002,"15min":0.93899999999999995},"min":{"1min":0.46700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":12.994,"15min":12.994},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.80000000000000004,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.754,"15min":0.90600000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.746,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.79600000000000004,"15min":0.97699999999999998},"min":{"1min":0.47799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78600000000000003,"5min":12.932,"15min":12.932},"last":0.63400000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78000000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.75700000000000001,"15min":0.91100000000000003},"min":{"1min":0.443,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.57399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":9940,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361900,"statfs":{"total":96636764160,"available":96626585600,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.627}]},{"osd":1,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.50600000000000001},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":0.755,"15min":0.755},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69799999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60099999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.433,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68300000000000005,"5min":0.754,"15min":0.754},"last":0.65000000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.38400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.67900000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.63500000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70299999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66700000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61199999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.67100000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68200000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77600000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69799999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.70399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9812,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362028,"statfs":{"total":96636764160,"available":96626716672,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.71299999999999997,"15min":0.62},"min":{"1min":0.433,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":11.763999999999999,"15min":11.763999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.76100000000000001,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74399999999999999,"5min":16.245000000000001,"15min":16.245000000000001},"last":0.52800000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.624,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67700000000000005,"5min":5.3849999999999998,"15min":5.3849999999999998},"last":0.42099999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71199999999999997,"5min":1.032,"15min":1.032},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.753,"5min":2.282,"15min":2.282},"last":0.36099999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.752,"5min":1.401,"15min":1.401},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82899999999999996,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.47299999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65500000000000003,"5min":1.478,"15min":1.478},"last":0.504},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.623},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77600000000000002,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.58099999999999996}]},{"osd":6,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79400000000000004,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73399999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64000000000000001,"15min":0.67900000000000005},"min":{"1min":0.41199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80800000000000005,"5min":2.444,"15min":2.444},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82299999999999995,"5min":5.8079999999999998,"15min":5.8079999999999998},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:13:00.673 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-28T11:08:30.774746+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=12, tm_sec=55, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:13:00.674 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-28T11:08:30.774746+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=12, tm_sec=55, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:13:00.674 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-28T11:08:25.687566+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=8, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=12, tm_sec=55, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:13:00.674 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-28T11:08:30.774746+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=12, tm_sec=55, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:13:00.674 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-28T11:08:30.774746+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=12, tm_sec=55, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:13:00.675 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-28T11:08:30.774746+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=12, tm_sec=55, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:13:00.675 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T11:13:03.636 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:13:03.639 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:13:20.675 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:13:20.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab3f58700 1 Processor -- start 2023-11-28T11:13:20.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab3f58700 1 -- start start 2023-11-28T11:13:20.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab3f58700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffaac0d15f0 0x7ffaac15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:20.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab3f58700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffaac15e010 0x7ffaac0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:20.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab3f58700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaac15af30 con 0x7ffaac06e400 2023-11-28T11:13:20.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab3f58700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaac15a9d0 con 0x7ffaac0d15f0 2023-11-28T11:13:20.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab3f58700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaac1584e0 con 0x7ffaac15e010 2023-11-28T11:13:20.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab14f3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffaac0d15f0 0x7ffaac15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:20.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab1cf4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ffaac06e400 0x7ffaac06e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46568/0 (socket says 172.21.15.125:46568) 2023-11-28T11:13:20.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab1cf4700 1 -- 172.21.15.125:0/3361517073 learned_addr learned my addr 172.21.15.125:0/3361517073 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:13:20.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab24f5700 1 --2- 172.21.15.125:0/3361517073 >> v2:172.21.15.167:3300/0 conn(0x7ffaac15e010 0x7ffaac0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:20.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab14f3700 1 -- 172.21.15.125:0/3361517073 >> v2:172.21.15.167:3300/0 conn(0x7ffaac15e010 msgr2=0x7ffaac0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:13:20.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab14f3700 1 --2- 172.21.15.125:0/3361517073 >> v2:172.21.15.167:3300/0 conn(0x7ffaac15e010 0x7ffaac0ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:20.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab14f3700 1 -- 172.21.15.125:0/3361517073 >> v1:172.21.15.125:6789/0 conn(0x7ffaac06e400 legacy=0x7ffaac06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:20.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab14f3700 1 -- 172.21.15.125:0/3361517073 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac15ef40 con 0x7ffaac0d15f0 2023-11-28T11:13:20.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab0cf2700 1 -- 172.21.15.125:0/3361517073 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69374366 0 0) 0x7ffaac15af30 con 0x7ffaac06e400 2023-11-28T11:13:20.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.811+0000 7ffab24f5700 1 --2- 172.21.15.125:0/3361517073 >> v2:172.21.15.167:3300/0 conn(0x7ffaac15e010 0x7ffaac0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:13:20.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab14f3700 1 --2- 172.21.15.125:0/3361517073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaac0d15f0 0x7ffaac15b3c0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0b60f0 tx=0x7ffa9c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b47be84393b4dd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:20.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab0cf2700 1 -- 172.21.15.125:0/3361517073 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c011830 con 0x7ffaac0d15f0 2023-11-28T11:13:20.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab0cf2700 1 -- 172.21.15.125:0/3361517073 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c011990 con 0x7ffaac0d15f0 2023-11-28T11:13:20.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab0cf2700 1 -- 172.21.15.125:0/3361517073 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c011d20 con 0x7ffaac0d15f0 2023-11-28T11:13:20.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab3f58700 1 -- 172.21.15.125:0/3361517073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaac0d15f0 msgr2=0x7ffaac15b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:20.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab3f58700 1 --2- 172.21.15.125:0/3361517073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaac0d15f0 0x7ffaac15b3c0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0b60f0 tx=0x7ffa9c009b20 comp rx=0 tx=0).stop 2023-11-28T11:13:20.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab3f58700 1 -- 172.21.15.125:0/3361517073 shutdown_connections 2023-11-28T11:13:20.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab3f58700 1 --2- 172.21.15.125:0/3361517073 >> v2:172.21.15.167:3300/0 conn(0x7ffaac15e010 0x7ffaac0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:20.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab3f58700 1 --2- 172.21.15.125:0/3361517073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaac0d15f0 0x7ffaac15b3c0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:20.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab3f58700 1 -- 172.21.15.125:0/3361517073 >> 172.21.15.125:0/3361517073 conn(0x7ffaac06a270 msgr2=0x7ffaac06a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:13:20.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab3f58700 1 -- 172.21.15.125:0/3361517073 shutdown_connections 2023-11-28T11:13:20.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.812+0000 7ffab3f58700 1 -- 172.21.15.125:0/3361517073 wait complete. 2023-11-28T11:13:20.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.814+0000 7ffab3f58700 1 Processor -- start 2023-11-28T11:13:20.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.814+0000 7ffab3f58700 1 -- start start 2023-11-28T11:13:20.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.814+0000 7ffab3f58700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaac06e400 0x7ffaac06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:20.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.814+0000 7ffab3f58700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaac0d15f0 0x7ffaac0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:20.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.814+0000 7ffab3f58700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffaac15e010 0x7ffaac137db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:20.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.814+0000 7ffab3f58700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac150960 con 0x7ffaac0d15f0 2023-11-28T11:13:20.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.814+0000 7ffab3f58700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac150c40 con 0x7ffaac06e400 2023-11-28T11:13:20.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.814+0000 7ffab3f58700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac150f20 con 0x7ffaac15e010 2023-11-28T11:13:20.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.814+0000 7ffab14f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaac0d15f0 0x7ffaac0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:20.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.814+0000 7ffab14f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaac0d15f0 0x7ffaac0cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34220/0 (socket says 172.21.15.125:34220) 2023-11-28T11:13:20.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.814+0000 7ffab14f3700 1 -- 172.21.15.125:0/1544111129 learned_addr learned my addr 172.21.15.125:0/1544111129 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:13:20.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.815+0000 7ffab14f3700 1 -- 172.21.15.125:0/1544111129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffaac15e010 msgr2=0x7ffaac137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:20.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.815+0000 7ffab14f3700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffaac15e010 0x7ffaac137db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:20.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.815+0000 7ffab14f3700 1 -- 172.21.15.125:0/1544111129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaac06e400 msgr2=0x7ffaac06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:20.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.815+0000 7ffab14f3700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaac06e400 0x7ffaac06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:20.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.815+0000 7ffab14f3700 1 -- 172.21.15.125:0/1544111129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c0094a0 con 0x7ffaac0d15f0 2023-11-28T11:13:20.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.815+0000 7ffab14f3700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaac0d15f0 0x7ffaac0cc480 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c013000 tx=0x7ffa9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:20.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.815+0000 7ffaa27fc700 1 -- 172.21.15.125:0/1544111129 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0038a0 con 0x7ffaac0d15f0 2023-11-28T11:13:20.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.815+0000 7ffaa27fc700 1 -- 172.21.15.125:0/1544111129 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c01f070 con 0x7ffaac0d15f0 2023-11-28T11:13:20.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.815+0000 7ffab3f58700 1 -- 172.21.15.125:0/1544111129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac15ec60 con 0x7ffaac0d15f0 2023-11-28T11:13:20.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.815+0000 7ffaa27fc700 1 -- 172.21.15.125:0/1544111129 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c003c40 con 0x7ffaac0d15f0 2023-11-28T11:13:20.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.815+0000 7ffab3f58700 1 -- 172.21.15.125:0/1544111129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac15e980 con 0x7ffaac0d15f0 2023-11-28T11:13:20.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.816+0000 7ffab3f58700 1 -- 172.21.15.125:0/1544111129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac15abc0 con 0x7ffaac0d15f0 2023-11-28T11:13:20.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.817+0000 7ffaa27fc700 1 -- 172.21.15.125:0/1544111129 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ffa9c00f050 con 0x7ffaac0d15f0 2023-11-28T11:13:20.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.817+0000 7ffaa27fc700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa900682f0 0x7ffa9006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:20.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.817+0000 7ffaa27fc700 1 -- 172.21.15.125:0/1544111129 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffa9c021070 con 0x7ffaac0d15f0 2023-11-28T11:13:20.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.817+0000 7ffab1cf4700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa900682f0 0x7ffa9006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:20.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.817+0000 7ffab1cf4700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa900682f0 0x7ffa9006a7a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80011e0 tx=0x7ffaa80079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:20.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.822+0000 7ffaa27fc700 1 -- 172.21.15.125:0/1544111129 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ffa9c053ec0 con 0x7ffaac0d15f0 2023-11-28T11:13:20.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:20.997+0000 7ffab3f58700 1 -- 172.21.15.125:0/1544111129 --> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffaac0743f0 con 0x7ffa900682f0 2023-11-28T11:13:21.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.000+0000 7ffaa27fc700 1 -- 172.21.15.125:0/1544111129 <== mgr.4107 v2:172.21.15.125:6832/103314 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72969 (secure 0 0 0) 0x7ffaac0743f0 con 0x7ffa900682f0 2023-11-28T11:13:21.003 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:13:21.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 -- 172.21.15.125:0/1544111129 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa900682f0 msgr2=0x7ffa9006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa900682f0 0x7ffa9006a7a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80011e0 tx=0x7ffaa80079b0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 -- 172.21.15.125:0/1544111129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaac0d15f0 msgr2=0x7ffaac0cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaac0d15f0 0x7ffaac0cc480 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c013000 tx=0x7ffa9c004750 comp rx=0 tx=0).stop 2023-11-28T11:13:21.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 -- 172.21.15.125:0/1544111129 shutdown_connections 2023-11-28T11:13:21.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7ffa900682f0 0x7ffa9006a7a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffaac15e010 0x7ffaac137db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaac06e400 0x7ffaac06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 --2- 172.21.15.125:0/1544111129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaac0d15f0 0x7ffaac0cc480 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 -- 172.21.15.125:0/1544111129 >> 172.21.15.125:0/1544111129 conn(0x7ffaac06a270 msgr2=0x7ffaac06a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:13:21.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 -- 172.21.15.125:0/1544111129 shutdown_connections 2023-11-28T11:13:21.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.002+0000 7ffab3f58700 1 -- 172.21.15.125:0/1544111129 wait complete. 2023-11-28T11:13:21.006 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-11-28T11:13:21.016 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2023-11-28T11:13:19.685759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":81384,"kb_used_data":7912,"kb_used_omap":0,"kb_used_meta":73408,"kb_avail":754893336,"statfs":{"total":773094113280,"available":773010776064,"internally_reserved":0,"allocated":8101888,"data_stored":4251320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":75169792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002531"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:12:58.225632+0000","last_change":"2023-11-28T11:12:58.225611+0000","last_active":"2023-11-28T11:12:58.225632+0000","last_peered":"2023-11-28T11:12:58.225632+0000","last_clean":"2023-11-28T11:12:58.225632+0000","last_became_active":"2023-11-28T11:08:31.794487+0000","last_became_peered":"2023-11-28T11:08:31.794487+0000","last_unstale":"2023-11-28T11:12:58.225632+0000","last_undegraded":"2023-11-28T11:12:58.225632+0000","last_fullsized":"2023-11-28T11:12:58.225632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:12:58.225528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:12:58.225528+0000","last_clean_scrub_stamp":"2023-11-28T11:12:58.225528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:33:02.285830+0000","scrub_duration":0.0034565109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:13:01.007264+0000","last_change":"2023-11-28T11:13:01.007236+0000","last_active":"2023-11-28T11:13:01.007264+0000","last_peered":"2023-11-28T11:13:01.007264+0000","last_clean":"2023-11-28T11:13:01.007264+0000","last_became_active":"2023-11-28T11:08:31.794823+0000","last_became_peered":"2023-11-28T11:08:31.794823+0000","last_unstale":"2023-11-28T11:13:01.007264+0000","last_undegraded":"2023-11-28T11:13:01.007264+0000","last_fullsized":"2023-11-28T11:13:01.007264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:13:01.007136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:13:01.007136+0000","last_clean_scrub_stamp":"2023-11-28T11:13:01.007136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:27.335580+0000","scrub_duration":0.0037433340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:12:59.308380+0000","last_change":"2023-11-28T11:12:59.308339+0000","last_active":"2023-11-28T11:12:59.308380+0000","last_peered":"2023-11-28T11:12:59.308380+0000","last_clean":"2023-11-28T11:12:59.308380+0000","last_became_active":"2023-11-28T11:08:32.635875+0000","last_became_peered":"2023-11-28T11:08:32.635875+0000","last_unstale":"2023-11-28T11:12:59.308380+0000","last_undegraded":"2023-11-28T11:12:59.308380+0000","last_fullsized":"2023-11-28T11:12:59.308380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:12:59.308250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:12:59.308250+0000","last_clean_scrub_stamp":"2023-11-28T11:12:59.308250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:18:32.482036+0000","scrub_duration":0.0035285949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:13:01.996469+0000","last_change":"2023-11-28T11:13:01.996399+0000","last_active":"2023-11-28T11:13:01.996469+0000","last_peered":"2023-11-28T11:13:01.996469+0000","last_clean":"2023-11-28T11:13:01.996469+0000","last_became_active":"2023-11-28T11:08:31.790138+0000","last_became_peered":"2023-11-28T11:08:31.790138+0000","last_unstale":"2023-11-28T11:13:01.996469+0000","last_undegraded":"2023-11-28T11:13:01.996469+0000","last_fullsized":"2023-11-28T11:13:01.996469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:13:01.996285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:13:01.996285+0000","last_clean_scrub_stamp":"2023-11-28T11:13:01.996285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:33:57.083979+0000","scrub_duration":0.0039896269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"71'119","reported_seq":233,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:13:04.735288+0000","last_change":"2023-11-28T11:13:04.735258+0000","last_active":"2023-11-28T11:13:04.735288+0000","last_peered":"2023-11-28T11:13:04.735288+0000","last_clean":"2023-11-28T11:13:04.735288+0000","last_became_active":"2023-11-28T11:08:26.702923+0000","last_became_peered":"2023-11-28T11:08:26.702923+0000","last_unstale":"2023-11-28T11:13:04.735288+0000","last_undegraded":"2023-11-28T11:13:04.735288+0000","last_fullsized":"2023-11-28T11:13:04.735288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'119","last_scrub_stamp":"2023-11-28T11:13:04.735132+0000","last_deep_scrub":"71'119","last_deep_scrub_stamp":"2023-11-28T11:13:04.735132+0000","last_clean_scrub_stamp":"2023-11-28T11:13:04.735132+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:31.063577+0000","scrub_duration":0.0096104129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:13:06.686360+0000","last_change":"2023-11-28T11:13:06.686330+0000","last_active":"2023-11-28T11:13:06.686360+0000","last_peered":"2023-11-28T11:13:06.686360+0000","last_clean":"2023-11-28T11:13:06.686360+0000","last_became_active":"2023-11-28T11:08:31.794759+0000","last_became_peered":"2023-11-28T11:08:31.794759+0000","last_unstale":"2023-11-28T11:13:06.686360+0000","last_undegraded":"2023-11-28T11:13:06.686360+0000","last_fullsized":"2023-11-28T11:13:06.686360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:13:06.686199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:13:06.686199+0000","last_clean_scrub_stamp":"2023-11-28T11:13:06.686199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:34:01.773893+0000","scrub_duration":0.0041566240000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:13:07.637925+0000","last_change":"2023-11-28T11:13:07.637895+0000","last_active":"2023-11-28T11:13:07.637925+0000","last_peered":"2023-11-28T11:13:07.637925+0000","last_clean":"2023-11-28T11:13:07.637925+0000","last_became_active":"2023-11-28T11:08:31.784715+0000","last_became_peered":"2023-11-28T11:08:31.784715+0000","last_unstale":"2023-11-28T11:13:07.637925+0000","last_undegraded":"2023-11-28T11:13:07.637925+0000","last_fullsized":"2023-11-28T11:13:07.637925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:13:07.637783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:13:07.637783+0000","last_clean_scrub_stamp":"2023-11-28T11:13:07.637783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:56:16.237086+0000","scrub_duration":0.0041512140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:12:59.190031+0000","last_change":"2023-11-28T11:12:59.189996+0000","last_active":"2023-11-28T11:12:59.190031+0000","last_peered":"2023-11-28T11:12:59.190031+0000","last_clean":"2023-11-28T11:12:59.190031+0000","last_became_active":"2023-11-28T11:08:31.795647+0000","last_became_peered":"2023-11-28T11:08:31.795647+0000","last_unstale":"2023-11-28T11:12:59.190031+0000","last_undegraded":"2023-11-28T11:12:59.190031+0000","last_fullsized":"2023-11-28T11:12:59.190031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:12:59.189831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:12:59.189831+0000","last_clean_scrub_stamp":"2023-11-28T11:12:59.189831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:33:54.277525+0000","scrub_duration":0.0037665540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:13:00.824890+0000","last_change":"2023-11-28T11:13:00.824856+0000","last_active":"2023-11-28T11:13:00.824890+0000","last_peered":"2023-11-28T11:13:00.824890+0000","last_clean":"2023-11-28T11:13:00.824890+0000","last_became_active":"2023-11-28T11:08:31.788912+0000","last_became_peered":"2023-11-28T11:08:31.788912+0000","last_unstale":"2023-11-28T11:13:00.824890+0000","last_undegraded":"2023-11-28T11:13:00.824890+0000","last_fullsized":"2023-11-28T11:13:00.824890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:13:00.824723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:13:00.824723+0000","last_clean_scrub_stamp":"2023-11-28T11:13:00.824723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:12.662388+0000","scrub_duration":0.0036246970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11224,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":9792,"kb_avail":94360616,"statfs":{"total":96636764160,"available":96625270784,"internally_reserved":0,"allocated":1458176,"data_stored":974191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10027008},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.66400000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.441},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.69899999999999995},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.68799999999999994,"5min":5.6420000000000003,"15min":5.6420000000000003},"last":0.46800000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.51300000000000001},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70999999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.753,"15min":0.753},"last":0.52100000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.74099999999999999},"min":{"1min":0.51900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66100000000000003,"5min":5.532,"15min":5.532},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":0.54400000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.46700000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.50700000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.376}]},{"osd":4,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53600000000000003,"15min":0.55200000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40899999999999997}]},{"osd":5,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56399999999999995,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72299999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.58199999999999996,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81999999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.315}]},{"osd":6,"last update":"Tue Nov 28 11:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59499999999999997,"15min":0.629},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.754,"5min":0.995,"15min":0.995},"last":0.35499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9684,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362156,"statfs":{"total":96636764160,"available":96626847744,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70199999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57999999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.65400000000000003,"15min":0.747},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":5.7939999999999996,"15min":5.7939999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67600000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.71699999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.66000000000000003,"15min":0.74299999999999999},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":5.7210000000000001,"15min":5.7210000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63900000000000001,"15min":0.70899999999999996},"min":{"1min":0.372,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71299999999999997,"5min":5.6970000000000001,"15min":5.6970000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.65400000000000003,"15min":0.747},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69599999999999995,"5min":5.8289999999999997,"15min":5.8289999999999997},"last":0.52500000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.627}]},{"osd":5,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51400000000000001,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.64300000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56699999999999995,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.67600000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.42499999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.504},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69699999999999995,"5min":1.137,"15min":1.137},"last":0.55300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9940,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361900,"statfs":{"total":96636764160,"available":96626585600,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.54200000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.25900000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48199999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.55500000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34499999999999997,"15min":0.34100000000000003},"min":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.372,"15min":0.36899999999999999},"min":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.52700000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.25700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.51200000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80400000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.80500000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.79200000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.999,"15min":0.999},"last":0.81999999999999995}]},{"osd":7,"last update":"Tue Nov 28 11:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80500000000000005,"5min":1.036,"15min":1.036},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.85199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11032,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":94360808,"statfs":{"total":96636764160,"available":96625467392,"internally_reserved":0,"allocated":1458176,"data_stored":974191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32500000000000001,"15min":0.311},"min":{"1min":0.22600000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.53200000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.26100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54800000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32500000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.38400000000000001,"15min":0.42299999999999999},"min":{"1min":0.22,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.307},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.41299999999999998,"15min":0.44500000000000001},"min":{"1min":0.25600000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.59399999999999997,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.41599999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.34999999999999998},"min":{"1min":0.307,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56499999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.376},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.379},"min":{"1min":0.29499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.38700000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85299999999999998,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.70199999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.629,"15min":0.67600000000000005},"min":{"1min":0.44500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84799999999999998,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.505,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83399999999999996,"5min":3.298,"15min":3.298},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.66900000000000004,"15min":0.72699999999999998},"min":{"1min":0.48099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91000000000000003,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":0.79800000000000004}]},{"osd":7,"last update":"Tue Nov 28 11:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.876,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.76000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9748,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362092,"statfs":{"total":96636764160,"available":96626782208,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.254,"5min":0.19,"15min":0.19},"max":{"1min":0.47699999999999998,"5min":0.503,"15min":0.503},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54700000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.34899999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27400000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.35699999999999998,"15min":0.34399999999999997},"min":{"1min":0.26700000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53900000000000003,"5min":1.002,"15min":1.002},"last":0.308}]},{"osd":3,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35899999999999999,"15min":0.35299999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46000000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.374},"min":{"1min":0.313,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.32000000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.875,"15min":0.875},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.44600000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67400000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56000000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.55700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77600000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71399999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45300000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44500000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.753,"5min":1.05,"15min":1.05},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":1.222,"15min":1.222},"last":0.501}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10004,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361836,"statfs":{"total":96636764160,"available":96626520064,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.36299999999999999},"min":{"1min":0.24099999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.52700000000000002,"5min":1.365,"15min":1.365},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.505,"15min":0.67000000000000004},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.502,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.32300000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.55200000000000005,"15min":0.74199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.53900000000000003,"5min":13.016999999999999,"15min":13.016999999999999},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.57499999999999996,"5min":1.448,"15min":1.448},"last":0.34000000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.42799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.32000000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54900000000000004,"5min":1.474,"15min":1.474},"last":0.30499999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.72099999999999997,"15min":0.85699999999999998},"min":{"1min":0.38300000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.76800000000000002,"15min":0.94599999999999995},"min":{"1min":0.433,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76000000000000001,"5min":12.967000000000001,"15min":12.967000000000001},"last":0.54700000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.76700000000000002,"15min":0.93899999999999995},"min":{"1min":0.46700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":12.994,"15min":12.994},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.80000000000000004,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.754,"15min":0.90600000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.746,"5min":11.007999999999999,"15min":11.007999999999999},"last":0.623},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.79600000000000004,"15min":0.97699999999999998},"min":{"1min":0.47799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78600000000000003,"5min":12.932,"15min":12.932},"last":0.56999999999999995}]},{"osd":7,"last update":"Tue Nov 28 11:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78000000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.75700000000000001,"15min":0.91100000000000003},"min":{"1min":0.443,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.65300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":9940,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361900,"statfs":{"total":96636764160,"available":96626585600,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.499},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.50600000000000001},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":0.755,"15min":0.755},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69799999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57999999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.433,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68300000000000005,"5min":0.754,"15min":0.754},"last":0.63700000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.38400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.67900000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.63500000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70299999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.42499999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66700000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61199999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.67100000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.38}]},{"osd":7,"last update":"Tue Nov 28 11:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77600000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69799999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.39500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9812,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362028,"statfs":{"total":96636764160,"available":96626716672,"internally_reserved":0,"allocated":864256,"data_stored":383823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.71299999999999997,"15min":0.62},"min":{"1min":0.433,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":11.763999999999999,"15min":11.763999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.76100000000000001,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74399999999999999,"5min":16.245000000000001,"15min":16.245000000000001},"last":0.66900000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.624,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67700000000000005,"5min":5.3849999999999998,"15min":5.3849999999999998},"last":0.432}]},{"osd":2,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71199999999999997,"5min":1.032,"15min":1.032},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.753,"5min":2.282,"15min":2.282},"last":0.58899999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.752,"5min":1.401,"15min":1.401},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82899999999999996,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65500000000000003,"5min":1.478,"15min":1.478},"last":0.624},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.623},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77600000000000002,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79400000000000004,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73399999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.68600000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64000000000000001,"15min":0.67900000000000005},"min":{"1min":0.41199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80800000000000005,"5min":2.444,"15min":2.444},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.45700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82299999999999995,"5min":5.8079999999999998,"15min":5.8079999999999998},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:13:21.021 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-28T11:13:21.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.140+0000 7f2b88168700 1 Processor -- start 2023-11-28T11:13:21.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.140+0000 7f2b88168700 1 -- start start 2023-11-28T11:13:21.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b88168700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b8015fe50 0x7f2b8006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b88168700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b80161370 con 0x7f2b800b27d0 2023-11-28T11:13:21.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b88168700 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b800cf700 con 0x7f2b800b3b80 2023-11-28T11:13:21.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b88168700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b80160220 con 0x7f2b8015fe50 2023-11-28T11:13:21.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b85f04700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b8015fe50 0x7f2b8006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b86705700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2b800b27d0 0x7f2b800cfb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46586/0 (socket says 172.21.15.125:46586) 2023-11-28T11:13:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b86705700 1 -- 172.21.15.125:0/641623807 learned_addr learned my addr 172.21.15.125:0/641623807 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-28T11:13:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b85f04700 1 -- 172.21.15.125:0/641623807 >> v1:172.21.15.167:6789/0 conn(0x7f2b800b3b80 legacy=0x7f2b80160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b85f04700 1 -- 172.21.15.125:0/641623807 >> v1:172.21.15.125:6789/0 conn(0x7f2b800b27d0 legacy=0x7f2b800cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b85f04700 1 -- 172.21.15.125:0/641623807 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800b3fd0 con 0x7f2b8015fe50 2023-11-28T11:13:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b84f02700 1 -- 172.21.15.125:0/641623807 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707799535 0 0) 0x7f2b80161370 con 0x7f2b800b27d0 2023-11-28T11:13:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b85f04700 1 --2- 172.21.15.125:0/641623807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8015fe50 0x7f2b8006d170 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009840 tx=0x7f2b7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cc630eb7c71277 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b84f02700 1 -- 172.21.15.125:0/641623807 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c011830 con 0x7f2b8015fe50 2023-11-28T11:13:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b84f02700 1 -- 172.21.15.125:0/641623807 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c011990 con 0x7f2b8015fe50 2023-11-28T11:13:21.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b84f02700 1 -- 172.21.15.125:0/641623807 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c011d20 con 0x7f2b8015fe50 2023-11-28T11:13:21.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b88168700 1 -- 172.21.15.125:0/641623807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8015fe50 msgr2=0x7f2b8006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b88168700 1 --2- 172.21.15.125:0/641623807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8015fe50 0x7f2b8006d170 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009840 tx=0x7f2b7c009b50 comp rx=0 tx=0).stop 2023-11-28T11:13:21.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b88168700 1 -- 172.21.15.125:0/641623807 shutdown_connections 2023-11-28T11:13:21.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b88168700 1 --2- 172.21.15.125:0/641623807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8015fe50 0x7f2b8006d170 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b88168700 1 -- 172.21.15.125:0/641623807 >> 172.21.15.125:0/641623807 conn(0x7f2b8006ea80 msgr2=0x7f2b8006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:13:21.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b88168700 1 -- 172.21.15.125:0/641623807 shutdown_connections 2023-11-28T11:13:21.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.141+0000 7f2b88168700 1 -- 172.21.15.125:0/641623807 wait complete. 2023-11-28T11:13:21.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.142+0000 7f2b88168700 1 Processor -- start 2023-11-28T11:13:21.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.142+0000 7f2b88168700 1 -- start start 2023-11-28T11:13:21.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b88168700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b800b27d0 0x7f2b80157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b88168700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b800b3b80 0x7f2b8015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b88168700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8015c8b0 0x7f2b800adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b88168700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8015cd50 con 0x7f2b8015c8b0 2023-11-28T11:13:21.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b88168700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80157a90 con 0x7f2b800b27d0 2023-11-28T11:13:21.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b88168700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b801f5a50 con 0x7f2b800b3b80 2023-11-28T11:13:21.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b86705700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8015c8b0 0x7f2b800adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b86705700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8015c8b0 0x7f2b800adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34236/0 (socket says 172.21.15.125:34236) 2023-11-28T11:13:21.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b86705700 1 -- 172.21.15.125:0/3946568807 learned_addr learned my addr 172.21.15.125:0/3946568807 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:13:21.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b85f04700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b800b27d0 0x7f2b80157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b85703700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b800b3b80 0x7f2b8015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b86705700 1 -- 172.21.15.125:0/3946568807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b800b3b80 msgr2=0x7f2b8015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b86705700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b800b3b80 0x7f2b8015c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b86705700 1 -- 172.21.15.125:0/3946568807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b800b27d0 msgr2=0x7f2b80157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b86705700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b800b27d0 0x7f2b80157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b86705700 1 -- 172.21.15.125:0/3946568807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0094a0 con 0x7f2b8015c8b0 2023-11-28T11:13:21.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.143+0000 7f2b85703700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b800b3b80 0x7f2b8015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:13:21.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.144+0000 7f2b86705700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8015c8b0 0x7f2b800adc80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800cc70 tx=0x7f2b7800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:21.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.144+0000 7f2b767fc700 1 -- 172.21.15.125:0/3946568807 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800ab70 con 0x7f2b8015c8b0 2023-11-28T11:13:21.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.144+0000 7f2b767fc700 1 -- 172.21.15.125:0/3946568807 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7800acf0 con 0x7f2b8015c8b0 2023-11-28T11:13:21.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.144+0000 7f2b88168700 1 -- 172.21.15.125:0/3946568807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b800cf0b0 con 0x7f2b8015c8b0 2023-11-28T11:13:21.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.144+0000 7f2b767fc700 1 -- 172.21.15.125:0/3946568807 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78007310 con 0x7f2b8015c8b0 2023-11-28T11:13:21.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.144+0000 7f2b88168700 1 -- 172.21.15.125:0/3946568807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b800cedd0 con 0x7f2b8015c8b0 2023-11-28T11:13:21.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.145+0000 7f2b88168700 1 -- 172.21.15.125:0/3946568807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b800cf390 con 0x7f2b8015c8b0 2023-11-28T11:13:21.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.146+0000 7f2b767fc700 1 -- 172.21.15.125:0/3946568807 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2b7801a030 con 0x7f2b8015c8b0 2023-11-28T11:13:21.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.146+0000 7f2b767fc700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2b640682f0 0x7f2b6406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.146+0000 7f2b767fc700 1 -- 172.21.15.125:0/3946568807 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2b78085970 con 0x7f2b8015c8b0 2023-11-28T11:13:21.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.146+0000 7f2b85f04700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2b640682f0 0x7f2b6406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.147+0000 7f2b85f04700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2b640682f0 0x7f2b6406a7a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2b80072a50 tx=0x7f2b7c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:21.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.151+0000 7f2b767fc700 1 -- 172.21.15.125:0/3946568807 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2b78052590 con 0x7f2b8015c8b0 2023-11-28T11:13:21.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.336+0000 7f2b88168700 1 -- 172.21.15.125:0/3946568807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2b800743f0 con 0x7f2b8015c8b0 2023-11-28T11:13:21.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.340+0000 7f2b767fc700 1 -- 172.21.15.125:0/3946568807 <== mon.0 v2:172.21.15.125:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2b7805e2e0 con 0x7f2b8015c8b0 2023-11-28T11:13:21.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.340+0000 7f2b767fc700 1 -- 172.21.15.125:0/3946568807 <== mon.0 v2:172.21.15.125:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2b78018020 con 0x7f2b8015c8b0 2023-11-28T11:13:21.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 -- 172.21.15.125:0/3946568807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2b640682f0 msgr2=0x7f2b6406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2b640682f0 0x7f2b6406a7a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2b80072a50 tx=0x7f2b7c01c040 comp rx=0 tx=0).stop 2023-11-28T11:13:21.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 -- 172.21.15.125:0/3946568807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8015c8b0 msgr2=0x7f2b800adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8015c8b0 0x7f2b800adc80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800cc70 tx=0x7f2b7800cf80 comp rx=0 tx=0).stop 2023-11-28T11:13:21.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 -- 172.21.15.125:0/3946568807 shutdown_connections 2023-11-28T11:13:21.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b8015c8b0 0x7f2b800adc80 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b800b27d0 0x7f2b80157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7f2b640682f0 0x7f2b6406a7a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 --2- 172.21.15.125:0/3946568807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b800b3b80 0x7f2b8015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 -- 172.21.15.125:0/3946568807 >> 172.21.15.125:0/3946568807 conn(0x7f2b8006ea80 msgr2=0x7f2b800cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:13:21.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 -- 172.21.15.125:0/3946568807 shutdown_connections 2023-11-28T11:13:21.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.343+0000 7f2b88168700 1 -- 172.21.15.125:0/3946568807 wait complete. 2023-11-28T11:13:21.357 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:13:21.357 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:13:21.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.476+0000 7fbe21a61700 1 Processor -- start 2023-11-28T11:13:21.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.477+0000 7fbe21a61700 1 -- start start 2023-11-28T11:13:21.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.477+0000 7fbe21a61700 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbe1c06a270 0x7fbe1c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.477+0000 7fbe21a61700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe1c15cc80 0x7fbe1c06de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.477+0000 7fbe21a61700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe1c06e3a0 0x7fbe1c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.477+0000 7fbe21a61700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1c0b2490 con 0x7fbe1c15cc80 2023-11-28T11:13:21.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.477+0000 7fbe21a61700 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1c06ab80 con 0x7fbe1c06a270 2023-11-28T11:13:21.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.477+0000 7fbe21a61700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c0b1810 con 0x7fbe1c06e3a0 2023-11-28T11:13:21.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe1a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe1c15cc80 0x7fbe1c06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe1a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe1c15cc80 0x7fbe1c06de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34240/0 (socket says 172.21.15.125:34240) 2023-11-28T11:13:21.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe1a7fc700 1 -- 172.21.15.125:0/2211867118 learned_addr learned my addr 172.21.15.125:0/2211867118 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:13:21.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe1affd700 1 --2- 172.21.15.125:0/2211867118 >> v2:172.21.15.167:3300/0 conn(0x7fbe1c06a270 0x7fbe1c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe1b7fe700 1 --2- 172.21.15.125:0/2211867118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe1c06e3a0 0x7fbe1c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe1a7fc700 1 -- 172.21.15.125:0/2211867118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe1c06e3a0 msgr2=0x7fbe1c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:13:21.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe1a7fc700 1 --2- 172.21.15.125:0/2211867118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe1c06e3a0 0x7fbe1c06ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe1a7fc700 1 -- 172.21.15.125:0/2211867118 >> v2:172.21.15.167:3300/0 conn(0x7fbe1c06a270 msgr2=0x7fbe1c06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:13:21.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe1a7fc700 1 --2- 172.21.15.125:0/2211867118 >> v2:172.21.15.167:3300/0 conn(0x7fbe1c06a270 0x7fbe1c06a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe1a7fc700 1 -- 172.21.15.125:0/2211867118 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c0b1af0 con 0x7fbe1c15cc80 2023-11-28T11:13:21.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe1a7fc700 1 --2- 172.21.15.125:0/2211867118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe1c15cc80 0x7fbe1c06de60 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c067380 tx=0x7fbe0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f3744b84e5040c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:21.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe19ffb700 1 -- 172.21.15.125:0/2211867118 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00b870 con 0x7fbe1c15cc80 2023-11-28T11:13:21.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe19ffb700 1 -- 172.21.15.125:0/2211867118 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbe0c00b9d0 con 0x7fbe1c15cc80 2023-11-28T11:13:21.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.478+0000 7fbe19ffb700 1 -- 172.21.15.125:0/2211867118 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00bd80 con 0x7fbe1c15cc80 2023-11-28T11:13:21.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.479+0000 7fbe21a61700 1 -- 172.21.15.125:0/2211867118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe1c15cc80 msgr2=0x7fbe1c06de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.479+0000 7fbe21a61700 1 --2- 172.21.15.125:0/2211867118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe1c15cc80 0x7fbe1c06de60 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c067380 tx=0x7fbe0c009bd0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.479+0000 7fbe21a61700 1 -- 172.21.15.125:0/2211867118 shutdown_connections 2023-11-28T11:13:21.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.479+0000 7fbe21a61700 1 --2- 172.21.15.125:0/2211867118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe1c06e3a0 0x7fbe1c06ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.479+0000 7fbe21a61700 1 --2- 172.21.15.125:0/2211867118 >> v2:172.21.15.167:3300/0 conn(0x7fbe1c06a270 0x7fbe1c06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.479+0000 7fbe21a61700 1 --2- 172.21.15.125:0/2211867118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe1c15cc80 0x7fbe1c06de60 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.479+0000 7fbe21a61700 1 -- 172.21.15.125:0/2211867118 >> 172.21.15.125:0/2211867118 conn(0x7fbe1c06c010 msgr2=0x7fbe1c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:13:21.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.479+0000 7fbe21a61700 1 -- 172.21.15.125:0/2211867118 shutdown_connections 2023-11-28T11:13:21.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.479+0000 7fbe21a61700 1 -- 172.21.15.125:0/2211867118 wait complete. 2023-11-28T11:13:21.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.480+0000 7fbe21a61700 1 Processor -- start 2023-11-28T11:13:21.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.480+0000 7fbe21a61700 1 -- start start 2023-11-28T11:13:21.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe21a61700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe1c06a270 0x7fbe1c0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe21a61700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe1c06e3a0 0x7fbe1c1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe21a61700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe1c15cc80 0x7fbe1c1f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe21a61700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c1f6c70 con 0x7fbe1c15cc80 2023-11-28T11:13:21.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe21a61700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c15f380 con 0x7fbe1c06e3a0 2023-11-28T11:13:21.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe21a61700 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c15e5c0 con 0x7fbe1c06a270 2023-11-28T11:13:21.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe1b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe1c15cc80 0x7fbe1c1f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe1affd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe1c06a270 0x7fbe1c0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe1b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe1c15cc80 0x7fbe1c1f62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34248/0 (socket says 172.21.15.125:34248) 2023-11-28T11:13:21.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe1a7fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe1c06e3a0 0x7fbe1c1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe1affd700 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe1c06a270 0x7fbe1c0b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.125:57484/0 (socket says 172.21.15.125:57484) 2023-11-28T11:13:21.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe1b7fe700 1 -- 172.21.15.125:0/4110588734 learned_addr learned my addr 172.21.15.125:0/4110588734 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-28T11:13:21.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe1b7fe700 1 -- 172.21.15.125:0/4110588734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe1c06a270 msgr2=0x7fbe1c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe1b7fe700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe1c06a270 0x7fbe1c0b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe1b7fe700 1 -- 172.21.15.125:0/4110588734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe1c06e3a0 msgr2=0x7fbe1c1f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe1b7fe700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe1c06e3a0 0x7fbe1c1f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.481+0000 7fbe1b7fe700 1 -- 172.21.15.125:0/4110588734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c009550 con 0x7fbe1c15cc80 2023-11-28T11:13:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.482+0000 7fbe1b7fe700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe1c15cc80 0x7fbe1c1f62c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fbe14007e60 tx=0x7fbe1400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:21.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.482+0000 7fbe03fff700 1 -- 172.21.15.125:0/4110588734 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400ed30 con 0x7fbe1c15cc80 2023-11-28T11:13:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.482+0000 7fbe03fff700 1 -- 172.21.15.125:0/4110588734 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbe14014420 con 0x7fbe1c15cc80 2023-11-28T11:13:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.482+0000 7fbe21a61700 1 -- 172.21.15.125:0/4110588734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c0b20b0 con 0x7fbe1c15cc80 2023-11-28T11:13:21.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.482+0000 7fbe03fff700 1 -- 172.21.15.125:0/4110588734 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140147f0 con 0x7fbe1c15cc80 2023-11-28T11:13:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.482+0000 7fbe21a61700 1 -- 172.21.15.125:0/4110588734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c0b1dd0 con 0x7fbe1c15cc80 2023-11-28T11:13:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.483+0000 7fbe21a61700 1 -- 172.21.15.125:0/4110588734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe1c06e800 con 0x7fbe1c15cc80 2023-11-28T11:13:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.483+0000 7fbe03fff700 1 -- 172.21.15.125:0/4110588734 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbe14012050 con 0x7fbe1c15cc80 2023-11-28T11:13:21.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.483+0000 7fbe03fff700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe080682f0 0x7fbe0806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:13:21.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.483+0000 7fbe03fff700 1 -- 172.21.15.125:0/4110588734 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbe14085ec0 con 0x7fbe1c15cc80 2023-11-28T11:13:21.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.483+0000 7fbe1affd700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe080682f0 0x7fbe0806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:13:21.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.484+0000 7fbe1affd700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe080682f0 0x7fbe0806a7a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbe10006b20 tx=0x7fbe10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:13:21.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.488+0000 7fbe03fff700 1 -- 172.21.15.125:0/4110588734 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbe14052950 con 0x7fbe1c15cc80 2023-11-28T11:13:21.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.711+0000 7fbe21a61700 1 -- 172.21.15.125:0/4110588734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe1c0743f0 con 0x7fbe1c15cc80 2023-11-28T11:13:21.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.711+0000 7fbe03fff700 1 -- 172.21.15.125:0/4110588734 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fbe14055f70 con 0x7fbe1c15cc80 2023-11-28T11:13:21.713 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-28T11:13:21.714 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5710,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3518974696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3518974696},{"type":"v1","addr":"172.21.15.167:6834","nonce":3518974696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6001,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2835202471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2835202471},{"type":"v1","addr":"172.21.15.167:6835","nonce":2835202471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/2475008501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2475008501},{"type":"v1","addr":"172.21.15.125:6836","nonce":2475008501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2392518832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":2392518832},{"type":"v1","addr":"172.21.15.125:6837","nonce":2392518832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-11-28T11:13:21.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.713+0000 7fbe21a61700 1 -- 172.21.15.125:0/4110588734 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe080682f0 msgr2=0x7fbe0806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.713+0000 7fbe21a61700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe080682f0 0x7fbe0806a7a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbe10006b20 tx=0x7fbe10008040 comp rx=0 tx=0).stop 2023-11-28T11:13:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.713+0000 7fbe21a61700 1 -- 172.21.15.125:0/4110588734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe1c15cc80 msgr2=0x7fbe1c1f62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:13:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.713+0000 7fbe21a61700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe1c15cc80 0x7fbe1c1f62c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fbe14007e60 tx=0x7fbe1400e3c0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.713+0000 7fbe21a61700 1 -- 172.21.15.125:0/4110588734 shutdown_connections 2023-11-28T11:13:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.713+0000 7fbe21a61700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe1c15cc80 0x7fbe1c1f62c0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.713+0000 7fbe21a61700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.125:6832/103314,v1:172.21.15.125:6833/103314] conn(0x7fbe080682f0 0x7fbe0806a7a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.713+0000 7fbe21a61700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe1c06a270 0x7fbe1c0b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.713+0000 7fbe21a61700 1 --2- 172.21.15.125:0/4110588734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe1c06e3a0 0x7fbe1c1f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:13:21.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.713+0000 7fbe21a61700 1 -- 172.21.15.125:0/4110588734 >> 172.21.15.125:0/4110588734 conn(0x7fbe1c06c010 msgr2=0x7fbe1c0b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:13:21.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.714+0000 7fbe21a61700 1 -- 172.21.15.125:0/4110588734 shutdown_connections 2023-11-28T11:13:21.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-28T11:13:21.714+0000 7fbe21a61700 1 -- 172.21.15.125:0/4110588734 wait complete. 2023-11-28T11:13:21.717 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 34 2023-11-28T11:13:21.728 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-28T11:13:21.728 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-28T11:13:21.728 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T11:13:21.728 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:21.737 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T11:13:21.737 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T11:13:21.738 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:21.787 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T11:13:21.787 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T11:13:21.787 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:21.798 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T11:13:21.799 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T11:13:21.799 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:21.850 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T11:13:21.850 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-28T11:13:21.851 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-28T11:13:21.851 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:21.884 INFO:tasks.ceph.osd.0:Stopped 2023-11-28T11:13:21.885 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-28T11:13:21.885 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:21.951 INFO:tasks.ceph.osd.1:Stopped 2023-11-28T11:13:21.952 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-28T11:13:21.952 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:22.027 INFO:tasks.ceph.osd.2:Stopped 2023-11-28T11:13:22.028 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-28T11:13:22.028 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:22.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-28T11:13:22.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-28T11:13:22.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-28T11:13:22.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-28T11:13:22.096 INFO:tasks.ceph.osd.3:Stopped 2023-11-28T11:13:22.097 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-28T11:13:22.097 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:22.136 INFO:tasks.ceph.osd.4:Stopped 2023-11-28T11:13:22.136 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-28T11:13:22.136 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:22.216 INFO:tasks.ceph.osd.5:Stopped 2023-11-28T11:13:22.216 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-28T11:13:22.216 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:22.289 INFO:tasks.ceph.osd.6:Stopped 2023-11-28T11:13:22.290 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-28T11:13:22.290 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:22.368 INFO:tasks.ceph.osd.7:Stopped 2023-11-28T11:13:22.368 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-28T11:13:22.369 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-28T11:13:22.369 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:22.393 INFO:tasks.ceph.mgr.y:Stopped 2023-11-28T11:13:22.393 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-28T11:13:22.393 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:22.433 INFO:tasks.ceph.mgr.x:Stopped 2023-11-28T11:13:22.434 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-28T11:13:22.434 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T11:13:22.435 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:22.445 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T11:13:22.446 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T11:13:22.446 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:22.485 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T11:13:22.486 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T11:13:22.486 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:13:22.537 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T11:13:22.538 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-28T11:13:22.538 DEBUG:teuthology.orchestra.run.smithi125:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-11-28T11:13:22.574 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:13:22.574 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-28T11:13:22.829 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:13:22.830 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-28T11:13:22.975 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:13:22.976 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-28T11:13:23.039 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:13:23.039 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-28T11:13:23.116 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:13:23.116 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-28T11:13:23.286 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:13:23.286 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-28T11:13:23.415 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:13:23.415 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-28T11:13:23.487 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:13:23.488 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-28T11:13:23.579 INFO:tasks.ceph:Archiving mon data... 2023-11-28T11:13:23.580 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954/data/mon.a.tgz 2023-11-28T11:13:23.580 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2023-11-28T11:13:23.599 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.naRhe3hsWK 2023-11-28T11:13:23.599 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.naRhe3hsWK 2023-11-28T11:13:23.745 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.naRhe3hsWK 2023-11-28T11:13:23.831 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.naRhe3hsWK is 401KB 2023-11-28T11:13:23.931 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.naRhe3hsWK 2023-11-28T11:13:23.947 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954/data/mon.b.tgz 2023-11-28T11:13:23.948 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2023-11-28T11:13:23.965 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.nUxzsx4WUB 2023-11-28T11:13:23.965 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.nUxzsx4WUB 2023-11-28T11:13:24.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.nUxzsx4WUB 2023-11-28T11:13:24.239 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.nUxzsx4WUB is 519KB 2023-11-28T11:13:24.336 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.nUxzsx4WUB 2023-11-28T11:13:24.353 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954/data/mon.c.tgz 2023-11-28T11:13:24.354 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2023-11-28T11:13:24.409 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.qBxycaxskg 2023-11-28T11:13:24.410 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.qBxycaxskg 2023-11-28T11:13:24.572 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.qBxycaxskg 2023-11-28T11:13:24.659 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.qBxycaxskg is 519KB 2023-11-28T11:13:24.756 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.qBxycaxskg 2023-11-28T11:13:24.772 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-28T11:13:24.773 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T11:13:24.775 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T11:13:24.838 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-28T11:13:24.838 DEBUG:teuthology.orchestra.run.smithi125:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T11:13:24.846 DEBUG:teuthology.orchestra.run.smithi167:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T11:13:24.886 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T11:13:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T11:13:24.920 INFO:tasks.ceph:Archiving crash dumps... 2023-11-28T11:13:24.921 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954/remote/smithi125/crash 2023-11-28T11:13:24.922 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T11:13:24.962 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954/remote/smithi167/crash 2023-11-28T11:13:24.963 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T11:13:24.990 INFO:tasks.ceph:Shutting down logrotate 2023-11-28T11:13:24.990 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:13:25.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:13:25.085 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T11:13:25.113 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T11:13:25.139 INFO:tasks.ceph:Compressing logs... 2023-11-28T11:13:25.139 DEBUG:teuthology.orchestra.run.smithi125:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T11:13:25.155 DEBUG:teuthology.orchestra.run.smithi167:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T11:13:26.825 INFO:tasks.ceph:Archiving logs... 2023-11-28T11:13:26.826 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954/remote/smithi125/log 2023-11-28T11:13:26.827 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T11:13:27.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-28T11:13:27.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-28T11:13:27.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-28T11:13:27.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-28T11:13:27.355 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954/remote/smithi167/log 2023-11-28T11:13:27.356 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T11:13:27.575 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-28T11:13:27.594 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-28T11:13:27.594 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T11:13:27.596 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T11:13:27.680 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-28T11:13:27.689 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-28T11:13:27.689 DEBUG:teuthology.orchestra.run.smithi125:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T11:13:27.692 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T11:13:27.706 INFO:teuthology.orchestra.run.smithi125.stderr:bash: ntpq: command not found 2023-11-28T11:13:27.708 INFO:teuthology.orchestra.run.smithi167.stderr:bash: ntpq: command not found 2023-11-28T11:13:27.711 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-28T11:13:27.711 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2023-11-28T11:13:27.711 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 +821us[ +821us] +/- 80ms 2023-11-28T11:13:27.712 INFO:teuthology.orchestra.run.smithi125.stdout:^* hv02.front.sepia.ceph.com 3 6 377 45 -678us[ -674us] +/- 54ms 2023-11-28T11:13:27.712 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +177us[ +177us] +/- 73ms 2023-11-28T11:13:27.712 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:13:27.713 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-28T11:13:27.714 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2023-11-28T11:13:27.714 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 +833us[ +838us] +/- 80ms 2023-11-28T11:13:27.714 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv02.front.sepia.ceph.com 3 6 377 43 -666us[ -660us] +/- 54ms 2023-11-28T11:13:27.714 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +213us[ +213us] +/- 73ms 2023-11-28T11:13:27.715 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:13:27.715 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-28T11:13:27.725 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-28T11:13:27.725 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-28T11:13:27.737 DEBUG:teuthology.orchestra.run.smithi125:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-28T11:13:27.856 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-28T11:13:27.953 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-28T11:13:27.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:13:27.986 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-28T11:13:28.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:13:28.018 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-28T11:13:28.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-28T11:13:28.045 INFO:teuthology.task.internal:Duration was 1082.657646 seconds 2023-11-28T11:13:28.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-28T11:13:28.059 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-28T11:13:28.060 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T11:13:28.062 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T11:13:28.106 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-28T11:13:28.108 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-28T11:13:28.380 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-28T11:13:28.380 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi125.front.sepia.ceph.com 2023-11-28T11:13:28.380 DEBUG:teuthology.orchestra.run.smithi125:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T11:13:28.401 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T11:13:28.402 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T11:13:28.427 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-28T11:13:28.427 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T11:13:28.444 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T11:13:28.509 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-28T11:13:28.510 DEBUG:teuthology.orchestra.run.smithi125:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T11:13:28.527 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T11:13:28.623 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-28T11:13:28.633 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-28T11:13:28.633 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T11:13:28.660 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T11:13:28.687 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-28T11:13:28.697 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T11:13:28.703 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T11:13:28.726 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = core 2023-11-28T11:13:28.752 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2023-11-28T11:13:28.766 DEBUG:teuthology.orchestra.run.smithi125:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T11:13:28.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:13:28.795 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T11:13:28.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:13:28.822 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-28T11:13:28.832 INFO:teuthology.task.internal:Transferring archived files... 2023-11-28T11:13:28.833 DEBUG:teuthology.misc:Transferring archived files from smithi125:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954/remote/smithi125 2023-11-28T11:13:28.833 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T11:13:28.874 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954/remote/smithi167 2023-11-28T11:13:28.875 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T11:13:28.912 INFO:teuthology.task.internal:Removing archive directory... 2023-11-28T11:13:28.912 DEBUG:teuthology.orchestra.run.smithi125:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T11:13:28.918 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T11:13:28.963 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-28T11:13:28.975 INFO:teuthology.task.internal:Not uploading archives. 2023-11-28T11:13:28.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-28T11:13:28.986 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-28T11:13:28.986 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T11:13:28.988 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T11:13:29.002 INFO:teuthology.orchestra.run.smithi125.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 11:13 /home/ubuntu/cephtest 2023-11-28T11:13:29.019 INFO:teuthology.orchestra.run.smithi167.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 11:13 /home/ubuntu/cephtest 2023-11-28T11:13:29.021 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-28T11:13:29.037 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-28T11:13:29.059 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T11:13:29.083 DEBUG:teuthology.nuke:shortname: smithi125 2023-11-28T11:13:29.084 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T11:13:29.105 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 10:49:55.772381', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T11:13:29.109 DEBUG:teuthology.nuke:shortname: smithi167 2023-11-28T11:13:29.109 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T11:13:29.132 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_10:48:03-fs-wip-neesingh-testing-231123-distro-default-smithi/7469954', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 10:49:55.773777', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T11:13:29.159 INFO:teuthology.orchestra.console.smithi125:Power off 2023-11-28T11:13:29.159 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T11:13:29.182 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-11-28T11:13:29.182 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T11:13:29.201 INFO:teuthology.orchestra.console.smithi167:Power off 2023-11-28T11:13:29.201 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T11:13:29.211 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-28T11:13:29.232 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-11-28T11:13:29.233 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T11:13:29.256 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-11-28T11:13:33.212 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T11:13:33.256 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T11:13:33.322 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-28T11:13:33.366 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-11-28T11:13:37.324 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T11:13:37.368 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T11:13:37.435 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-28T11:13:37.478 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-11-28T11:13:37.535 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-11-28T11:13:37.581 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-11-28T11:13:37.686 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} duration: 1082.657645702362 failure_reason: 'Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub)' flavor: default owner: scheduled_neesingh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a49e98d90bf4486c85be3a404566665e status: fail success: false 2023-11-28T11:13:37.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T11:13:37.763 INFO:teuthology.run:FAIL